-- Logs begin at Tue 2022-10-11 00:29:23 UTC, end at Tue 2022-10-11 03:08:10 UTC. -- Oct 11 01:06:28.309635 n-d-772273-9 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 01:06:28.318181 n-d-772273-9 devstack@n-api.service[104674]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 01:06:28 2022] *** Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: nodename: n-d-772273-9 Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: machine: x86_64 Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: clock source: unix Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: pcre jit disabled Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: detected number of CPU cores: 4 Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: current working directory: / Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: detected binary path: /usr/bin/uwsgi-core Oct 11 01:06:28.320200 n-d-772273-9 devstack@n-api.service[104674]: your processes number limit is 47680 Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: your memory page size is 4096 bytes Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: detected max file descriptor number: 2048 Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: lock engine: pthread robust mutexes Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: thunder lock: enabled Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 01:06:28.320827 n-d-772273-9 devstack@n-api.service[104674]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 01:06:28.359494 n-d-772273-9 devstack@n-api.service[104674]: Python main interpreter initialized at 0x55f878ab59c0 Oct 11 01:06:28.359494 n-d-772273-9 devstack@n-api.service[104674]: python threads support enabled Oct 11 01:06:28.359494 n-d-772273-9 devstack@n-api.service[104674]: your server socket listen backlog is limited to 100 connections Oct 11 01:06:28.359494 n-d-772273-9 devstack@n-api.service[104674]: your mercy for graceful operations on workers is 90 seconds Oct 11 01:06:28.359822 n-d-772273-9 devstack@n-api.service[104674]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 01:06:28.359897 n-d-772273-9 devstack@n-api.service[104674]: *** Operational MODE: preforking *** Oct 11 01:06:28.360149 n-d-772273-9 devstack@n-api.service[104674]: *** uWSGI is running in multiple interpreter mode *** Oct 11 01:06:28.360149 n-d-772273-9 devstack@n-api.service[104674]: spawned uWSGI master process (pid: 104674) Oct 11 01:06:28.360329 n-d-772273-9 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 01:06:28.360874 n-d-772273-9 devstack@n-api.service[104674]: spawned uWSGI worker 1 (pid: 104675, cores: 1) Oct 11 01:06:28.361201 n-d-772273-9 devstack@n-api.service[104674]: spawned uWSGI worker 2 (pid: 104676, cores: 1) Oct 11 01:06:28.362930 n-d-772273-9 devstack@n-api.service[104674]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 01:06:29.009449 n-d-772273-9 devstack@n-api.service[104676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 01:06:29.017045 n-d-772273-9 devstack@n-api.service[104675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 01:06:30.117000 n-d-772273-9 devstack@n-api.service[104676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:06:30.117000 n-d-772273-9 devstack@n-api.service[104676]: from cryptography.utils import int_from_bytes Oct 11 01:06:30.117511 n-d-772273-9 devstack@n-api.service[104676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:06:30.117511 n-d-772273-9 devstack@n-api.service[104676]: from cryptography.utils import int_from_bytes Oct 11 01:06:30.118160 n-d-772273-9 devstack@n-api.service[104675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:06:30.118160 n-d-772273-9 devstack@n-api.service[104675]: from cryptography.utils import int_from_bytes Oct 11 01:06:30.118578 n-d-772273-9 devstack@n-api.service[104675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:06:30.118578 n-d-772273-9 devstack@n-api.service[104675]: from cryptography.utils import int_from_bytes Oct 11 01:06:32.788018 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 01:06:32.788574 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 01:06:32.788795 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 01:06:32.789147 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 01:06:32.789398 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 01:06:32.789785 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.790107 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.790399 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 01:06:32.790747 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.790828 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 01:06:32.790905 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.791032 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.791188 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 01:06:32.791358 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.791574 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 01:06:32.791662 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.791832 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 01:06:32.791973 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792226 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792313 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792532 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792619 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792841 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.792928 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793154 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-772273-9 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793240 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793467 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793563 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793765 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.793852 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794067 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794160 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794375 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794479 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794668 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794767 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.794943 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795028 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795264 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795447 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795612 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-772273-9 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795767 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.795914 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796213 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796368 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796517 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796618 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796819 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.796906 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797178 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797286 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797436 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797543 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797736 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.797832 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798049 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798229 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798349 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798524 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798663 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798830 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.798962 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.799138 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.799458 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-772273-9 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.799548 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.799777 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.799875 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800080 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800167 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800420 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800514 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800724 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.800818 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801049 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801136 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801359 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801455 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801702 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.801801 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-772273-9 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802012 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802116 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802308 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802396 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802626 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802722 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.802936 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803080 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803245 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803419 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803578 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803736 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.803878 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804057 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804153 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804379 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804466 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804685 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.804823 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805012 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805110 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805305 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805464 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805551 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805630 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805837 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.805931 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806155 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806255 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806464 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806552 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806776 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.806881 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807019 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807117 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807264 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807431 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807602 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807727 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.807913 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808004 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808220 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808315 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808519 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808607 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808817 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.808916 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809119 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809207 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809417 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809518 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809671 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809759 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.809990 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810078 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810284 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810384 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810592 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810679 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.810899 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811040 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811204 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811308 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811534 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811623 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811842 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.811942 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812146 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812235 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812451 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812538 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812750 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.812838 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813063 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813150 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813380 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813468 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813684 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813771 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.813991 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814081 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814302 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814391 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814602 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814688 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814899 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.814997 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815197 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815284 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815534 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815641 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815896 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.815999 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816194 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816289 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816442 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816540 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816737 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.816824 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817034 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817130 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817342 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817439 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817652 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817806 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.817935 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818032 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818232 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818330 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818525 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818621 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818820 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.818916 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819117 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819214 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819437 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819529 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819738 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.819826 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820037 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820127 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820336 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820423 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820640 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820726 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.820938 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821026 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821235 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821321 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821532 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821619 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821843 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.821980 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822140 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822227 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822439 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822525 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822739 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.822839 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823038 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823129 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823348 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823438 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823666 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823755 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.823965 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824053 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824262 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824352 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824573 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824674 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824870 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.824959 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825166 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825263 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825471 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825566 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825769 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.825862 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826068 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826163 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826377 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826464 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826668 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826754 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.826966 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827131 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827275 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827428 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827600 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827726 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827896 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.827998 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828192 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828290 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828488 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828576 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828784 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.828885 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829079 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829167 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829374 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829461 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829668 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829765 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.829958 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830047 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830269 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830355 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830574 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830670 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830876 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.830963 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.831173 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.831258 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832020 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832133 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832324 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832410 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832631 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.832718 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.832931 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.833027 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.833254 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.833342 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.833574 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.833661 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.833888 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.833976 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.834202 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.834289 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.834507 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.834603 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.834812 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.834898 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:06:32.835120 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.835207 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.835464 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.835568 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.835770 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.835914 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836075 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836176 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836379 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836476 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836696 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.836790 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837008 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837138 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837327 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837424 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837637 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837725 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.837944 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838063 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838253 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838352 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838557 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838654 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838867 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.838963 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839184 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839281 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839525 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839617 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839833 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.839929 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840154 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840242 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840475 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840565 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840790 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.840888 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841099 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841187 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841410 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841496 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841713 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.841801 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842016 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842149 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842324 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842412 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842653 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842742 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.842963 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843053 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843267 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843374 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843604 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843719 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.843912 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844016 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844223 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844311 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844526 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844691 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844829 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.844926 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845131 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845220 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845433 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845531 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845732 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.845821 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846061 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846149 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846373 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846473 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846686 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.846774 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.847013 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.847677 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.847888 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.847978 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848205 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848293 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848519 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848616 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848823 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.848913 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849131 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849218 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849432 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849519 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849734 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.849823 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850035 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850123 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850339 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850435 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850643 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850733 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.850955 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851043 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851275 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851381 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851604 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851694 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.851912 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852000 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852223 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852320 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852527 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852614 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852831 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.852931 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853135 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853233 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853435 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853524 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853741 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.853829 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854045 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854143 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854343 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854432 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854658 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854755 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.854962 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855060 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855263 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855371 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855603 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855692 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855902 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.855999 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856200 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856291 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856508 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856597 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856810 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.856900 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857113 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857201 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857419 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857509 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857721 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.857812 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858035 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858123 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858339 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858435 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858639 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858733 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.858951 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859038 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859263 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859460 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859601 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859689 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859910 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.859997 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860220 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860324 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860530 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860618 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860827 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.860917 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.861129 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.861227 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.861428 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.861516 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.861977 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862076 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862279 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862412 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862580 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862671 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862897 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.862985 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863192 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863283 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863513 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863604 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863809 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.863910 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864105 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864196 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864416 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864505 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864716 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.864813 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865013 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865102 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865308 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865396 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865603 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865691 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.865935 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866024 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866232 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866319 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866533 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866633 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866853 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.866942 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867162 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867251 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867495 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867600 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867799 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.867897 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868100 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868188 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868401 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868497 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868706 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.868795 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869009 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869097 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869313 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869415 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869625 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869713 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.869928 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870025 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870240 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870333 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870541 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870629 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870853 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.870942 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871156 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871246 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871488 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871591 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871787 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.871918 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872093 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872247 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872432 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872560 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872756 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.872880 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873068 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873191 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873382 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873514 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873684 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873850 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.873992 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874141 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874293 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874447 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874595 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874764 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.874898 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875105 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875194 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875466 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875559 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875788 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.875878 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876108 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876194 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876409 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876502 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876722 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.876812 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877024 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877113 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877335 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877422 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877629 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877731 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.877935 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878031 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878276 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878376 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878589 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878697 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.878908 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879001 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879208 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879305 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879536 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879627 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879850 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.879938 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880153 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880249 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880458 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880548 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880762 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.880850 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881061 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881162 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881357 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881446 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881658 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881746 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.881966 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882103 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882271 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882359 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882571 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882660 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882866 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.882993 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883171 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883258 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883494 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883585 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883793 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.883883 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884087 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884177 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884392 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884526 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884704 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.884794 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885007 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885096 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885313 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885409 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885621 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885710 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.885915 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886009 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886211 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886309 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886521 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886612 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886821 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.886909 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887117 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887216 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887437 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887531 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887737 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.887827 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888071 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888169 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888373 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888461 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888669 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888758 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.888977 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889067 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889287 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889376 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889589 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889685 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889893 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.889982 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890193 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890280 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890493 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890582 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890803 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.890894 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891108 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891197 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891437 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891529 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891736 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.891835 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892039 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892129 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892346 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892444 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892648 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892737 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.892961 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.893059 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.893260 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.893357 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.893560 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.893648 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.894369 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.894466 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.894679 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.894776 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.894983 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.895071 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.895292 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.895398 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.895630 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.895927 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896017 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896251 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896337 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896558 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896654 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896866 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.896953 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897177 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897284 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897483 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897573 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897798 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.897897 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.898113 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.898201 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.898421 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.898720 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.898815 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899021 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899117 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899320 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899442 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899638 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899741 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.899940 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900040 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900235 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900331 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900533 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900648 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900829 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.900979 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901130 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901296 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901426 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901604 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901722 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.901917 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902007 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902227 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902316 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902535 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902633 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902848 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.902936 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903156 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903252 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903475 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903566 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903778 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.903878 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904076 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904165 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904372 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904462 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904668 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904764 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.904964 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905053 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905266 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905361 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905579 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905667 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905881 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.905969 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906194 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906283 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906499 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906626 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906813 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.906909 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907110 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907199 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907439 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907531 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907734 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.907833 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908031 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908120 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908325 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908413 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908627 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908723 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.908925 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.909014 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.909219 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.909307 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910100 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910207 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910411 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910500 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910713 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.910810 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911015 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911112 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911310 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911476 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911634 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911723 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.911933 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912024 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912240 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912329 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912546 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912636 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912849 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.912938 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913142 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913237 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913443 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913533 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913745 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.913834 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914041 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914131 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914343 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914442 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914638 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914772 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.914946 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915042 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915242 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915361 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915561 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915651 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915859 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.915957 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916159 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916261 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916459 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916547 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916754 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.916842 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917056 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917156 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917356 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917443 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917652 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917744 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.917949 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918042 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918250 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918339 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918546 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918673 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918843 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.918933 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919143 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919241 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919477 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919569 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919787 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.919877 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920082 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920169 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920384 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920473 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920681 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920760 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.920977 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921065 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921272 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921370 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921569 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921657 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921862 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.921951 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922157 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922255 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922451 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922547 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922750 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.922838 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923044 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923141 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923372 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923464 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923676 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923765 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.923972 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924077 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924268 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924365 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924565 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924661 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924888 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.924977 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925195 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925285 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925501 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925590 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925805 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.925894 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926108 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926204 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926429 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926518 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926734 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.926876 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927037 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927125 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927436 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927530 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927667 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927758 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.927980 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928068 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928283 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928381 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928588 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928685 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928886 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.928975 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929182 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929280 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929494 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929583 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929797 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.929893 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930100 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930197 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930410 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930499 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930722 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.930811 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931036 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931133 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931350 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931442 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931654 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931743 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.931956 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932055 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932258 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932346 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932562 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932683 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932870 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.932974 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933174 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933275 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933479 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933586 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933783 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.933889 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934086 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934192 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934388 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934486 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934686 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934785 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.934989 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935090 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935293 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935402 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935614 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935703 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.935930 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936018 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936230 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936332 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936528 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936617 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.936904 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937006 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937128 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937226 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937431 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937519 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937730 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.937819 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938037 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938137 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938350 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938440 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938656 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938743 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.938984 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939091 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939294 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939404 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939621 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939708 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.939930 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.940017 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.940235 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.940321 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.940535 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.940622 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.941347 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.941440 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.941743 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.941829 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942048 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942159 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942355 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942468 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942649 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942733 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.942936 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943028 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943246 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943359 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943585 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943676 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943882 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.943997 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944180 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944286 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944473 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944622 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944785 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.944939 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945068 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945259 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945402 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945564 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945787 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.945936 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946074 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946210 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946376 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946512 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946764 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.946911 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947073 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947169 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947392 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947489 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947701 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.947792 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948013 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948101 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948314 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948413 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948613 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948796 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.948954 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949100 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949241 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949380 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949517 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949655 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.949804 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950022 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950163 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950333 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950479 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950645 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950800 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.950968 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951108 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951277 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951452 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951599 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951748 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.951894 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952031 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952220 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952358 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952532 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952672 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.952894 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953040 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953179 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953345 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953466 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953558 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953781 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.953870 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954078 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954174 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954383 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954474 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954684 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954773 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.954979 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955075 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955293 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955402 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955619 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955748 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.955924 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.956073 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.956228 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.956428 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957127 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957248 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957432 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957576 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957731 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.957885 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958047 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958194 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958346 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958507 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958661 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958814 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.958973 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959120 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959294 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959537 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959629 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959849 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.959939 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960166 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960269 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960480 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960569 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960791 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.960880 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961090 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961191 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961392 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961482 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961717 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.961805 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962017 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962113 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962332 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962421 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962651 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962739 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.962974 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963087 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963284 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963449 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963628 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963717 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.963948 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964037 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964259 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964347 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964560 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964650 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964864 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.964953 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965178 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965277 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965474 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965561 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965772 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.965869 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966075 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966164 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966372 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966462 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966670 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966761 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.966966 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967063 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967267 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967395 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967589 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967721 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.967886 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968044 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968184 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968358 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968497 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968678 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.968795 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969007 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969097 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969315 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969405 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969619 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969709 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.969931 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970022 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970238 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970329 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970544 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970643 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970849 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.970947 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971160 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971251 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971484 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971574 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971789 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.971888 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972121 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972211 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972431 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972519 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972741 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.972839 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973056 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973172 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973371 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973490 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973679 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973790 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.973987 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974086 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974291 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974404 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974600 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974698 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.974907 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975007 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975217 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975323 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975587 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975761 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.975916 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976088 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976243 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976397 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976562 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976705 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.976880 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977011 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977198 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977318 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977517 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977627 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977834 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.977923 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978150 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978248 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978462 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978560 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978779 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.978868 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979094 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979192 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979435 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979530 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979754 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.979958 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980082 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980295 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980395 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980612 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980711 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.980929 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981027 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981243 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981340 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981562 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981651 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981879 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.981982 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982195 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982285 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982499 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982594 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982811 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.982902 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983125 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983230 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983460 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983557 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983783 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.983879 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984074 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984176 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984381 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984474 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984685 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984789 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.984988 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985089 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985295 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985411 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985605 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985696 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.985920 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.986009 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.986248 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.986356 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.986813 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.986911 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987123 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987214 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987456 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987563 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987802 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.987894 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988147 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988312 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988463 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988619 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988784 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.988942 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989083 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989257 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989400 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989573 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989714 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.989880 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990032 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990190 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990350 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990508 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990674 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.990807 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991010 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991113 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991344 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991492 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991671 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991802 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.991989 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992092 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992314 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992403 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992696 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992837 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.992996 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.993158 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.993308 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.993496 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.993586 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.993827 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994118 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994218 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994456 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994546 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994768 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.994857 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995087 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995178 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995419 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995512 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995731 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.995819 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996035 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996128 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996346 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996434 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996642 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996731 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.996941 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997031 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997250 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997341 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997554 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997654 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997851 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.997949 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.998147 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.998324 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.998451 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.998697 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.998796 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999037 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999124 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999352 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999444 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999656 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999746 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:32.999975 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000065 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000274 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000364 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000573 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000664 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000870 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.000973 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001173 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001271 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001470 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001559 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001766 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.001863 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002062 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002162 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002359 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002449 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002664 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002754 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.002962 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.003059 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.003794 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.003904 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004099 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004214 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004407 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004510 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004715 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.004805 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005021 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005117 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005319 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005409 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005633 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005726 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.005931 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006020 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006229 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006321 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006533 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006621 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006833 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.006921 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007138 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007227 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007465 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007558 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007771 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.007861 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008072 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008169 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008384 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008475 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008691 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.008908 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009050 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009236 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009357 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009550 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009667 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009877 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.009957 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010202 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010289 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010505 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010589 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010804 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.010883 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011103 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011180 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011445 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011530 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011754 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.011835 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012058 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012136 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012358 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012445 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012660 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012746 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.012962 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.013041 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.013264 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.013559 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.013638 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.013968 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014059 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014162 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014240 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014463 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014542 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014763 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.014862 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015064 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015142 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015383 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015467 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015692 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015770 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.015999 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016090 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016334 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016425 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016647 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016736 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.016955 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017053 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017261 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017349 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017570 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017700 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017874 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.017974 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018177 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018267 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018480 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018577 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018785 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.018876 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.019678 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.019772 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.019993 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020083 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020300 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020389 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020601 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020691 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.020913 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021231 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021329 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021578 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021668 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021890 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.021979 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022206 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022297 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022513 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022610 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022829 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.022919 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023141 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023229 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023472 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023585 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023789 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.023885 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024099 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024192 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024416 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024509 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024746 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.024862 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025067 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025156 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025378 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025467 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025675 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.025974 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026093 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026273 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026412 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026571 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026764 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.026872 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027096 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027189 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027439 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027546 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027769 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.027879 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028426 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028498 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028566 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028642 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028712 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028779 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.028938 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029050 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029234 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029328 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029537 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029660 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029835 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.029993 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030131 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030321 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030414 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030632 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030720 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.030941 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031049 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031251 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031378 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031590 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031680 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031886 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.031989 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032185 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032279 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032483 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032574 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032781 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.032880 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033077 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033167 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033400 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033488 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033709 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.033810 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034014 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034102 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034312 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034399 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034633 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034727 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.034943 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035034 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035250 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035373 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035589 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035680 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035893 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.035980 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036200 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036289 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036508 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036598 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036809 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.036897 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037116 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037205 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037416 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037506 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037722 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.037810 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038124 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038237 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038323 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038404 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038625 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038713 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.038949 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039095 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039251 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039369 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039585 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039674 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039890 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.039992 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040195 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040284 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040500 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040598 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040806 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.040905 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041124 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041212 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041441 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041528 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041739 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.041829 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042058 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042147 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042372 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042496 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042681 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042777 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.042988 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043084 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043293 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043422 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043641 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043732 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.043954 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044043 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044261 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044406 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044565 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044656 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044869 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.044959 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045175 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045323 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045484 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045582 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045788 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.045877 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046094 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046193 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046404 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046493 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046712 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.046802 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047027 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047116 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047367 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047460 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047679 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047767 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.047996 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048086 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048311 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048402 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048625 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048713 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.048941 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049037 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049254 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049343 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049569 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049658 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049877 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.049966 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.050207 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.050299 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.050507 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.050606 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.050747 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 01:06:33.050837 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.051123 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.051461 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.051784 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.052102 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.052433 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.052762 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.053075 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.053403 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.053730 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.054079 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.054393 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.054740 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.055071 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.055414 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.055736 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.056045 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:06:33.056289 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 01:06:33.111936 n-d-772273-9 devstack@n-api.service[104676]: INFO dbcounter [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Registered counter for database nova_api Oct 11 01:06:33.118439 n-d-772273-9 devstack@n-api.service[104675]: INFO dbcounter [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Registered counter for database nova_api Oct 11 01:06:33.133239 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_db.sqlalchemy.engines [None req-3769298b-88ce-4c51-8053-927675aef335 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.138625 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_db.sqlalchemy.engines [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.140384 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writer thread running {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.146025 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writer thread running {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.198835 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.context [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=104676) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 01:06:33.202915 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:06:33.203426 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:06:33.203525 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.context [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=104675) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 01:06:33.204988 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:06:33.205729 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:06:33.206175 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:06:33.207994 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:06:33.208473 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:06:33.208815 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:06:33.210013 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:06:33.210750 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:06:33.210859 n-d-772273-9 devstack@n-api.service[104676]: INFO dbcounter [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Registered counter for database nova_cell0 Oct 11 01:06:33.211188 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:06:33.213488 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_concurrency.lockutils [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:06:33.214847 n-d-772273-9 devstack@n-api.service[104676]: INFO dbcounter [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Registered counter for database nova_cell1 Oct 11 01:06:33.215490 n-d-772273-9 devstack@n-api.service[104675]: INFO dbcounter [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Registered counter for database nova_cell0 Oct 11 01:06:33.219504 n-d-772273-9 devstack@n-api.service[104675]: INFO dbcounter [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Registered counter for database nova_cell1 Oct 11 01:06:33.222509 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_db.sqlalchemy.engines [None req-3769298b-88ce-4c51-8053-927675aef335 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.224221 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_db.sqlalchemy.engines [None req-3769298b-88ce-4c51-8053-927675aef335 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.226297 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_db.sqlalchemy.engines [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.229966 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writer thread running {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.230089 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_db.sqlalchemy.engines [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.231828 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writer thread running {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.232530 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writer thread running {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.375094 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writer thread running {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.382116 n-d-772273-9 devstack@n-api.service[104676]: INFO dbcounter [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Registered counter for database nova_cell0 Oct 11 01:06:33.384209 n-d-772273-9 devstack@n-api.service[104675]: INFO dbcounter [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Registered counter for database nova_cell0 Oct 11 01:06:33.390952 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_db.sqlalchemy.engines [None req-3769298b-88ce-4c51-8053-927675aef335 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.392800 n-d-772273-9 devstack@n-api.service[104675]: DEBUG oslo_db.sqlalchemy.engines [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:06:33.395530 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writer thread running {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.397172 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writer thread running {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:06:33.735263 n-d-772273-9 devstack@n-api.service[104675]: WARNING keystonemiddleware.auth_token [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:06:33.736052 n-d-772273-9 devstack@n-api.service[104676]: WARNING keystonemiddleware.auth_token [None req-3769298b-88ce-4c51-8053-927675aef335 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:06:33.743559 n-d-772273-9 devstack@n-api.service[104675]: WARNING keystonemiddleware.auth_token [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:06:33.744289 n-d-772273-9 devstack@n-api.service[104676]: WARNING keystonemiddleware.auth_token [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:06:34.083838 n-d-772273-9 devstack@n-api.service[104675]: WARNING keystonemiddleware.auth_token [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:06:34.085921 n-d-772273-9 devstack@n-api.service[104676]: WARNING keystonemiddleware.auth_token [None req-3769298b-88ce-4c51-8053-927675aef335 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:06:34.089786 n-d-772273-9 devstack@n-api.service[104675]: WARNING keystonemiddleware.auth_token [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:06:34.091864 n-d-772273-9 devstack@n-api.service[104676]: WARNING keystonemiddleware.auth_token [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:06:34.095118 n-d-772273-9 devstack@n-api.service[104675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f878ab59c0 pid: 104675 (default app) Oct 11 01:06:34.097681 n-d-772273-9 devstack@n-api.service[104676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f878ab59c0 pid: 104676 (default app) Oct 11 01:06:34.097858 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:06:34.099080 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-f09af1ca-259d-464e-9e3f-452ae8df7374 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002371 Oct 11 01:06:34.099513 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Tue Oct 11 01:06:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:07:54.898440 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:07:54.899674 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-3769298b-88ce-4c51-8053-927675aef335 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Oct 11 01:07:54.900072 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:07:54.914544 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_api:SELECT=3 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:54.917365 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_cell0:SELECT=3 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:54.918607 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_cell1:SELECT=3 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:54.920363 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:55.782614 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-f9dc61fb-0447-4cf5-960c-8138f0eee063 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:07:55.816191 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-f9dc61fb-0447-4cf5-960c-8138f0eee063 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909537 Oct 11 01:07:55.816979 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:07:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:07:58.455431 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-3769298b-88ce-4c51-8053-927675aef335 None None] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:07:58.456457 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-3769298b-88ce-4c51-8053-927675aef335 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 11 01:07:58.457123 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:07:58.897868 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-864a0003-ed57-4220-91fd-6e2e6f792185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "id": "c1"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:07:58.947084 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-864a0003-ed57-4220-91fd-6e2e6f792185 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483915 Oct 11 01:07:58.947689 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:07:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:07:58.961396 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_api:SELECT=3 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:58.962486 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_cell1:SELECT=3 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:58.963190 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_cell0:SELECT=3 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:58.964197 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:07:59.173234 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-a331295d-b42d-4cb3-bb2b-2fd7e9d3905f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:07:59.244605 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-a331295d-b42d-4cb3-bb2b-2fd7e9d3905f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288572 Oct 11 01:07:59.245371 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1336 bytes} [Tue Oct 11 01:07:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:01.869630 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-864a0003-ed57-4220-91fd-6e2e6f792185 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:01.870655 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-864a0003-ed57-4220-91fd-6e2e6f792185 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 11 01:08:01.871053 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:02.669029 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-83f5ace9-f206-48c0-a2e9-3a472bcfbdb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:02.722392 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-83f5ace9-f206-48c0-a2e9-3a472bcfbdb9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.844204 Oct 11 01:08:02.723552 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:02.737489 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-d952622a-9c42-4b0a-953a-d4bb9ddd26ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:02.795536 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-d952622a-9c42-4b0a-953a-d4bb9ddd26ab admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062881 Oct 11 01:08:02.797782 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1336 bytes} [Tue Oct 11 01:08:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:05.727621 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-83f5ace9-f206-48c0-a2e9-3a472bcfbdb9 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:05.728611 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-83f5ace9-f206-48c0-a2e9-3a472bcfbdb9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 11 01:08:05.736482 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:06.296896 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-81124709-bdb0-40f5-99d9-3d2ab360d3eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:06.318013 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-81124709-bdb0-40f5-99d9-3d2ab360d3eb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581485 Oct 11 01:08:06.319398 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:06.331529 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-be2def92-6bd1-4a68-b69f-949a67549e18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:06.361596 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-be2def92-6bd1-4a68-b69f-949a67549e18 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033850 Oct 11 01:08:06.362781 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1336 bytes} [Tue Oct 11 01:08:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:08:08.989644 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-81124709-bdb0-40f5-99d9-3d2ab360d3eb admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:08.990609 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-81124709-bdb0-40f5-99d9-3d2ab360d3eb admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 11 01:08:08.991015 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:09.441674 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-aa6140ea-c49c-4e84-beea-90600bd7b1ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:09.467817 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-aa6140ea-c49c-4e84-beea-90600bd7b1ed admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469902 Oct 11 01:08:09.468485 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:09.481614 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-500210df-1946-4690-a259-c566c62c8829 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:09.516414 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-500210df-1946-4690-a259-c566c62c8829 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038433 Oct 11 01:08:09.517338 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1336 bytes} [Tue Oct 11 01:08:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:12.263840 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-aa6140ea-c49c-4e84-beea-90600bd7b1ed admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:12.265689 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-aa6140ea-c49c-4e84-beea-90600bd7b1ed admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002318 Oct 11 01:08:12.266624 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:12.732615 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:12.754810 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481090 Oct 11 01:08:12.756134 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:12.768181 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-66a1c284-ae57-4906-8269-c2e90758a32d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:12.795912 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-66a1c284-ae57-4906-8269-c2e90758a32d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031389 Oct 11 01:08:12.812933 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1336 bytes} [Tue Oct 11 01:08:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:15.441666 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:15.442712 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 11 01:08:15.443293 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:15.845870 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-8095ace8-4cff-408b-a624-0b589dd45729 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:15.871956 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-8095ace8-4cff-408b-a624-0b589dd45729 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.422626 Oct 11 01:08:15.872550 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:08:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:18.872293 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:18.873559 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-f2806715-e87e-4e6d-9473-be928a7459f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Oct 11 01:08:18.874119 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:19.328066 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-d0180bb1-08f8-415b-83d3-15142bdd40aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:19.348129 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-d0180bb1-08f8-415b-83d3-15142bdd40aa admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467425 Oct 11 01:08:19.348704 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:08:19.361313 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-fa7fcff7-a792-407b-b080-5831a2e8b3dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:19.389424 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-fa7fcff7-a792-407b-b080-5831a2e8b3dd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031824 Oct 11 01:08:19.390038 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1333 bytes} [Tue Oct 11 01:08:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:22.028628 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-d0180bb1-08f8-415b-83d3-15142bdd40aa admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:22.029644 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-d0180bb1-08f8-415b-83d3-15142bdd40aa admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 11 01:08:22.030379 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:22.425454 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-5156948e-4658-401b-bd30-30251c26485f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "name": "m1.small", "id": "2", "vcpus": 1}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:22.447197 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-5156948e-4658-401b-bd30-30251c26485f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410831 Oct 11 01:08:22.447864 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:22.460780 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-c347b59a-a8a7-4cba-ac07-55de54ea36b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:22.486584 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-c347b59a-a8a7-4cba-ac07-55de54ea36b1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029483 Oct 11 01:08:22.487194 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1333 bytes} [Tue Oct 11 01:08:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:08:25.083514 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-5156948e-4658-401b-bd30-30251c26485f admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:25.084534 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-5156948e-4658-401b-bd30-30251c26485f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Oct 11 01:08:25.084947 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:25.457318 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-3ca71e54-1de0-4412-83b5-067ea08921d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:25.478242 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-3ca71e54-1de0-4412-83b5-067ea08921d7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385998 Oct 11 01:08:25.483368 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:08:25.491880 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-75747617-3471-4dfc-80d1-7319feae8847 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:25.496698 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:08:25.517873 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-75747617-3471-4dfc-80d1-7319feae8847 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029599 Oct 11 01:08:25.518662 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1333 bytes} [Tue Oct 11 01:08:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:28.137287 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-3ca71e54-1de0-4412-83b5-067ea08921d7 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:28.138302 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-3ca71e54-1de0-4412-83b5-067ea08921d7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 11 01:08:28.138700 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:28.580640 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-db4e661a-7ea5-450c-8929-e460d691ba10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:28.602283 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-db4e661a-7ea5-450c-8929-e460d691ba10 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457352 Oct 11 01:08:28.602837 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:08:28.615525 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-1051aea2-31fc-4d4a-9010-e6dae0ecafed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:28.639267 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-1051aea2-31fc-4d4a-9010-e6dae0ecafed admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027338 Oct 11 01:08:28.640151 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1333 bytes} [Tue Oct 11 01:08:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:31.303839 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-db4e661a-7ea5-450c-8929-e460d691ba10 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:31.304773 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-db4e661a-7ea5-450c-8929-e460d691ba10 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 11 01:08:31.305172 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:31.748151 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "ram": 16384}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:31.759895 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:08:31.772891 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460827 Oct 11 01:08:31.781387 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1283 bytes} [Tue Oct 11 01:08:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:08:31.786560 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-5de98ffa-03da-4af5-8d6a-4fab5d9a4efd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:08:31.818846 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-5de98ffa-03da-4af5-8d6a-4fab5d9a4efd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036149 Oct 11 01:08:31.819966 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1333 bytes} [Tue Oct 11 01:08:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:08:52.397041 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:52.397978 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 11 01:08:52.398377 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:52.409337 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:08:52.787072 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-c97bea8b-29c2-4a35-83e3-d9a8b0a1b2e4 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:52.805155 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-c97bea8b-29c2-4a35-83e3-d9a8b0a1b2e4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400188 Oct 11 01:08:52.805680 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:54.094850 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:54.095894 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-6eaa1aca-2382-4bb8-8887-8a63f9930d6f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 11 01:08:54.096296 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:54.622590 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-2a8a23b6-91ca-4353-a654-3e66f82305fe admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:54.627988 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.wsgi [None req-2a8a23b6-91ca-4353-a654-3e66f82305fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-2a8a23b6-91ca-4353-a654-3e66f82305fe admin admin] Request method failure captured: Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Accept: application/json Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Accept-Encoding: gzip, deflate Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Connection: keep-alive Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Content-Length: 0 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Host: 10.222.0.66 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: Openstack-System-Scope: None Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: User-Agent: python-novaclient Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Auth-Token: gAAAAABjRMIlKjEAYKzWRMkWpYh00bHCN5BS49vZGOwoz8uUWf0L4wUQFfiRv9_-HlX6OW_wR0sJMwUKW2VQ3rJ19oxAlHmSg_Qu1uKx3OeCWY9vZZ6T0_JdyX2msUltFGFBjRh0fVRYi1BSKBXAawtPJegzLeGD0Y78NTgvgXedke645VEbMIU Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Id: None Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Name: None Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Identity-Status: Confirmed Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Is-Admin-Project: True Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Id: default Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Name: Default Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Name: admin Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Role: admin,reader,member Oct 11 01:08:54.631255 n-d-772273-9 devstack@n-api.service[104675]: X-Roles: admin,reader,member Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant: admin Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Name: admin Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-User: admin Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Id: default Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Name: Default Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: X-User-Name: admin Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: method: > Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: exception: Flavor 42 could not be found. Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: action_args: {'id': '42'} Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:54.632961 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:54.634588 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.636060 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-2a8a23b6-91ca-4353-a654-3e66f82305fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:54.637579 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-2a8a23b6-91ca-4353-a654-3e66f82305fe admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392844 Oct 11 01:08:54.637579 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Tue Oct 11 01:08:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:54.643814 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-024450e9-bf3a-472b-8911-395a55bbbc59 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:54.666884 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-024450e9-bf3a-472b-8911-395a55bbbc59 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027409 Oct 11 01:08:54.667428 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:54.681469 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-b8f386ec-b819-4ee4-bb7a-dad7cb6194e9 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:54.703538 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-b8f386ec-b819-4ee4-bb7a-dad7cb6194e9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027015 Oct 11 01:08:54.704082 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:54.714093 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-18ea0a57-5e5d-49a1-8019-686aa47c4ebd admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:54.719706 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.wsgi [None req-18ea0a57-5e5d-49a1-8019-686aa47c4ebd admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-18ea0a57-5e5d-49a1-8019-686aa47c4ebd admin admin] Request method failure captured: Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Accept: application/json Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Accept-Encoding: gzip, deflate Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Connection: keep-alive Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Content-Length: 0 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Host: 10.222.0.66 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: Openstack-System-Scope: None Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: User-Agent: python-novaclient Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Auth-Token: gAAAAABjRMIlKjEAYKzWRMkWpYh00bHCN5BS49vZGOwoz8uUWf0L4wUQFfiRv9_-HlX6OW_wR0sJMwUKW2VQ3rJ19oxAlHmSg_Qu1uKx3OeCWY9vZZ6T0_JdyX2msUltFGFBjRh0fVRYi1BSKBXAawtPJegzLeGD0Y78NTgvgXedke645VEbMIU Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Id: None Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Name: None Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Identity-Status: Confirmed Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Is-Admin-Project: True Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Id: default Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Name: Default Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Name: admin Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Role: admin,reader,member Oct 11 01:08:54.723008 n-d-772273-9 devstack@n-api.service[104676]: X-Roles: admin,reader,member Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant: admin Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Name: admin Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-User: admin Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Id: default Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Name: Default Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: X-User-Name: admin Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: method: > Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: exception: Flavor 42 could not be found. Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: action_args: {'id': '42'} Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:54.724574 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:54.729417 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:54.730721 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-18ea0a57-5e5d-49a1-8019-686aa47c4ebd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:54.732007 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-18ea0a57-5e5d-49a1-8019-686aa47c4ebd admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014631 Oct 11 01:08:54.732007 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Tue Oct 11 01:08:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:55.925459 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-b8f386ec-b819-4ee4-bb7a-dad7cb6194e9 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:55.926476 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-b8f386ec-b819-4ee4-bb7a-dad7cb6194e9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 11 01:08:55.926897 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:56.455129 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-4276386a-0c5f-49f7-8545-bdb4ba5376bf admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:56.460101 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.wsgi [None req-4276386a-0c5f-49f7-8545-bdb4ba5376bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-4276386a-0c5f-49f7-8545-bdb4ba5376bf admin admin] Request method failure captured: Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Accept: application/json Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Accept-Encoding: gzip, deflate Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Connection: keep-alive Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Content-Length: 0 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Host: 10.222.0.66 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: Openstack-System-Scope: None Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: User-Agent: python-novaclient Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Auth-Token: gAAAAABjRMInhgpJHXkhyfSa_Fo41CyyKt2BTBybzLTxEs-KI0NWlhKgcQj-NeBwjovBxArsuhQx9EypBD0SWGrVBeSq0NvibM0giAGaueyox5Rrxa0sZbTM0YJI-OH_qvJpulX0heXNqieWFDOEEKKlajtSVoosEKVpGFFFQ-wb5KfcPyLRFcA Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Id: None Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Name: None Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Identity-Status: Confirmed Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Is-Admin-Project: True Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Id: default Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Name: Default Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Name: admin Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Role: admin,reader,member Oct 11 01:08:56.461611 n-d-772273-9 devstack@n-api.service[104676]: X-Roles: admin,reader,member Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant: admin Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Name: admin Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-User: admin Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Id: default Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Name: Default Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: X-User-Name: admin Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: method: > Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: exception: Flavor 84 could not be found. Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: action_args: {'id': '84'} Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:56.463224 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:56.464141 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.465311 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-4276386a-0c5f-49f7-8545-bdb4ba5376bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:56.466574 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-4276386a-0c5f-49f7-8545-bdb4ba5376bf admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398541 Oct 11 01:08:56.466574 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Tue Oct 11 01:08:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:56.472731 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52e206ac-e738-4eff-8c6f-e8f23d524281 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:56.487735 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52e206ac-e738-4eff-8c6f-e8f23d524281 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018507 Oct 11 01:08:56.488251 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:08:56.498149 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-be543f7d-121a-4068-9004-cf1e8a1d3201 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:56.514066 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-be543f7d-121a-4068-9004-cf1e8a1d3201 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019718 Oct 11 01:08:56.514590 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:08:56.523889 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-02176787-236d-46e2-8903-794483664680 admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:56.528912 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.wsgi [None req-02176787-236d-46e2-8903-794483664680 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-02176787-236d-46e2-8903-794483664680 admin admin] Request method failure captured: Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Accept: application/json Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Accept-Encoding: gzip, deflate Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Connection: keep-alive Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Content-Length: 0 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Host: 10.222.0.66 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: Openstack-System-Scope: None Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: User-Agent: python-novaclient Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Auth-Token: gAAAAABjRMInhgpJHXkhyfSa_Fo41CyyKt2BTBybzLTxEs-KI0NWlhKgcQj-NeBwjovBxArsuhQx9EypBD0SWGrVBeSq0NvibM0giAGaueyox5Rrxa0sZbTM0YJI-OH_qvJpulX0heXNqieWFDOEEKKlajtSVoosEKVpGFFFQ-wb5KfcPyLRFcA Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Id: None Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Name: None Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Identity-Status: Confirmed Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Is-Admin-Project: True Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Id: default Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Name: Default Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Name: admin Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Role: admin,reader,member Oct 11 01:08:56.530413 n-d-772273-9 devstack@n-api.service[104675]: X-Roles: admin,reader,member Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant: admin Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Name: admin Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-User: admin Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Id: default Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Name: Default Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: X-User-Name: admin Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: method: > Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: exception: Flavor 84 could not be found. Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: action_args: {'id': '84'} Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:56.532006 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:56.532954 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:56.534271 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-02176787-236d-46e2-8903-794483664680 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:56.535553 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-02176787-236d-46e2-8903-794483664680 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011379 Oct 11 01:08:56.535553 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Tue Oct 11 01:08:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:57.729794 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-be543f7d-121a-4068-9004-cf1e8a1d3201 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:57.730813 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-be543f7d-121a-4068-9004-cf1e8a1d3201 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 11 01:08:57.731216 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:08:58.252796 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-aa291345-1dea-4f6e-ba3e-e0fff151e8be admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:58.258651 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.wsgi [None req-aa291345-1dea-4f6e-ba3e-e0fff151e8be admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-aa291345-1dea-4f6e-ba3e-e0fff151e8be admin admin] Request method failure captured: Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Accept: application/json Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Accept-Encoding: gzip, deflate Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Connection: keep-alive Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Content-Length: 0 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Host: 10.222.0.66 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: Openstack-System-Scope: None Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: User-Agent: python-novaclient Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Auth-Token: gAAAAABjRMIpfhnQjrb5PLW8uyXM72qFqOgTli2ge6xwsgYUEJayfE2wjlm80hlpyFiqaA4fUsNKRabq2kADz4yjNvA0o-FF-BiNyrGJgE4l91dhYeKVUZ7qlEP0Ub4tMCl0Nvb7SFPjdc6bwk6VpSdqW03Jli-07tdwZOb-BLKdXbx_K_1-0mw Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Id: None Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Domain-Name: None Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Identity-Status: Confirmed Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Is-Admin-Project: True Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Id: default Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Domain-Name: Default Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Project-Name: admin Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Role: admin,reader,member Oct 11 01:08:58.260186 n-d-772273-9 devstack@n-api.service[104675]: X-Roles: admin,reader,member Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant: admin Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-Tenant-Name: admin Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-User: admin Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Id: default Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-User-Domain-Name: Default Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: X-User-Name: admin Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: method: > Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: exception: Flavor 451 could not be found. Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: action_args: {'id': '451'} Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:58.261768 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:58.262582 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.263738 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-aa291345-1dea-4f6e-ba3e-e0fff151e8be admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:58.265240 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-aa291345-1dea-4f6e-ba3e-e0fff151e8be admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394531 Oct 11 01:08:58.265240 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:08:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:58.271426 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-a95e1a76-afba-434e-8c14-86d4e10daa4b admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:58.286117 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-a95e1a76-afba-434e-8c14-86d4e10daa4b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018220 Oct 11 01:08:58.286639 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:58.296452 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:58.311566 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018704 Oct 11 01:08:58.312098 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Tue Oct 11 01:08:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:08:58.321162 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-fabeb044-68bb-4f7e-950f-efdc4280255e admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:58.326042 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.wsgi [None req-fabeb044-68bb-4f7e-950f-efdc4280255e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-fabeb044-68bb-4f7e-950f-efdc4280255e admin admin] Request method failure captured: Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Accept: application/json Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Accept-Encoding: gzip, deflate Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Connection: keep-alive Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Content-Length: 0 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Host: 10.222.0.66 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Openstack-Api-Version: compute 2.92 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: Openstack-System-Scope: None Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: User-Agent: python-novaclient Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Auth-Token: gAAAAABjRMIpfhnQjrb5PLW8uyXM72qFqOgTli2ge6xwsgYUEJayfE2wjlm80hlpyFiqaA4fUsNKRabq2kADz4yjNvA0o-FF-BiNyrGJgE4l91dhYeKVUZ7qlEP0Ub4tMCl0Nvb7SFPjdc6bwk6VpSdqW03Jli-07tdwZOb-BLKdXbx_K_1-0mw Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Id: None Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Domain-Name: None Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Identity-Status: Confirmed Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Is-Admin-Project: True Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Id: default Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Domain-Name: Default Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Project-Name: admin Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Role: admin,reader,member Oct 11 01:08:58.327588 n-d-772273-9 devstack@n-api.service[104676]: X-Roles: admin,reader,member Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b543145009ac42e88e6035d712963ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b543145009ac42e88e6035d712963ff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b543145009ac42e88e6035d712963ff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant: admin Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Id: b543145009ac42e88e6035d712963ff6 Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-Tenant-Name: admin Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-User: admin Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Id: default Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-User-Domain-Name: Default Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-User-Id: 1fcece0692f846c9981843fced01b7ac Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: X-User-Name: admin Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: method: > Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: exception: Flavor 451 could not be found. Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: action_args: {'id': '451'} Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:08:58.329265 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:58.330126 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: ERROR nova.api.openstack.wsgi Oct 11 01:08:58.331281 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-fabeb044-68bb-4f7e-950f-efdc4280255e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:08:58.332426 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-fabeb044-68bb-4f7e-950f-efdc4280255e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011312 Oct 11 01:08:58.332426 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:08:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:08:59.539558 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:08:59.541139 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Oct 11 01:08:59.541546 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:09:00.054614 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-5ec09df0-1640-4752-ad87-5648992bec2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:09:00.073540 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-5ec09df0-1640-4752-ad87-5648992bec2c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.395012 Oct 11 01:09:00.074073 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Tue Oct 11 01:08:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:09:01.278389 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:09:01.279560 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 11 01:09:01.279911 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:09:01.795010 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-291d526a-21bc-43c0-8cb2-f18952f98fcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:09:01.812835 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-291d526a-21bc-43c0-8cb2-f18952f98fcf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.394797 Oct 11 01:09:01.813353 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Tue Oct 11 01:09:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:09:03.024872 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:09:03.025882 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Oct 11 01:09:03.026283 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:09:03.539048 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-61b6d0aa-082a-44e2-9f4f-14218779af36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:09:03.557918 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-61b6d0aa-082a-44e2-9f4f-14218779af36 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395179 Oct 11 01:09:03.558458 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Tue Oct 11 01:09:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:09:04.761171 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:09:04.762221 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 11 01:09:04.762670 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:09:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:09:05.276742 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-430ab66d-0c9a-41e0-af51-03e8ca0b903a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:09:05.296285 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-430ab66d-0c9a-41e0-af51-03e8ca0b903a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395489 Oct 11 01:09:05.296833 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Tue Oct 11 01:09:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:09:06.507074 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:09:06.508118 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 11 01:09:06.508547 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:09:07.026768 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-d2a14150-63b7-405a-b107-3d8c9dddabac admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:09:07.046963 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-d2a14150-63b7-405a-b107-3d8c9dddabac admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400728 Oct 11 01:09:07.047525 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Tue Oct 11 01:09:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:10:03.176091 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.177068 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-52c14044-d019-4b03-9928-0d468c367d6d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 11 01:10:03.177470 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 931 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:10:03.188110 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:10:03.561149 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-4b60049b-e962-44c0-8ad2-6f3902cfc72e admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.581500 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-4b60049b-e962-44c0-8ad2-6f3902cfc72e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397879 Oct 11 01:10:03.582638 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:10:03.603264 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_api:SELECT=14 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:10:03.607475 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-fb0ca118-ea9f-4a46-a6ad-a2d6f6ed113d admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.614693 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-fb0ca118-ea9f-4a46-a6ad-a2d6f6ed113d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012816 Oct 11 01:10:03.615205 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1283 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:10:03.626392 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-29b7925e-6d7b-4fa7-a1e8-cb19f6d17205 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.634083 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-29b7925e-6d7b-4fa7-a1e8-cb19f6d17205 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011213 Oct 11 01:10:03.634594 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1286 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:10:03.646008 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.653007 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011053 Oct 11 01:10:03.653514 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1286 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:10:03.664988 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-67f56005-8dd5-4272-9c41-37e3de2d7b6f admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:10:03.672029 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-67f56005-8dd5-4272-9c41-37e3de2d7b6f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010477 Oct 11 01:10:03.672542 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1283 bytes} [Tue Oct 11 01:10:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:15:27.160708 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:15:27.161764 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 11 01:15:27.162162 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:15:27.302346 n-d-772273-9 devstack@n-api.service[104676]: DEBUG dbcounter [-] [104676] Writing DB stats nova_api:SELECT=6 {{(pid=104676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:15:27.445620 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:15:27.450358 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:15:27.450824 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:15:27.451243 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:15:27.451987 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:15:27.452422 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:15:27.452828 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:15:27.492350 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-7d0480a6-7a4e-4760-92dc-b9efdca1daa3 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.191143 Oct 11 01:15:27.492932 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 35/70] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:15:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:15:28.576864 n-d-772273-9 devstack@n-api.service[104675]: DEBUG nova.api.openstack.wsgi [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] Calling method '>' {{(pid=104675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:15:28.577907 n-d-772273-9 devstack@n-api.service[104675]: INFO nova.api.openstack.requestlog [None req-3e8bebd4-bb65-4eed-b00c-30ecd2a7133a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 11 01:15:28.578303 n-d-772273-9 devstack@n-api.service[104675]: [pid: 104675|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1074 bytes} [Tue Oct 11 01:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:15:28.769103 n-d-772273-9 devstack@n-api.service[104676]: DEBUG nova.api.openstack.wsgi [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Calling method '>' {{(pid=104676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:15:28.772532 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:15:28.772997 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:15:28.773416 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:15:28.774156 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:15:28.774589 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:15:28.774994 n-d-772273-9 devstack@n-api.service[104676]: DEBUG oslo_concurrency.lockutils [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:15:28.799532 n-d-772273-9 devstack@n-api.service[104676]: INFO nova.api.openstack.requestlog [None req-638303fa-85a2-42ca-ba32-5148b78bd495 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082753 Oct 11 01:15:28.800005 n-d-772273-9 devstack@n-api.service[104676]: [pid: 104676|app: 0|req: 36/72] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:15:28 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:16:13.528298 n-d-772273-9 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 01:16:13.528838 n-d-772273-9 devstack@n-api.service[104674]: Tue Oct 11 01:16:13 2022 - graceful shutdown triggered... Oct 11 01:16:13.529309 n-d-772273-9 devstack@n-api.service[104675]: Gracefully killing worker 1 (pid: 104675)... Oct 11 01:16:13.530403 n-d-772273-9 devstack@n-api.service[104676]: Gracefully killing worker 2 (pid: 104676)... Oct 11 01:16:13.656808 n-d-772273-9 devstack@n-api.service[104675]: DEBUG dbcounter [-] [104675] Writing DB stats nova_api:SELECT=4 {{(pid=104675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:16:14.529947 n-d-772273-9 devstack@n-api.service[104674]: worker 1 buried after 1 seconds Oct 11 01:16:14.530443 n-d-772273-9 devstack@n-api.service[104674]: worker 2 buried after 1 seconds Oct 11 01:16:14.530443 n-d-772273-9 devstack@n-api.service[104674]: goodbye to uWSGI. Oct 11 01:16:14.531549 n-d-772273-9 systemd[1]: devstack@n-api.service: Succeeded. Oct 11 01:16:14.532098 n-d-772273-9 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 01:16:14.534850 n-d-772273-9 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 01:16:14.549747 n-d-772273-9 devstack@n-api.service[120484]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 01:16:14 2022] *** Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: nodename: n-d-772273-9 Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: machine: x86_64 Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: clock source: unix Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: pcre jit disabled Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: detected number of CPU cores: 4 Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: current working directory: / Oct 11 01:16:14.568158 n-d-772273-9 devstack@n-api.service[120484]: detected binary path: /usr/bin/uwsgi-core Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: your processes number limit is 47680 Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: your memory page size is 4096 bytes Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: detected max file descriptor number: 2048 Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: lock engine: pthread robust mutexes Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: thunder lock: enabled Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 01:16:14.568969 n-d-772273-9 devstack@n-api.service[120484]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 01:16:14.610087 n-d-772273-9 devstack@n-api.service[120484]: Python main interpreter initialized at 0x55b3fcfb19c0 Oct 11 01:16:14.610087 n-d-772273-9 devstack@n-api.service[120484]: python threads support enabled Oct 11 01:16:14.610087 n-d-772273-9 devstack@n-api.service[120484]: your server socket listen backlog is limited to 100 connections Oct 11 01:16:14.610087 n-d-772273-9 devstack@n-api.service[120484]: your mercy for graceful operations on workers is 90 seconds Oct 11 01:16:14.610562 n-d-772273-9 devstack@n-api.service[120484]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 01:16:14.610562 n-d-772273-9 devstack@n-api.service[120484]: *** Operational MODE: preforking *** Oct 11 01:16:14.610784 n-d-772273-9 devstack@n-api.service[120484]: *** uWSGI is running in multiple interpreter mode *** Oct 11 01:16:14.610784 n-d-772273-9 devstack@n-api.service[120484]: spawned uWSGI master process (pid: 120484) Oct 11 01:16:14.611009 n-d-772273-9 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 01:16:14.612546 n-d-772273-9 devstack@n-api.service[120484]: spawned uWSGI worker 1 (pid: 120493, cores: 1) Oct 11 01:16:14.614887 n-d-772273-9 devstack@n-api.service[120484]: spawned uWSGI worker 2 (pid: 120494, cores: 1) Oct 11 01:16:14.615162 n-d-772273-9 devstack@n-api.service[120484]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 01:16:15.274782 n-d-772273-9 devstack@n-api.service[120493]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 01:16:15.284850 n-d-772273-9 devstack@n-api.service[120494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 01:16:16.442305 n-d-772273-9 devstack@n-api.service[120493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:16:16.442305 n-d-772273-9 devstack@n-api.service[120493]: from cryptography.utils import int_from_bytes Oct 11 01:16:16.442825 n-d-772273-9 devstack@n-api.service[120494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:16:16.442825 n-d-772273-9 devstack@n-api.service[120494]: from cryptography.utils import int_from_bytes Oct 11 01:16:16.443221 n-d-772273-9 devstack@n-api.service[120493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:16:16.443221 n-d-772273-9 devstack@n-api.service[120493]: from cryptography.utils import int_from_bytes Oct 11 01:16:16.443563 n-d-772273-9 devstack@n-api.service[120494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 01:16:16.443563 n-d-772273-9 devstack@n-api.service[120494]: from cryptography.utils import int_from_bytes Oct 11 01:16:18.954080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 01:16:18.954743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 01:16:18.955104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 01:16:18.955195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 01:16:18.955715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 01:16:18.955821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 01:16:18.955908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 01:16:18.956072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 01:16:18.956155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 01:16:18.956236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 01:16:18.956236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.956383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.956464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.956545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.956629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.956712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.957956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.958851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-772273-9 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-772273-9 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.959921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.960844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.961868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.962055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.962235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.962492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.962808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.963245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.963522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.963778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.963997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.964214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.964443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.964659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.964877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.965091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.965308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.965529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.965746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.965961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.966174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.966381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.966612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-772273-9 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.966834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.967047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.967263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.967508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.967776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.968006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.968214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-772273-9 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.968437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.968653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.968842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.969030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.969647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.969815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.969971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.970136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.970324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.970583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.970741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.970893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.971902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.972992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.973232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.973387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.973539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.973701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.973846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.974997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.975936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.976850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.977997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.978916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.979068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.979212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.979783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.979938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.980115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.980271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.980426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.980746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.980907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.981947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.982972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.983223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.983473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.983624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.983818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.983967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.984925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.985850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.986994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.987149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.987295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.987517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.987663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.987861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.988925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.989070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.989212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.989355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.989808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.990067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.990225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.990381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.990526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.990846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.991952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.992850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.993091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.993345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.993509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.993733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.993891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.994935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.995870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.996940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.997587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.997746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.997940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.998977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.999131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.999282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.999470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:18.999642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.000088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.000321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.000481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.000634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.000786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.001877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.002907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.003075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.003320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.003563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.003741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.003982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.004143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.004287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.005009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.005178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.005331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.005475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.005618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.005770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.005916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.006059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.006203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 01:16:19.006486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.006650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.006814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.006970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.007132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.007287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.007531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.007687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.007883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.008955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.009110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.009262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.009407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.009559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.009710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.010924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.011312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.011505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.011663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.011818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.011963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.012117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.012262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.012406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.012559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.012704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.013583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.013823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.013991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.014982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.015280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.015459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.015616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.015787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.016905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.017981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.018905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.019831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.020267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.020431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.020585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.020739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.020886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.021062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.021539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.021686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.021838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.021993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.022910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.023480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.024886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.025940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.026950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.027896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.028975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.029870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.030981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.031126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.031290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.031714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.031866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.032934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.033950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.034196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.034374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.034610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.034759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.034902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.035961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.036939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.037678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.037841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.037996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.038969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.039765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.041121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.042536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.042536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.042936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.043934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.044171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.044390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.044551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.044551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.044929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.045854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.046877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.047895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.048052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.048253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.048498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.048651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.048849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.049995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.050150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.050299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.050686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.050846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.050996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.051154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.051313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.051497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.051680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.051680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.052882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.053770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.054532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.054698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.054935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.055732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.056997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.057158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.057308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.057457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.057617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.058862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.059023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.059181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.059331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.060072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.060230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.060397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.060556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.060920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.061870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.062286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.062451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.062451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.062451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.062898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.063903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.064072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.064223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.064454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.064706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.064870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.065920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.066956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.067931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.068975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.069892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.070043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.070203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.070365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.070526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.070682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.071919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.072075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.072479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.072645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.072805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.072955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.073935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.074093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.074251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.074410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.074687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.074920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.075101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.075992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.076212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.076375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.076534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.077979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.078976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.079946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.080103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.080278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.080431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.080689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.080863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.081226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.081391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.081391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.081698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.081856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.082006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.082156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.082333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.082640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.082892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.083868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.084956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.085176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.085332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.085577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.086288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.086465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.086620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.086790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.087875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.088864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.089974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.090967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.091322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.091505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.091658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.091894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.092945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.093189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.093442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.093606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.093756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.093916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.094908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.095083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.095321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.095526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.095772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.095928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.096706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.097019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.098883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.099844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.100945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.101104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.101274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.101654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.101817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.101967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.102125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.102296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.102456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.102608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.102804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.103039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.103220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.103606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.103767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.103919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.104854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.105100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.105264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.105520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.105676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.105919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.106076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.106226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.106384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.106713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.106888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.107946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.108098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.108263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.108415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.108853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.109809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.110957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.111966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.112971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.113179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.113273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.113369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.113455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.113561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.114910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.115811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.116969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.117997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.118929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.119879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.120878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.121946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.122033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.122661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.122756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.122841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.122938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.123894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.124984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.125957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.126947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.127972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.128943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.129911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.130960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.131801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.132986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.133416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.134542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.134722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.134722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.135890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.136053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.136397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.136557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.136709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.136867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.137805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.138926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.139790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.140768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.141946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.142221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.142328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.142566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.142660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.142901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.143007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.143216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.143572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.143862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.143964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.144971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.145911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.146886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.147117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.147381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.147480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.147721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.147812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.148987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.149923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.150981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.151950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.152915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.153918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.154897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.155860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.156983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.157143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.157396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.157560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.157700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.157844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.158001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.158153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.158311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.158454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.158608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.159804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.160100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.160203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.160422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.160515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.160740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.161062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.161399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.161558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.161770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.162068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.162413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.162740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.163072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.163423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.163752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.163856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.164964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.165959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.166180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.166296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.166502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.166611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.166826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.167873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.168878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.169896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.170997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.171210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.171308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.171576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.171671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.171912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.172995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.173926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.174877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.175849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.176934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.177060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.177288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.177382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.177613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.177942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.178904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.179904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.180976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.181885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.182826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.183802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.184004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.184262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.184371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.185908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.186847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.187852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.188968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.189246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.189559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.191573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.191792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.191971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.192948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.193927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.194895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.195849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.196871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.197673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.198947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.199107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.199251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.199648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.199835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.200033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.200259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.200959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.201987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.202901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.203970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.204926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.205987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.206924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.207984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.208247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.208472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.208643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.208806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.208912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.209945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.210953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.211913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.212966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.213899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.214852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.215958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.216988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.217927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.218973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.219994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.220945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.221878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.222835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.223799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.224985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.225947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.226118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.226267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.226392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.226613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.226933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.227253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.227412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.227593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.227694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.227985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 01:16:19.228088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.228397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.228670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.229028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.230258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.230599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.230932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.232038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.232359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.232701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.233203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.233344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.233675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.234001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.234331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.234656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.234981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.235420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.235662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.235999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.236364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.236690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.237028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.237364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.237722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.238047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.238401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.238743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.239166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.239440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.239760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 01:16:19.240012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 01:16:19.292256 n-d-772273-9 devstack@n-api.service[120494]: INFO dbcounter [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Registered counter for database nova_api Oct 11 01:16:19.303002 n-d-772273-9 devstack@n-api.service[120493]: INFO dbcounter [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Registered counter for database nova_api Oct 11 01:16:19.314125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.322467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.323668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.331588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writer thread running {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.379394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.context [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120494) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 01:16:19.383477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:16:19.383967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:16:19.385564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:16:19.386313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:16:19.386755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:16:19.388840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:16:19.389796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.context [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120493) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 01:16:19.390871 n-d-772273-9 devstack@n-api.service[120494]: INFO dbcounter [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Registered counter for database nova_cell0 Oct 11 01:16:19.393893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:16:19.394390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:16:19.395661 n-d-772273-9 devstack@n-api.service[120494]: INFO dbcounter [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Registered counter for database nova_cell1 Oct 11 01:16:19.396038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:16:19.396795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:16:19.397248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:16:19.399303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:16:19.401424 n-d-772273-9 devstack@n-api.service[120493]: INFO dbcounter [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Registered counter for database nova_cell0 Oct 11 01:16:19.402710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.406468 n-d-772273-9 devstack@n-api.service[120493]: INFO dbcounter [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Registered counter for database nova_cell1 Oct 11 01:16:19.412523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.416284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.416876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.417444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.425849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writer thread running {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.426187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writer thread running {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.556752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.567568 n-d-772273-9 devstack@n-api.service[120494]: INFO dbcounter [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Registered counter for database nova_cell0 Oct 11 01:16:19.573026 n-d-772273-9 devstack@n-api.service[120493]: INFO dbcounter [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Registered counter for database nova_cell0 Oct 11 01:16:19.574316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.579355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.581049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_db.sqlalchemy.engines [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 01:16:19.585739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writer thread running {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 01:16:19.904896 n-d-772273-9 devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:16:19.908137 n-d-772273-9 devstack@n-api.service[120493]: WARNING keystonemiddleware.auth_token [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:16:19.912507 n-d-772273-9 devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:16:19.916233 n-d-772273-9 devstack@n-api.service[120493]: WARNING keystonemiddleware.auth_token [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:16:20.262285 n-d-772273-9 devstack@n-api.service[120493]: WARNING keystonemiddleware.auth_token [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:16:20.263934 n-d-772273-9 devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 01:16:20.268901 n-d-772273-9 devstack@n-api.service[120493]: WARNING keystonemiddleware.auth_token [None req-a3c73f33-1b2f-4e63-9183-4622bbeba6f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:16:20.270256 n-d-772273-9 devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-b5d55377-e9ad-4f5d-872b-41364ffa7838 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 01:16:20.275430 n-d-772273-9 devstack@n-api.service[120493]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3fcfb19c0 pid: 120493 (default app) Oct 11 01:16:20.276809 n-d-772273-9 devstack@n-api.service[120494]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3fcfb19c0 pid: 120494 (default app) Oct 11 01:17:00.190164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.192109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.193966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.195151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.421441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.423332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.424192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:00.426503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:01.624956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Calling method '.version_select at 0x7f1135efe820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:01.629718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:01.630216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:01.630656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:01.631405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:01.631861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:01.632284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:01.712946 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8626ab7f-8246-4855-9d7d-0f0959e5dbd7 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.535975 Oct 11 01:17:01.714147 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1/1] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:17:00 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:01.791753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:01.811975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:01.812464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:01.812903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:01.813631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:01.823700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:01.824448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:01.910058 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b5ef9ed-139b-460e-b505-23fcc47bb5dc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.494854 Oct 11 01:17:01.911484 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1/2] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:17:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:17:02.037297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Calling method '.version_select at 0x7f1135db41f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:02.058150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120493) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 01:17:02.059143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.059818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.060423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.094807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1515690885", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:02.114267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.114927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.117317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.148851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.149541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.150176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.195800 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b4f17d3-68d4-4f53-8d13-8d67c9cf2f73 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.458353 Oct 11 01:17:02.195800 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1208 bytes} [Tue Oct 11 01:17:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:17:02.345937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '.version_select at 0x7f1135dc3160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:02.347903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.348475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.348974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.388824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.391979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.392529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.423624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:02.424112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:02.424598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:02.445250 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be428776-872f-4805-9ff3-a49a1be4b0ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.261469 Oct 11 01:17:02.445996 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:17:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:02.556994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:02.588871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8de931e-7ab9-4047-9bdc-ed14bcaddef5 tempest-InstanceUsageAuditLogTestJSON-1651604415 tempest-InstanceUsageAuditLogTestJSON-1651604415-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:02.633206 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8de931e-7ab9-4047-9bdc-ed14bcaddef5 tempest-InstanceUsageAuditLogTestJSON-1651604415 tempest-InstanceUsageAuditLogTestJSON-1651604415-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 01:17:01" status: 200 len: 318 microversion: 2.1 time: 0.176840 Oct 11 01:17:02.643271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 4/5] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:17:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2001%3A17%3A01 => generated 318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:02.849209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-146f53e0-c0f0-4460-b8e7-4e009ca2a5cc tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Calling method '.version_select at 0x7f1135d66790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:02.852948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-146f53e0-c0f0-4460-b8e7-4e009ca2a5cc tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-146f53e0-c0f0-4460-b8e7-4e009ca2a5cc tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:02.857010 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:17:02.858094 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:02.858748 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 01:17:02.859605 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:02.863749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-146f53e0-c0f0-4460-b8e7-4e009ca2a5cc tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:02.865362 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-146f53e0-c0f0-4460-b8e7-4e009ca2a5cc tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.220849 Oct 11 01:17:02.866376 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 5/6] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:17:02 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:03.006892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:03.007408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:03.007811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:03.008223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:03.008643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:03.023862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:03.024652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:03.025922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:03.026925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:03.027638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:03.028462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:03.034264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b15e729a-6812-48cb-aed3-3a2d7c68dbce tempest-AZAdminNegativeTestJSON-769014611 tempest-AZAdminNegativeTestJSON-769014611-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:03.036599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b15e729a-6812-48cb-aed3-3a2d7c68dbce tempest-AZAdminNegativeTestJSON-769014611 tempest-AZAdminNegativeTestJSON-769014611-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b0ddc889e11d4ac699c319ccc9453358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a758c38d3d540fc871ee0f8b3407e57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b15e729a-6812-48cb-aed3-3a2d7c68dbce tempest-AZAdminNegativeTestJSON-769014611 tempest-AZAdminNegativeTestJSON-769014611-project] Request method failure captured: Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQL2j2q68_6sBpsZblWwvTcjuX6ITJmXd6djHBVbtwbBszcAR6OG38I5j-yGpR6sU08i7eqnd1bhsOrbtmLDEpCWkSETqqaQp3iHSe_K1WBIpKp4yFBbimy_lTluAlzprlCGMoEtfN0OOkXrTjhAybKiW0A7axQgQQB-WFBZKYKlUY Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 3a758c38d3d540fc871ee0f8b3407e57 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AZAdminNegativeTestJSON-769014611 Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:03.039986 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3a758c38d3d540fc871ee0f8b3407e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3a758c38d3d540fc871ee0f8b3407e57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3a758c38d3d540fc871ee0f8b3407e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3a758c38d3d540fc871ee0f8b3407e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AZAdminNegativeTestJSON-769014611 Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 3a758c38d3d540fc871ee0f8b3407e57 Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-769014611 Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AZAdminNegativeTestJSON-769014611-project Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b0ddc889e11d4ac699c319ccc9453358 Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AZAdminNegativeTestJSON-769014611-project Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 01:17:03.041076 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:03.041614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 01:17:03.042469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.046281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b15e729a-6812-48cb-aed3-3a2d7c68dbce tempest-AZAdminNegativeTestJSON-769014611 tempest-AZAdminNegativeTestJSON-769014611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:03.047384 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b15e729a-6812-48cb-aed3-3a2d7c68dbce tempest-AZAdminNegativeTestJSON-769014611 tempest-AZAdminNegativeTestJSON-769014611-project] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.179753 Oct 11 01:17:03.049403 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 6/7] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:17:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 182 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:03.062388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cb00eaa-d20e-4a18-b9e4-73e1195ccd76 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1291825863"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:03.067683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Getting quotas for project dc916a1348664647a2a632c659f238cd. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:03.075221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Getting quotas for user 6a8b97feb0d1432b8e5de7e19fb68454 and project dc916a1348664647a2a632c659f238cd. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:03.087514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:03.091433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:03.106805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-7cb00eaa-d20e-4a18-b9e4-73e1195ccd76 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 2e26a4bf-e434-446c-a138-12320f7e7b78 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:03.181900 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb28d28e-0f9f-4749-b15a-3d44a3e397f8 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265513 Oct 11 01:17:03.185365 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2/8] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:03.190896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07d845b8-f064-4803-9cb9-7765de18cb5b tempest-InstanceUsageAuditLogTestJSON-1651604415 tempest-InstanceUsageAuditLogTestJSON-1651604415-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:03.237940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cb00eaa-d20e-4a18-b9e4-73e1195ccd76 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.186968 Oct 11 01:17:03.239755 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 7/9] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:03.253330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54faccf9-63c1-4ad2-a6fe-2882e98df6ee tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Calling method '.version_select at 0x7f1135ccad30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:03.258704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54faccf9-63c1-4ad2-a6fe-2882e98df6ee tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54faccf9-63c1-4ad2-a6fe-2882e98df6ee tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hosts/n-d-772273-9/reboot HTTP/1.1 Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:03.261047 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'n-d-772273-9'} Oct 11 01:17:03.262280 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:03.263067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 01:17:03.263928 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:03.264676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54faccf9-63c1-4ad2-a6fe-2882e98df6ee tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:03.264676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54faccf9-63c1-4ad2-a6fe-2882e98df6ee tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-772273-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018750 Oct 11 01:17:03.264676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 8/10] 10.222.0.66 () {58 vars in 1188 bytes} [Tue Oct 11 01:17:03 2022] GET /compute/v2.1/os-hosts/n-d-772273-9/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:03.268418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07d845b8-f064-4803-9cb9-7765de18cb5b tempest-InstanceUsageAuditLogTestJSON-1651604415 tempest-InstanceUsageAuditLogTestJSON-1651604415-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.079036 Oct 11 01:17:03.272165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12b31f4c-c325-4e11-8ba4-99490fd01c6d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:03.274870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12b31f4c-c325-4e11-8ba4-99490fd01c6d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:03.278829 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3/11] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:17:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:03.292875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79062a44-8796-439c-8901-6849d2d1bab6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:03.364223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79062a44-8796-439c-8901-6849d2d1bab6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:03.364724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79062a44-8796-439c-8901-6849d2d1bab6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:03.365158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79062a44-8796-439c-8901-6849d2d1bab6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:04.445069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12b31f4c-c325-4e11-8ba4-99490fd01c6d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:04.489954 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79062a44-8796-439c-8901-6849d2d1bab6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.204011 Oct 11 01:17:04.498965 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 4/12] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:04.501051 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12b31f4c-c325-4e11-8ba4-99490fd01c6d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1220 microversion: 2.1 time: 1.234886 Oct 11 01:17:04.502687 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 9/13] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:03 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1220 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:04.517778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4236733d-baef-4cfb-afe2-38cbc5aa918c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Calling method '.version_select at 0x7f11354939d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.519123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:04.547971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:04.549067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:04.549883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:04.554143 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4236733d-baef-4cfb-afe2-38cbc5aa918c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4236733d-baef-4cfb-afe2-38cbc5aa918c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.570033 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'nonexistent_hostname'} Oct 11 01:17:04.571577 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:04.572619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 01:17:04.575589 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4236733d-baef-4cfb-afe2-38cbc5aa918c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4236733d-baef-4cfb-afe2-38cbc5aa918c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.075591 Oct 11 01:17:04.576732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 5/14] 10.222.0.66 () {58 vars in 1212 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:04.586777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c816e78a-8f69-46cd-9bff-6485fe553931 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Calling method '.version_select at 0x7f113672ae50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.601055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c816e78a-8f69-46cd-9bff-6485fe553931 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c816e78a-8f69-46cd-9bff-6485fe553931 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/n-d-772273-9 HTTP/1.1 Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:04.604470 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9'} Oct 11 01:17:04.605511 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.606225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 01:17:04.607060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.607871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c816e78a-8f69-46cd-9bff-6485fe553931 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.607871 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c816e78a-8f69-46cd-9bff-6485fe553931 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-772273-9" status: 403 len: 109 microversion: 2.1 time: 0.023642 Oct 11 01:17:04.611731 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 6/15] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/n-d-772273-9 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:04.616379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5920ba2d-d692-4067-8e13-02b7d8d471ff tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Calling method '.version_select at 0x7f1135300040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.635630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-772273-9. Oct 11 01:17:04.648883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5920ba2d-d692-4067-8e13-02b7d8d471ff tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5920ba2d-d692-4067-8e13-02b7d8d471ff tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.651010 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'nonexistent_hostname'} Oct 11 01:17:04.652519 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.657403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.659078 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.660758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5920ba2d-d692-4067-8e13-02b7d8d471ff tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.660758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5920ba2d-d692-4067-8e13-02b7d8d471ff tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039632 Oct 11 01:17:04.660758 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 7/16] 10.222.0.66 () {58 vars in 1191 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:04.669065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-430f7846-1ef4-4e9d-bf6a-33b2293280d6 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Calling method '.version_select at 0x7f1135300550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 39 Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:04.683936 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: {"add_host": {"host": "n-h1-772273-9"}} Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:04.685046 n-d-772273-9 devstack@n-api.service[120493]: exception: Aggregate 1 already has host n-h1-772273-9. Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-772273-9'}}} Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:17:04.685668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-772273-9-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 01:17:04.686632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 01:17:04.687530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:17:04.688933 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-772273-9-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 1, 17, 4, 619010), 'updated_at': None, 'host': 'n-h1-772273-9', 'aggregate_id': 1}] Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.690882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-772273-9. Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.693797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-772273-9. Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:04.697108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:04.700803 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-772273-9. Oct 11 01:17:04.700803 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.701394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-430f7846-1ef4-4e9d-bf6a-33b2293280d6 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:04.701551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-772273-9. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.701551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c914bf6-8b67-4a9b-9112-9e059d65ed3b tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.176445 Oct 11 01:17:04.701551 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 10/17] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:04 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-430f7846-1ef4-4e9d-bf6a-33b2293280d6 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/n-d-772273-9/shutdown HTTP/1.1 Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:04.701951 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9'} Oct 11 01:17:04.704438 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.706040 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 01:17:04.709010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.711007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-430f7846-1ef4-4e9d-bf6a-33b2293280d6 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.711007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-430f7846-1ef4-4e9d-bf6a-33b2293280d6 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-772273-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.038741 Oct 11 01:17:04.711273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a911fc6-fd65-433c-aef5-aa8e7e7aa8a3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:04.711450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 8/18] 10.222.0.66 () {58 vars in 1194 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/n-d-772273-9/shutdown => generated 113 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:04.725467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0dd00acd-b976-4490-9889-41ba0691955c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Calling method '.version_select at 0x7f1135300dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.747697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a911fc6-fd65-433c-aef5-aa8e7e7aa8a3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:04.748439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a911fc6-fd65-433c-aef5-aa8e7e7aa8a3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:04.749570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a911fc6-fd65-433c-aef5-aa8e7e7aa8a3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:04.771304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0dd00acd-b976-4490-9889-41ba0691955c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0dd00acd-b976-4490-9889-41ba0691955c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.776477 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'nonexistent_hostname'} Oct 11 01:17:04.777587 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:04.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 01:17:04.779122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.781197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0dd00acd-b976-4490-9889-41ba0691955c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.782859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0dd00acd-b976-4490-9889-41ba0691955c tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.068006 Oct 11 01:17:04.789160 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:04.824968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-480c7cda-6413-45b1-a77c-ef8848e6b8b7 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Calling method '.version_select at 0x7f11365a84c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.826935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-480c7cda-6413-45b1-a77c-ef8848e6b8b7 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-480c7cda-6413-45b1-a77c-ef8848e6b8b7 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/n-d-772273-9/startup HTTP/1.1 Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:04.842485 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9'} Oct 11 01:17:04.844463 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.846716 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 01:17:04.847975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.849074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-480c7cda-6413-45b1-a77c-ef8848e6b8b7 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.856211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-480c7cda-6413-45b1-a77c-ef8848e6b8b7 tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-772273-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.065638 Oct 11 01:17:04.861894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 10/20] 10.222.0.66 () {58 vars in 1191 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/n-d-772273-9/startup => generated 110 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:04.873441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-831ee95a-39af-4fb6-9d28-517a0c2a1704 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Calling method '.version_select at 0x7f11354431f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:04.907002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-831ee95a-39af-4fb6-9d28-517a0c2a1704 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-831ee95a-39af-4fb6-9d28-517a0c2a1704 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.917522 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'nonexistent_hostname'} Oct 11 01:17:04.918915 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:04.919963 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 01:17:04.921030 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:04.922852 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.926117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-831ee95a-39af-4fb6-9d28-517a0c2a1704 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.927527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-831ee95a-39af-4fb6-9d28-517a0c2a1704 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.064287 Oct 11 01:17:04.931413 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 11/21] 10.222.0.66 () {58 vars in 1215 bytes} [Tue Oct 11 01:17:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:04.945711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7b113ce-e3b1-4f74-96b3-f629905c1c68 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Action: 'update', calling method: .version_select at 0x7f11352ebf70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7b113ce-e3b1-4f74-96b3-f629905c1c68 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-hosts/n-d-772273-9 HTTP/1.1 Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 51 Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.959690 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: {"status": "enable", "maintenance_mode": "invalid"} Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.960725 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance: Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.966082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.967265 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:04.968170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:04.968170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:17:04.968170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:17:04.968170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.968170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.974195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7b113ce-e3b1-4f74-96b3-f629905c1c68 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:04.975060 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7b113ce-e3b1-4f74-96b3-f629905c1c68 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-772273-9" status: 400 len: 199 microversion: 2.1 time: 0.036038 Oct 11 01:17:04.976014 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 12/22] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:17:04 2022] PUT /compute/v2.1/os-hosts/n-d-772273-9 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:17:04.992352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56c90c65-147f-4e23-8f29-e6a8b592e97f tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Action: 'update', calling method: .version_select at 0x7f1135300ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56c90c65-147f-4e23-8f29-e6a8b592e97f tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-hosts/n-d-772273-9 HTTP/1.1 Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 51 Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:04.996504 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: {"status": "invalid", "maintenance_mode": "enable"} Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:04.997558 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance: Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:04.998182 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.001581 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.002504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.002504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:17:05.002504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:17:05.002504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 01:17:05.002504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.003961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56c90c65-147f-4e23-8f29-e6a8b592e97f tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:05.005005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56c90c65-147f-4e23-8f29-e6a8b592e97f tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-772273-9" status: 400 len: 189 microversion: 2.1 time: 0.022817 Oct 11 01:17:05.006400 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 13/23] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:17:04 2022] PUT /compute/v2.1/os-hosts/n-d-772273-9 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:17:05.015884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc09b167-bf65-42ce-9b2b-aab123fa5eba tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Action: 'update', calling method: .version_select at 0x7f11353303a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.034583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc09b167-bf65-42ce-9b2b-aab123fa5eba tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c3afc05f5c0b4f6ba09ff356dc7f0352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2151c7fe40431ead7f01ba73eb01ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc09b167-bf65-42ce-9b2b-aab123fa5eba tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Request method failure captured: Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-hosts/n-d-772273-9 HTTP/1.1 Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 50 Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJOpcnKLIN3_xFU2Si2nQuGCR_J66UoNMkM01rgw65doB7gzwk4kTMFFnAdebeWMBAveFJrtiNpNiF7k9oJGvKMM_14X9pmi_VxEcRcbDulpghBfVZ07Ta5F6Uq8WRS4R82dIrvBoAYLRLA_kOGQKD_pR-AMP-BDICs8mU2xgeWVI Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:05.039679 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca2151c7fe40431ead7f01ba73eb01ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ca2151c7fe40431ead7f01ba73eb01ca Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1113920263 Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: c3afc05f5c0b4f6ba09ff356dc7f0352 Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1113920263-project Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 01:17:05.041150 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:05.041978 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 01:17:05.043363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.045638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc09b167-bf65-42ce-9b2b-aab123fa5eba tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:05.047734 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc09b167-bf65-42ce-9b2b-aab123fa5eba tempest-HostsAdminNegativeTestJSON-1113920263 tempest-HostsAdminNegativeTestJSON-1113920263-project] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-772273-9" status: 403 len: 111 microversion: 2.1 time: 0.035293 Oct 11 01:17:05.051190 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 14/24] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:17:05 2022] PUT /compute/v2.1/os-hosts/n-d-772273-9 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:05.062416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56f7c6cb-100a-45e1-9655-4b280891632a tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Action: 'update', calling method: .version_select at 0x7f11352b5820>, body: {"status": null, "maintenance_mode": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56f7c6cb-100a-45e1-9655-4b280891632a tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-hosts/n-d-772273-9 HTTP/1.1 Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 42 Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:05.074377 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: {"status": null, "maintenance_mode": null} Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 01:17:05.075695 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-d-772273-9', 'body': {'status': None, 'maintenance_mode': None}} Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance: Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi None Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.076486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.077809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.078705 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:17:05.078705 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:17:05.078705 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 01:17:05.078705 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.080160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56f7c6cb-100a-45e1-9655-4b280891632a tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:05.084059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56f7c6cb-100a-45e1-9655-4b280891632a tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-772273-9" status: 400 len: 127 microversion: 2.1 time: 0.027718 Oct 11 01:17:05.085317 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 15/25] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:17:05 2022] PUT /compute/v2.1/os-hosts/n-d-772273-9 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:17:05.096774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Action: 'update', calling method: .version_select at 0x7f113530bd30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.102206 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.hosts [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Enabling host nonexistent_hostname. Oct 11 01:17:05.127559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Request method failure captured: Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 50 Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMDbCJJqyfxWtgnlXdXKYQbqS6gjs1sOXoUB_jnOYiJvwnaobSdO3Nb2w39Huni0dCT138MtYaDZOKi1JkI9UymDRZBERylPFPQ3jZmWdgUn8EhalwX3WMSwlpty_QLpq90gytb5T096TF-cLiz5QhcmpK7HW4wAmzJ_14K3Dh6Mo Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:05.132484 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f340aa70ea424137bcceda8a4a6f690d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f340aa70ea424137bcceda8a4a6f690d Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1428915706 Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc35bfb6504e4476886296354887eac3 Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1428915706-project-admin Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:05.133572 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:05.134817 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:05.135732 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 01:17:05.136674 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:05.137333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:05.138021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-258d56bf-dbe7-4c70-8702-612ba34570f8 tempest-HostsAdminNegativeTestJSON-1428915706 tempest-HostsAdminNegativeTestJSON-1428915706-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.047070 Oct 11 01:17:05.146714 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 16/26] 10.222.0.66 () {60 vars in 1211 bytes} [Tue Oct 11 01:17:05 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:05.358293 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a911fc6-fd65-433c-aef5-aa8e7e7aa8a3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.665445 Oct 11 01:17:05.359260 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 11/27] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:04 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:05.371798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a8d8d18-a9c8-4ce1-8206-c15a2c5447cc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:05.434786 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a8d8d18-a9c8-4ce1-8206-c15a2c5447cc tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.067882 Oct 11 01:17:05.437156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 17/28] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:05 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:05.449251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b0355f2-7d5b-44eb-85c4-a2d2098fb14a tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1150146660"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.455389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-2b0355f2-7d5b-44eb-85c4-a2d2098fb14a tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 02c34656-85e0-4a76-b86e-f76735c88545 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:05.463100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f746527d-1f60-4a15-9fbb-9217da113991 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2115506119"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.469620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-f746527d-1f60-4a15-9fbb-9217da113991 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Generated uuid 139cc55c-5f2d-4f60-9b4e-056230e6e950 for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:05.499380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b0355f2-7d5b-44eb-85c4-a2d2098fb14a tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052605 Oct 11 01:17:05.500464 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 12/29] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:05.555744 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f746527d-1f60-4a15-9fbb-9217da113991 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.099060 Oct 11 01:17:05.557541 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 18/30] 10.222.0.66 () {62 vars in 1205 bytes} [Tue Oct 11 01:17:05 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:05.565124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:05.572934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:05.602823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:05.603391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:05.603820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:05.604540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:05.605015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:05.605440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:05.834282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:05.858512 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52b2ae7a-d6f8-486e-a3d3-7d9f1866206a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1224 microversion: 2.1 time: 0.299890 Oct 11 01:17:05.864401 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 19/31] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:05 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1224 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:05.872206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5262f14-5f4a-4d57-bc5b-9fcfd95de387 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-38490994"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:05.989687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ae93e85a-da53-4d50-89a0-b6c38eceb8fc tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.000010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ae93e85a-da53-4d50-89a0-b6c38eceb8fc tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ae93e85a-da53-4d50-89a0-b6c38eceb8fc tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 39 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:06.003612 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: {"add_host": {"host": "n-h1-772273-9"}} Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.004712 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-772273-9'}}} Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:06.005334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 01:17:06.006212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.007094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ae93e85a-da53-4d50-89a0-b6c38eceb8fc tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.011819 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ae93e85a-da53-4d50-89a0-b6c38eceb8fc tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.499125 Oct 11 01:17:06.019903 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 13/32] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 511 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:06.047585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd5324e4-9379-41bb-95ad-31044858a6d9 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:06.114596 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd5324e4-9379-41bb-95ad-31044858a6d9 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.083472 Oct 11 01:17:06.116722 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 14/33] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:06 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:06.117422 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5262f14-5f4a-4d57-bc5b-9fcfd95de387 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 297 microversion: 2.41 time: 0.251713 Oct 11 01:17:06.118801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 20/34] 10.222.0.66 () {62 vars in 1210 bytes} [Tue Oct 11 01:17:05 2022] PUT /compute/v2.1/os-aggregates/3 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:06.142213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-201866ff-a497-4f8f-8385-7271aec2f5ef tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:06.143518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70118dd9-788f-4803-8a57-5d21f8b24aa9 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-743510731"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.155117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-70118dd9-788f-4803-8a57-5d21f8b24aa9 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 49e7a4e9-d450-40fc-bbd3-67911e1ae8f1 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:06.167800 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-201866ff-a497-4f8f-8385-7271aec2f5ef tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 297 microversion: 2.41 time: 0.039718 Oct 11 01:17:06.170131 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 21/35] 10.222.0.66 () {60 vars in 1190 bytes} [Tue Oct 11 01:17:06 2022] GET /compute/v2.1/os-aggregates/3 => generated 297 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:06.200212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6557b1d1-ab10-40b0-a6b0-aec85108b9d4 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.220705 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70118dd9-788f-4803-8a57-5d21f8b24aa9 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.099389 Oct 11 01:17:06.227607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 15/36] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:06.245865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6557b1d1-ab10-40b0-a6b0-aec85108b9d4 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.249064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6557b1d1-ab10-40b0-a6b0-aec85108b9d4 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.266759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-851150772"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.269599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6557b1d1-ab10-40b0-a6b0-aec85108b9d4 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.307899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.308298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.321849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.343299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.345823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.352774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.384089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-851150772 could not be found. Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 57 Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:06.389748 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: {"add_host": {"host": "tempest-nonexist_host-851150772"}} Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.390861 n-d-772273-9 devstack@n-api.service[120493]: exception: Compute host tempest-nonexist_host-851150772 could not be found. Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-851150772'}}} Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-851150772' is not mapped to any cell Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.395454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 11 01:17:06.396569 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-851150772 could not be found. Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-851150772 could not be found. Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.397530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-851150772 could not be found. Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-851150772 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8eb9265a-6e03-433f-89d2-a986e3afe9f2 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.156367 Oct 11 01:17:06.398484 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 16/37] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:06.414430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ddb730a3-92f5-4a10-80df-da5ecbd6aeb3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:06.454061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ddb730a3-92f5-4a10-80df-da5ecbd6aeb3 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.047570 Oct 11 01:17:06.456343 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 17/38] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:06 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:06.477853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14eb1e84-1780-4955-8aab-97df9e6288b8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14eb1e84-1780-4955-8aab-97df9e6288b8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 283 Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:06.484795 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.486178 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:17:06.487108 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.487806 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.488792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.489669 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:17:06.489669 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:17:06.489669 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:17:06.489669 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.492493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14eb1e84-1780-4955-8aab-97df9e6288b8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.493682 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14eb1e84-1780-4955-8aab-97df9e6288b8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032322 Oct 11 01:17:06.494716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 18/39] 10.222.0.66 () {60 vars in 1165 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:17:06.509041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f8a1b2d-b9c2-43a5-ba91-cbf9a6477be6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f8a1b2d-b9c2-43a5-ba91-cbf9a6477be6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 27 Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:06.515759 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: {"aggregate": {"name": ""}} Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.517173 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '' Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.518040 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:17:06.519353 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.523367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f8a1b2d-b9c2-43a5-ba91-cbf9a6477be6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.526510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f8a1b2d-b9c2-43a5-ba91-cbf9a6477be6 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023549 Oct 11 01:17:06.528048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 19/40] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:17:06.541445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8839556d-86d0-47a9-8738-51dae70626b6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1009057652"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.550057 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6557b1d1-ab10-40b0-a6b0-aec85108b9d4 tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 312 microversion: 2.41 time: 0.364359 Oct 11 01:17:06.551372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 22/41] 10.222.0.66 () {62 vars in 1232 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:06.555540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8839556d-86d0-47a9-8738-51dae70626b6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:06.565342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ef6c308-2990-41d0-846c-0e9419ddcaae tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8839556d-86d0-47a9-8738-51dae70626b6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 60 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:06.569791 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: {"aggregate": {"name": "tempest-test_aggregate-1009057652"}} Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.570884 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1009057652'}}} Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:06.571540 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:06.573338 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 01:17:06.574256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.575476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8839556d-86d0-47a9-8738-51dae70626b6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.576358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8839556d-86d0-47a9-8738-51dae70626b6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.041631 Oct 11 01:17:06.578772 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 20/42] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:17:06.596457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ef6c308-2990-41d0-846c-0e9419ddcaae tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.596820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd4e01de-e2b1-41f0-ac70-bea8a3ad790c tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1294421578"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.598849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ef6c308-2990-41d0-846c-0e9419ddcaae tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.599618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ef6c308-2990-41d0-846c-0e9419ddcaae tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.608379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-fd4e01de-e2b1-41f0-ac70-bea8a3ad790c tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 39d55f88-c29a-46d4-9166-42bb0b88cd6d for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:06.671294 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd4e01de-e2b1-41f0-ac70-bea8a3ad790c tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086817 Oct 11 01:17:06.674106 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 21/43] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:06.688642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1294421578"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.698520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 4bbf2c5f-edc7-496c-a998-4553576cdac0 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:06.713921 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1294421578 already exists. Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 60 Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:06.717087 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: {"aggregate": {"name": "tempest-test_aggregate-1294421578"}} Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:06.718190 n-d-772273-9 devstack@n-api.service[120493]: exception: Aggregate tempest-test_aggregate-1294421578 already exists. Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1294421578'}}} Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 11 01:17:06.718847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1294421578 already exists. Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:06.719792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1294421578 already exists. Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1294421578 already exists. Oct 11 01:17:06.720706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:06.724351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1294421578 already exists. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:06.727502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73d81048-233f-4f01-a8ab-68fe554ef654 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.043578 Oct 11 01:17:06.730367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:06.747698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e8cd89c-73c0-4e1e-b1c8-46758bc78025 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:06.833889 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e8cd89c-73c0-4e1e-b1c8-46758bc78025 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.096896 Oct 11 01:17:06.834946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 23/45] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:06 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:06.863371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cbc2c631-bf5b-47db-94de-a7b8e616ea12 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1954315556"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:06.883146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-cbc2c631-bf5b-47db-94de-a7b8e616ea12 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 57ba4663-6c99-4aca-bc62-24806c515481 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:06.900283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ef6c308-2990-41d0-846c-0e9419ddcaae tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 297 microversion: 2.41 time: 0.340711 Oct 11 01:17:06.911069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 23/46] 10.222.0.66 () {62 vars in 1232 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 297 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:06.921823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:06.922457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:06.938388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.939133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.939890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.940611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:06.943101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:06.950248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:06.982167 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cbc2c631-bf5b-47db-94de-a7b8e616ea12 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.139416 Oct 11 01:17:06.986258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.000989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-991bbeac-a406-4182-97b9-e16ffa71e1de tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.081684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-991bbeac-a406-4182-97b9-e16ffa71e1de tempest-AggregatesAdminTestV241-1241924407 tempest-AggregatesAdminTestV241-1241924407-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.091954 Oct 11 01:17:07.087290 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 25/48] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:17:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.105914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c142244-314c-40e2-aba4-1c8ad0482017 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.118235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c142244-314c-40e2-aba4-1c8ad0482017 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c142244-314c-40e2-aba4-1c8ad0482017 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:07.122875 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 01:17:07.124258 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6'} Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:07.124956 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 01:17:07.126001 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.126943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c142244-314c-40e2-aba4-1c8ad0482017 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:07.131806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c142244-314c-40e2-aba4-1c8ad0482017 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.037665 Oct 11 01:17:07.132639 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 26/49] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:07 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:07.146816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd6757b6-d6ed-4043-ae64-0785ce39e9bb tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-293077668", "name": "tempest-test_aggregate-596667122"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:07.172998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:07.181929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-fd6757b6-d6ed-4043-ae64-0785ce39e9bb tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 140dd7e9-c3fd-422e-b46c-86339b4581b4 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:07.189076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c19233d-7418-4612-9315-9378e4fd140b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1272 microversion: 2.1 time: 0.268731 Oct 11 01:17:07.206437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 24/50] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:06 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:07.224923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8850c6a-bd30-41e5-bc52-3f77b9c66f72 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.252308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd6757b6-d6ed-4043-ae64-0785ce39e9bb tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.118554 Oct 11 01:17:07.252911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 27/51] 10.222.0.66 () {60 vars in 1165 bytes} [Tue Oct 11 01:17:07 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.267541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3362666b-8c5e-4f01-9f5e-1b913fda2beb tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.282122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3362666b-8c5e-4f01-9f5e-1b913fda2beb tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.021030 Oct 11 01:17:07.282651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 28/52] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:17:07 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.299480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8850c6a-bd30-41e5-bc52-3f77b9c66f72 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.090032 Oct 11 01:17:07.303037 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 25/53] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:07 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:07.307013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29c87463-e52c-49ea-a16a-8dfb8ab0fc5d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:07.315668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fba8e2c3-5804-456c-b830-c9fade19bd52 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.343723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29c87463-e52c-49ea-a16a-8dfb8ab0fc5d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:07.344338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29c87463-e52c-49ea-a16a-8dfb8ab0fc5d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:07.344793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29c87463-e52c-49ea-a16a-8dfb8ab0fc5d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:07.362304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fba8e2c3-5804-456c-b830-c9fade19bd52 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fba8e2c3-5804-456c-b830-c9fade19bd52 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:07.374097 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: exception: Aggregate -1 could not be found. Oct 11 01:17:07.375161 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '-1'} Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:07.375800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.376770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.377808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fba8e2c3-5804-456c-b830-c9fade19bd52 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:07.378145 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fba8e2c3-5804-456c-b830-c9fade19bd52 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.066958 Oct 11 01:17:07.384646 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 26/54] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:07.389503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0674dae8-8bce-4bee-a3a8-4696a4adabf7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-121832672"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:07.396101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:07.416054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-0674dae8-8bce-4bee-a3a8-4696a4adabf7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 6759e0ca-b9be-4623-9a8d-1c53290422fd for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:07.504592 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0674dae8-8bce-4bee-a3a8-4696a4adabf7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.118727 Oct 11 01:17:07.505400 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 27/55] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.539459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e6fdece-f04e-44c2-a304-02acc9d52803 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.541624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e6fdece-f04e-44c2-a304-02acc9d52803 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e6fdece-f04e-44c2-a304-02acc9d52803 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:07.543173 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 01:17:07.544335 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '8'} Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:07.544959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 01:17:07.545870 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.549841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e6fdece-f04e-44c2-a304-02acc9d52803 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:07.550731 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e6fdece-f04e-44c2-a304-02acc9d52803 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.035581 Oct 11 01:17:07.551275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 28/56] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:17:07 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:07.580182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1181ee1-d854-4893-8f49-42d482b27cfa tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.658495 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1181ee1-d854-4893-8f49-42d482b27cfa tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.096514 Oct 11 01:17:07.660168 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 29/57] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:07.664242 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29c87463-e52c-49ea-a16a-8dfb8ab0fc5d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 312 microversion: 2.1 time: 0.364739 Oct 11 01:17:07.664840 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 29/58] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:07 2022] POST /compute/v2.1/os-aggregates/7/action => generated 312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:07.671635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-deeb48b1-823a-46ca-bae4-a445ebfc9bd7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.688026 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-deeb48b1-823a-46ca-bae4-a445ebfc9bd7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-deeb48b1-823a-46ca-bae4-a445ebfc9bd7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:07.694061 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: exception: Aggregate -1 could not be found. Oct 11 01:17:07.695307 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '-1'} Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.695945 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 01:17:07.696935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.699698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-deeb48b1-823a-46ca-bae4-a445ebfc9bd7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:07.702818 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-deeb48b1-823a-46ca-bae4-a445ebfc9bd7 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035788 Oct 11 01:17:07.705790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:07.718009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66ffeb31-c6c6-42da-a7b8-a817f6872b0f tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:07.719554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66ffeb31-c6c6-42da-a7b8-a817f6872b0f tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66ffeb31-c6c6-42da-a7b8-a817f6872b0f tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:07.721101 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 01:17:07.722252 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:07.722827 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:07.724571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66ffeb31-c6c6-42da-a7b8-a817f6872b0f tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:07.725409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66ffeb31-c6c6-42da-a7b8-a817f6872b0f tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010068 Oct 11 01:17:07.741709 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 30/60] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:17:07 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:08.221408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:08.222405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:08.232257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:08.233003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:08.233876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:08.234984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:08.236642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:08.238145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:08.596681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:08.616101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e5c89201-c33c-4942-a071-02c7bb556edf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1299 microversion: 2.1 time: 0.399826 Oct 11 01:17:08.633118 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 31/61] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:08 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1299 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:08.853736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1504466780", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "availability_zone": "tempest-test_az-293077668"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:08.881244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:08.883625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:08.887391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:08.890730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:08.893320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:08.894187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:09.045986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:09.552691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:09.553207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:09.553704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:09.565624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:09.566146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:09.583249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:09.621037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:09.622050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:09.625778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:09.628906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:09.631595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:09.632401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:09.641543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:09.642321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:09.657805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:09.658323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:09.658774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:09.661429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:09.663175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:09.665045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:09.688834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Getting quotas for project 4eb01d1d700444f7ae5d2b1cc5af31dd. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:09.708944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Getting quotas for user 31f8e281a57048f8b57f65aa8a14593b and project 4eb01d1d700444f7ae5d2b1cc5af31dd. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:09.768299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:09.781075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:09.888339 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ee1a608-5df1-4ed6-a221-0fe812961b75 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750245 Oct 11 01:17:09.906339 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:09.925619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84e1abe8-913f-4748-8c6d-e1c4a6e6d7d4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:09.926583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84e1abe8-913f-4748-8c6d-e1c4a6e6d7d4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:10.182991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84e1abe8-913f-4748-8c6d-e1c4a6e6d7d4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:10.216675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84e1abe8-913f-4748-8c6d-e1c4a6e6d7d4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1242 microversion: 2.1 time: 0.296463 Oct 11 01:17:10.222505 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:09 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1242 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:10.261155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:10.273759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e0e640e-09c4-4275-8bce-cad415468a97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.636723 Oct 11 01:17:10.299635 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:09 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:11.243830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52907f97-7c23-4dcc-907e-1d58daca2355 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:11.244463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52907f97-7c23-4dcc-907e-1d58daca2355 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:11.301245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:11.301903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:11.310411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:11.316471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:11.320958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:11.322060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:11.324451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:11.328287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:11.408111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52907f97-7c23-4dcc-907e-1d58daca2355 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:11.424007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52907f97-7c23-4dcc-907e-1d58daca2355 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1242 microversion: 2.1 time: 0.180987 Oct 11 01:17:11.425502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:11 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:11.765744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:11.780395 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4188f92-9655-44aa-bf22-8da3f7a4b465 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.478951 Oct 11 01:17:11.781956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 33/66] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:11 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:12.448498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:12.449114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:12.456917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:12.466333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:12.467551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:12.469265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:12.469672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:12.470101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:12.704608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:12.766516 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c921ec5c-d038-4b5d-9eeb-3c8409e410b2 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1290 microversion: 2.1 time: 0.320143 Oct 11 01:17:12.767210 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 34/67] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:12 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1290 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:12.811449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:12.812116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:12.823601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:12.825001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:12.826800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:12.827799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:12.830369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:12.831098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:13.519745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:13.532779 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1660d26-dbd2-49c3-8736-b7e60c5de11d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.726930 Oct 11 01:17:13.533922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 34/68] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:12 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:13.796720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:13.797918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:13.808054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:13.814556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:13.815409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:13.820487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:13.823878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:13.825697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:14.501851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:14.512580 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f12233f1-059b-4f69-b96c-569273d920c1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1308 microversion: 2.1 time: 0.722327 Oct 11 01:17:14.528403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 35/69] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:13 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:14.560164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:14.562747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:14.567696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:14.578129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:14.584204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:14.584951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:14.586533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:14.587925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:14.593273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:15.395540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:15.420481 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12855341-f15c-4377-b357-8263d27047b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.867131 Oct 11 01:17:15.439369 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 35/70] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:14 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:15.541216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:15.542934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:15.561718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:15.568460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:15.569267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:15.580193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:15.585377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:15.585972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.113286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96acba1-3fc3-46ad-b1d5-eb9cb655c801", "tag": "6111d98d-2674-4854-b0d8-7846149ce04d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:16.126864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:16.150292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:16.150725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:16.151963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b25923e-5b45-4dea-a3fc-cfeac5df3b89 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1296 microversion: 2.1 time: 0.614429 Oct 11 01:17:16.152322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.163374 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 36/71] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:15 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1296 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:16.220683 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Creating event network-changed:6111d98d-2674-4854-b0d8-7846149ce04d for instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 on n-h1-772273-9 Oct 11 01:17:16.221328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:17:16.221740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7041c2c9-9151-4f71-9b6b-afef5e3096f2 req-71626bdb-b4d2-4110-873e-b34c250ef3f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:17:16.222732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:16.223192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:16.223750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.224479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:16.224938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:16.225359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.262636 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.compute.rpcapi [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 01:17:16.263563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] Releasing lock "compute-rpcapi-router" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:17:16.292007 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d46ccc4-1d6f-4f2b-b43d-6fd8a41ad52e None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574958 Oct 11 01:17:16.292771 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 36/72] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:17:16.450885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:16.451965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:16.479317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:16.479910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:16.480459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.481284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:16.481868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:16.482982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:16.601767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1395879067", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:16.725014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:18.286359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:18.301091 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45908ba2-82d2-48db-ba29-12215f61f11e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 1.854780 Oct 11 01:17:18.311098 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 37/73] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:16 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:18.567795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:18.568301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:18.568770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:18.569369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:18.569786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:18.592705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:18.593202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:18.598102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:18.599035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:18.602653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:18.603283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:18.640042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Getting quotas for project 9fae1bc4e02c4092b0d9145917755102. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:18.644438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Getting quotas for user 26a642a7da224e16af27c5df40c5fde5 and project 9fae1bc4e02c4092b0d9145917755102. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:18.658908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:18.662062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:18.729749 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37185905-58d1-4e18-804a-33e4bee9af25 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.573548 Oct 11 01:17:18.737402 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 37/74] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:18.743956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:18.744748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:18.751839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:18.752582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:18.753160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:18.754047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:18.754659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:18.755227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:18.828894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be4bdde4-6a7f-44fe-820f-d5abc8b04145 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2069126531", "id": 2007983742, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:18.941236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be4bdde4-6a7f-44fe-820f-d5abc8b04145 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.609989 Oct 11 01:17:18.944897 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 38/75] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:18 2022] POST /compute/v2.1/flavors => generated 439 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:19.153460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1dde76a9-d607-4b8c-88ab-a9a1a4fac7b5 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Action: 'create', calling method: .version_select at 0x7f113bbf0b80>, body: {"keypair": {"name": "tempest-keypair-356766259", "type": "ssh", "user_id": "b3537c9b60954e1da2417e1a2f94169c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/JiQgRdds2o0TWQ2/Gh56MiQwvFuTywVUYaBjatINcEUpGw1XxB2azdxML65qXZDX8R9i21vx0EpHp9Fm2pllypearN4H2OsyW0mZMAxrSStYro77r3m5pmGOkNoFeSA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:19.242646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1dde76a9-d607-4b8c-88ab-a9a1a4fac7b5 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:19.258943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1dde76a9-d607-4b8c-88ab-a9a1a4fac7b5 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for user 663b9b1379b04f44952b0a94937ab757 and project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:19.329730 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1dde76a9-d607-4b8c-88ab-a9a1a4fac7b5 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.380694 Oct 11 01:17:19.344922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 39/76] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:17:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 399 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:17:19.360006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-17019ba4-6675-4226-9517-555dbebded41 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:19.362940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-17019ba4-6675-4226-9517-555dbebded41 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:19.516369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-17019ba4-6675-4226-9517-555dbebded41 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:19.537317 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-17019ba4-6675-4226-9517-555dbebded41 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1219 microversion: 2.1 time: 0.187550 Oct 11 01:17:19.538358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 40/77] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:19 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:19.575478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0bd37aea-ab3a-436a-bcd0-4c664818da9f tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:19.615985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:19.632856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f9bcd52-b75d-48c4-be5e-f8b24ea3c81e tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.894081 Oct 11 01:17:19.635510 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 38/78] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:18 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:19.647985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:19.649067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:19.661765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:19.662629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:19.663215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:19.664819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:19.665433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:19.666009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:20.185812 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0bd37aea-ab3a-436a-bcd0-4c664818da9f tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2007983742/action" status: 200 len: 97 microversion: 2.1 time: 0.627965 Oct 11 01:17:20.198499 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 41/79] 10.222.0.66 () {60 vars in 1200 bytes} [Tue Oct 11 01:17:19 2022] POST /compute/v2.1/flavors/2007983742/action => generated 97 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:20.206305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f832c6-9e68-44dd-a9f4-ad41ddeda068 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Action: 'create', calling method: .version_select at 0x7f1134f80820>, body: {"keypair": {"name": "tempest-keypair-1413974461", "type": "ssh", "user_id": "b3537c9b60954e1da2417e1a2f94169c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn+VgxLHNnSLO4qMFG7prr7UjkSOiwmZPjFE27xX7P5da2mmYl/WxNSS2B+Hsiu78BxAYs3WqUflyFyaaCj+B9m9G20mfV3Hfczw8sNKlN8YoREor5mJKC7TzO3kO8Wtg=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:20.260185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-08f832c6-9e68-44dd-a9f4-ad41ddeda068 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:20.271621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-08f832c6-9e68-44dd-a9f4-ad41ddeda068 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for user 663b9b1379b04f44952b0a94937ab757 and project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:20.360308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08f832c6-9e68-44dd-a9f4-ad41ddeda068 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.159422 Oct 11 01:17:20.362876 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 42/80] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:17:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:17:20.375387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-241309de-31c0-4e2f-ac22-2208e490a87e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:20.839378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:20.847816 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37bc15cf-8751-4f2f-a0c2-a6fc1c1ac07a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 1.209939 Oct 11 01:17:20.848405 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 39/81] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:19 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:20.873517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6da5e8a6-ead8-4fa7-830d-8ed1d274ea92 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Calling method '.version_select at 0x7f1135202ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:20.944468 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6da5e8a6-ead8-4fa7-830d-8ed1d274ea92 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-356766259?user_id=b3537c9b60954e1da2417e1a2f94169c" status: 200 len: 511 microversion: 2.10 time: 0.079662 Oct 11 01:17:20.947917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 40/82] 10.222.0.66 () {60 vars in 1337 bytes} [Tue Oct 11 01:17:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-356766259?user_id=b3537c9b60954e1da2417e1a2f94169c => generated 511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:20.962490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:20.964880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:21.008640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.015824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.015824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.015824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.015824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.016325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.258513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:21.272634 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4bc5bba-f435-4849-b3c6-6f6b7b19a311 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1271 microversion: 2.1 time: 0.320462 Oct 11 01:17:21.276118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 41/83] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:20 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:21.295594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:21.296238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:21.317381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.317879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.318491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.319645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.320324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.323835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.345648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-241309de-31c0-4e2f-ac22-2208e490a87e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-241309de-31c0-4e2f-ac22-2208e490a87e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Request method failure captured: Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/flavors/2007983742/action HTTP/1.1 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 67 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQajo1gHyN1xYb23KZaq4KcVw0yr2XVWBMg1zjEHPw-XPrM39j0Z_K7J6AFh8hXDCurhoX4UPha8zeYPYqILqFiiQFpVneWGNPN2YsB2VGOksUCayXtOjdOcLxtES-8GxUZRhbZ8s0RcSOZrv0iYr6iFgPf5YeRuneZZ7DNfE8Awzg Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:21.353559 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c984ef4ba4d14b208279e893a7730008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 417b788a3aab4698ba686feb2e69d865 Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} Oct 11 01:17:21.355042 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: exception: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2007983742', 'body': {'addTenantAccess': {'tenant': '70c34c2abbfa456aa4f7c7f6dea746e3'}}} Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:17:21.355863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-70c34c2abbfa456aa4f7c7f6dea746e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 01:17:21.356946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 01:17:21.358264 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:17:21.359268 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-70c34c2abbfa456aa4f7c7f6dea746e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 1, 17, 21, 335830), 'updated_at': None, 'flavor_id': 15, 'project_id': '70c34c2abbfa456aa4f7c7f6dea746e3'}] Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:21.360287 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:21.362391 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:21.365303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:21.366533 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. Oct 11 01:17:21.366533 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:21.372307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-241309de-31c0-4e2f-ac22-2208e490a87e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 70c34c2abbfa456aa4f7c7f6dea746e3 combination. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:21.374803 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-241309de-31c0-4e2f-ac22-2208e490a87e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2007983742/action" status: 409 len: 152 microversion: 2.1 time: 1.008285 Oct 11 01:17:21.382030 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 43/84] 10.222.0.66 () {60 vars in 1200 bytes} [Tue Oct 11 01:17:20 2022] POST /compute/v2.1/flavors/2007983742/action => generated 152 bytes in 1017 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:21.397396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1edc0044-aca8-4a8d-bbe9-f93162e70215 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Action: 'create', calling method: .version_select at 0x7f11350191f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-311020252", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjoISbiyouWVRD/vhzEUy2kaHeNtGcPKGvJd+EPLIDmcpA9SuIVcGUbftkVsXDaDwniy09fHoWu5K1AXboNxSWAj0DPog8MNCiNHKExFgy9+Yy9d3kJrs1EzeLwB7a4qw=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:21.440231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1edc0044-aca8-4a8d-bbe9-f93162e70215 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:21.451301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1edc0044-aca8-4a8d-bbe9-f93162e70215 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Getting quotas for user 663b9b1379b04f44952b0a94937ab757 and project a11738c528fd4004a429aa411445643c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:21.507110 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1edc0044-aca8-4a8d-bbe9-f93162e70215 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.121410 Oct 11 01:17:21.508516 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 44/85] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:17:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:17:21.527943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f56984f6-e2af-4e21-9f9d-a1f901b98a1c tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:21.879697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f56984f6-e2af-4e21-9f9d-a1f901b98a1c tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2007983742/action" status: 200 len: 21 microversion: 2.1 time: 0.361565 Oct 11 01:17:21.887591 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 45/86] 10.222.0.66 () {60 vars in 1200 bytes} [Tue Oct 11 01:17:21 2022] POST /compute/v2.1/flavors/2007983742/action => generated 21 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:21.894404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eade5045-7bfa-4d51-9b4d-973e906a5755 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Calling method '.version_select at 0x7f1134f2f9d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:21.919214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:21.923809 n-d-772273-9 devstack@n-api.service[120493]: WARNING oslo_db.sqlalchemy.utils [None req-eade5045-7bfa-4d51-9b4d-973e906a5755 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 01:17:21.929068 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3847cf1d-bc22-41c1-b7f8-de2012d658da tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.649529 Oct 11 01:17:21.929673 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 42/87] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:21 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:21.934734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:21.935368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:21.958690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.961545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.962004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.962750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:21.963210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:21.963656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:21.968550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eade5045-7bfa-4d51-9b4d-973e906a5755 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "GET /compute/v2.1/os-keypairs?user_id=b3537c9b60954e1da2417e1a2f94169c" status: 200 len: 725 microversion: 2.10 time: 0.085537 Oct 11 01:17:21.969149 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 46/88] 10.222.0.66 () {60 vars in 1259 bytes} [Tue Oct 11 01:17:21 2022] GET /compute/v2.1/os-keypairs?user_id=b3537c9b60954e1da2417e1a2f94169c => generated 725 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:21.989664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f807a36-da52-4766-8ef0-78c26476aaac tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.110262 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5f807a36-da52-4766-8ef0-78c26476aaac tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2007983742" status: 202 len: 0 microversion: 2.1 time: 0.140008 Oct 11 01:17:22.111675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 47/89] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:17:21 2022] DELETE /compute/v2.1/flavors/2007983742 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:22.116392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d2814fc-e42c-4b42-9c48-f8db37f583e1 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Calling method '.version_select at 0x7f1134f2f280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.138167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:22.148667 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d2814fc-e42c-4b42-9c48-f8db37f583e1 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-311020252" status: 204 len: 0 microversion: 2.10 time: 0.035870 Oct 11 01:17:22.150344 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 48/90] 10.222.0.66 () {60 vars in 1322 bytes} [Tue Oct 11 01:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-311020252 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:17:22.158823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-68842a09-3bcc-496a-bb4f-cd686af7a6ac tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.211612 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-68842a09-3bcc-496a-bb4f-cd686af7a6ac tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059631 Oct 11 01:17:22.213200 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 49/91] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:22.222406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c479adf-996d-402f-80e5-6aa72d086c10 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Calling method '.version_select at 0x7f1134f3a1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.266075 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c479adf-996d-402f-80e5-6aa72d086c10 tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413974461?user_id=b3537c9b60954e1da2417e1a2f94169c" status: 204 len: 0 microversion: 2.10 time: 0.050698 Oct 11 01:17:22.268271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 50/92] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413974461?user_id=b3537c9b60954e1da2417e1a2f94169c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:17:22.283375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb48b55a-895f-442d-94c5-8c035db4c922 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-5736876", "id": 303261317, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:22.327153 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb48b55a-895f-442d-94c5-8c035db4c922 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.057483 Oct 11 01:17:22.329902 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 51/93] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:22 2022] POST /compute/v2.1/flavors => generated 432 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:22.344723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d576f2c-4da8-499c-9cda-73d5462e28ce tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] Calling method '.version_select at 0x7f1134eefaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.396055 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d576f2c-4da8-499c-9cda-73d5462e28ce tempest-KeyPairsV210TestJSON-92273116 tempest-KeyPairsV210TestJSON-92273116-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356766259?user_id=b3537c9b60954e1da2417e1a2f94169c" status: 204 len: 0 microversion: 2.10 time: 0.062264 Oct 11 01:17:22.397336 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 52/94] 10.222.0.66 () {60 vars in 1340 bytes} [Tue Oct 11 01:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356766259?user_id=b3537c9b60954e1da2417e1a2f94169c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:17:22.412186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.413994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:22.432744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:22.434555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:22.437245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:22.438194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:22.440437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:22.440910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:22.659816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:22.678471 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4689ec11-7cd2-4fff-929a-9f11ced4b6b5 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.740434 Oct 11 01:17:22.679575 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 43/95] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:21 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:22.689542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e555e5f-bb08-450e-9906-131153f2abda tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.756465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7e555e5f-bb08-450e-9906-131153f2abda tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e555e5f-bb08-450e-9906-131153f2abda tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Request method failure captured: Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/flavors/303261317/os-flavor-access HTTP/1.1 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQajo1gHyN1xYb23KZaq4KcVw0yr2XVWBMg1zjEHPw-XPrM39j0Z_K7J6AFh8hXDCurhoX4UPha8zeYPYqILqFiiQFpVneWGNPN2YsB2VGOksUCayXtOjdOcLxtES-8GxUZRhbZ8s0RcSOZrv0iYr6iFgPf5YeRuneZZ7DNfE8Awzg Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:22.759057 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c984ef4ba4d14b208279e893a7730008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 417b788a3aab4698ba686feb2e69d865 Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: exception: Access list not available for public flavors. Oct 11 01:17:22.760193 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '303261317'} Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 11 01:17:22.760804 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:22.764701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e555e5f-bb08-450e-9906-131153f2abda tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:22.765806 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e555e5f-bb08-450e-9906-131153f2abda tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/303261317/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.084655 Oct 11 01:17:22.770453 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 44/96] 10.222.0.66 () {58 vars in 1206 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/flavors/303261317/os-flavor-access => generated 91 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:22.802856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:22.813290 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-092121b9-6d7f-4462-aaf3-e7593a85dd7e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1277 microversion: 2.1 time: 0.413975 Oct 11 01:17:22.814095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 53/97] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1277 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:22.818913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ea91542-04c0-49cb-af38-7958ebe5bd03 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.862157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ea91542-04c0-49cb-af38-7958ebe5bd03 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/303261317" status: 202 len: 0 microversion: 2.1 time: 0.044360 Oct 11 01:17:22.867884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 54/98] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:17:22 2022] DELETE /compute/v2.1/flavors/303261317 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:22.873149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5429b62-05d2-446a-b9a2-184209f199de tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.902924 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5429b62-05d2-446a-b9a2-184209f199de tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033821 Oct 11 01:17:22.904034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 55/99] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:22.926985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf82ff2e-2f68-41c0-a7bf-d952564fab19 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1275751369", "id": 1675228077, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:22.964850 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf82ff2e-2f68-41c0-a7bf-d952564fab19 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.042682 Oct 11 01:17:22.973193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 56/100] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:22 2022] POST /compute/v2.1/flavors => generated 439 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:22.983280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:22.983946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:22.991223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:22.991774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:22.992218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:22.993118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:22.994267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:22.994810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.228281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:23.240426 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75f2b331-e631-4d2e-bc04-852343483964 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.265956 Oct 11 01:17:23.242043 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 57/101] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:23.264390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Calling method '.version_select at 0x7f113512f3a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:23.274618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120494) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 01:17:23.275444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.276629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.277413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.320914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.322430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.323181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.345255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.345990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.346701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.357433 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24bf0254-ae0c-4efd-9455-f59f8f6ca1b5 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.585456 Oct 11 01:17:23.364561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 45/102] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:17:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:23.407852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e114a8c0-ef98-43f8-ba91-757f7bec93fd tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:23.415962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e114a8c0-ef98-43f8-ba91-757f7bec93fd tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '320900260baa4089b9804dec295790c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c34c2abbfa456aa4f7c7f6dea746e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e114a8c0-ef98-43f8-ba91-757f7bec93fd tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Request method failure captured: Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/flavors/1675228077/action HTTP/1.1 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 67 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQX8Dxl6Tgj63ZTJsFg1bmSIvRSih9sncg7f51XGBXNN1m3swN12FshMy0glFB3p-0oSzKhamZP80S29xeaKuAjAUjhDoV43AGlQmzJRfkM1pZ-jyfb732kV6bwhWFlocevcskm964qiTZULENmhtbC7x-1ghNOKwjWO57abge9MCE Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 70c34c2abbfa456aa4f7c7f6dea746e3 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:23.417571 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 70c34c2abbfa456aa4f7c7f6dea746e3 Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsAccessNegativeTestJSON-619608406-project Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 320900260baa4089b9804dec295790c7 Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-619608406-project Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} Oct 11 01:17:23.418659 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1675228077', 'body': {'addTenantAccess': {'tenant': '70c34c2abbfa456aa4f7c7f6dea746e3'}}} Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:23.419301 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 01:17:23.420296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:23.423778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e114a8c0-ef98-43f8-ba91-757f7bec93fd tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:23.424917 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e114a8c0-ef98-43f8-ba91-757f7bec93fd tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] 10.222.0.66 "POST /compute/v2.1/flavors/1675228077/action" status: 403 len: 130 microversion: 2.1 time: 0.181578 Oct 11 01:17:23.425532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 58/103] 10.222.0.66 () {60 vars in 1200 bytes} [Tue Oct 11 01:17:23 2022] POST /compute/v2.1/flavors/1675228077/action => generated 130 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:23.436123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Calling method '.version_select at 0x7f1134f3aca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:23.438002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.438492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.439506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.465345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.466509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.467478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.477805 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-10bd39d7-e657-453d-b588-b160fa5e1266 tempest-HypervisorAdminV228Test-336658216 tempest-HypervisorAdminV228Test-336658216-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.051197 Oct 11 01:17:23.493812 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 59/104] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:17:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:17:23.500364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78e3fd23-2d4d-45f8-9d25-e0236f12dc2e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:23.518456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4778026-c61f-4b8d-b2c4-43902a65b247", "tag": "f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:23.577243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.578113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.582704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.583427 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78e3fd23-2d4d-45f8-9d25-e0236f12dc2e tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1675228077" status: 202 len: 0 microversion: 2.1 time: 0.086903 Oct 11 01:17:23.591508 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 60/105] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:17:23 2022] DELETE /compute/v2.1/flavors/1675228077 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:23.605433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1547ddf1-9bae-46ae-874d-bbb768cecd93 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:23.635154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Creating event network-changed:f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d for instance a4778026-c61f-4b8d-b2c4-43902a65b247 on n-h1-772273-9 Oct 11 01:17:23.638663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:17:23.639431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-41b233ea-6337-4b0a-9be0-dfcde8e89592 req-a53cf8e9-1870-451c-8903-85a387b5070e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:17:23.640639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.641279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.641821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.643101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.644189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.644877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.656454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.rpcapi [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 01:17:23.657296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] Releasing lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:17:23.658184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1547ddf1-9bae-46ae-874d-bbb768cecd93 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064658 Oct 11 01:17:23.658787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 61/106] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:23.678643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-016397c9-6c88-4546-9f66-d76bb708645f tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-995678937", "id": 866919573, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:23.707313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-016397c9-6c88-4546-9f66-d76bb708645f tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.032077 Oct 11 01:17:23.712861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-567c37a6-3a96-4fc1-b498-f78585171c86 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337457 Oct 11 01:17:23.713829 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 46/107] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:23.717000 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 62/108] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:23 2022] POST /compute/v2.1/flavors => generated 435 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:23.722679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb66da4b-4bd5-4cee-a811-34d736436e13 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:23.723450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:23.724503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:23.755483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.756155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.756780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:23.757672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:23.758820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:23.759423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:24.093064 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eb66da4b-4bd5-4cee-a811-34d736436e13 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/866919573/action" status: 200 len: 96 microversion: 2.1 time: 0.374211 Oct 11 01:17:24.113362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 63/109] 10.222.0.66 () {60 vars in 1197 bytes} [Tue Oct 11 01:17:23 2022] POST /compute/v2.1/flavors/866919573/action => generated 96 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:24.133768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:24.134351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:24.146169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:24.146757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:24.147220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:24.152810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:24.153467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:24.153924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:24.776484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:24.783953 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c8ec1d4-f109-4dec-bda9-af27d4500fb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.668762 Oct 11 01:17:24.785059 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 64/110] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:24 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:24.799761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd0ebc05-80e0-4eba-ad40-37276767ebfc tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:24.803309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd0ebc05-80e0-4eba-ad40-37276767ebfc tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '320900260baa4089b9804dec295790c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c34c2abbfa456aa4f7c7f6dea746e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd0ebc05-80e0-4eba-ad40-37276767ebfc tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Request method failure captured: Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/flavors/866919573/action HTTP/1.1 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 70 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQX8Dxl6Tgj63ZTJsFg1bmSIvRSih9sncg7f51XGBXNN1m3swN12FshMy0glFB3p-0oSzKhamZP80S29xeaKuAjAUjhDoV43AGlQmzJRfkM1pZ-jyfb732kV6bwhWFlocevcskm964qiTZULENmhtbC7x-1ghNOKwjWO57abge9MCE Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 70c34c2abbfa456aa4f7c7f6dea746e3 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:24.805853 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/70c34c2abbfa456aa4f7c7f6dea746e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 70c34c2abbfa456aa4f7c7f6dea746e3 Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-619608406 Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsAccessNegativeTestJSON-619608406-project Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 320900260baa4089b9804dec295790c7 Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-619608406-project Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: {"removeTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} Oct 11 01:17:24.807317 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '866919573', 'body': {'removeTenantAccess': {'tenant': '70c34c2abbfa456aa4f7c7f6dea746e3'}}} Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can( Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:24.808004 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 01:17:24.809096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:24.810056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd0ebc05-80e0-4eba-ad40-37276767ebfc tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:24.814353 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd0ebc05-80e0-4eba-ad40-37276767ebfc tempest-FlavorsAccessNegativeTestJSON-619608406 tempest-FlavorsAccessNegativeTestJSON-619608406-project] 10.222.0.66 "POST /compute/v2.1/flavors/866919573/action" status: 403 len: 133 microversion: 2.1 time: 0.027821 Oct 11 01:17:24.816032 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 65/111] 10.222.0.66 () {60 vars in 1197 bytes} [Tue Oct 11 01:17:24 2022] POST /compute/v2.1/flavors/866919573/action => generated 133 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:24.825507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:24.826266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:24.844009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:24.844742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:24.845173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:24.855804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:24.860541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:24.861075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:24.861526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:24.864865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-228fd6e2-7235-4fe9-a37d-4e36a5c144a0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 1.149789 Oct 11 01:17:24.882924 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 47/112] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:23 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:25.212826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:25.227268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72e6b8bd-b77a-40c4-ab71-f90e0e29faf1 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.408109 Oct 11 01:17:25.227900 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 66/113] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:24 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:25.233646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6471b89e-1c76-48f4-925e-ea56b96eaf4c tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70c34c2abbfa456aa4f7c7f6dea746e3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:25.263442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-224fe1be-825c-4947-93bf-2b09f02af738 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.289252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-224fe1be-825c-4947-93bf-2b09f02af738 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.404609 Oct 11 01:17:25.311778 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 48/114] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:25.606317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5640381b-7533-4d2f-82fd-32eb4eb06d85 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-358635596", "id": 1334067820, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:25.668715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5640381b-7533-4d2f-82fd-32eb4eb06d85 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.355496 Oct 11 01:17:25.669576 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 49/115] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:25.682684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-064ba67b-91ef-450b-9f1c-8cee15f2b6cd tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.691808 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-064ba67b-91ef-450b-9f1c-8cee15f2b6cd tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013242 Oct 11 01:17:25.692558 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 50/116] 10.222.0.66 () {58 vars in 1182 bytes} [Tue Oct 11 01:17:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:25.711828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17646445-3aac-466e-9f43-4c2e1c705c05 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1695046241", "id": 1754149565, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:25.745489 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17646445-3aac-466e-9f43-4c2e1c705c05 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.045892 Oct 11 01:17:25.746655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 51/117] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:25 2022] POST /compute/v2.1/flavors => generated 425 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:25.762881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c55bec50-181f-41fc-a88e-9875c537d78f tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.777073 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c55bec50-181f-41fc-a88e-9875c537d78f tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019834 Oct 11 01:17:25.778658 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 52/118] 10.222.0.66 () {58 vars in 1182 bytes} [Tue Oct 11 01:17:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:25.798687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-814310b8-2b8a-4200-97fe-b075b0cba391 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Action: 'create', calling method: .version_select at 0x7f11350aa310>, body: {"keypair": {"name": "tempest-keypair-2123105706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNTqN2nbaT9UCOd/c/h5rPdqJS/OI1rjear36+vDxeQToKfNrk77rqJ1WQSs7sXtwFmptSH5/dRdL3qgDZucdy2ZT7jEKhM4YEky+VL3Lax2EmiShfvuil6RkhSZBSoNw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:25.827462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6471b89e-1c76-48f4-925e-ea56b96eaf4c tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/866919573/action" status: 200 len: 21 microversion: 2.1 time: 0.597284 Oct 11 01:17:25.828065 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 67/119] 10.222.0.66 () {60 vars in 1197 bytes} [Tue Oct 11 01:17:25 2022] POST /compute/v2.1/flavors/866919573/action => generated 21 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:25.833505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.834248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:25.846619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:25.847434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:25.848314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:25.848817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-814310b8-2b8a-4200-97fe-b075b0cba391 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:25.849558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:25.850224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:25.850855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:25.855852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-814310b8-2b8a-4200-97fe-b075b0cba391 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for user 8ceaad6f2134402197aa3f86afe2eb80 and project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:25.898107 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-814310b8-2b8a-4200-97fe-b075b0cba391 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109989 Oct 11 01:17:25.898987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 53/120] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:17:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:25.920073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f25f8a7-5d95-4529-862e-f84efd4649ef tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.935727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:25.967355 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f25f8a7-5d95-4529-862e-f84efd4649ef tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/866919573" status: 202 len: 0 microversion: 2.1 time: 0.066861 Oct 11 01:17:25.971109 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 54/121] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:17:25 2022] DELETE /compute/v2.1/flavors/866919573 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:25.978018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:25.978692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:25.986371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:25.986866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:25.987310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:25.988098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:25.988720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:25.989150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:25.998413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:26.263139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:26.313235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:26.324821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:26.327478 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac71b2f2-59c4-49a2-bfbc-3c8ca50fac5d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.498088 Oct 11 01:17:26.345904 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 68/122] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:25 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:26.361793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ef68411-d97d-4ba0-8211-ce4b0c7321a2 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:26.369396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:26.379252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2507730a-76c4-481e-9bdf-025b4283f0bf tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.409554 Oct 11 01:17:26.385120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 55/123] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:25 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:26.395731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:26.401029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:26.414930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:26.417716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:26.418531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:26.419559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:26.422183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:26.425879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:26.445546 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ef68411-d97d-4ba0-8211-ce4b0c7321a2 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.095271 Oct 11 01:17:26.455764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 69/124] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:26 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:26.485556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-838d0aed-ec95-4bc1-8678-53cf1134a6dd tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1394669428", "id": 220120476, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:26.543900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-838d0aed-ec95-4bc1-8678-53cf1134a6dd tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.079479 Oct 11 01:17:26.544594 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 70/125] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:26 2022] POST /compute/v2.1/flavors => generated 436 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:17:26.566148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8642b13-1976-4417-a34c-228386a661bb tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "38e4256f7d4c4f808bfd5495fae020da"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:27.067878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:27.083236 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9cb6416e-4de4-4fbd-a59f-c82788c3ead4 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.696358 Oct 11 01:17:27.088467 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 56/126] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:26 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:27.139361 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f8642b13-1976-4417-a34c-228386a661bb tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] HTTP exception thrown: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8642b13-1976-4417-a34c-228386a661bb tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Request method failure captured: Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/flavors/220120476/action HTTP/1.1 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 70 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQajo1gHyN1xYb23KZaq4KcVw0yr2XVWBMg1zjEHPw-XPrM39j0Z_K7J6AFh8hXDCurhoX4UPha8zeYPYqILqFiiQFpVneWGNPN2YsB2VGOksUCayXtOjdOcLxtES-8GxUZRhbZ8s0RcSOZrv0iYr6iFgPf5YeRuneZZ7DNfE8Awzg Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:27.141597 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c984ef4ba4d14b208279e893a7730008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c984ef4ba4d14b208279e893a7730008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c984ef4ba4d14b208279e893a7730008 Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764 Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 417b788a3aab4698ba686feb2e69d865 Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: {"removeTenantAccess": {"tenant": "38e4256f7d4c4f808bfd5495fae020da"}} Oct 11 01:17:27.142924 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: exception: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '220120476', 'body': {'removeTenantAccess': {'tenant': '38e4256f7d4c4f808bfd5495fae020da'}}} Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 11 01:17:27.143690 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:27.144844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. Oct 11 01:17:27.146467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:27.154666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8642b13-1976-4417-a34c-228386a661bb tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Returning 404 to user: Flavor access not found for 21 / 38e4256f7d4c4f808bfd5495fae020da combination. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:27.157138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f8642b13-1976-4417-a34c-228386a661bb tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/220120476/action" status: 404 len: 124 microversion: 2.1 time: 0.602677 Oct 11 01:17:27.157972 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 71/127] 10.222.0.66 () {60 vars in 1197 bytes} [Tue Oct 11 01:17:26 2022] POST /compute/v2.1/flavors/220120476/action => generated 124 bytes in 604 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:27.168158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4d4b95f-770b-47a7-bf3f-e7b98adb94e9 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:27.205189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4d4b95f-770b-47a7-bf3f-e7b98adb94e9 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/220120476" status: 202 len: 0 microversion: 2.1 time: 0.042513 Oct 11 01:17:27.206344 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 57/128] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:17:27 2022] DELETE /compute/v2.1/flavors/220120476 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:27.216286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e5cdebc8-1b04-4d91-82e0-72dfc026a0e3 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:27.249011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e5cdebc8-1b04-4d91-82e0-72dfc026a0e3 tempest-FlavorsAccessNegativeTestJSON-1269517764 tempest-FlavorsAccessNegativeTestJSON-1269517764-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.038546 Oct 11 01:17:27.259918 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 72/129] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:27 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:27.356565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:27.357478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:27.364900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:27.368860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:27.370155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:27.372968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:27.373788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:27.375868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:27.410962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:27.411869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:27.426956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:27.431654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:27.432300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:27.433249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:27.433753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:27.434187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:27.977559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:27.990582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1295ba34-73e0-4dd0-9d30-86d62650fc97 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.586735 Oct 11 01:17:27.995626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 73/130] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:27 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:28.014559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:28.026531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1159ff26-d2b6-4e0c-8eb9-bd9e48c1389c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.674148 Oct 11 01:17:28.027834 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 58/131] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:27 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:28.113539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:28.114677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:28.123502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:28.131366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:28.134713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:28.136908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:28.137414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:28.137854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:28.735805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:28.746227 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c53f7c7b-ed1d-47a7-908e-ed8fc039ed5a tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.638674 Oct 11 01:17:28.750012 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 74/132] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:28 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:29.022895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:29.022895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:29.036832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.037347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.037795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.039616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.039870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.040820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.055839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:29.056643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:29.076342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.083283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.083998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.085562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.091134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.091806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.527032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:29.527461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:29.536036 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5dac300d-585e-4008-af23-70b30a396158 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.485925 Oct 11 01:17:29.537341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 75/133] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:29 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:29.548006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1531026231", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "1754149565", "adminPass": "***", "networks": [{"uuid": "2df52ec0-0bc5-4a60-b133-32e97fce5b7a"}], "security_groups": [{"name": "tempest-securitygroup--336078661"}], "key_name": "tempest-keypair-2123105706", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:29.555934 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9cf4cfd-1b8c-41f8-8938-f266ec3436ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.539669 Oct 11 01:17:29.557085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 59/134] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:29 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:29.774149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:29.774767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:29.786478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.790532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.792915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.797089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:29.798150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:29.799610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:29.811847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] validate_networks() for [('2df52ec0-0bc5-4a60-b133-32e97fce5b7a', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:30.199138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:30.213346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ed9ed28-d091-4fc3-b36e-5cefe2a0e7d0 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.443946 Oct 11 01:17:30.214809 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 60/135] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:29 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:30.309209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96acba1-3fc3-46ad-b1d5-eb9cb655c801", "name": "network-vif-plugged", "status": "completed", "tag": "6111d98d-2674-4854-b0d8-7846149ce04d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:30.335215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:30.336131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:30.337787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:30.356325 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] Creating event network-vif-plugged:6111d98d-2674-4854-b0d8-7846149ce04d for instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 on n-h1-772273-9 Oct 11 01:17:30.369667 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c0a9bff6-bf72-401f-8b8d-602d0e50fe07 req-93e63225-ae09-4f77-bdad-d79d46cd84ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152085 Oct 11 01:17:30.373868 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 61/136] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:30.562059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:30.562931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:30.569717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:30.570484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:30.571466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:30.572532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:30.573125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:30.573742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:30.847278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:30.855282 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ef084b6-b4ba-4939-89ac-35986a3c72fb tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.297851 Oct 11 01:17:30.871292 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 62/137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:30 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:30.876726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:30.877585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:30.884687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:30.885425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:30.886131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:30.886999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:30.887634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:30.888390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.260593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:31.261686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:31.263439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:31.264399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:31.265012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:31.265457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:31.272745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-646f6bf8-8988-4a49-988f-e4d1fd77e3ed tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.399955 Oct 11 01:17:31.274826 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 63/138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:30 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:31.275751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.276413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.276850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.277598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.278012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.278433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.310786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:31.315568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for user 8ceaad6f2134402197aa3f86afe2eb80 and project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:31.334091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:31.341957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:31.358991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=84,nova_api:INSERT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:31.413387 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7550c09-3f59-497e-8c24-cf9347eebd4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.871003 Oct 11 01:17:31.414945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 76/139] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:31.430121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:31.430761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:31.435195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1409679216", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:31.438264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.438758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.439190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.439984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.440584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.441163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.501045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:31.764205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:31.785190 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ca806ca-e5db-440c-af16-a45f015e163f tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.361499 Oct 11 01:17:31.805680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 77/140] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:31 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:31.813970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7089ca33-e9af-46f3-b412-724a42b6b67e tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:31.814595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7089ca33-e9af-46f3-b412-724a42b6b67e tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:31.877640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:31.879024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:31.879860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:31.880477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:31.881092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:31.890317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=31 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:31.894426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.895026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.895722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.896978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.897609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.898668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.908591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=13 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:31.923449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Getting quotas for project e143609d565f41d692bc5093e710f15c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:31.929678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Getting quotas for user 58d1148982974a3fb4c50dd91c1b316a and project e143609d565f41d692bc5093e710f15c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:31.931889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7089ca33-e9af-46f3-b412-724a42b6b67e tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:31.940434 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7089ca33-e9af-46f3-b412-724a42b6b67e tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1265 microversion: 2.1 time: 0.133557 Oct 11 01:17:31.941779 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 78/141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:31 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:31.946873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:31.947045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:31.947871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:31.949791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:31.955212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.956617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.957238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:31.958127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:31.958817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:31.959469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.054295 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b67090ea-05d7-4003-9e82-b74aace4c0a9 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777502 Oct 11 01:17:32.056438 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 64/142] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:32.066769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8284f4a6-755c-44c2-896e-b1746b7dd525 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:32.068761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8284f4a6-755c-44c2-896e-b1746b7dd525 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:32.293277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8284f4a6-755c-44c2-896e-b1746b7dd525 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:32.304336 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8284f4a6-755c-44c2-896e-b1746b7dd525 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1223 microversion: 2.1 time: 0.241703 Oct 11 01:17:32.327087 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 65/143] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:32 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:32.333144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80875faa-2587-4743-816a-d75f0599a51a", "tag": "df626864-6773-4d71-8405-74bb2c9a7435"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:32.345807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.347982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.348853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.366300 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] Creating event network-changed:df626864-6773-4d71-8405-74bb2c9a7435 for instance 80875faa-2587-4743-816a-d75f0599a51a on n-h2-772273-9 Oct 11 01:17:32.375209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8e384f30-d190-4c6b-9afb-df1e6c29755c req-333d7ce7-55eb-45dc-8e16-ffc911c86806 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046293 Oct 11 01:17:32.376656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 66/144] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:32.385213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:32.386347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:32.396407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.397144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.408016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.410268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.410833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.411427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.417121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:32.427633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d4fe8b4-7fcd-4a63-8d70-c836a4d7d658 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.484511 Oct 11 01:17:32.434463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 79/145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:31 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:32.701668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:32.711505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac309e19-bec9-45c8-baf6-b79a12ad5c78 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1341 microversion: 2.1 time: 0.333024 Oct 11 01:17:32.712437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 67/146] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:32 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:32.814570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:32.815888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:32.829306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.832429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.833810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.839982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.840401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.841510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.971089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:32.971994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:32.990026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.990664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.991299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:32.993458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:32.994158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:32.996901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.128756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:33.137794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d1301e3-0bc7-4efa-bb60-ed9900a34036 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1317 microversion: 2.1 time: 0.171988 Oct 11 01:17:33.146214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:33.147861 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 68/147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:32 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:33.153840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4778026-c61f-4b8d-b2c4-43902a65b247", "name": "network-vif-plugged", "status": "completed", "tag": "f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:33.171399 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-918fff8e-90f3-4bc5-9699-7f6340ea0bd7 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.361562 Oct 11 01:17:33.172312 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 80/148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:32 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:33.214467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.217092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.218917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.240011 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] Creating event network-vif-plugged:f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d for instance a4778026-c61f-4b8d-b2c4-43902a65b247 on n-h1-772273-9 Oct 11 01:17:33.250465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3680fee6-d32d-4d36-a3e3-cdc6079b08d8 req-2da73f03-6ffc-45d2-b377-525440b53532 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100563 Oct 11 01:17:33.251916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 69/149] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:33.337660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:33.338345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:33.347600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.348290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.355829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.356892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.357980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.359369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.458010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:33.458713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:33.469169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.469668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.470107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.470815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.471274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.471735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.735450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:33.746203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0d9c250-e9fc-455d-8778-8826fe22e158 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1227 microversion: 2.1 time: 0.413836 Oct 11 01:17:33.747656 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 81/150] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:33 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1227 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:33.758908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:33.759863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:33.767750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.768515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.776322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.777307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:33.778110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:33.779117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:33.883236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:33.892099 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76a6afa3-d16c-4889-aec8-f33dc44f5cb8 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.438476 Oct 11 01:17:33.892563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 70/151] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:33 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:34.162586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:34.164429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:34.177357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.178084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.178905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.179870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.181214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.183284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.555440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:34.565024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:34.565764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8253a966-ec37-4416-aae8-b69bbc2bde3c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1491 microversion: 2.1 time: 0.816276 Oct 11 01:17:34.566527 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 82/152] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:33 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1491 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:34.572815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:34.573646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:34.576167 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa9c5669-eb09-483a-842e-6c4595090242 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1323 microversion: 2.1 time: 0.417378 Oct 11 01:17:34.576807 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 71/153] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:34 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:34.593220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.594056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.594758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.595873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.596500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.597112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.818547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:34.834335 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c01eea8d-e243-4484-a8d2-d520cbfe14bc tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1338 microversion: 2.1 time: 0.266399 Oct 11 01:17:34.835231 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 83/154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:34 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1338 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:34.857578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:34.858216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:34.865397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.865559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.866077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.867326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.867855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.868466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.948303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:34.958238 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2adeb94f-93eb-4027-b4fd-9e1cffeb9462 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1275 microversion: 2.1 time: 0.103795 Oct 11 01:17:34.958951 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 84/155] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:34 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1275 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:34.964007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:34.964882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:34.972081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.972860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.973420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.974212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:34.974777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:34.975299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:34.994367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:34.995148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:35.005238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.006416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.009737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.010743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.011609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.012486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.172850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:17:35.188018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:35.199474 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-09c2a572-5c9d-4518-9dba-49583fc3d584 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.238912 Oct 11 01:17:35.200996 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 85/156] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:34 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:35.410921 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c5c366c-5dfd-4637-9cc8-6bb3501faa3e tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 204 len: 0 microversion: 2.1 time: 0.819469 Oct 11 01:17:35.412108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 72/157] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:17:34 2022] DELETE /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:17:35.420540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:35.422633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:35.432000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.432681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.433564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.434978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.435677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.436213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.589126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:35.597108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-025eb563-866e-4a75-b361-e770434238f0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1497 microversion: 2.1 time: 0.180364 Oct 11 01:17:35.600173 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 86/158] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:35 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:35.605066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:35.606062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:35.612591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.613188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.613879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.615308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.615989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.616993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.698176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:35.709242 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f95b1e91-08a3-4e66-8452-d7f480a1b7e5 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1323 microversion: 2.1 time: 0.107560 Oct 11 01:17:35.710084 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 87/159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:35 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1323 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:35.740253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd4f99c5-b27a-458f-addb-2e2e756a0425 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-912949038", "ram": 512, "vcpus": 1, "disk": 10, "id": 2048690835, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:35.763486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fd4f99c5-b27a-458f-addb-2e2e756a0425 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.211290 Oct 11 01:17:35.764124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 73/160] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:17:35.776842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-835cd5b7-78fd-448a-9275-ff50d4bcad44 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:35.815256 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-835cd5b7-78fd-448a-9275-ff50d4bcad44 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042391 Oct 11 01:17:35.816316 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 88/161] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:17:35 2022] POST /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:35.860969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:35.863402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:35.872603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.873306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.873753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:35.874626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:35.875781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:35.876855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.020733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30a4e9db-d13d-46eb-9a78-9f9ed51ee665 tempest-FlavorsExtraSpecsTestJSON-1006282318 tempest-FlavorsExtraSpecsTestJSON-1006282318-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:36.037325 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30a4e9db-d13d-46eb-9a78-9f9ed51ee665 tempest-FlavorsExtraSpecsTestJSON-1006282318 tempest-FlavorsExtraSpecsTestJSON-1006282318-project] 10.222.0.66 "GET /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.214622 Oct 11 01:17:36.039536 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 74/162] 10.222.0.66 () {58 vars in 1203 bytes} [Tue Oct 11 01:17:35 2022] GET /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:36.044919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:36.045050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:36.050942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.051383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.051968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.052806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.053400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.054544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.094406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:36.103475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c581cd8-e5ef-4017-806e-ea9f78176943 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1487 microversion: 2.1 time: 0.246666 Oct 11 01:17:36.104683 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 89/163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:35 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1487 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:36.123672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3adbb16-e87b-43d1-95d5-8dd54ecd6b31 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:36.165943 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3adbb16-e87b-43d1-95d5-8dd54ecd6b31 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059854 Oct 11 01:17:36.168050 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 90/164] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:17:36 2022] POST /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:36.181493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:36.182514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:36.190837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.191483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.192014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.192977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.193730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.194265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.553525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:36.566787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35a34df3-dd43-4ca1-86c2-d90dc05f2eeb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1275 microversion: 2.1 time: 0.526104 Oct 11 01:17:36.583142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 75/165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:36 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1275 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:36.588493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7848eed-c78c-4ee5-8f75-897ed47aab55 tempest-FlavorsExtraSpecsTestJSON-1006282318 tempest-FlavorsExtraSpecsTestJSON-1006282318-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:36.599385 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7848eed-c78c-4ee5-8f75-897ed47aab55 tempest-FlavorsExtraSpecsTestJSON-1006282318 tempest-FlavorsExtraSpecsTestJSON-1006282318-project] 10.222.0.66 "GET /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014956 Oct 11 01:17:36.608979 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 76/166] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:17:36 2022] GET /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes => generated 22 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:36.613934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:36.614551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:36.625516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.626043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.626490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:36.627223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:36.629881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:36.630349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.119909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:37.124326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:37.140059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb70ab33-ea58-497a-976b-dece4cf9af85 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.528746 Oct 11 01:17:37.143708 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 77/167] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:36 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:37.158772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d7f7ab7-ae93-45ac-bfd7-5e3d1ec4ead0 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:37.190165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d7f7ab7-ae93-45ac-bfd7-5e3d1ec4ead0 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045005 Oct 11 01:17:37.191126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 78/168] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:17:37 2022] POST /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:37.196914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.197526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:37.201392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:37.205934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.206579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.207166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.208186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.208820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.209829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.280633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3795c85-efb1-4d13-9206-c67f8a63de96 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1638 microversion: 2.1 time: 1.103664 Oct 11 01:17:37.282288 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 91/169] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:36 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1638 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:37.292357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.293216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:37.300666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.301254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.301786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.302752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.303283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.304393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.486867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:37.498083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-150f16e8-aa14-44fb-a8b1-0d9213bf6be2 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1323 microversion: 2.1 time: 0.214501 Oct 11 01:17:37.499406 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 92/170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:37.515328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6bd6aba2-9de4-47c8-9bff-562508646155 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.525528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6bd6aba2-9de4-47c8-9bff-562508646155 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024672 Oct 11 01:17:37.526625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 93/171] 10.222.0.66 () {58 vars in 1203 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:37.532688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.533206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:37.539732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.540207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.540897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.541635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.541815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.542206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.548982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:37.573495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:17:37.684303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:37.697492 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b5e7235-2f59-4f20-873c-65283b4512b1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1497 microversion: 2.1 time: 0.503002 Oct 11 01:17:37.711390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 79/172] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:37.711390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cf285da-ec9c-4bb2-9f73-88cbe81ee4a2 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:37.779571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cf285da-ec9c-4bb2-9f73-88cbe81ee4a2 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.075508 Oct 11 01:17:37.781962 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 80/173] 10.222.0.66 () {60 vars in 1265 bytes} [Tue Oct 11 01:17:37 2022] PUT /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes => generated 22 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:37.793668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.794508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:37.804728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1edccbf-df6d-4756-83f1-38789ed17056 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 204 len: 0 microversion: 2.1 time: 0.274653 Oct 11 01:17:37.805507 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 94/174] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:17:37 2022] DELETE /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:17:37.816251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.817090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.818699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.820431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.820549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a00104f-26c2-4b85-9d9d-1bd49b6b6e80 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.821612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.822363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.835198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a00104f-26c2-4b85-9d9d-1bd49b6b6e80 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027802 Oct 11 01:17:37.835816 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 95/175] 10.222.0.66 () {58 vars in 1203 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/flavors/2048690835/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:37.852406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:37.853137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:37.859517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.859967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.860434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:37.861462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:37.861573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:37.861979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.013093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:38.028988 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24df3346-463c-4c3a-9854-f0c165298c5e tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1281 microversion: 2.1 time: 0.245705 Oct 11 01:17:38.029783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 81/176] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:38.048737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2987cd4-cc7f-441b-82c9-0874d45cec99 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.089960 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2987cd4-cc7f-441b-82c9-0874d45cec99 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.052973 Oct 11 01:17:38.091074 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 82/177] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:17:38 2022] DELETE /compute/v2.1/flavors/2048690835/os-extra_specs/hw:numa_nodes => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:38.102824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8613d39a-a4c0-4298-bda1-cbf2ad51523e tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.150958 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8613d39a-a4c0-4298-bda1-cbf2ad51523e tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2048690835/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.052578 Oct 11 01:17:38.158300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 83/178] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:17:38 2022] DELETE /compute/v2.1/flavors/2048690835/os-extra_specs/hw:cpu_policy => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:38.188496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b077eb7-9427-447e-9714-bb8f88bd8bee tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.214390 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b077eb7-9427-447e-9714-bb8f88bd8bee tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/2048690835/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.053097 Oct 11 01:17:38.217559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 84/179] 10.222.0.66 () {58 vars in 1203 bytes} [Tue Oct 11 01:17:38 2022] GET /compute/v2.1/flavors/2048690835/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:38.229264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:38.236827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.239992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:38.242504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07bb6cc3-d76e-4a61-a86a-e374c3d5ed38 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1493 microversion: 2.1 time: 0.394092 Oct 11 01:17:38.243386 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 96/180] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:37 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1493 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:38.262846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71fc5046-e10b-47a0-b7c0-55db3c173829 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.270292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.271530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.272186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.273151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.273811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.274483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.322918 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71fc5046-e10b-47a0-b7c0-55db3c173829 tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2048690835" status: 202 len: 0 microversion: 2.1 time: 0.071944 Oct 11 01:17:38.324255 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 97/181] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:17:38 2022] DELETE /compute/v2.1/flavors/2048690835 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:17:38.332489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fef809ef-d603-4c9f-b00d-d046b7e0077f tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.371824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fef809ef-d603-4c9f-b00d-d046b7e0077f tempest-FlavorsExtraSpecsTestJSON-1665652469 tempest-FlavorsExtraSpecsTestJSON-1665652469-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.042960 Oct 11 01:17:38.373165 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 98/182] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:17:38 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:38.526858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.527881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:38.545262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.545826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.547694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.550284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.550885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.555004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.700409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:38.738409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-375c17a7-ec04-4108-ac01-3a308353b6ce tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.513227 Oct 11 01:17:38.743993 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 85/183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:38 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:38.769806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:38.771871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:38.787073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.787602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.788082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:38.788801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:38.789254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:38.800108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.133605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:39.145546 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d06e4f3-ce5f-4e9f-a08c-444eba71ae66 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.626462 Oct 11 01:17:39.146367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 99/184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:38 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:39.169876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:39.174739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:39.188760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.190231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.191061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.194072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.195206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.196928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.210809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:39.222503 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-032ce1a7-b693-4b92-af2b-a46e294e76d6 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 200 len: 1455 microversion: 2.1 time: 0.471870 Oct 11 01:17:39.236873 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 86/185] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:38 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 1455 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:39.248424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96acba1-3fc3-46ad-b1d5-eb9cb655c801", "name": "network-vif-deleted", "tag": "6111d98d-2674-4854-b0d8-7846149ce04d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:39.259075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.259925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.260613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.273637 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] Creating event network-vif-deleted:6111d98d-2674-4854-b0d8-7846149ce04d for instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 on n-h1-772273-9 Oct 11 01:17:39.279983 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-21bcbbca-68a3-49e9-af08-5d449fee2f99 req-8d4720b7-d36d-48ad-a53d-370a705d8c40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041363 Oct 11 01:17:39.280887 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 87/186] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:39.289274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:39.290900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:39.298601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.299378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.300728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.301682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.302354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.302992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.796998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:39.805862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36621708-d765-4757-a139-1b8e123b0821 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.639715 Oct 11 01:17:39.822151 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 100/187] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:39 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:39.828619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:39.829482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:39.836601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.839208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.839907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.840847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:39.841533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:39.842700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:39.901077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:39.916218 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a75d4df-0b50-469e-86e1-7e316779dbb3 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1493 microversion: 2.1 time: 0.633569 Oct 11 01:17:39.917179 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 88/188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:39 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1493 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:40.173193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:40.174082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:40.180783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.181601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.182146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.182959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.183701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.184347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.355136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:40.371026 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-76b4ca9c-703f-43f4-9dbc-122a0ddb42ee tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.546220 Oct 11 01:17:40.372804 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 101/189] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:39 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:40.386824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:40.388305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:40.395367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.396349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.397040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.398816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.399597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.400483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.421684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 HTTP/1.1 Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:40.425207 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:17:40.426704 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b96acba1-3fc3-46ad-b1d5-eb9cb655c801'} Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:40.427639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:17:40.428967 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:40.469225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:40.470852 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8ad9fff-5091-41e4-afda-a2dd293a3acd tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 404 len: 111 microversion: 2.1 time: 0.095797 Oct 11 01:17:40.472701 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 102/190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:40 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:40.496258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b358efc-5322-4b94-b17f-37cc3c9acba5", "tag": "3c414428-b270-48ae-90f4-eb19b8debac3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:40.512072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.512712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.513652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.529597 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] Creating event network-changed:3c414428-b270-48ae-90f4-eb19b8debac3 for instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 on n-h2-772273-9 Oct 11 01:17:40.535588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7e516a28-c4fb-44fd-8254-91947500f4f2 req-f3213070-a7a6-453b-bba6-600397f5f95f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044454 Oct 11 01:17:40.537725 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 103/191] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:40.578845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:40.592640 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62c1e389-d821-48dd-8b5e-e156b6e358ec tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.423697 Oct 11 01:17:40.594628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 89/192] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:40 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:40.650620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-520315035", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:40.751367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:40.829562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:40.830241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:40.841638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.842347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.843812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:40.851313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:40.852412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:40.853377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.299611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:41.349005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:41.349693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:41.351051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:41.351607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:41.352127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:41.376531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.379697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.380322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.381180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.381683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.387754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.436768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:41.443465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Getting quotas for project dc916a1348664647a2a632c659f238cd. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:41.446313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-537ee640-1aef-42b5-aa7d-ff0da36e1074 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.620648 Oct 11 01:17:41.446441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=83,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:41.449877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Getting quotas for user 6a8b97feb0d1432b8e5de7e19fb68454 and project dc916a1348664647a2a632c659f238cd. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:41.463312 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 90/193] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:40 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:41.469731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:41.470958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:41.494064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.500373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.502126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:41.502790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.503788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.505992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.512976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.518153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:41.631373 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-274b3a65-eab8-446a-b3e5-5b37b9e95abe tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988607 Oct 11 01:17:41.633086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 104/194] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:17:41.654702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:41.658788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:41.677076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.677916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.680532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.681519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.684340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.685125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.883485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f8e281a57048f8b57f65aa8a14593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb01d1d700444f7ae5d2b1cc5af31dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:41.899428 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55521b08-1989-4932-8ce5-6891a24ff574 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 200 len: 1451 microversion: 2.1 time: 0.426901 Oct 11 01:17:41.900516 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 91/195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:41 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 1451 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:41.905421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ace3d0-bfe7-4425-8305-66da94d20497", "tag": "8f35a7d1-55b8-484a-a63c-3859df8a2516"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:41.917464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:41.932473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:41.932974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:41.933435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:41.975644 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] Creating event network-changed:8f35a7d1-55b8-484a-a63c-3859df8a2516 for instance 06ace3d0-bfe7-4425-8305-66da94d20497 on n-h2-772273-9 Oct 11 01:17:41.986002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2bda5a87-f61e-4401-951c-aa1f98f38f15 req-cc4a7873-57e9-4c62-be0a-9bff5da0b646 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084037 Oct 11 01:17:41.993443 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 92/196] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:41.999262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:42.000028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:42.038254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.038810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.040980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.042002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.043898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.044668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.300663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:42.598285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:42.615090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5accb468-ce6d-44a9-b85f-aa6267aee638 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.972695 Oct 11 01:17:42.630679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 105/197] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:41 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:42.643985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0753e2d5-ab10-4b4e-9d81-199d3eb821ac tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:42.644864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0753e2d5-ab10-4b4e-9d81-199d3eb821ac tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:42.749511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:42.765527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9727fefd-7470-4367-846f-007eec29fc1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.769353 Oct 11 01:17:42.766166 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 93/198] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:41 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:42.796437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:42.798198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:42.804783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0753e2d5-ab10-4b4e-9d81-199d3eb821ac tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:42.813782 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0753e2d5-ab10-4b4e-9d81-199d3eb821ac tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1219 microversion: 2.1 time: 0.181966 Oct 11 01:17:42.815450 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 106/199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:42 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:42.815870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.816540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.819262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.820182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4778026-c61f-4b8d-b2c4-43902a65b247", "name": "network-vif-deleted", "tag": "f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:42.822283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.822922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.823699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.865052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.865944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.866556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.882996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] Creating event network-vif-deleted:f4cfd5f6-4eaa-4725-9ace-2b60ab5cea7d for instance a4778026-c61f-4b8d-b2c4-43902a65b247 on n-h1-772273-9 Oct 11 01:17:42.888804 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f3c0a323-a0dc-41d1-b6e8-aef82d64e551 req-7c2a6904-c557-4301-af06-38a92234e990 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072102 Oct 11 01:17:42.890109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 107/200] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:42.937507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:42.946585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:42.966146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.970543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.972766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:42.973695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:42.974691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:42.976490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.005971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] HTTP exception thrown: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Request method failure captured: Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 HTTP/1.1 Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQLW06zOA97SCEHfR0-VwIfvyMpPN6glDzXzId9sFGOxep5zkkkORKgJ1VaJ0kE5dBowocUywN4z5v6zpdI0VAyyXIZi8aoo8OKEPuttlTTJ-aCsM9NCpFd3L4Th6AlyM8m-PZ3yDVLaxXY419gH4dHpV-6sCTRfvvmfPO_8hAXh_s Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:43.013155 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 31f8e281a57048f8b57f65aa8a14593b Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:43.014479 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'a4778026-c61f-4b8d-b2c4-43902a65b247'} Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:43.015253 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:43.016556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:43.017734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Returning 404 to user: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:43.017734 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08f03be7-4ee8-4eab-a05f-b136ada5d271 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 404 len: 111 microversion: 2.1 time: 0.091294 Oct 11 01:17:43.019679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 108/201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:42 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:43.037644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80875faa-2587-4743-816a-d75f0599a51a", "name": "network-vif-plugged", "status": "completed", "tag": "df626864-6773-4d71-8405-74bb2c9a7435"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:43.061112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.061611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.063848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.089959 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] Creating event network-vif-plugged:df626864-6773-4d71-8405-74bb2c9a7435 for instance 80875faa-2587-4743-816a-d75f0599a51a on n-h2-772273-9 Oct 11 01:17:43.105187 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-949dc33d-0f79-44af-a858-258c22a63cf7 req-44319a3b-d0e4-45e7-b3ea-dd5756ab613c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076923 Oct 11 01:17:43.105830 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 109/202] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:43.120164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1ef2651-85ac-48a1-aa86-fa2b894cdba3 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:43.151990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1ef2651-85ac-48a1-aa86-fa2b894cdba3 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.152669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1ef2651-85ac-48a1-aa86-fa2b894cdba3 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.153246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1ef2651-85ac-48a1-aa86-fa2b894cdba3 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.187620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:43.197768 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce5152db-3ac1-414c-ba75-cc78e6b60dbd tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.413908 Oct 11 01:17:43.200258 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 94/203] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:42 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:43.392301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1ef2651-85ac-48a1-aa86-fa2b894cdba3 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 297 microversion: 2.1 time: 0.283449 Oct 11 01:17:43.392919 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 110/204] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:43 2022] POST /compute/v2.1/os-aggregates/7/action => generated 297 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:43.404976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a38112d8-8cd3-4cc0-90b1-c4431d6ca459 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:43.465205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a38112d8-8cd3-4cc0-90b1-c4431d6ca459 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.050857 Oct 11 01:17:43.466000 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 95/205] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:43 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:43.487294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed9dd203-57be-481c-a2d1-cd3d602fc56f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-94485991"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:43.492153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-ed9dd203-57be-481c-a2d1-cd3d602fc56f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 2ec88e2d-1266-4f2b-babb-cd16cde246ff for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:43.536333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed9dd203-57be-481c-a2d1-cd3d602fc56f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.053152 Oct 11 01:17:43.538326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 111/206] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:43 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:43.549474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3571e7a-8053-48ce-a3ea-ea7c2413f1ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:43.576551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3571e7a-8053-48ce-a3ea-ea7c2413f1ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.577202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3571e7a-8053-48ce-a3ea-ea7c2413f1ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.577712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3571e7a-8053-48ce-a3ea-ea7c2413f1ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.650747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:43.654446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:43.673906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.675280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.675826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.677443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.679855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.680651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.809997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3571e7a-8053-48ce-a3ea-ea7c2413f1ec tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 240 microversion: 2.1 time: 0.264370 Oct 11 01:17:43.817804 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 96/207] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:43 2022] POST /compute/v2.1/os-aggregates/9/action => generated 240 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:43.823325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:43.826890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:43.836213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.836976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.837651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.838587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.839670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.840455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.877945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:43.892231 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c73b9938-8bc6-437d-abcd-95fef9cb615a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.255265 Oct 11 01:17:43.903437 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 112/208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:43 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:43.909084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a19d6b3-03d3-46ac-bca0-91f502e740b1 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:43.938164 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a19d6b3-03d3-46ac-bca0-91f502e740b1 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.041995 Oct 11 01:17:43.938748 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 113/209] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:17:43 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:43.961421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:43.962048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:43.989167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.989910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.990367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:43.991161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:43.991664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:43.992093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.116247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:44.125446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-77d1ae55-ec80-4e77-94de-31092d0f07af tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.306313 Oct 11 01:17:44.130150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 97/210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:43 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:44.156670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73e75d8d-8511-465b-a8b0-f71ce3d5bf03 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:44.179869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:44.189694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73e75d8d-8511-465b-a8b0-f71ce3d5bf03 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.190209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73e75d8d-8511-465b-a8b0-f71ce3d5bf03 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.190602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73e75d8d-8511-465b-a8b0-f71ce3d5bf03 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.196297 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36ac3078-7a4f-4f0a-aeca-e70452d2187a tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1279 microversion: 2.1 time: 0.256506 Oct 11 01:17:44.197415 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 114/211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:43 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:44.226817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:44.227509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:44.233819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.234344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.234789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.235597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.236442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.236873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.431005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73e75d8d-8511-465b-a8b0-f71ce3d5bf03 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 225 microversion: 2.1 time: 0.281421 Oct 11 01:17:44.432509 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 98/212] 10.222.0.66 () {60 vars in 1191 bytes} [Tue Oct 11 01:17:44 2022] POST /compute/v2.1/os-aggregates/9/action => generated 225 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:44.445563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-947b91f5-ee76-445d-8283-79ed1e95d294 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:44.495778 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-947b91f5-ee76-445d-8283-79ed1e95d294 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.055157 Oct 11 01:17:44.496387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 99/213] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:44 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:44.514469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-775bba70-9af5-45ea-8372-c39fc28429d6 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-152206887"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:44.516212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:44.521182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-775bba70-9af5-45ea-8372-c39fc28429d6 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 6e71866b-8050-4a5b-a7aa-887a698fb4a3 for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:44.530445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0b1b5d7-896e-4eba-a791-5d4f3e2e8d45 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.308326 Oct 11 01:17:44.531360 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 115/214] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:44 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:44.583103 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-775bba70-9af5-45ea-8372-c39fc28429d6 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078019 Oct 11 01:17:44.584655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 100/215] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:44.601844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-319d4124-9e63-4d4b-b022-da009f8d363f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:44.612279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-319d4124-9e63-4d4b-b022-da009f8d363f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.612875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-319d4124-9e63-4d4b-b022-da009f8d363f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.613966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-319d4124-9e63-4d4b-b022-da009f8d363f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.762234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-319d4124-9e63-4d4b-b022-da009f8d363f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.166150 Oct 11 01:17:44.763031 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 116/216] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:44 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:44.776402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-992301c7-eca4-4ccc-98e6-af60d88afa93 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:44.791763 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-992301c7-eca4-4ccc-98e6-af60d88afa93 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.021349 Oct 11 01:17:44.792621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 101/217] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:17:44 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:44.828408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b34babd-1b62-4d5e-a814-d55cc43bf02a tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:44.846416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b34babd-1b62-4d5e-a814-d55cc43bf02a tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.847248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b34babd-1b62-4d5e-a814-d55cc43bf02a tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.847899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b34babd-1b62-4d5e-a814-d55cc43bf02a tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.917839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:44.918437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:44.925966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.926451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.927048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:44.927907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:44.929066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:44.929646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.009525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b34babd-1b62-4d5e-a814-d55cc43bf02a tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.191029 Oct 11 01:17:45.010380 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 117/218] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:44 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:45.026579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7d8a9cd-4094-485a-9c27-0e591f0549a5 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:45.067963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7d8a9cd-4094-485a-9c27-0e591f0549a5 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.046595 Oct 11 01:17:45.072463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 118/219] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:45 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:45.083285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8280f67e-6ddc-4b5d-8977-d7f7ffc41997 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1104868021"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:45.087083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-8280f67e-6ddc-4b5d-8977-d7f7ffc41997 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid d3fc3a37-8e0a-490e-9fee-da012e6c9614 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:45.119108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8280f67e-6ddc-4b5d-8977-d7f7ffc41997 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040608 Oct 11 01:17:45.120898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 119/220] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:17:45.136198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39340011-b599-4e39-b44e-86beb354efb7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:45.152934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39340011-b599-4e39-b44e-86beb354efb7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.154290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39340011-b599-4e39-b44e-86beb354efb7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.154955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39340011-b599-4e39-b44e-86beb354efb7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.262423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:45.280066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-660fc218-7ebb-40ff-8c97-3fcdc433a275 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.365454 Oct 11 01:17:45.280685 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 102/221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:44 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:45.288600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:45.295314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:45.308672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.316181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.316635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.317395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.317858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.318290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.527524 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39340011-b599-4e39-b44e-86beb354efb7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.398967 Oct 11 01:17:45.528508 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 120/222] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:45.533626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:45.535569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:45.551481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.551982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.552416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.554718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.555187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.557164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.782120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:45.792703 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10b2747d-3950-438e-8d6c-2ff69b53f4c7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.510341 Oct 11 01:17:45.793279 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 103/223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:45 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:45.799367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fa91752-e896-4fa9-ac17-d9279c632293 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:45.819692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fa91752-e896-4fa9-ac17-d9279c632293 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.820181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fa91752-e896-4fa9-ac17-d9279c632293 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.820872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fa91752-e896-4fa9-ac17-d9279c632293 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.898546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:45.911117 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87d1b2ed-7deb-46ca-8c20-7fac458cdea9 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.381328 Oct 11 01:17:45.912137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 121/224] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:45 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:45.921342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:45.924770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:45.933205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.946172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.947793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:45.950229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:45.953165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:45.954511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.014807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:46.051731 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fa91752-e896-4fa9-ac17-d9279c632293 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.257352 Oct 11 01:17:46.052726 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 104/225] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:46.217223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48a8f220-c83f-4775-a2fa-f98e1595966b tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Calling method '.version_select at 0x7f11350913a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:46.333656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=8,nova_api:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:46.356184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48a8f220-c83f-4775-a2fa-f98e1595966b tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 371 microversion: 2.1 time: 0.302021 Oct 11 01:17:46.368667 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 105/226] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:17:46 2022] GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:46.380962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25d24b58-1239-46eb-a5b6-414e9e98575c tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:46.424540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:46.437158 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb0faa72-29c1-4a38-ab47-a1a4142cb644 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.521251 Oct 11 01:17:46.439896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25d24b58-1239-46eb-a5b6-414e9e98575c tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.068824 Oct 11 01:17:46.440761 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 106/227] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:46 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:46.450289 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 122/228] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:45 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:46.452494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:46.453815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:46.462992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f1135188e50>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:46.479393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:46.480715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:46.481243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.482594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:46.483151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:46.483845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.578432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=31 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:46.598635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:46.599130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:46.599599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.600374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:46.600873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:46.601299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.733574 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7190dea4-095e-4b48-9cfd-01fc83b134e7 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 328 microversion: 2.1 time: 0.279754 Oct 11 01:17:46.735847 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 123/229] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:46 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:46.755807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8ff945-91aa-4c4c-9bb4-e12f2184be0d", "tag": "ef11184e-cfd1-4d3f-b5fd-737358b71829"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:46.793268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:46.793911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:46.796241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:46.828889 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] Creating event network-changed:ef11184e-cfd1-4d3f-b5fd-737358b71829 for instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d on n-h1-772273-9 Oct 11 01:17:46.844234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-052d195e-b0da-4349-a07c-c6e729b49926 req-b588eecd-b3f4-4afc-be04-62baf3d47abb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103986 Oct 11 01:17:46.845140 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 124/230] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:46.855614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70d75d3e-bf77-4a41-96d3-3796a7bf72a4 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-281340128"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:46.866388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-70d75d3e-bf77-4a41-96d3-3796a7bf72a4 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 8c878415-f867-47b3-8493-4d1b12cf038d for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:46.885261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:46.924687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70d75d3e-bf77-4a41-96d3-3796a7bf72a4 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073698 Oct 11 01:17:46.926601 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 125/231] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:46.934454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9fa30ad-b0d0-4982-a5a6-a7be820cf891 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-334473847"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:46.957524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-f9fa30ad-b0d0-4982-a5a6-a7be820cf891 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid 1dc899df-9793-4cbd-9ea0-40c3ca3edf4f for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:46.997679 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9fa30ad-b0d0-4982-a5a6-a7be820cf891 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068879 Oct 11 01:17:46.998363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 126/232] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:47.004384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:47.005588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:47.020313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.020930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.021398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.022151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.022610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.023036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.169245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:47.183482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:47.200081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ea40d34-d264-4b0d-abfc-992e849fda39 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.757684 Oct 11 01:17:47.200993 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 107/233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:46 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:47.209043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:47.209802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:47.218419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.219090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.219958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.221091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.221698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.227971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.476746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:47.485864 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b30817d4-6085-4551-abeb-33f677adaac0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.486260 Oct 11 01:17:47.501441 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 127/234] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:46 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:47.508472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72cbbb9e-2d55-4993-a06d-5a0856c12dac tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:47.548347 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72cbbb9e-2d55-4993-a06d-5a0856c12dac tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.044992 Oct 11 01:17:47.549081 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 128/235] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:47.594476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:47.607316 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0dc6cc1-9005-41a4-8755-99a46dfbd43e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.403474 Oct 11 01:17:47.608376 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 108/236] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:47 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:47.616733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d2555f2-959b-4084-9991-6f6032a0a079 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:47.625329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-896375709", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:47.630466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d2555f2-959b-4084-9991-6f6032a0a079 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.631763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d2555f2-959b-4084-9991-6f6032a0a079 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.632457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d2555f2-959b-4084-9991-6f6032a0a079 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.685997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:47.826558 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d2555f2-959b-4084-9991-6f6032a0a079 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.216994 Oct 11 01:17:47.827169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 109/237] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:47 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:47.831982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:47.835112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:47.844093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.844589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.845025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:47.845736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:47.846181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:47.846599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.253123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:48.253596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:48.254252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:48.254752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:48.255276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:48.258056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:48.267411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.268080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.269002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.269852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.270509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.271036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.280982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b4f9c953-a4d6-4628-a793-43a2d51ae04b tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.452427 Oct 11 01:17:48.281595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 110/238] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:47 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:48.286583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0b6078a-d06f-464d-9c4c-a9540fdc1bd8 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.296176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:48.300985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f0b6078a-d06f-464d-9c4c-a9540fdc1bd8 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 11 01:17:48.302296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for user 31509c3686c44a719b95e8bbf71ae338 and project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0b6078a-d06f-464d-9c4c-a9540fdc1bd8 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Request method failure captured: Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQNLrd7WP8HcAtLMvQ-sLIwlvG8t6imz0z8AL3RnTZhX1mI0uhU8Tx02BQoXc2P9iCkuwQZ-6Uhrv5WteVYbXuaYdekAumAgyES5yZAWJ9wZjjHSdoXCySBF8LBwd_jSa_nDCUDzfkeDDvM_jibG96BsRMIENVU_PpNpnTvCIKbjBE Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:48.302704 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 23e9ec901f9e4df1bcfe1d6b81c2a406 Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: exception: Aggregate 12 could not be found. Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '12'} Oct 11 01:17:48.303899 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.304627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 11 01:17:48.305606 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.308038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0b6078a-d06f-464d-9c4c-a9540fdc1bd8 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:48.308038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0b6078a-d06f-464d-9c4c-a9540fdc1bd8 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.022387 Oct 11 01:17:48.308038 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 111/239] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:48 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:48.324257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49793e2f-ca36-46eb-a1d5-8eb93b5f77e6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:48.328127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-49793e2f-ca36-46eb-a1d5-8eb93b5f77e6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '83557807042c435fbd83841f8cbf5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed437e9f500741da8ee968d808b7dba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49793e2f-ca36-46eb-a1d5-8eb93b5f77e6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Request method failure captured: Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 42 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQJk6ONDssDM1zVt70dwm-fxgVuzkhU9zVYrhV86eOUduaWmUhERS1zGs5AjgNL_3Cm4_tNthKZtdZdRPXt08TU3xsnzDEEprDvSmdOmtRJ1gk43hqS9RaK_PNHWG2KJSpetysnzRdBnq7u7dfJM7iBIix57gvxP28QYqZNtWu1TpY Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:48.330867 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed437e9f500741da8ee968d808b7dba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ed437e9f500741da8ee968d808b7dba8 Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607 Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 83557807042c435fbd83841f8cbf5749 Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1081415607-project Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: {"remove_host": {"host": "n-h1-772273-9"}} Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:48.333936 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-772273-9'}}} Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:48.335395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 01:17:48.336845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.338124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49793e2f-ca36-46eb-a1d5-8eb93b5f77e6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:48.338212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.utils [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] cores quota exceeded for 63b5bade1ce44dff83da7aa7aefdc6d9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120493) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 01:17:48.338212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 01:17:48.339524 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49793e2f-ca36-46eb-a1d5-8eb93b5f77e6 tempest-AggregatesAdminNegativeTestJSON-1081415607 tempest-AggregatesAdminNegativeTestJSON-1081415607-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.030362 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Request method failure captured: Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 144 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQ4bDnWs2KCbGGx5BycUns4J_fjGx5FM3mBkNRaQA7WWE_WiTyYTS6-hUvLekZfy1Zin6hUGxZS5T3ENC4yslMggtkvCSRNX59VfE9zieQN9L5MFZfXtcPtzIzFjtWgBHrqnHfFA_g5mxiXL_-C8S5JPZa2eYdAzQfCLdv2WoQy8cQ Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:48.340611 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 31509c3686c44a719b95e8bbf71ae338 Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-896375709", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} Oct 11 01:17:48.342524 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-896375709', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452'}}} Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 01:17:48.343427 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.344639 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.346796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba797624-ca6e-44a9-82d5-62899b00bb9b tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.792070 Oct 11 01:17:48.348856 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 129/240] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:47 2022] POST /compute/v2.1/servers => generated 111 bytes in 798 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:48.351057 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 112/241] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:48 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:48.354217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.355713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:48.360361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e4f9748-b6ed-464d-bcb7-eb02fb3f318d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.364168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.364987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.365866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.366872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.367756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.368447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.374696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5e4f9748-b6ed-464d-bcb7-eb02fb3f318d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e4f9748-b6ed-464d-bcb7-eb02fb3f318d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Request method failure captured: Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQNLrd7WP8HcAtLMvQ-sLIwlvG8t6imz0z8AL3RnTZhX1mI0uhU8Tx02BQoXc2P9iCkuwQZ-6Uhrv5WteVYbXuaYdekAumAgyES5yZAWJ9wZjjHSdoXCySBF8LBwd_jSa_nDCUDzfkeDDvM_jibG96BsRMIENVU_PpNpnTvCIKbjBE Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:48.376758 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 23e9ec901f9e4df1bcfe1d6b81c2a406 Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: exception: Aggregate 12 could not be found. Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '12'} Oct 11 01:17:48.377932 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:48.378634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:48.379627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e4f9748-b6ed-464d-bcb7-eb02fb3f318d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:48.383707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e4f9748-b6ed-464d-bcb7-eb02fb3f318d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.025436 Oct 11 01:17:48.385020 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 113/242] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:48.390383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f11350aa700>, body: {"quota_set": {"cores": 20}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:48.480754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.481719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.482710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.484126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.484752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.485357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.575855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0de01ae-dc6e-4f53-a7ba-b85014de984e tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 329 microversion: 2.1 time: 0.189426 Oct 11 01:17:48.577472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 114/243] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:48 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 329 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:48.591402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-311ee648-5a48-4a99-ba52-b64d3a8c06ee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:48.603674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-311ee648-5a48-4a99-ba52-b64d3a8c06ee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.604326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-311ee648-5a48-4a99-ba52-b64d3a8c06ee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.605085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-311ee648-5a48-4a99-ba52-b64d3a8c06ee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.658431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:48.677053 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe4452d4-4674-405e-a2a3-63dafc56c345 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1319 microversion: 2.1 time: 0.328412 Oct 11 01:17:48.677954 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 130/244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:48 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:48.698939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ea77370-bb36-41fb-80c9-ea2cae125845 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1260341124", "name": "tempest-test_aggregate-1159253683"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:48.703113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-3ea77370-bb36-41fb-80c9-ea2cae125845 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid ca62ab9d-ff76-4b5b-9d2b-2eb7fac615fe for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:48.759377 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ea77370-bb36-41fb-80c9-ea2cae125845 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.078497 Oct 11 01:17:48.760852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 131/245] 10.222.0.66 () {60 vars in 1165 bytes} [Tue Oct 11 01:17:48 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:48.767301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.768029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:48.776525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.777019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.777460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.778170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.778625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.779152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.791837 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-311ee648-5a48-4a99-ba52-b64d3a8c06ee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.212579 Oct 11 01:17:48.798669 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 115/246] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:48 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:48.800323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60ea1b65-ba2e-459d-835b-c2ed194c0a03 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Calling method '.version_select at 0x7f113505ab80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.909780 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60ea1b65-ba2e-459d-835b-c2ed194c0a03 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 371 microversion: 2.1 time: 0.113907 Oct 11 01:17:48.910558 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 116/247] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:17:48 2022] GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:48.915999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:48.916321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:48.922701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.923194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.923674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:48.924442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:48.924847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:48.925274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.201918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:49.209563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:49.213345 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d647fe2-5f8e-40d7-9055-9cff2c9f5178 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.451433 Oct 11 01:17:49.214067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 132/248] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:48 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:49.219867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b358efc-5322-4b94-b17f-37cc3c9acba5", "name": "network-vif-plugged", "status": "completed", "tag": "3c414428-b270-48ae-90f4-eb19b8debac3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.228196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e4553f2-2952-4b8c-aa1b-80e551c1c406 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.316730 Oct 11 01:17:49.230895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.231670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.232527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.234472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 117/249] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:48 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:49.239988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a65a994-9b80-4a1d-9a37-5572e05c38e7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.268146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] Creating event network-vif-plugged:3c414428-b270-48ae-90f4-eb19b8debac3 for instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 on n-h2-772273-9 Oct 11 01:17:49.274439 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-38941439-9806-4b37-98e8-c7b99d176798 req-7c78daf9-29b9-451d-ba7a-e7faf4066859 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058797 Oct 11 01:17:49.275315 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a65a994-9b80-4a1d-9a37-5572e05c38e7 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.039314 Oct 11 01:17:49.275646 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 133/250] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:49.279028 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 118/251] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:49.281610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0369e092-f708-4a57-9ad3-43daf45e96ef tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.283622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f113512fe50>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.310161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0369e092-f708-4a57-9ad3-43daf45e96ef tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.033241 Oct 11 01:17:49.311386 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 134/252] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:49.323108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7899c84d-eadf-41b4-b055-0514beb0413e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.331139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7899c84d-eadf-41b4-b055-0514beb0413e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7899c84d-eadf-41b4-b055-0514beb0413e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Request method failure captured: Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQNLrd7WP8HcAtLMvQ-sLIwlvG8t6imz0z8AL3RnTZhX1mI0uhU8Tx02BQoXc2P9iCkuwQZ-6Uhrv5WteVYbXuaYdekAumAgyES5yZAWJ9wZjjHSdoXCySBF8LBwd_jSa_nDCUDzfkeDDvM_jibG96BsRMIENVU_PpNpnTvCIKbjBE Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:17:49.333309 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 23e9ec901f9e4df1bcfe1d6b81c2a406 Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: exception: Aggregate 14 could not be found. Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '14'} Oct 11 01:17:49.334874 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.335798 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 11 01:17:49.337073 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.339392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7899c84d-eadf-41b4-b055-0514beb0413e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:49.341204 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7899c84d-eadf-41b4-b055-0514beb0413e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.023914 Oct 11 01:17:49.342236 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 135/253] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:49 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:49.348605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.350985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:49.366481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.367512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.368152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.369064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.369658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.370390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.414113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.414658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.415093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.415854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.416313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.416739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.494945 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4910b9cd-3077-4159-909b-972ae26b6ddc tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 328 microversion: 2.1 time: 0.214654 Oct 11 01:17:49.495716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 119/254] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:49 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 328 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:49.500595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71438f63-87af-47c0-b2a4-1841a165dfee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1769202145"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.504864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-71438f63-87af-47c0-b2a4-1841a165dfee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Generated uuid a2d830eb-9cf2-4c3c-b329-244a96427cad for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:49.536094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-71438f63-87af-47c0-b2a4-1841a165dfee tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038414 Oct 11 01:17:49.545182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 120/255] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:49.551599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a16aaf47-92fd-4a6a-909a-732a0d47010e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.568117 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a16aaf47-92fd-4a6a-909a-732a0d47010e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a16aaf47-92fd-4a6a-909a-732a0d47010e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Request method failure captured: Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQNLrd7WP8HcAtLMvQ-sLIwlvG8t6imz0z8AL3RnTZhX1mI0uhU8Tx02BQoXc2P9iCkuwQZ-6Uhrv5WteVYbXuaYdekAumAgyES5yZAWJ9wZjjHSdoXCySBF8LBwd_jSa_nDCUDzfkeDDvM_jibG96BsRMIENVU_PpNpnTvCIKbjBE Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:49.569910 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f151bbc91be4f6193a0a5632011a8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4f151bbc91be4f6193a0a5632011a8d7 Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-994742198 Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 23e9ec901f9e4df1bcfe1d6b81c2a406 Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminTestJSON-994742198-project-admin Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: exception: Aggregate 14 could not be found. Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '14'} Oct 11 01:17:49.571406 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:49.572108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.573097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a16aaf47-92fd-4a6a-909a-732a0d47010e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a16aaf47-92fd-4a6a-909a-732a0d47010e tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.025060 Oct 11 01:17:49.574197 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 121/256] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:49.579091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.590540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.591047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.591564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.602249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.602823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.603330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.611731 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.compute.aggregates [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 01:17:49.612313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Request method failure captured: Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 42 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQMNg9YUGC8usNbXFWnTn1CUoVynnfv-Gp2Uw6FXoKMP6K9lI6Toc4Kk3UjrR1w7GFGhgePG9ezW7bKAEAkjI3osLjixiDOhWkpF6SmL9YOiVxpPPxruUNumcJRmPjsUXgqH_GinWEYEtdnQrKTY84eenDd1C0lwOX_l7DbjVgVs2k Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:49.614260 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c80c2b0f4b32482bbe1f2ecd3e42a5ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c80c2b0f4b32482bbe1f2ecd3e42a5ce Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-999017959 Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f975548ec3e749e699834790e88c2129 Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: {"remove_host": {"host": "nonexist_host"}} Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:49.615837 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 01:17:49.616709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 11 01:17:49.618082 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.619445 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61e4c6bb-c1dc-48b5-825d-dbe988059e5d tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.043258 Oct 11 01:17:49.621381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 122/257] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:17:49.626603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1091811551", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.682252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:49.682971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:49.690615 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a322a6ee-4c3b-4475-a4dc-0543071c0c24 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1323 microversion: 2.1 time: 0.347093 Oct 11 01:17:49.691215 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 136/258] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:49 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1323 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:49.695829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-342f0e24-6928-4489-92de-3ee7011e734f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1791982580"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:49.699959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-342f0e24-6928-4489-92de-3ee7011e734f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 3727fb03-cf92-42b3-8b08-d392986140c1 for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:49.747989 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-342f0e24-6928-4489-92de-3ee7011e734f tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055568 Oct 11 01:17:49.757655 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 137/259] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:49.766539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b67f181a-f940-41fd-afd4-5b28e342c5d8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.793380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b67f181a-f940-41fd-afd4-5b28e342c5d8 tempest-AggregatesAdminNegativeTestJSON-999017959 tempest-AggregatesAdminNegativeTestJSON-999017959-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.034118 Oct 11 01:17:49.794325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 138/260] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:49.799578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:49.800197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:49.807077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.807594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.808045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:49.808945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:49.809412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:49.809844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.251666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:50.252131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:50.252759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:50.253193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:50.253845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:50.264891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:50.266485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.267169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.274650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.275749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.276756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.276894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f0502d9-cc7d-4a54-89ab-f20e57be2913 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1468 microversion: 2.1 time: 0.481464 Oct 11 01:17:50.277889 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 139/261] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:49 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:50.284074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.284930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d851e8dd-2851-4172-ab6a-2ecc8ac7e907 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:50.300479 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d851e8dd-2851-4172-ab6a-2ecc8ac7e907 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.020759 Oct 11 01:17:50.307378 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 140/262] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:50.317124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:50.322555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for user 31509c3686c44a719b95e8bbf71ae338 and project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:50.337259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.utils [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] instances quota exceeded for 63b5bade1ce44dff83da7aa7aefdc6d9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120494) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 01:17:50.338090 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Request method failure captured: Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 145 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQ4bDnWs2KCbGGx5BycUns4J_fjGx5FM3mBkNRaQA7WWE_WiTyYTS6-hUvLekZfy1Zin6hUGxZS5T3ENC4yslMggtkvCSRNX59VfE9zieQN9L5MFZfXtcPtzIzFjtWgBHrqnHfFA_g5mxiXL_-C8S5JPZa2eYdAzQfCLdv2WoQy8cQ Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:50.343126 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 31509c3686c44a719b95e8bbf71ae338 Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1091811551", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} Oct 11 01:17:50.344651 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1091811551', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452'}}} Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 01:17:50.345553 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:50.346837 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.348250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b242898-5c23-4680-b469-98a3dd2bf429 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.722715 Oct 11 01:17:50.350108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 123/263] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:49 2022] POST /compute/v2.1/servers => generated 119 bytes in 732 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:50.355437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:50.356449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:50.364502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:50.369035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.369629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.370237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.372209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.372209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.372209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.580638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1562992386", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:50.675159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] validate_networks() for [('9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:50.715726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:50.732011 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f75713a-4555-47ea-ba52-1e22e3590ca3 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.380904 Oct 11 01:17:50.732597 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 124/264] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:50 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:50.741373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:50.741373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:50.756139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.756966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.759063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:50.760016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:50.760675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:50.761366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:51.090177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:51.103696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0151945-a4c9-4231-91fc-41b144b81f34 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.368389 Oct 11 01:17:51.104877 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 125/265] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:50 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:51.389074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1018618974", "block_migration": true, "disk_over_commit": false}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:51.403064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:51.412806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:51.413649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:51.415040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:51.417481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:51.418440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:51.419077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:51.588665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:51.589251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:51.589534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:51.589941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:51.590349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:51.604038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:51.604522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:51.604951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:51.605666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:51.609030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:51.611033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:51.630572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:51.635670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for user ef7f0979c5764837ae474f3a09cedb7b and project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:51.649936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:51.653671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:51.719831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8370d1e7-9afe-4c72-995a-788e219b6cf0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416877 Oct 11 01:17:51.720792 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 141/266] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:51.725759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88828edc-ec6e-4ad9-8ed2-f949354742f4 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:51.790084 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88828edc-ec6e-4ad9-8ed2-f949354742f4 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.066196 Oct 11 01:17:51.791400 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 142/267] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:17:51 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:51.804028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f1134c309d0>, body: {"quota_set": {"instances": 10}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:51.865507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lazy-loading 'flavor' on Instance uuid 80875faa-2587-4743-816a-d75f0599a51a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:17:51.988932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Going to try to live migrate instance to tempest-host-1018618974 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:17:52.009938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] HTTP exception thrown: Compute host tempest-host-1018618974 could not be found. Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Request method failure captured: Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a/action HTTP/1.1 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 107 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQbN6g4hnlF2ZWYpMInE51lTnwSqrDopvsoGC8d62c1aKCSsi8wRgnw19NSnWbCQFWI1JWXjs7R92oFxeS9fQty3kncWrHE0Zx8syJj3tkMFfOZ_GKe23Xk-SjSAhByFK1D9jqaHesHx1PoIQtdQP_eFdKzrc7t1jjgD3OwvuZzgh0 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: db86466a811245ac80a97261bdedd26c Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:17:52.014034 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/db86466a811245ac80a97261bdedd26c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_db86466a811245ac80a97261bdedd26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/db86466a811245ac80a97261bdedd26c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/db86466a811245ac80a97261bdedd26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: db86466a811245ac80a97261bdedd26c Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveMigrationNegativeTest-1907155810-project-admin Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 267ade580c324813834f0ffad72b3ac9 Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveMigrationNegativeTest-1907155810-project-admin Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: {"os-migrateLive": {"host": "tempest-host-1018618974", "block_migration": true, "disk_over_commit": false}} Oct 11 01:17:52.015474 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: exception: Compute host tempest-host-1018618974 could not be found. Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '80875faa-2587-4743-816a-d75f0599a51a', 'body': {'os-migrateLive': {'host': 'tempest-host-1018618974', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:17:52.016256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1018618974 could not be found. Oct 11 01:17:52.017512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1018618974 could not be found. Oct 11 01:17:52.018840 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1018618974 could not be found. Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Returning 400 to user: Compute host tempest-host-1018618974 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:52.020220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfbe8209-1e20-4b64-b339-4658cc2b83ee tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a/action" status: 400 len: 100 microversion: 2.1 time: 0.912749 Oct 11 01:17:52.025211 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 126/268] 10.222.0.66 () {60 vars in 1279 bytes} [Tue Oct 11 01:17:51 2022] POST /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a/action => generated 100 bytes in 919 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:17:52.034444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.035193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.058173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.058679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.059131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.059886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.060349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.060784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.239622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:52.248873 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78e901f6-7abe-4924-93e7-a666273c9dcb tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1472 microversion: 2.1 time: 0.222525 Oct 11 01:17:52.252646 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 127/269] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:52.262610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95ca5ebe-7e1f-4fe2-961d-1cb051285147 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.263665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95ca5ebe-7e1f-4fe2-961d-1cb051285147 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.355006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.356013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.356504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.357665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.358408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.358989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.400229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95ca5ebe-7e1f-4fe2-961d-1cb051285147 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:52.415125 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95ca5ebe-7e1f-4fe2-961d-1cb051285147 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1211 microversion: 2.1 time: 0.160717 Oct 11 01:17:52.418172 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 128/270] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:52.428996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.434806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.461782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.462284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.462725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.468041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.468934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.469878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.536791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:52.572302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d9965ca-1f07-42fa-89ba-466af9419d91 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 329 microversion: 2.1 time: 0.764060 Oct 11 01:17:52.573148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 143/271] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:51 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 329 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:52.600776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eba14868-ad1d-448c-a13f-c466ed43e000 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.647705 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eba14868-ad1d-448c-a13f-c466ed43e000 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.059046 Oct 11 01:17:52.648369 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 144/272] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:52.660398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.661020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.671422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.672388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.672816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.674260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.674862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.675428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.827327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:52.841677 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7fe6143c-a530-4856-a92c-6635a46fdbc7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.422256 Oct 11 01:17:52.852406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 129/273] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:52.863130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.864275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.872099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.873719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.876020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.876871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.877416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.877928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.903424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:52.912815 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c7a9c65b-4698-4fce-9b70-e924c1c1ce08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1468 microversion: 2.1 time: 0.255949 Oct 11 01:17:52.915931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 145/274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:52.937399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:52.938153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:52.952019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.952350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.952738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:52.953458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:52.953913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:52.954444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.005042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Request method failure captured: Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5/diagnostics HTTP/1.1 Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQowFAkeTIOsXiA7q9gZXrJqWEF1bX3H1lKGciCkCVKq5P1tLMFOHbv0Qq_lg-02Wq3u2KlPlKfydj8cV85_-of9LfIrmHViB3ObVepCFWS0iA1B6eg7IcjeqkkrMzHwfrQ3XZ8xH8E4JbyRseByA3Nnw4wvZWCaTNGY0PF3s5rJMs Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e143609d565f41d692bc5093e710f15c Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:53.010711 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e143609d565f41d692bc5093e710f15c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e143609d565f41d692bc5093e710f15c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e143609d565f41d692bc5093e710f15c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e143609d565f41d692bc5093e710f15c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e143609d565f41d692bc5093e710f15c Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiagnosticsNegativeTest-323140016-project Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 58d1148982974a3fb4c50dd91c1b316a Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-323140016-project Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:53.012266 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '2b358efc-5322-4b94-b17f-37cc3c9acba5'} Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:53.012997 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 01:17:53.014283 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:53.018564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:53.022680 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15dcf3d0-8dfe-4af1-97b4-9b76a8e02411 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.105276 Oct 11 01:17:53.025823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 146/275] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5/diagnostics => generated 117 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:53.041493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67ec983e-c47e-4480-aac8-1681b4f0ca49 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Calling method '.version_select at 0x7f1134ce8c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:53.139966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:53.148183 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bea2fc5-e44b-46c3-8d6f-eb7b07a8637d tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.294440 Oct 11 01:17:53.163465 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 130/276] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:52 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:53.163465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c5b06ad-a5c0-43d3-b64d-583d6c311982 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:53.177107 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c5b06ad-a5c0-43d3-b64d-583d6c311982 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.026953 Oct 11 01:17:53.178859 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 131/277] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:53 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:53.186931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:53.187636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:53.195608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.196094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.196782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.197498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.198072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.198878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.264088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:17:53.462201 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67ec983e-c47e-4480-aac8-1681b4f0ca49 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 371 microversion: 2.1 time: 0.434473 Oct 11 01:17:53.470361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 147/278] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:17:53 2022] GET /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:53.475714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1733595847", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:53.483589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff0a973e-ed68-4734-8b2a-e67df26ea3fe tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 204 len: 0 microversion: 2.1 time: 0.302692 Oct 11 01:17:53.487506 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 132/279] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:17:53 2022] DELETE /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:17:53.494960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-128b4b82-834c-4a65-8f73-527c9bd4b85d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1784933360", "availability_zone": "tempest-test_az-440416265"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:53.523004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-128b4b82-834c-4a65-8f73-527c9bd4b85d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid 46b820d1-4cdd-46e2-a8db-42cdbf725754 for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:53.547369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:53.572567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-128b4b82-834c-4a65-8f73-527c9bd4b85d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.085678 Oct 11 01:17:53.575625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 133/280] 10.222.0.66 () {60 vars in 1165 bytes} [Tue Oct 11 01:17:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:53.592758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:53.593624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:53.603177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.603933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.605401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.606587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.607203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.608073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.726934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:53.735631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5353198a-c1e8-4b4c-93d8-2aad02a65570 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1269 microversion: 2.1 time: 0.157350 Oct 11 01:17:53.736822 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 134/281] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:53 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:53.756063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f1134f62dc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:53.886721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:53.888547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:53.889754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:53.890546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:53.891723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:53.913828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.914487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.915677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.917700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:53.918583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:53.919030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:53.948923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Getting quotas for project 9fae1bc4e02c4092b0d9145917755102. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:53.954262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Getting quotas for user 26a642a7da224e16af27c5df40c5fde5 and project 9fae1bc4e02c4092b0d9145917755102. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:53.976418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:17:53.978652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:17:54.055925 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0984296b-4163-4419-a794-5b8acd305b62 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581756 Oct 11 01:17:54.063178 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 148/282] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:17:54.071614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:54.072238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:54.078625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.079776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.080227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.080946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.081407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.081840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.181749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.182206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.184134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.185795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.186284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.187402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.276906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:54.288880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-340fee1a-c248-49ac-b4ef-671bc8be7fc2 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1478 microversion: 2.1 time: 0.220043 Oct 11 01:17:54.304730 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 149/283] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:54 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1478 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:54.316533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-782e8e7b-9e31-4d89-821a-02e42e316891 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1784933360_new", "availability_zone": "tempest-test_az-440416265_new"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:54.341461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b48655c-e36c-4997-93be-989eb299ee79 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 325 microversion: 2.1 time: 0.602069 Oct 11 01:17:54.342488 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 135/284] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:53 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:54.358685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:54.359651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:54.369508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.370562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.371457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.372639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.373334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.374018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.401754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:54.540020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-782e8e7b-9e31-4d89-821a-02e42e316891 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.541016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-782e8e7b-9e31-4d89-821a-02e42e316891 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.541572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-782e8e7b-9e31-4d89-821a-02e42e316891 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.598559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-782e8e7b-9e31-4d89-821a-02e42e316891 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.292586 Oct 11 01:17:54.600282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 150/285] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:17:54 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:54.604432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:54.607239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf52a456-8e8e-4ed0-8279-e86517aaab86 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:54.608946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf52a456-8e8e-4ed0-8279-e86517aaab86 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:54.616395 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-042f36f6-0270-4238-9cdf-37212260f805 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.272530 Oct 11 01:17:54.619939 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 136/286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:54 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:54.634291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:54.634914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:54.655518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.664059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.664850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.672540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.672977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.673473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.676555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf52a456-8e8e-4ed0-8279-e86517aaab86 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:54.685247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf52a456-8e8e-4ed0-8279-e86517aaab86 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1219 microversion: 2.1 time: 0.083392 Oct 11 01:17:54.686056 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 151/287] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:54 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:54.934372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:54.937260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.937960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.938928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:54.941944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:54.947916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:54.951773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.032507 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcfa5024-6524-4255-8772-b0bf11285fda tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.343180 Oct 11 01:17:55.033361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 152/288] 10.222.0.66 () {58 vars in 1164 bytes} [Tue Oct 11 01:17:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:17:55.039264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-733490798", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:55.091539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:55.103471 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-484f6e97-2c68-49db-bf31-f22580a5464e tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.479134 Oct 11 01:17:55.104084 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 137/289] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:54 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:55.116405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-19da9b77-62ab-4637-bd66-976ffe10ec30 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.137533 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-19da9b77-62ab-4637-bd66-976ffe10ec30 tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.031442 Oct 11 01:17:55.138773 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 138/290] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:17:55 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:55.155547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.157865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:55.166251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:17:55.172692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.175359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.177922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.178736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.179981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.180413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.615630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:55.624363 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-edcbcec9-6f3e-42bc-85ba-1f17afd6262a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.484576 Oct 11 01:17:55.625323 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 139/291] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:55 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:55.631774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ace3d0-bfe7-4425-8305-66da94d20497", "name": "network-vif-plugged", "status": "completed", "tag": "8f35a7d1-55b8-484a-a63c-3859df8a2516"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:55.647453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.648285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.648929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.661238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] Creating event network-vif-plugged:8f35a7d1-55b8-484a-a63c-3859df8a2516 for instance 06ace3d0-bfe7-4425-8305-66da94d20497 on n-h2-772273-9 Oct 11 01:17:55.664844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:17:55.665508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:17:55.666260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:17:55.666482 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-296a336a-7d3c-4f2f-8220-6a6702faa3c9 req-c1095741-caa4-4efa-8ab9-169a545db9ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Oct 11 01:17:55.667096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:17:55.667765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 140/292] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:55.671863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:17:55.673844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.675742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.676393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.676982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.678424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.679046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.679665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.684566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.685101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.686465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.687275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.687828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.688992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.709457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b336246b-0e08-4dfb-bfa4-256490e0c638 tempest-AZAdminV2TestJSON-1848000373 tempest-AZAdminV2TestJSON-1848000373-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.039941 Oct 11 01:17:55.710316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 141/293] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:17:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:55.714965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:17:55.715475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-45b00c42-d6ac-41ee-bec7-ab749276a9de tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.722754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Getting quotas for user 31509c3686c44a719b95e8bbf71ae338 and project 63b5bade1ce44dff83da7aa7aefdc6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:17:55.753634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.utils [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] ram quota exceeded for 63b5bade1ce44dff83da7aa7aefdc6d9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120493) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 01:17:55.757914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Request method failure captured: Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 144 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQ4bDnWs2KCbGGx5BycUns4J_fjGx5FM3mBkNRaQA7WWE_WiTyYTS6-hUvLekZfy1Zin6hUGxZS5T3ENC4yslMggtkvCSRNX59VfE9zieQN9L5MFZfXtcPtzIzFjtWgBHrqnHfFA_g5mxiXL_-C8S5JPZa2eYdAzQfCLdv2WoQy8cQ Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:17:55.760579 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 31509c3686c44a719b95e8bbf71ae338 Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-733490798", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} Oct 11 01:17:55.761928 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-733490798', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452'}}} Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 01:17:55.762600 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:55.763607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.764716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:55.765874 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21482764-cdb9-47c8-ae52-7ccc559f52d5 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.727337 Oct 11 01:17:55.770477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-45b00c42-d6ac-41ee-bec7-ab749276a9de tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.058723 Oct 11 01:17:55.774437 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 153/294] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:17:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 740 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:55.775657 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 142/295] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:55.779527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.780142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:55.784414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:55.785179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:55.794303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.794803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.795242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.798045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.798872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.799646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.801745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.805330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:55.806375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.806949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:55.808127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:55.810113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.212684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:56.228895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c3d0b47-aa05-4964-b5cb-caa9126a64d0 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.452103 Oct 11 01:17:56.229486 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 143/296] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:55 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:56.249920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:56.250845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:56.257940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.258555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.259027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.259868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.260402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.260890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.387964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:56.398083 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1aad1367-e10c-47e3-bf2f-99f4b8581753 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1277 microversion: 2.1 time: 0.153239 Oct 11 01:17:56.398983 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 144/297] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:56 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:56.404033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Action: 'update', calling method: .version_select at 0x7f1134e5aa60>, body: {"quota_set": {"ram": 51200}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:56.466830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:56.480233 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-09cc3b19-4606-433f-b951-3b0a6d0e0249 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1478 microversion: 2.1 time: 0.704515 Oct 11 01:17:56.486122 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 154/298] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:55 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1478 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:56.496431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d74f414b-b5dc-43b5-95f5-99e9dc0e211d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1270587380"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:56.502671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.aggregate [None req-d74f414b-b5dc-43b5-95f5-99e9dc0e211d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Generated uuid b583d08e-c835-4d6f-8c47-54a119decf1c for aggregate {{(pid=120493) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:17:56.528465 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d74f414b-b5dc-43b5-95f5-99e9dc0e211d tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040098 Oct 11 01:17:56.530178 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 155/299] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:17:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:56.541155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:56.544665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:56.551803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.552571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.553151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.554770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.557280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.557718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.769918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.770470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.770885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.772397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.773114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.773802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.836214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:56.849189 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-343dabdf-24f5-4024-9956-dca49aa277d0 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.316977 Oct 11 01:17:56.863384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 156/300] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:56 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:56.863384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fb6b75-af88-4705-a346-11b2319f09f5", "tag": "bdc0a7c5-e120-4cc9-bd46-ea705d703f0a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:56.876993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.877806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.878760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.881903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84ce54bd-a98c-47b0-b961-82f239dc1347 tempest-QuotasAdminNegativeTest-95168390 tempest-QuotasAdminNegativeTest-95168390-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 200 len: 329 microversion: 2.1 time: 0.481817 Oct 11 01:17:56.882816 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 145/301] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:56 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 329 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:56.887798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e169e4a4-4f8c-4bca-b6c6-2dbeba6c34ca tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:56.897048 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e169e4a4-4f8c-4bca-b6c6-2dbeba6c34ca tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.012156 Oct 11 01:17:56.898471 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 146/302] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:17:56 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:56.903687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b358efc-5322-4b94-b17f-37cc3c9acba5", "name": "network-vif-deleted", "tag": "3c414428-b270-48ae-90f4-eb19b8debac3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:56.905010 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] Creating event network-changed:bdc0a7c5-e120-4cc9-bd46-ea705d703f0a for instance 14fb6b75-af88-4705-a346-11b2319f09f5 on n-h1-772273-9 Oct 11 01:17:56.910851 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-feb393e6-46bc-4b2f-9ebd-a6afdf3f7915 req-0702f88a-7a7e-4206-9efa-0279d7e7d31d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058584 Oct 11 01:17:56.911912 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 157/303] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:56.914905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:56.919009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:56.919764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:56.921406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.922216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.922841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.927786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.928287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.928957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.930500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:56.931158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:56.931809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:56.935636 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] Creating event network-vif-deleted:3c414428-b270-48ae-90f4-eb19b8debac3 for instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 on n-h2-772273-9 Oct 11 01:17:56.940772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-90e49e22-ae8c-47f4-885f-3dd838f06077 req-31a70478-aea2-4216-9f41-61cf80f2aff3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041013 Oct 11 01:17:56.944861 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 147/304] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:56.951261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82a429f0-dc86-46e5-9fe7-01c8d6420531 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Action: 'update', calling method: .version_select at 0x7f1134e5a3a0>, body: {"quota_set": {"ram": 0}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:56.956632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82a429f0-dc86-46e5-9fe7-01c8d6420531 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '31509c3686c44a719b95e8bbf71ae338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5bade1ce44dff83da7aa7aefdc6d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82a429f0-dc86-46e5-9fe7-01c8d6420531 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Request method failure captured: Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 HTTP/1.1 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 25 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQ4bDnWs2KCbGGx5BycUns4J_fjGx5FM3mBkNRaQA7WWE_WiTyYTS6-hUvLekZfy1Zin6hUGxZS5T3ENC4yslMggtkvCSRNX59VfE9zieQN9L5MFZfXtcPtzIzFjtWgBHrqnHfFA_g5mxiXL_-C8S5JPZa2eYdAzQfCLdv2WoQy8cQ Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:56.959672 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/63b5bade1ce44dff83da7aa7aefdc6d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 63b5bade1ce44dff83da7aa7aefdc6d9 Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2022995206 Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 31509c3686c44a719b95e8bbf71ae338 Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-QuotasAdminNegativeTest-2022995206-project Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: {"quota_set": {"ram": 0}} Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 01:17:56.961239 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '63b5bade1ce44dff83da7aa7aefdc6d9', 'body': {'quota_set': {'ram': 0}}} Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:17:56.962212 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:56.964100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82a429f0-dc86-46e5-9fe7-01c8d6420531 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82a429f0-dc86-46e5-9fe7-01c8d6420531 tempest-QuotasAdminNegativeTest-2022995206 tempest-QuotasAdminNegativeTest-2022995206-project] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9" status: 403 len: 116 microversion: 2.1 time: 0.017807 Oct 11 01:17:56.967260 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 148/305] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:17:56 2022] PUT /compute/v2.1/os-quota-sets/63b5bade1ce44dff83da7aa7aefdc6d9 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:56.971658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db4c5917-9729-499f-825f-080f9ceccd1b tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.003216 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db4c5917-9729-499f-825f-080f9ceccd1b tempest-AggregatesAdminTestJSON-994742198 tempest-AggregatesAdminTestJSON-994742198-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.036857 Oct 11 01:17:57.009322 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 149/306] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:17:56 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:17:57.018761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.020576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.027719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.028216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.028657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.029374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.029827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.030897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.048926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] HTTP exception thrown: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Request method failure captured: Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 HTTP/1.1 Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQLW06zOA97SCEHfR0-VwIfvyMpPN6glDzXzId9sFGOxep5zkkkORKgJ1VaJ0kE5dBowocUywN4z5v6zpdI0VAyyXIZi8aoo8OKEPuttlTTJ-aCsM9NCpFd3L4Th6AlyM8m-PZ3yDVLaxXY419gH4dHpV-6sCTRfvvmfPO_8hAXh_s Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:57.051650 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 31f8e281a57048f8b57f65aa8a14593b Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.052977 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a4778026-c61f-4b8d-b2c4-43902a65b247'} Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:57.053653 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.054744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.055930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Returning 404 to user: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:57.055930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ded1118-7dd9-4109-bebd-f990be2b5747 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 404 len: 111 microversion: 2.1 time: 0.042331 Oct 11 01:17:57.057522 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 150/307] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:17:57 2022] DELETE /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:57.064152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.064775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] [instance: a4778026-c61f-4b8d-b2c4-43902a65b247] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.073392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.073891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.074334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.075045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.075750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.076361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.095105 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] HTTP exception thrown: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Request method failure captured: Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 HTTP/1.1 Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQLW06zOA97SCEHfR0-VwIfvyMpPN6glDzXzId9sFGOxep5zkkkORKgJ1VaJ0kE5dBowocUywN4z5v6zpdI0VAyyXIZi8aoo8OKEPuttlTTJ-aCsM9NCpFd3L4Th6AlyM8m-PZ3yDVLaxXY419gH4dHpV-6sCTRfvvmfPO_8hAXh_s Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:57.097018 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4eb01d1d700444f7ae5d2b1cc5af31dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4eb01d1d700444f7ae5d2b1cc5af31dd Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-370957065 Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 31f8e281a57048f8b57f65aa8a14593b Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AggregatesAdminTestJSON-370957065-project Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.098272 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a4778026-c61f-4b8d-b2c4-43902a65b247'} Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:57.100136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. Oct 11 01:17:57.101595 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:57.103634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] Returning 404 to user: Instance a4778026-c61f-4b8d-b2c4-43902a65b247 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:57.104770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96548a02-ce1a-4dd0-9a9d-334fb9929d49 tempest-AggregatesAdminTestJSON-370957065 tempest-AggregatesAdminTestJSON-370957065-project] 10.222.0.66 "GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247" status: 404 len: 111 microversion: 2.1 time: 0.046010 Oct 11 01:17:57.111155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 151/308] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:57 2022] GET /compute/v2.1/servers/a4778026-c61f-4b8d-b2c4-43902a65b247 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:57.181194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:57.196234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b12378ab-7f69-451f-ad85-9c738f29b693 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.283081 Oct 11 01:17:57.220958 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 158/309] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:56 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:57.257867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.258591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.280656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.281152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.281589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.282296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.282746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.283165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.421832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.422453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.432846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.433344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.433774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.437136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.437899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.438476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.473324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:57.482152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78520843-daea-4423-a94f-c510a03e1349 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1390 microversion: 2.1 time: 0.232051 Oct 11 01:17:57.496167 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 152/310] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:57 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:57.510785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.511456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.520949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.521541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.522061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.522767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.523218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.523670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.616930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.617748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.619581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.620244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lazy-loading 'fault' on Instance uuid 2b358efc-5322-4b94-b17f-37cc3c9acba5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:17:57.701748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d1148982974a3fb4c50dd91c1b316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e143609d565f41d692bc5093e710f15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:57.716714 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28b0a8ee-bb31-45ec-aeb2-5e19c7d32811 tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 200 len: 1313 microversion: 2.1 time: 0.207652 Oct 11 01:17:57.718521 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 153/311] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:57 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:57.729422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ff945-91aa-4c4c-9bb4-e12f2184be0d", "name": "network-vif-plugged", "status": "completed", "tag": "ef11184e-cfd1-4d3f-b5fd-737358b71829"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:57.756572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.757264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.758910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.770337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:57.785630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99c52d6a-d3f4-4010-a547-402a55281498 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.367459 Oct 11 01:17:57.789470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 159/312] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:57 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:17:57.794585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] Creating event network-vif-plugged:ef11184e-cfd1-4d3f-b5fd-737358b71829 for instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d on n-h1-772273-9 Oct 11 01:17:57.807015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a92aedaf-1f73-49be-972f-9e54fd38247f req-973de31a-f231-4a9c-b435-4ff6fdeeb30d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087047 Oct 11 01:17:57.810829 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 154/313] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:57.876594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:57.877477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:57.885967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.886847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.887508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:57.888562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:57.889327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:57.890053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.133400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:58.138143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:17:58.143539 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49896544-d454-452a-a51c-a7342a9efe41 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.271714 Oct 11 01:17:58.144304 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 160/314] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:57 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:58.229176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:58.230469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:58.241384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.241937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.242381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.243145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.243859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.244441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.438771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:58.449554 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-19a2bcd8-95cb-4a8d-9b3e-420782606c27 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.227143 Oct 11 01:17:58.451179 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 155/315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:58 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:58.510587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:58.511205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:58.519743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.520625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.521960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.523174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.523864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.524563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.720661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:58.735779 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-219a581b-779f-49c8-bd00-c62a75018f1f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1589 microversion: 2.1 time: 0.230129 Oct 11 01:17:58.738676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 161/316] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:58 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1589 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:58.746815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:58.747469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] [instance: 2b358efc-5322-4b94-b17f-37cc3c9acba5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:58.761864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.764558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.768896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.770642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:58.771357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:58.772124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.774658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.776610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.779317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.780295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.781268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.783988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.784940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.785735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.829377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] HTTP exception thrown: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Request method failure captured: Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 HTTP/1.1 Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQowFAkeTIOsXiA7q9gZXrJqWEF1bX3H1lKGciCkCVKq5P1tLMFOHbv0Qq_lg-02Wq3u2KlPlKfydj8cV85_-of9LfIrmHViB3ObVepCFWS0iA1B6eg7IcjeqkkrMzHwfrQ3XZ8xH8E4JbyRseByA3Nnw4wvZWCaTNGY0PF3s5rJMs Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e143609d565f41d692bc5093e710f15c Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:17:58.834022 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e143609d565f41d692bc5093e710f15c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e143609d565f41d692bc5093e710f15c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e143609d565f41d692bc5093e710f15c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e143609d565f41d692bc5093e710f15c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e143609d565f41d692bc5093e710f15c Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-323140016 Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerDiagnosticsNegativeTest-323140016-project Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 58d1148982974a3fb4c50dd91c1b316a Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-323140016-project Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. Oct 11 01:17:58.835319 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2b358efc-5322-4b94-b17f-37cc3c9acba5'} Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:17:58.836009 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. Oct 11 01:17:58.837070 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:17:58.838101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] Returning 404 to user: Instance 2b358efc-5322-4b94-b17f-37cc3c9acba5 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:17:58.838101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-32ddb91f-5043-4de3-9799-051c9f5b5d6a tempest-ServerDiagnosticsNegativeTest-323140016 tempest-ServerDiagnosticsNegativeTest-323140016-project] 10.222.0.66 "GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5" status: 404 len: 111 microversion: 2.1 time: 0.094313 Oct 11 01:17:58.844389 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 156/317] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:58 2022] GET /compute/v2.1/servers/2b358efc-5322-4b94-b17f-37cc3c9acba5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:17:58.865238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:58.866895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:58.881486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.881486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.881486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.881769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:58.882262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:58.883445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:58.996593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-732daccf-827d-403d-8045-63e34a118b30 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233065 Oct 11 01:17:58.997300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 162/318] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:17:58 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:59.168416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:59.170307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:59.186778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:59.187274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:59.187936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:59.189149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:59.189744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:59.190386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:59.387735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:59.403567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-117cc793-3a3c-4f74-87e6-9ced87df463a tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.552146 Oct 11 01:17:59.404485 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 157/319] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:58 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:59.409499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d307da28-8744-4eda-ad4b-0f2b8ae97ca2", "tag": "6aac5abb-8ec6-4f52-b762-2b7839d7cf40"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:17:59.438232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:59.439489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:59.440216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:59.457312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] Creating event network-changed:6aac5abb-8ec6-4f52-b762-2b7839d7cf40 for instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 on n-h2-772273-9 Oct 11 01:17:59.465812 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-45052f97-6c74-450c-b7af-b6d88d1aabf5 req-f33c2784-2ad7-41f3-a5da-d818fae844a3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059165 Oct 11 01:17:59.467199 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 158/320] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:17:59.479380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:17:59.480785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:17:59.489561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:59.490429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:59.490966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:59.491927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:17:59.492495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:17:59.492979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:17:59.710086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:59.719268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed7abcf2-97c5-40b6-8fe7-364a0dee3791 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1319 microversion: 2.1 time: 0.554979 Oct 11 01:17:59.722494 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 163/321] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:59 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:17:59.816883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:17:59.830489 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84917dc9-3d0f-4d36-ac13-b7e0fe82f2e0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.358154 Oct 11 01:17:59.835722 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 159/322] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:17:59 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:00.428881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:00.429477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:00.440701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:00.442121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:00.443936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:00.445227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:00.446654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:00.449085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:00.757790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:00.763090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:00.773054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:00.774318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:00.775193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:00.776269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:00.777330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:00.777969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:00.992805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:01.017451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1eb7c16b-ed50-41a3-912e-3d9131d700ef tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.593476 Oct 11 01:18:01.018386 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 164/323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:00 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:01.023875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:01.024664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:01.031726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.032660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.033368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.034293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.034896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.035621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.177622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:01.188160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1fff00c-b2e1-4098-9738-6978ccea0fe7 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1468 microversion: 2.1 time: 0.441980 Oct 11 01:18:01.211165 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 160/324] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:00 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:01.220807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:01.223130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:01.242019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.242695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.243289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.244203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.244810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.245243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.353106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:01.361128 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1434b7f5-763d-43c8-9dd4-4065d57e7e5d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.341433 Oct 11 01:18:01.381116 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 165/325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:01 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:01.385195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7af7d6d-407a-43f1-9c61-48ea66a1aad5 tempest-DeleteServersAdminTestJSON-181891623 tempest-DeleteServersAdminTestJSON-181891623-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d/action" status: 202 len: 0 microversion: 2.1 time: 0.167782 Oct 11 01:18:01.386651 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 161/326] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:01 2022] POST /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:18:01.396233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:01.397104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:01.404029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.404507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.405119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.406349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.407861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.408516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.454657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.455271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.455595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.456049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lazy-loading 'fault' on Instance uuid 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:01.680325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:01.695320 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b044f65-e847-4659-b3d1-2a934bbf1449 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1451 microversion: 2.1 time: 0.302480 Oct 11 01:18:01.696370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 166/327] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:01 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1451 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:01.726759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:01.727504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:01.737355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.738611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.739981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.741340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.742009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.743815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.767741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:01.768564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:01.771801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:01.780742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:01.781981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.782633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.783219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.784108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:01.785764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:01.787857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:01.814101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:18:01.981415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c04c085-c932-456c-b294-dc811c2c3202 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 204 len: 0 microversion: 2.1 time: 0.260339 Oct 11 01:18:01.982656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 162/328] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:01 2022] DELETE /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:01.993498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ace3d0-bfe7-4425-8305-66da94d20497", "tag": "8f35a7d1-55b8-484a-a63c-3859df8a2516"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:02.005151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.005807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.006600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.028537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] Creating event network-changed:8f35a7d1-55b8-484a-a63c-3859df8a2516 for instance 06ace3d0-bfe7-4425-8305-66da94d20497 on n-h2-772273-9 Oct 11 01:18:02.035097 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e9edee59-8f36-40f6-8a75-a9bf6567f3da req-ddf0a897-db16-4ce4-afee-203cf5fa47f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050860 Oct 11 01:18:02.035749 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 163/329] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:02.041846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:02.042541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:02.050966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.051712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.052346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.053849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.054442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.055536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.074959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:02.096205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.096924 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2343342b-0b5c-49c1-99d5-0407969bab3d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 200 len: 1589 microversion: 2.1 time: 0.325499 Oct 11 01:18:02.098114 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 167/330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:01 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 1589 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:02.106970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:02.107629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:02.112932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.113425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.117142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lazy-loading 'fault' on Instance uuid 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:02.132621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.133732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.134283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.135193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.136123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.152492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.382275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:02.385568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:02.394549 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a277017-d755-4027-b866-98d182b29716 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.290902 Oct 11 01:18:02.395394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 168/331] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:02 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:02.401436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:02.402370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:02.416244 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91d69606-464f-4487-b8f3-53b41fdd2e86 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1457 microversion: 2.1 time: 0.376443 Oct 11 01:18:02.422864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.423400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.423847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.424638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:02.426841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:02.428004 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 164/332] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:02 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1457 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:02.429359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:02.726281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:02.740461 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-18c3ce50-c002-4623-ba14-c2f65316a402 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.340608 Oct 11 01:18:02.743074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 169/333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:02 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:03.123497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9c77133-6c55-40d8-9576-1a606f355699 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-272809301", "id": 53195361, "os-flavor-access:is_public": "False"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:03.156093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9c77133-6c55-40d8-9576-1a606f355699 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.557198 Oct 11 01:18:03.157833 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 165/334] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:02 2022] POST /compute/v2.1/flavors => generated 424 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:18:03.164413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fb6b75-af88-4705-a346-11b2319f09f5", "name": "network-vif-plugged", "status": "completed", "tag": "bdc0a7c5-e120-4cc9-bd46-ea705d703f0a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:03.179649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.183649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.184197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.204829 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] Creating event network-vif-plugged:bdc0a7c5-e120-4cc9-bd46-ea705d703f0a for instance 14fb6b75-af88-4705-a346-11b2319f09f5 on n-h1-772273-9 Oct 11 01:18:03.210729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-84825f28-33d6-4e02-8ae4-e5b5dd4f8abb req-8d219703-3753-4d3a-ace3-7c3c0e87430b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051330 Oct 11 01:18:03.211630 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 166/335] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:03.220494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21cfcded-806b-402e-b14d-c2aef0dffb05 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2479f39e72ae4f0b9f0ec335d2ac1493"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:03.305144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d03de0f-5230-4ec5-a191-0bcf17357cff tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Calling method '.version_select at 0x7f1134ce8790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:03.335924 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4d03de0f-5230-4ec5-a191-0bcf17357cff tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d03de0f-5230-4ec5-a191-0bcf17357cff tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/images/af82f719-c00a-4ecb-83dd-ce1efb844d01/metadata/os_distro HTTP/1.1 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:03.355080 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'image_id': 'af82f719-c00a-4ecb-83dd-ce1efb844d01', 'id': 'os_distro'} Oct 11 01:18:03.356644 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.357461 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af82f719-c00a-4ecb-83dd-ce1efb844d01 Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.358742 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af82f719-c00a-4ecb-83dd-ce1efb844d01 could not be found. Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:03.360388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:03.361578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.364703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d03de0f-5230-4ec5-a191-0bcf17357cff tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:03.365738 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d03de0f-5230-4ec5-a191-0bcf17357cff tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "DELETE /compute/v2.1/images/af82f719-c00a-4ecb-83dd-ce1efb844d01/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.618963 Oct 11 01:18:03.366451 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 170/336] 10.222.0.66 () {58 vars in 1293 bytes} [Tue Oct 11 01:18:02 2022] DELETE /compute/v2.1/images/af82f719-c00a-4ecb-83dd-ce1efb844d01/metadata/os_distro => generated 62 bytes in 620 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:03.378153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b340312e-cd15-4876-be19-d3bc5d0faa5b tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Calling method '.version_select at 0x7f1134c4ab80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:03.406973 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b340312e-cd15-4876-be19-d3bc5d0faa5b tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b340312e-cd15-4876-be19-d3bc5d0faa5b tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/images/21139725-22ca-45b4-9d77-118286b5d5e9/metadata/os_version HTTP/1.1 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:03.409066 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'image_id': '21139725-22ca-45b4-9d77-118286b5d5e9', 'id': 'os_version'} Oct 11 01:18:03.410287 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.412624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 21139725-22ca-45b4-9d77-118286b5d5e9 Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.413579 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21139725-22ca-45b4-9d77-118286b5d5e9 could not be found. Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:03.414658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.416787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b340312e-cd15-4876-be19-d3bc5d0faa5b tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:03.419957 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b340312e-cd15-4876-be19-d3bc5d0faa5b tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "GET /compute/v2.1/images/21139725-22ca-45b4-9d77-118286b5d5e9/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037100 Oct 11 01:18:03.419957 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 171/337] 10.222.0.66 () {58 vars in 1293 bytes} [Tue Oct 11 01:18:03 2022] GET /compute/v2.1/images/21139725-22ca-45b4-9d77-118286b5d5e9/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 01:18:03.423216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2de63c46-872d-4248-9a5e-aba2695eb07a tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Calling method '.version_select at 0x7f1134ce8940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:03.451080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2de63c46-872d-4248-9a5e-aba2695eb07a tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2de63c46-872d-4248-9a5e-aba2695eb07a tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/images/e1320efa-b7cb-46fb-aa95-d2988c6cfe1f/metadata HTTP/1.1 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:03.453457 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'image_id': 'e1320efa-b7cb-46fb-aa95-d2988c6cfe1f'} Oct 11 01:18:03.454636 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.455364 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1320efa-b7cb-46fb-aa95-d2988c6cfe1f Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:03.456294 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1320efa-b7cb-46fb-aa95-d2988c6cfe1f could not be found. Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:03.457313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:03.458328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2de63c46-872d-4248-9a5e-aba2695eb07a tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:03.459248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2de63c46-872d-4248-9a5e-aba2695eb07a tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "GET /compute/v2.1/images/e1320efa-b7cb-46fb-aa95-d2988c6cfe1f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035905 Oct 11 01:18:03.460343 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 172/338] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:18:03 2022] GET /compute/v2.1/images/e1320efa-b7cb-46fb-aa95-d2988c6cfe1f/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:03.470033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:03.474883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:03.486885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.487923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.488839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.490644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.491321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.492036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.840537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:03.850170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7720ac6c-0e9a-4a7b-a09e-9eb271c5ef08 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.389429 Oct 11 01:18:03.851674 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 173/339] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:03 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:03.856797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:03.857688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:03.865125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.865813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.866494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.867161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.867935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.868647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.905349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:03.906064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:03.906616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:03.907145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lazy-loading 'fault' on Instance uuid 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:03.941612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21cfcded-806b-402e-b14d-c2aef0dffb05 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/53195361/action" status: 200 len: 95 microversion: 2.1 time: 0.725299 Oct 11 01:18:03.949570 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 167/340] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:18:03 2022] POST /compute/v2.1/flavors/53195361/action => generated 95 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:18:03.958715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1316e83f-292f-4999-92b8-b78fe0b9e038 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Action: 'update_all', calling method: .version_select at 0x7f1134d97dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:03.997566 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1316e83f-292f-4999-92b8-b78fe0b9e038 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1316e83f-292f-4999-92b8-b78fe0b9e038 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/images/1ab52940-4998-4ded-bbc1-468504c0ad18/metadata HTTP/1.1 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 57 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:04.006715 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:04.008168 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'image_id': '1ab52940-4998-4ded-bbc1-468504c0ad18', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.009122 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1ab52940-4998-4ded-bbc1-468504c0ad18 Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.010288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ab52940-4998-4ded-bbc1-468504c0ad18 could not be found. Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:04.011584 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:04.012778 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.014111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:04.016393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1316e83f-292f-4999-92b8-b78fe0b9e038 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:04.017265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1316e83f-292f-4999-92b8-b78fe0b9e038 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "PUT /compute/v2.1/images/1ab52940-4998-4ded-bbc1-468504c0ad18/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066470 Oct 11 01:18:04.025396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 168/341] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:18:03 2022] PUT /compute/v2.1/images/1ab52940-4998-4ded-bbc1-468504c0ad18/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:04.026599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40769144-e3d1-435b-92e5-afbc2186916c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1415 microversion: 2.1 time: 0.173267 Oct 11 01:18:04.027956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 174/342] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:03 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1415 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:04.048862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:04.052054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:04.069480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:04.071623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:04.072159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:04.074019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:04.075004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:04.076050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:04.258853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:04.266446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed328ca2-c3e9-402b-b43e-14bfa41c791c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1311 microversion: 2.1 time: 0.243933 Oct 11 01:18:04.267220 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 169/343] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:04 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:04.289336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-433bd644-d553-4d4e-bf61-b2671c6654b5 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Action: 'update', calling method: .version_select at 0x7f1134dc7790>, body: {"meta": {"os_distro": "alt"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:04.297589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea6f7cbc-86cb-4cf3-a0fc-68a46ea49fd9 tempest-FlavorsAccessTestJSON-678023189 tempest-FlavorsAccessTestJSON-678023189-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:04.311916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-433bd644-d553-4d4e-bf61-b2671c6654b5 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-433bd644-d553-4d4e-bf61-b2671c6654b5 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/images/400aa406-3014-4ab7-8824-8a7b7eef2433/metadata/os_distro HTTP/1.1 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 30 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:04.313972 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: {"meta": {"os_distro": "alt"}} Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:04.315476 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'image_id': '400aa406-3014-4ab7-8824-8a7b7eef2433', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.316413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 400aa406-3014-4ab7-8824-8a7b7eef2433 Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.317685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 400aa406-3014-4ab7-8824-8a7b7eef2433 could not be found. Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:04.318937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:04.320571 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.322042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-433bd644-d553-4d4e-bf61-b2671c6654b5 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:04.322042 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-433bd644-d553-4d4e-bf61-b2671c6654b5 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "PUT /compute/v2.1/images/400aa406-3014-4ab7-8824-8a7b7eef2433/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.033916 Oct 11 01:18:04.322042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 170/344] 10.222.0.66 () {60 vars in 1310 bytes} [Tue Oct 11 01:18:04 2022] PUT /compute/v2.1/images/400aa406-3014-4ab7-8824-8a7b7eef2433/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:04.326200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ff945-91aa-4c4c-9bb4-e12f2184be0d", "name": "network-vif-deleted", "tag": "ef11184e-cfd1-4d3f-b5fd-737358b71829"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:04.335759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea6f7cbc-86cb-4cf3-a0fc-68a46ea49fd9 tempest-FlavorsAccessTestJSON-678023189 tempest-FlavorsAccessTestJSON-678023189-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.1 time: 0.306371 Oct 11 01:18:04.336878 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 175/345] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:04 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:04.352790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:04.353299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:04.353727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:04.364319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce59b0dc-1674-4e33-8e77-b242773e71f2 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Action: 'create', calling method: .version_select at 0x7f1134c30940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:04.365638 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] Creating event network-vif-deleted:ef11184e-cfd1-4d3f-b5fd-737358b71829 for instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d on n-h1-772273-9 Oct 11 01:18:04.370496 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fa69cdbf-5e98-4823-a0f9-d677dea82bd2 req-013ab1df-780a-4032-bcea-07abb7d699ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047665 Oct 11 01:18:04.374513 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 171/346] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:04.379961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6af7dda9-128c-474b-8937-124128da43e6 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2479f39e72ae4f0b9f0ec335d2ac1493"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:04.407796 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ce59b0dc-1674-4e33-8e77-b242773e71f2 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] HTTP exception thrown: Image not found. Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce59b0dc-1674-4e33-8e77-b242773e71f2 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Request method failure captured: Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/images/3e49b835-c92b-4625-99a7-9d8ecce4a4f9/metadata HTTP/1.1 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 57 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRKDdJtvbRHFuMbWHls2laPqyk-TGcBFbsYIiT4l7ChDGdEAlRwlrl8uJPHtB9W8624PtJT5Y_uqQ1okuQL9zs3TZWkv8kR3aX2h496LQSQQJFwGfvK83ITup3hZnL3Z9gs2bIcAEYPxvgKr3MPCxdxIhmO8XEyBKI6UZ4ipAEU4K8 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:04.410091 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a050e763df8a4ac28fcf78ef61b4a063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a050e763df8a4ac28fcf78ef61b4a063 Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188 Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a3a73272a7024a2ab0551419d4c1ff89 Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1818150188-project Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:18:04.412208 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'image_id': '3e49b835-c92b-4625-99a7-9d8ecce4a4f9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.413160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3e49b835-c92b-4625-99a7-9d8ecce4a4f9 Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:04.415558 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e49b835-c92b-4625-99a7-9d8ecce4a4f9 could not be found. Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:04.416867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:04.418755 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:04.420748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce59b0dc-1674-4e33-8e77-b242773e71f2 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:04.420748 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce59b0dc-1674-4e33-8e77-b242773e71f2 tempest-ImagesMetadataNegativeTestJSON-1818150188 tempest-ImagesMetadataNegativeTestJSON-1818150188-project] 10.222.0.66 "POST /compute/v2.1/images/3e49b835-c92b-4625-99a7-9d8ecce4a4f9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074593 Oct 11 01:18:04.420748 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 176/347] 10.222.0.66 () {60 vars in 1281 bytes} [Tue Oct 11 01:18:04 2022] POST /compute/v2.1/images/3e49b835-c92b-4625-99a7-9d8ecce4a4f9/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:04.875670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8c652ac-ab95-4121-bd89-b973094346b4 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1318796890", "id": 1331668871, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:04.902642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8c652ac-ab95-4121-bd89-b973094346b4 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.343918 Oct 11 01:18:04.903665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 177/348] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:18:04 2022] POST /compute/v2.1/flavors => generated 471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:18:04.909148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:04.910163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:04.917009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:04.917747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:04.918323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:04.919176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:04.919804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:04.920506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:04.921168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6af7dda9-128c-474b-8937-124128da43e6 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/53195361/action" status: 200 len: 21 microversion: 2.1 time: 0.545190 Oct 11 01:18:04.927300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 172/349] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:18:04 2022] POST /compute/v2.1/flavors/53195361/action => generated 21 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:18:04.934489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b99aeada-3ab5-4f36-91e1-44030837ab3b tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:05.125650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:05.143834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3a997d2-b84c-48b8-a433-ebc1da2a8b21 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.235555 Oct 11 01:18:05.146355 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b99aeada-3ab5-4f36-91e1-44030837ab3b tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1331668871/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.215812 Oct 11 01:18:05.147873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 178/350] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:04 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.156715 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 173/351] 10.222.0.66 () {62 vars in 1265 bytes} [Tue Oct 11 01:18:04 2022] POST /compute/v2.1/flavors/1331668871/os-extra_specs => generated 62 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.160723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6cab92a-d22d-4155-8ccd-60d822b3f94c tempest-FlavorsAccessTestJSON-678023189 tempest-FlavorsAccessTestJSON-678023189-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.175372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.179207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:05.194739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.195907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.197773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.200390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.202112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.203656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.213030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6cab92a-d22d-4155-8ccd-60d822b3f94c tempest-FlavorsAccessTestJSON-678023189 tempest-FlavorsAccessTestJSON-678023189-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6242 microversion: 2.1 time: 0.063848 Oct 11 01:18:05.213647 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 179/352] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/flavors/detail => generated 6242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.231194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28ce5d32-189f-45d3-a93a-146d692ba1b9 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.275942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.276689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.277123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.278300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lazy-loading 'fault' on Instance uuid 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:05.293551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28ce5d32-189f-45d3-a93a-146d692ba1b9 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1331668871" status: 202 len: 0 microversion: 2.86 time: 0.078815 Oct 11 01:18:05.294147 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 180/353] 10.222.0.66 () {60 vars in 1202 bytes} [Tue Oct 11 01:18:05 2022] DELETE /compute/v2.1/flavors/1331668871 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:05.307300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5b8ada8-5c5a-46fb-98ca-c1b74057a717 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.329876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5b8ada8-5c5a-46fb-98ca-c1b74057a717 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/53195361" status: 202 len: 0 microversion: 2.1 time: 0.030010 Oct 11 01:18:05.331070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 181/354] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:18:05 2022] DELETE /compute/v2.1/flavors/53195361 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:05.337535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.338337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:05.339742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b97feb0d1432b8e5de7e19fb68454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc916a1348664647a2a632c659f238cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:05.345319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.345808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.346529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.347426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.348025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4972aff-bd83-4b04-95a5-f30147fef81b tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 200 len: 1309 microversion: 2.1 time: 0.194240 Oct 11 01:18:05.348158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.349020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.349295 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 174/355] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.357959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31a1829e-6acb-44b4-80c0-a714aa6ab837 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.411671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31a1829e-6acb-44b4-80c0-a714aa6ab837 tempest-FlavorMetadataValidation-379463434 tempest-FlavorMetadataValidation-379463434-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.058060 Oct 11 01:18:05.412112 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 175/356] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:05.418844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23e9a0b5-3fef-4512-9c96-0399ab3423c7 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.454835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23e9a0b5-3fef-4512-9c96-0399ab3423c7 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041639 Oct 11 01:18:05.456162 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 176/357] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.484315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82adbb94-1972-4828-bd51-cc41a2ecd9c4 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1913131951", "id": 825549147, "os-flavor-access:is_public": "False"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:05.550017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:05.553237 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82adbb94-1972-4828-bd51-cc41a2ecd9c4 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.077517 Oct 11 01:18:05.554211 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 177/358] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:05 2022] POST /compute/v2.1/flavors => generated 428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:05.559006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eabe3dd1-ea1f-4b80-ad5c-06cafaf05871 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1495 microversion: 2.1 time: 0.226473 Oct 11 01:18:05.559989 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 182/359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1495 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.566247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83d557c7-48d5-4533-a3ad-da0ef90d057a tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.584440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:05.594628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83d557c7-48d5-4533-a3ad-da0ef90d057a tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/825549147/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032485 Oct 11 01:18:05.595215 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 178/360] 10.222.0.66 () {58 vars in 1206 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/flavors/825549147/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:18:05.606184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04fb4bab-9c8c-420a-ab7f-390ea89cde68 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.633605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04fb4bab-9c8c-420a-ab7f-390ea89cde68 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/825549147" status: 202 len: 0 microversion: 2.1 time: 0.031176 Oct 11 01:18:05.636288 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 179/361] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:18:05 2022] DELETE /compute/v2.1/flavors/825549147 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:05.646456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92a28d0c-454f-4a6a-a1a2-37d784ca1fb0 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.673227 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92a28d0c-454f-4a6a-a1a2-37d784ca1fb0 tempest-FlavorsAccessTestJSON-1334245550 tempest-FlavorsAccessTestJSON-1334245550-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031807 Oct 11 01:18:05.675606 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 180/362] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:05.702295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:05.739783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=43 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:05.919946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:05.920554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:05.927135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.927690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.928127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:05.928823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:05.929277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:05.929705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.095767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf0defc4-6c1a-4569-b552-abc0f7e1f5d1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1646 microversion: 2.1 time: 0.515616 Oct 11 01:18:06.096938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 183/363] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:05 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1646 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:06.118375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:06.119219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:06.125319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.126154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.126766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.127658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.128319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.128712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.280467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b90e49c-4165-4003-b535-d2ebb785ce9f tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1646 microversion: 2.1 time: 0.165887 Oct 11 01:18:06.283391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 184/364] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:06 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1646 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:06.288220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:06.288845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:06.295274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.295780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.296215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.297183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.297886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.298523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.362376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1940121965", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:06.481785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:06.502249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:06.511829 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ece017b-5e9e-44f7-bf81-25683aebb011 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.227314 Oct 11 01:18:06.515968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 185/365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:06 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:06.520727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:06.533990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.534484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.535319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.541804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.542866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.543654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.554360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:06.579304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30eebaa7-8f92-4506-9a2a-5282a8561387 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062083 Oct 11 01:18:06.581556 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 186/366] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:18:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:06.593148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:06.594846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:06.610837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.612613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.613094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.613830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.626346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.627291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.678602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d HTTP/1.1 Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:06.680261 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:06.681440 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4e8ff945-91aa-4c4c-9bb4-e12f2184be0d'} Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:06.682105 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:06.683221 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:06.694984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:06.694984 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2aff4356-ce27-4727-a801-eec66a68c46f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 404 len: 111 microversion: 2.1 time: 0.100226 Oct 11 01:18:06.694984 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 187/367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:06 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:06.707530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": true, "disk_over_commit": false}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:06.710047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:06.734042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.734557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.738021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.740496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.740984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.765954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.786774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:06.869886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=44 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:06.938467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lazy-loading 'flavor' on Instance uuid 14fb6b75-af88-4705-a346-11b2319f09f5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:06.941827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:06.942292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:06.943024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:06.943462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:06.944351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:06.962844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.964726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.965867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:06.967232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:06.969407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:06.970056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:07.006791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Getting quotas for project 0957aad6b14547dd892fe171de611a15. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:07.012817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Getting quotas for user 93b9e02b63f1440d9d7bddfb6aa458f4 and project 0957aad6b14547dd892fe171de611a15. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:07.027589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120493) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:18:07.045071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:07.048484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:07.119123 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5c57c3b-ea0d-4c90-af11-155277b5a90b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109201 Oct 11 01:18:07.127880 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 181/368] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:18:07.134043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:07.134822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:07.142512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:07.143504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:07.144160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:07.145245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:07.146592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:07.147194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:07.174311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d HTTP/1.1 Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:07.177122 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:07.178333 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4e8ff945-91aa-4c4c-9bb4-e12f2184be0d'} Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:07.179052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:07.180141 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:07.182488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:07.183442 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c08a64b-45d3-46aa-9501-3b3c2971f3c4 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 404 len: 111 microversion: 2.1 time: 0.054142 Oct 11 01:18:07.184221 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 182/369] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:07 2022] DELETE /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:07.200045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d307da28-8744-4eda-ad4b-0f2b8ae97ca2", "name": "network-vif-plugged", "status": "completed", "tag": "6aac5abb-8ec6-4f52-b762-2b7839d7cf40"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:07.216176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:07.222960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:07.224027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:07.250607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] Creating event network-vif-plugged:6aac5abb-8ec6-4f52-b762-2b7839d7cf40 for instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 on n-h2-772273-9 Oct 11 01:18:07.256474 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-94631782-1d79-4c3e-bf33-c7a5baf1632e req-ca606072-69b0-4ad8-918c-5b4643424ef0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070883 Oct 11 01:18:07.261753 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 183/370] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:07.269918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4461c76-5709-4854-875c-f285d7a9262e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:07.271973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4461c76-5709-4854-875c-f285d7a9262e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:07.439061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4461c76-5709-4854-875c-f285d7a9262e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:07.449399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4461c76-5709-4854-875c-f285d7a9262e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1222 microversion: 2.1 time: 0.184954 Oct 11 01:18:07.454154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 184/371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:07 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:07.999171 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24a81d9f-10a2-4952-9df1-699e0bf5e033 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.543426 Oct 11 01:18:07.999953 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 185/372] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:18:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 545 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 01:18:08.013016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.015842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:08.033791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.035702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.036788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.037701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.038388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.039008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.057940 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d HTTP/1.1 Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.060289 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:08.061505 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4e8ff945-91aa-4c4c-9bb4-e12f2184be0d'} Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.062170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. Oct 11 01:18:08.065341 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.070381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance 4e8ff945-91aa-4c4c-9bb4-e12f2184be0d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.071507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa02dbf4-5453-42f4-9d8d-0f2bc0f76b6c tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d" status: 404 len: 111 microversion: 2.1 time: 0.065450 Oct 11 01:18:08.075982 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 186/373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] GET /compute/v2.1/servers/4e8ff945-91aa-4c4c-9bb4-e12f2184be0d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:08.084281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.085266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:08.092306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.094116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.094697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.095528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.096491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.097093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.285778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:08.311884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af4379a1-c9a4-4889-855b-2a27f13f738d tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1319 microversion: 2.1 time: 0.234430 Oct 11 01:18:08.313647 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 187/374] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:08.331224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1dbc2661-9fb9-48d9-9ead-f09a3a584242 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Calling method '.version_select at 0x7f1134cb4940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.375715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1dbc2661-9fb9-48d9-9ead-f09a3a584242 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] HTTP exception thrown: Image not found. Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1dbc2661-9fb9-48d9-9ead-f09a3a584242 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Request method failure captured: Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRPwp09ECzwQ5VUnrCz3f9SzOktUI2FdITcmBtSsXbj6HDIwN2AcjmlDewIGt4Kku-5MfIm2jRmNrPnI2dpX3jEQUoqmfWQ8PJvHKZpOUwwJYlKQit-pPj2TM5AmSTMlJEBYwUA6zfrcHGDFFyRS5HJpVt1ZZlcJv5E-ro0BT1XCK8 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.377608 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_02a08e2fc20841efa67724ceb466492d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0bd9aaa458f146f78e8bdc69d09431c1 Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '-1'} Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.378865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.379720 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.380757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:08.381800 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.383306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1dbc2661-9fb9-48d9-9ead-f09a3a584242 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.384208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1dbc2661-9fb9-48d9-9ead-f09a3a584242 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068331 Oct 11 01:18:08.384771 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 188/375] 10.222.0.66 () {58 vars in 1134 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:08.392399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.393113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:08.402155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.403596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.405634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.406744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.410093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.411451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.442123 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 HTTP/1.1 Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.447318 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.448816 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b96acba1-3fc3-46ad-b1d5-eb9cb655c801'} Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.449484 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.450532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.452132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.453035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30784efb-01da-48a1-bf04-ee6352e96db1 tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 404 len: 111 microversion: 2.1 time: 0.067189 Oct 11 01:18:08.453784 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 189/376] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:08.468098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-add014c5-e062-44e7-b6c5-401ce8d9f237 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Calling method '.version_select at 0x7f1134e9e9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.499800 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-add014c5-e062-44e7-b6c5-401ce8d9f237 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] HTTP exception thrown: Image not found. Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-add014c5-e062-44e7-b6c5-401ce8d9f237 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Request method failure captured: Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/25c3046b-cce3-489c-a92f-a7dffec91d6j HTTP/1.1 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRPwp09ECzwQ5VUnrCz3f9SzOktUI2FdITcmBtSsXbj6HDIwN2AcjmlDewIGt4Kku-5MfIm2jRmNrPnI2dpX3jEQUoqmfWQ8PJvHKZpOUwwJYlKQit-pPj2TM5AmSTMlJEBYwUA6zfrcHGDFFyRS5HJpVt1ZZlcJv5E-ro0BT1XCK8 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.501740 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_02a08e2fc20841efa67724ceb466492d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0bd9aaa458f146f78e8bdc69d09431c1 Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '25c3046b-cce3-489c-a92f-a7dffec91d6j'} Oct 11 01:18:08.503274 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 25c3046b-cce3-489c-a92f-a7dffec91d6j to delete Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.504172 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25c3046b-cce3-489c-a92f-a7dffec91d6j could not be found. Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.505224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-add014c5-e062-44e7-b6c5-401ce8d9f237 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.506270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-add014c5-e062-44e7-b6c5-401ce8d9f237 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/25c3046b-cce3-489c-a92f-a7dffec91d6j" status: 404 len: 62 microversion: 2.1 time: 0.042707 Oct 11 01:18:08.507068 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 190/377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/images/25c3046b-cce3-489c-a92f-a7dffec91d6j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:08.511999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.512613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] [instance: b96acba1-3fc3-46ad-b1d5-eb9cb655c801] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:08.520059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.520589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.521029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.521742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.522198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.522620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.547862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] HTTP exception thrown: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Request method failure captured: Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 HTTP/1.1 Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQKtgnnVP4zJfJVq8gbVULSKTLOAwIkZua-vDh2W77EDSGrWrAX1VLoH1yML1OHITsOQerx2u-xiGXgC2pads_kE3VNlZMVEZOujv8b7GCmz2GTGXP5odXyOuPbT-BIIK2r0jr4ClNFAvxhFdEawfnwBMpitE_D9xiQf0O0h1m7XBU Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.550192 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc916a1348664647a2a632c659f238cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc916a1348664647a2a632c659f238cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc916a1348664647a2a632c659f238cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: dc916a1348664647a2a632c659f238cd Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-533996637 Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6a8b97feb0d1432b8e5de7e19fb68454 Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersAdminTestJSON-533996637-project Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.552025 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b96acba1-3fc3-46ad-b1d5-eb9cb655c801'} Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.552777 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. Oct 11 01:18:08.553853 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.554805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] Returning 404 to user: Instance b96acba1-3fc3-46ad-b1d5-eb9cb655c801 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.554805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8b05239-1c36-4980-b6db-ee2139cb6f2f tempest-DeleteServersAdminTestJSON-533996637 tempest-DeleteServersAdminTestJSON-533996637-project] 10.222.0.66 "GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801" status: 404 len: 111 microversion: 2.1 time: 0.048210 Oct 11 01:18:08.554805 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 191/378] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] GET /compute/v2.1/servers/b96acba1-3fc3-46ad-b1d5-eb9cb655c801 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:08.573195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.573679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:08.595887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.596434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.599332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.600442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:08.601247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:08.601697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:08.680713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:08.693258 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a37c2e1c-c078-42d4-bda7-8c838cb43107 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1274 microversion: 2.1 time: 0.138279 Oct 11 01:18:08.694557 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 192/379] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:08.715435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a219372-0a01-427b-883b-44e294fcedb8 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Calling method '.version_select at 0x7f1134ca4790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.741775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3a219372-0a01-427b-883b-44e294fcedb8 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] HTTP exception thrown: Image not found. Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a219372-0a01-427b-883b-44e294fcedb8 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Request method failure captured: Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/8ba68b2a-2b94-4e02-a006-8fc30158b5b91 HTTP/1.1 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRPwp09ECzwQ5VUnrCz3f9SzOktUI2FdITcmBtSsXbj6HDIwN2AcjmlDewIGt4Kku-5MfIm2jRmNrPnI2dpX3jEQUoqmfWQ8PJvHKZpOUwwJYlKQit-pPj2TM5AmSTMlJEBYwUA6zfrcHGDFFyRS5HJpVt1ZZlcJv5E-ro0BT1XCK8 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.743997 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_02a08e2fc20841efa67724ceb466492d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0bd9aaa458f146f78e8bdc69d09431c1 Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '8ba68b2a-2b94-4e02-a006-8fc30158b5b91'} Oct 11 01:18:08.745190 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ba68b2a-2b94-4e02-a006-8fc30158b5b91 to delete Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.745900 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ba68b2a-2b94-4e02-a006-8fc30158b5b91 could not be found. Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.746898 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:08.748087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.751193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a219372-0a01-427b-883b-44e294fcedb8 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.752165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a219372-0a01-427b-883b-44e294fcedb8 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/8ba68b2a-2b94-4e02-a006-8fc30158b5b91" status: 404 len: 62 microversion: 2.1 time: 0.056433 Oct 11 01:18:08.752892 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 193/380] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/images/8ba68b2a-2b94-4e02-a006-8fc30158b5b91 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:08.768711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f75507a-53d4-427b-b92c-74209cd4db4f tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Calling method '.version_select at 0x7f1134cb4040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.795274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5f75507a-53d4-427b-b92c-74209cd4db4f tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] HTTP exception thrown: Image not found. Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f75507a-53d4-427b-b92c-74209cd4db4f tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Request method failure captured: Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/tempest-invalid-110816843 HTTP/1.1 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRPwp09ECzwQ5VUnrCz3f9SzOktUI2FdITcmBtSsXbj6HDIwN2AcjmlDewIGt4Kku-5MfIm2jRmNrPnI2dpX3jEQUoqmfWQ8PJvHKZpOUwwJYlKQit-pPj2TM5AmSTMlJEBYwUA6zfrcHGDFFyRS5HJpVt1ZZlcJv5E-ro0BT1XCK8 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.797468 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_02a08e2fc20841efa67724ceb466492d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0bd9aaa458f146f78e8bdc69d09431c1 Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'tempest-invalid-110816843'} Oct 11 01:18:08.798821 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-110816843 to delete Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.799619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-110816843 could not be found. Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.800822 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:08.804158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.807084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f75507a-53d4-427b-b92c-74209cd4db4f tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.808589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f75507a-53d4-427b-b92c-74209cd4db4f tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/tempest-invalid-110816843" status: 404 len: 62 microversion: 2.1 time: 0.049562 Oct 11 01:18:08.810296 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 194/381] 10.222.0.66 () {58 vars in 1203 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/images/tempest-invalid-110816843 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 01:18:08.823220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-959fbbc3-31d5-4247-a738-f8827cd53007 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Calling method '.version_select at 0x7f1134ca4310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:08.861999 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-959fbbc3-31d5-4247-a738-f8827cd53007 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] HTTP exception thrown: Image not found. Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-959fbbc3-31d5-4247-a738-f8827cd53007 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Request method failure captured: Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/435a0d59-6b4a-4a09-b860-8baf1dd7f517 HTTP/1.1 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRPwp09ECzwQ5VUnrCz3f9SzOktUI2FdITcmBtSsXbj6HDIwN2AcjmlDewIGt4Kku-5MfIm2jRmNrPnI2dpX3jEQUoqmfWQ8PJvHKZpOUwwJYlKQit-pPj2TM5AmSTMlJEBYwUA6zfrcHGDFFyRS5HJpVt1ZZlcJv5E-ro0BT1XCK8 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:08.864369 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_02a08e2fc20841efa67724ceb466492d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/02a08e2fc20841efa67724ceb466492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 02a08e2fc20841efa67724ceb466492d Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616 Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0bd9aaa458f146f78e8bdc69d09431c1 Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1987043616-project Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '435a0d59-6b4a-4a09-b860-8baf1dd7f517'} Oct 11 01:18:08.865656 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 435a0d59-6b4a-4a09-b860-8baf1dd7f517 to delete Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.866351 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 435a0d59-6b4a-4a09-b860-8baf1dd7f517 could not be found. Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:08.867367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-959fbbc3-31d5-4247-a738-f8827cd53007 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:08.868421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-959fbbc3-31d5-4247-a738-f8827cd53007 tempest-ImagesDeleteNegativeTestJSON-1987043616 tempest-ImagesDeleteNegativeTestJSON-1987043616-project] 10.222.0.66 "DELETE /compute/v2.1/images/435a0d59-6b4a-4a09-b860-8baf1dd7f517" status: 404 len: 62 microversion: 2.1 time: 0.048644 Oct 11 01:18:08.872274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 195/382] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:08 2022] DELETE /compute/v2.1/images/435a0d59-6b4a-4a09-b860-8baf1dd7f517 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:09.348703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:09.349331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:09.368306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.368832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.369278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:09.370004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.370445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.370874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:09.567814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:09.579635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5938cda0-9356-4ea6-a5f3-089da8f07af6 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1469 microversion: 2.1 time: 0.243210 Oct 11 01:18:09.580273 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 196/383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:09 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:09.602531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:09.603035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:09.609464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.610153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.610954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:09.611915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.613076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.614788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:09.653351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lazy-loading 'flavor' on Instance uuid d307da28-8744-4eda-ad4b-0f2b8ae97ca2 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:09.742080 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-647f7049-e43b-4d78-b023-5c4fd70e155c tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2/action" status: 202 len: 0 microversion: 2.1 time: 0.142678 Oct 11 01:18:09.742761 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 197/384] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:09 2022] POST /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:18:09.753605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:09.754869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:09.769768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.770297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.770738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:09.779117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:09.779956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:09.781818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:10.087408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:10.097671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce0fb0ae-334d-45e2-a43c-56c84c531f30 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.353683 Oct 11 01:18:10.099356 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 198/385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:09 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:10.124425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:10.125396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:10.151437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:10.152233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:10.155513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:10.156556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:10.157881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:10.158882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:10.480302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:10.490978 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f1ecaa5-a3fd-4acb-abfa-ae1c105bf698 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1477 microversion: 2.1 time: 0.376448 Oct 11 01:18:10.491649 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 199/386] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:10 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:10.929624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9c605c-02d8-4da7-a1de-a9fe8d49841e", "tag": "4b65e650-17a9-4853-9e0e-1d02e1458d50"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:10.944685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:10.948129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:10.951706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:10.962382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:10.980461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] Creating event network-changed:4b65e650-17a9-4853-9e0e-1d02e1458d50 for instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e on n-h1-772273-9 Oct 11 01:18:10.998635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6286dd15-5062-40ee-a19c-529849896970 req-fab9be2f-c852-4965-a319-c0140b57e17d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072983 Oct 11 01:18:11.003632 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 200/387] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:11.125395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:11.126438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:11.138582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.139075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.139551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.140254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.140714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.141143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.374981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8a5b3cf-ef93-4080-a608-85a648ba06a2 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5/action" status: 202 len: 0 microversion: 2.1 time: 4.682402 Oct 11 01:18:11.375814 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 188/388] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:06 2022] POST /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5/action => generated 0 bytes in 4684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:11.385089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:11.386095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:11.397311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:11.406328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.409287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a780cb32-8384-4913-9fe3-21ee65e937f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.287790 Oct 11 01:18:11.410077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.424907 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 201/389] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:11 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:11.425182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.432791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.433454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.439842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.513290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:11.514317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:11.524171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.531504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.531966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.532720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.533182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.533619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.824927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:11.838596 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55f78b0b-45be-484b-b975-78730f68a7ae tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.455492 Oct 11 01:18:11.838596 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 189/390] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:11 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:11.896248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:11.910509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a2039cd-5b1b-40b2-b4f0-839a6e3cb11e tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1460 microversion: 2.1 time: 0.400944 Oct 11 01:18:11.912362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 202/391] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:11 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1460 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:11.939087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:11.941192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:11.949798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.950804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.951366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:11.952267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:11.952806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:11.953501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.293304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134a8f5e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.295066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.295576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.296155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.311837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.312592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.313220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.327408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.327901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.328339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.334325 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbf29bee-eda2-4472-b45d-a763ecd783dd tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.495227 Oct 11 01:18:12.334907 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 190/392] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:12.347547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134a8fc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.350215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.350699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.351131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.371443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.372390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.373908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.390298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.391892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.392553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.396525 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40392189-fc23-45a5-82e2-c6881414e179 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1611 microversion: 2.1 time: 0.463809 Oct 11 01:18:12.411379 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 203/393] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:11 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1611 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:12.423561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34b5304a-01aa-4f9e-82fc-f508614138da tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.080267 Oct 11 01:18:12.425638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.429935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.431024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.431880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.432969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.433798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.434382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.435539 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 191/394] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:12.445094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.445835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:12.455184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.455728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.456162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.457880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.458505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.459671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.484068 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd91c4c4-6720-4b62-bdd8-ca3291cf3257 tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062443 Oct 11 01:18:12.486196 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 204/395] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:12.499947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134c290d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.503300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.504260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.504743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.520341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.520829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.521265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.531947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.532726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.533348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.540303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2edf2f0-cddc-4fe3-ae7f-b0f2b9ca0670 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052637 Oct 11 01:18:12.550049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 205/396] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:12.554364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-772273-9", "block_migration": true, "disk_over_commit": false}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:12.558585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:12.564538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.565022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.565661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.566742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.567365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.568036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.596133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Lazy-loading 'flavor' on Instance uuid d307da28-8744-4eda-ad4b-0f2b8ae97ca2 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:12.611145 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 while it is in vm_state suspended Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Request method failure captured: Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2/action HTTP/1.1 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 97 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQbN6g4hnlF2ZWYpMInE51lTnwSqrDopvsoGC8d62c1aKCSsi8wRgnw19NSnWbCQFWI1JWXjs7R92oFxeS9fQty3kncWrHE0Zx8syJj3tkMFfOZ_GKe23Xk-SjSAhByFK1D9jqaHesHx1PoIQtdQP_eFdKzrc7t1jjgD3OwvuZzgh0 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: db86466a811245ac80a97261bdedd26c Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:18:12.613526 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/db86466a811245ac80a97261bdedd26c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_db86466a811245ac80a97261bdedd26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/db86466a811245ac80a97261bdedd26c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/db86466a811245ac80a97261bdedd26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: db86466a811245ac80a97261bdedd26c Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1907155810 Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveMigrationNegativeTest-1907155810-project-admin Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 267ade580c324813834f0ffad72b3ac9 Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveMigrationNegativeTest-1907155810-project-admin Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: {"os-migrateLive": {"host": "n-h1-772273-9", "block_migration": true, "disk_over_commit": false}} Oct 11 01:18:12.614717 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'os-migrateLive' instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 while it is in vm_state suspended Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd307da28-8744-4eda-ad4b-0f2b8ae97ca2', 'body': {'os-migrateLive': {'host': 'n-h1-772273-9', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 01:18:12.615449 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:12.616408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 while it is in vm_state suspended Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 while it is in vm_state suspended Oct 11 01:18:12.617474 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:12.619959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 while it is in vm_state suspended {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:12.621099 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd3cc775-0a01-4d11-a9c0-22e27547912b tempest-LiveMigrationNegativeTest-1907155810 tempest-LiveMigrationNegativeTest-1907155810-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2/action" status: 409 len: 155 microversion: 2.1 time: 0.072252 Oct 11 01:18:12.622191 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 206/397] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:12 2022] POST /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:12.631997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134ca4ee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.634017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.634693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.635324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.655374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.656064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.656979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.665221 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7895acc5-ea76-4d93-a134-1ec8227191c7 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036687 Oct 11 01:18:12.667059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 207/398] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:12.672107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.672792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:12.682728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.683225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.685429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.686060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.686521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.686946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.751529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:18:12.856111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:12.876577 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5a1d960-f294-452d-a45e-86792e2be43c tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.438822 Oct 11 01:18:12.877524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 192/399] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:12.885256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-584d800f-20f9-4c98-880e-b22f00c99f3d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134c0cc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.887667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-584d800f-20f9-4c98-880e-b22f00c99f3d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.888680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-584d800f-20f9-4c98-880e-b22f00c99f3d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.889865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-584d800f-20f9-4c98-880e-b22f00c99f3d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.910372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82e05785-522b-43d2-9355-e4fb7f7b37f9 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 204 len: 0 microversion: 2.1 time: 0.240851 Oct 11 01:18:12.912306 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 208/400] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:12 2022] DELETE /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:12.913631 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-584d800f-20f9-4c98-880e-b22f00c99f3d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.032319 Oct 11 01:18:12.922389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 193/401] 10.222.0.66 () {58 vars in 1179 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:12.928036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:12.928887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:12.936858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.937556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.938184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:12.939728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:12.940557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:12.941172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.190291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac1ef7f7-8a20-4c7e-85ca-0ef24d318e28 tempest-ListImageFiltersNegativeTestJSON-1533175362 tempest-ListImageFiltersNegativeTestJSON-1533175362-project] Calling method '.version_select at 0x7f1134d978b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.204981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:13.223945 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60dcbce1-0622-4252-9118-1902eec86816 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.300068 Oct 11 01:18:13.225185 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 194/402] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:13.228915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ac1ef7f7-8a20-4c7e-85ca-0ef24d318e28 tempest-ListImageFiltersNegativeTestJSON-1533175362 tempest-ListImageFiltersNegativeTestJSON-1533175362-project] HTTP exception thrown: Image not found. Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac1ef7f7-8a20-4c7e-85ca-0ef24d318e28 tempest-ListImageFiltersNegativeTestJSON-1533175362 tempest-ListImageFiltersNegativeTestJSON-1533175362-project] Request method failure captured: Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/images/c3716756-8421-40ea-8177-5e1b1be03f23 HTTP/1.1 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRUtAvuvRfPTGWpeC4SRRHTzD0hLq8DU2x86Wpq7OwmziMgUBU6_wUuGTzd4-Z-0VZNK2zrHak_p6i0zEulrSS3dPpvr6uSAiAcH97yPE4-YCadoRARUjQXl4FdTu0SXZArIBE0LzNjt6LjZSZtvlpO7LNz8LDnHvoMu9ePO9xRAD8 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2821e40cb4084c5b9a4ba093a21ef864 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1533175362 Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:13.231567 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2821e40cb4084c5b9a4ba093a21ef864"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2821e40cb4084c5b9a4ba093a21ef864"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2821e40cb4084c5b9a4ba093a21ef864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2821e40cb4084c5b9a4ba093a21ef864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1533175362 Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2821e40cb4084c5b9a4ba093a21ef864 Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1533175362 Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ListImageFiltersNegativeTestJSON-1533175362-project Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7755daa3d3114b33a8decef8e5a89e9e Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1533175362-project Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c3716756-8421-40ea-8177-5e1b1be03f23'} Oct 11 01:18:13.232792 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:13.233758 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c3716756-8421-40ea-8177-5e1b1be03f23 Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:18:13.234821 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3716756-8421-40ea-8177-5e1b1be03f23 could not be found. Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:13.237131 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:13.240482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac1ef7f7-8a20-4c7e-85ca-0ef24d318e28 tempest-ListImageFiltersNegativeTestJSON-1533175362 tempest-ListImageFiltersNegativeTestJSON-1533175362-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:13.242635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac1ef7f7-8a20-4c7e-85ca-0ef24d318e28 tempest-ListImageFiltersNegativeTestJSON-1533175362 tempest-ListImageFiltersNegativeTestJSON-1533175362-project] 10.222.0.66 "GET /compute/v2.1/images/c3716756-8421-40ea-8177-5e1b1be03f23" status: 404 len: 62 microversion: 2.1 time: 0.318394 Oct 11 01:18:13.242635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 209/403] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:18:12 2022] GET /compute/v2.1/images/c3716756-8421-40ea-8177-5e1b1be03f23 => generated 62 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:13.245249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.246876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:13.263970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.264981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.267998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.269056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.270309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.271474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.530072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:13.540676 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-74098573-e0f4-4fa5-8fc5-3bc32ba1b2d2 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1466 microversion: 2.1 time: 0.305547 Oct 11 01:18:13.555367 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 210/404] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:13.556082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134c29e50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.561413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.562735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.563517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.585396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.586455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.587052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.600905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.602005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.602628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.611153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0fe49d1d-b6d7-4501-a4aa-14a8083f4d58 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061640 Oct 11 01:18:13.612963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 211/405] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:13.617874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fb6b75-af88-4705-a346-11b2319f09f5", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc0a7c5-e120-4cc9-bd46-ea705d703f0a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:13.630189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.630889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.631529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.644238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] Creating event network-vif-unplugged:bdc0a7c5-e120-4cc9-bd46-ea705d703f0a for instance 14fb6b75-af88-4705-a346-11b2319f09f5 on n-h1-772273-9 Oct 11 01:18:13.654503 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-edf0d79a-a3a0-417f-907d-13368a760e8e req-5924563f-bb70-469d-bf35-c098bb38db68 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040083 Oct 11 01:18:13.656963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 212/406] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:13.663692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134ca4f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.665569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.666216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.667133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.688791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.689571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.690180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.698354 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5310941f-e163-440a-9a9b-59e455d7480d tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.040204 Oct 11 01:18:13.700439 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 213/407] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:13.718732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134ca4430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.722026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.722916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.724114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.730523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-336273e8-2e63-4b02-a90e-440ce6a134fc tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1022876701", "id": 230379903, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:13.752681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.753468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.755063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.762368 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f88a40f5-5e6f-4869-82c0-96cb34c735d3 tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.050179 Oct 11 01:18:13.763813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 214/408] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:13.773428 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-336273e8-2e63-4b02-a90e-440ce6a134fc tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.546237 Oct 11 01:18:13.774361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 195/409] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:18:13 2022] POST /compute/v2.1/flavors => generated 465 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:13.779098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Calling method '.version_select at 0x7f1134ca4d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.781171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.781627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.782116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.795166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.795704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.796126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.808238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.808780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.809220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.839113 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad2dab71-47a1-467d-be5a-390d8fd5114c tempest-HypervisorAdminTestJSON-24843359 tempest-HypervisorAdminTestJSON-24843359-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.064840 Oct 11 01:18:13.840466 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 215/410] 10.222.0.66 () {58 vars in 1173 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:18:13.908514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:13.911252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:13.921646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.922228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.922727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:13.923593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:13.924206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:13.924777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:14.165293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:14.169397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-002b6004-e3d1-4ab4-bf67-258c957373e8 tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.173003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-014e45df-4df0-4730-928d-2a91a43d5d32 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.272361 Oct 11 01:18:14.189782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 216/411] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:14.194314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-002b6004-e3d1-4ab4-bf67-258c957373e8 tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] 10.222.0.66 "GET /compute/v2.1/flavors/230379903" status: 200 len: 465 microversion: 2.61 time: 0.406399 Oct 11 01:18:14.194882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 196/412] 10.222.0.66 () {60 vars in 1196 bytes} [Tue Oct 11 01:18:13 2022] GET /compute/v2.1/flavors/230379903 => generated 465 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:14.212236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b679efc-67e3-4f3c-b8d0-3c95643a221a tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] Action: 'update', calling method: .version_select at 0x7f11362c4040>, body: {"flavor": {"description": "new"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:14.242795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:14.257102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.257851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:14.264668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:14.266427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:14.267181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:14.268070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:14.268685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:14.269528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:14.280560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b679efc-67e3-4f3c-b8d0-3c95643a221a tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/230379903" status: 200 len: 466 microversion: 2.61 time: 0.072138 Oct 11 01:18:14.290040 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 217/413] 10.222.0.66 () {62 vars in 1216 bytes} [Tue Oct 11 01:18:14 2022] PUT /compute/v2.1/flavors/230379903 => generated 466 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:14.295731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c648b589-e0c2-41c5-b249-9c4296326bb5 tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.332726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c648b589-e0c2-41c5-b249-9c4296326bb5 tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.041579 Oct 11 01:18:14.333350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 218/414] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:14.355933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-846b91d1-f547-4983-975c-f537994c86ab tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.385077 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-846b91d1-f547-4983-975c-f537994c86ab tempest-FlavorsV261TestJSON-1352853740 tempest-FlavorsV261TestJSON-1352853740-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.033132 Oct 11 01:18:14.385677 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 219/415] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:18:14.403042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e96afa01-b33e-4725-b3e5-c08ddc385b2e tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.424260 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e96afa01-b33e-4725-b3e5-c08ddc385b2e tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/230379903" status: 202 len: 0 microversion: 2.61 time: 0.024867 Oct 11 01:18:14.428625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 220/416] 10.222.0.66 () {60 vars in 1199 bytes} [Tue Oct 11 01:18:14 2022] DELETE /compute/v2.1/flavors/230379903 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:14.438615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91600cd0-c6a3-4bd5-8856-ab50cca1ab39 tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.463037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91600cd0-c6a3-4bd5-8856-ab50cca1ab39 tempest-FlavorsV261TestJSON-991238594 tempest-FlavorsV261TestJSON-991238594-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.032075 Oct 11 01:18:14.464074 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 221/417] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:18:14.482225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:14.493237 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2093acf9-5948-406c-a96c-9b5bab29785b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.242579 Oct 11 01:18:14.494710 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 197/418] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:14.564515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:14.565123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:14.574959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:14.575475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:14.575910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:14.576642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:14.577091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:14.577530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:14.904807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:14.917395 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c85d4cb-c814-4e25-a042-2fcf3d38e41c tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1466 microversion: 2.1 time: 0.356624 Oct 11 01:18:14.917991 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 222/419] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1466 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:15.164201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Calling method '.version_select at 0x7f1134b303a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.177803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.178319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.178770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.198904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.200075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:15.221402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.223616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.226521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.227321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.227817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.230061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.232190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.232694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.233855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.293326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.294167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.294595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.308060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.308804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.309466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.346443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.349319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.349975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.357905 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-607f0a96-5620-4702-b71f-93531013c306 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.648040 Oct 11 01:18:15.359935 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 198/420] 10.222.0.66 () {60 vars in 1243 bytes} [Tue Oct 11 01:18:14 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:15.381622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Calling method '.version_select at 0x7f1134a93430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.392178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.393772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.397305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.446612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.447410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.459986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.551784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.556672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.558925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.591748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.593919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.596365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.668459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.669388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.670060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.681398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-509494e0-9e86-4845-9bae-224ced3ce454 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.306330 Oct 11 01:18:15.682961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 199/421] 10.222.0.66 () {60 vars in 1222 bytes} [Tue Oct 11 01:18:15 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:15.688946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.690307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:15.699567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.700138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.700798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.701744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.703201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.703844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.719124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:15.732326 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37b5c010-c983-4123-b2a7-830da24cc4ec tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.538755 Oct 11 01:18:15.734606 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 223/422] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:15 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:15.754954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Calling method '.version_select at 0x7f1134bc4040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.759300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.760299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.760926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.763642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:15.795160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.795740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.796366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.808831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6bfce2ec-1755-49b3-8069-c291a71f4992 tempest-HypervisorAdminV253TestBase-2090904105 tempest-HypervisorAdminV253TestBase-2090904105-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/d5862a23-5c1f-4e46-8ea0-8a1498966004" status: 200 len: 792 microversion: 2.53 time: 0.072537 Oct 11 01:18:15.821273 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 224/423] 10.222.0.66 () {60 vars in 1298 bytes} [Tue Oct 11 01:18:15 2022] GET /compute/v2.1/os-hypervisors/d5862a23-5c1f-4e46-8ea0-8a1498966004 => generated 792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:15.834950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fb6b75-af88-4705-a346-11b2319f09f5", "tag": "bdc0a7c5-e120-4cc9-bd46-ea705d703f0a"}, {"server_uuid": "d307da28-8744-4eda-ad4b-0f2b8ae97ca2", "name": "network-vif-deleted", "tag": "6aac5abb-8ec6-4f52-b762-2b7839d7cf40"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:15.850567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.850666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.851960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.868158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Creating event network-changed:bdc0a7c5-e120-4cc9-bd46-ea705d703f0a for instance 14fb6b75-af88-4705-a346-11b2319f09f5 on n-h1-772273-9 Oct 11 01:18:15.868158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] Creating event network-vif-deleted:6aac5abb-8ec6-4f52-b762-2b7839d7cf40 for instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 on n-h2-772273-9 Oct 11 01:18:15.879640 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0a31f15a-3346-46e9-a482-0a7963bc7e99 req-1a429c0e-f6de-44d2-b293-686db365b658 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056345 Oct 11 01:18:15.880423 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 225/424] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:15.926061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:15.938348 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a649903-ab2c-405f-90c0-115e7427caff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.254035 Oct 11 01:18:15.939119 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 200/425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:15 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:15.941978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:15.942688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:15.955149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.955669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.956469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:15.959615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:15.960083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:15.960669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:16.024038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:16.024635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:16.025077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:16.025527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lazy-loading 'fault' on Instance uuid d307da28-8744-4eda-ad4b-0f2b8ae97ca2 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:16.089845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:16.104928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e78aa11b-17e4-4884-861f-59e7a6f63306 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 200 len: 1309 microversion: 2.1 time: 0.168157 Oct 11 01:18:16.105616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 226/426] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:15 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:16.553654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:16.764131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:16.768346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:16.781111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:16.781802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:16.782606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:16.784491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:16.785806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:16.786478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.031484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:17.040319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9083a81f-d017-4b88-8a73-c9b53d59be8a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.283972 Oct 11 01:18:17.057264 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 227/427] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:16 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:17.065458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c605c-02d8-4da7-a1de-a9fe8d49841e", "name": "network-vif-plugged", "status": "completed", "tag": "4b65e650-17a9-4853-9e0e-1d02e1458d50"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:17.079152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.080053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.080667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.093550 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] Creating event network-vif-plugged:4b65e650-17a9-4853-9e0e-1d02e1458d50 for instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e on n-h1-772273-9 Oct 11 01:18:17.104310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-137547cc-27db-47b3-9f77-ff9aa2bb1734 req-c4c11ada-3047-4ce9-8717-6b5f2ef3c1c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040576 Oct 11 01:18:17.104310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 228/428] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:17.114429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eaaa67b5-755b-41a3-80f8-2d5d3fce826c tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] Calling method '.version_select at 0x7f1134a1b550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.137249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.138134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:17.154581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.155086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.157904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.158636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.159093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.163789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.172659 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eaaa67b5-755b-41a3-80f8-2d5d3fce826c tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] 10.222.0.66 "GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74" status: 200 len: 784 microversion: 2.1 time: 0.651452 Oct 11 01:18:17.173599 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 201/429] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:18:16 2022] GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74 => generated 784 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:17.180182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.181473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: d307da28-8744-4eda-ad4b-0f2b8ae97ca2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:17.189793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.190508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.191476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.192623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.194249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.194873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.258823 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] HTTP exception thrown: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Request method failure captured: Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 HTTP/1.1 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQXkH1BaHYxpJBY5Rm4thnKUQappKHpwvBhCwmD1FUimvL62ZEzhR_zb4ltkeeaV6aW-5CkDHC-IH8Ki2yJEf2ChAG9oHLuVsG9NZabB6opmqqrcOOE7CUuyNCb_rS74K49B38oMhqPkxID7-gpK9vosDYgT4B4RKlJRHVg5FsW69c Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9fae1bc4e02c4092b0d9145917755102 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:17.262060 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9fae1bc4e02c4092b0d9145917755102 Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-LiveMigrationNegativeTest-1029488119-project Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26a642a7da224e16af27c5df40c5fde5 Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-LiveMigrationNegativeTest-1029488119-project Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. Oct 11 01:18:17.263315 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd307da28-8744-4eda-ad4b-0f2b8ae97ca2'} Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:17.264049 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. Oct 11 01:18:17.265101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:17.276246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Returning 404 to user: Instance d307da28-8744-4eda-ad4b-0f2b8ae97ca2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:17.277515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29d62c91-7446-4089-b34d-e6fe8ca70183 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2" status: 404 len: 111 microversion: 2.1 time: 0.102905 Oct 11 01:18:17.278096 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 202/430] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:17 2022] GET /compute/v2.1/servers/d307da28-8744-4eda-ad4b-0f2b8ae97ca2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:17.282933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27f0f1d5-b090-4b14-96cd-67f57227a680 tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] Calling method '.version_select at 0x7f1134b30ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.434510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27f0f1d5-b090-4b14-96cd-67f57227a680 tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] 10.222.0.66 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.155262 Oct 11 01:18:17.435904 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 203/431] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Oct 11 01:18:17 2022] GET /compute/v2.1/images => generated 445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:17.441398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.442229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:17.445165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:17.450958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.451764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.452564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.453483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.454145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.454779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.496547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:18:17.499071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:17.499996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:17.512800 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed7247cd-b5ac-4b09-ae6a-0e9d8af49459 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.409653 Oct 11 01:18:17.515900 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 229/432] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:17 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:17.533128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32fea4ed-334a-44f0-9eb4-777362862022 tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] Calling method '.version_select at 0x7f1134bccdc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.608236 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-32fea4ed-334a-44f0-9eb4-777362862022 tempest-ListImagesTestJSON-609282926 tempest-ListImagesTestJSON-609282926-project] 10.222.0.66 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.089740 Oct 11 01:18:17.610356 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 230/433] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:18:17 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:17.612174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:17.632020 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78d35344-c24d-4b26-b3c9-47cf75b63366 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "DELETE /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 204 len: 0 microversion: 2.1 time: 0.194369 Oct 11 01:18:17.632969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 204/434] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:17 2022] DELETE /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:17.642784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:17.643616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:17.650239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.650739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.651355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.652293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:17.652944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:17.653762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:17.879232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:17.898460 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f883575-027f-4064-8430-48a6970dae24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1474 microversion: 2.1 time: 0.260528 Oct 11 01:18:17.899463 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 231/435] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:17 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1474 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:18.075523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:18.077022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:18.089053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.090323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.091093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:18.092534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.093235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.095150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:18.317927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:18.329548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f63cfce9-2996-42cb-a704-5871266190ad tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1322 microversion: 2.1 time: 0.264263 Oct 11 01:18:18.331061 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 205/436] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:18 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:18.538744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:18.539836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:18.554085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.554583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.555037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:18.562157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.563771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.564222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:18.730106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:18.740351 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9b15274-a55f-4168-8b40-0b3ca67a8afd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.205489 Oct 11 01:18:18.757763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 232/437] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:18 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:18.922033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:18.923242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:18.929884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.930379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.930929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:18.931827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:18.932280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:18.932868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.090891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:19.099346 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbe2d58e-99e4-46e6-bd84-822604759a65 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1474 microversion: 2.1 time: 0.181032 Oct 11 01:18:19.099941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 206/438] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:18 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1474 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:19.361566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.364919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:19.374442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.374967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.375470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.376804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.377274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.377706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.527635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:19.536152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56a5bdf9-2ba7-43d3-a49e-0cad70b25d7a tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1472 microversion: 2.1 time: 0.186670 Oct 11 01:18:19.536858 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 233/439] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:19.657974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Calling method '.version_select at 0x7f1134eefaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.660429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.660903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.661739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.677793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.678271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.678925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.690074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.691242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.691701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.698807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4dfdb09b-0c19-4fe4-9aae-a6fc243e938e tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.345605 Oct 11 01:18:19.706497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 207/440] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:19.712606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Calling method '.version_select at 0x7f1134a931f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.714718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.715495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.715776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.735125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.735630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.736275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.760885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.761295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.761770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.767653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-415fe66b-e2eb-4af4-8548-f26e609e5be8 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h1-772273-9/servers" status: 200 len: 275 microversion: 2.1 time: 0.059450 Oct 11 01:18:19.775879 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 208/441] 10.222.0.66 () {58 vars in 1212 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-772273-9/servers => generated 275 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:19.780657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.781268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:19.787674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.788159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.788590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.789281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.789727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.790148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.865504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:19.866082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] [instance: 7889f335-db98-4986-abca-e158e7cce33c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:19.871758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] HTTP exception thrown: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Request method failure captured: Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/7889f335-db98-4986-abca-e158e7cce33c/action HTTP/1.1 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 15 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRNO0HX7CaIdvM57qTU5x1Z5ninlc_mJjca0Ne7_Rvhr4nwQYPcfSPI3KRy6a-r2p4OdBL5uZEg1qfDRyFxRRIovBTyp7WYPvjIgp1xeIC3L6QYoBqMYQ7TKsjaONPwtEddOk6PnSHMB4i3YXtmdKeolu1yx3kWHALxpZ-9tvcIlCY Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:18:19.873768 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: daf6193545a9468eb85b10b9aa9a2688 Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: {"migrate": {}} Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:19.874981 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '7889f335-db98-4986-abca-e158e7cce33c', 'body': {'migrate': {}}} Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:19.875742 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. Oct 11 01:18:19.876789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:19.879421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Returning 404 to user: Instance 7889f335-db98-4986-abca-e158e7cce33c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:19.879421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01ac099d-e6e8-402a-ac2b-360f301483b0 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/7889f335-db98-4986-abca-e158e7cce33c/action" status: 404 len: 111 microversion: 2.1 time: 0.318932 Oct 11 01:18:19.885725 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 234/442] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:19 2022] POST /compute/v2.1/servers/7889f335-db98-4986-abca-e158e7cce33c/action => generated 111 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:18:19.891924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Calling method '.version_select at 0x7f1134ca4790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.895624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.896238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.896857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.918402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.918900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.919428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.930422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.930909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.931366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.940691 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05b245bf-2be3-468f-b39e-b92c1b206f7a tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053832 Oct 11 01:18:19.942135 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 235/443] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:19.952241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Calling method '.version_select at 0x7f1134b1dee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:19.953954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.954438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.954877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.971843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:19.972892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:19.974006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:19.982366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0817f707-c486-479c-b259-1abd60fe7698 tempest-HypervisorAdminUnderV252Test-515778271 tempest-HypervisorAdminUnderV252Test-515778271-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h1-772273-9/search" status: 200 len: 104 microversion: 2.1 time: 0.033559 Oct 11 01:18:19.983266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 236/444] 10.222.0.66 () {58 vars in 1209 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-772273-9/search => generated 104 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:20.017876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:20.028400 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e4e2ad8-b304-4286-bd6c-bac35767aad8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.251410 Oct 11 01:18:20.029309 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 209/445] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:19 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:20.048781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1271078988", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:20.107557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:20.124311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:20.124919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:20.132659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:20.133455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:20.133888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:20.134729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:20.135478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:20.136339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:20.650431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:20.661413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62786d5e-9c0c-4d48-9051-43b191f9cb43 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1474 microversion: 2.1 time: 0.540342 Oct 11 01:18:20.662754 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 210/446] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:20 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1474 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:20.783060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:20.783664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:20.784346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:20.784809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:20.785221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:20.805968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:20.809982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:20.810465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:20.815540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:20.820256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:20.827828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80875faa-2587-4743-816a-d75f0599a51a", "name": "network-vif-deleted", "tag": "df626864-6773-4d71-8405-74bb2c9a7435"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:20.835719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:20.883738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:20.884224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:20.889504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:20.947640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Creating event network-vif-deleted:df626864-6773-4d71-8405-74bb2c9a7435 for instance 80875faa-2587-4743-816a-d75f0599a51a on n-h2-772273-9 Oct 11 01:18:20.950227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Getting quotas for project 0957aad6b14547dd892fe171de611a15. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:20.965509 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141994 Oct 11 01:18:20.966123 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 211/447] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:18:20.975821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Getting quotas for user 93b9e02b63f1440d9d7bddfb6aa458f4 and project 0957aad6b14547dd892fe171de611a15. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:21.018435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:21.023432 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d7a7f18a-24d5-4e81-943f-3ae1cdc5a6af req-9ad4cc80-4a7d-43f1-a9e8-de98b964d3a4 service nova] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004802 Oct 11 01:18:21.031880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:21.032585 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 212/448] 10.222.0.66 () {56 vars in 886 bytes} [Tue Oct 11 01:18:21 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 01:18:21.044583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:21.055320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:21.056849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:21.090817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.094516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.100035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:21.102934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.103990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.108221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:21.205063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8a21852-98b5-4d1d-b6dd-3934062742fe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160053 Oct 11 01:18:21.210269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 237/449] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:18:21.219734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5767f7c-610d-403e-8452-e9025fd13df2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:21.221024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5767f7c-610d-403e-8452-e9025fd13df2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:21.457442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5767f7c-610d-403e-8452-e9025fd13df2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:21.469397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5767f7c-610d-403e-8452-e9025fd13df2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1222 microversion: 2.1 time: 0.253760 Oct 11 01:18:21.480060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 238/450] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:21 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:21.518401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:21.532404 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97fa7def-d00e-4053-8ada-7d9487b08f84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.482102 Oct 11 01:18:21.534087 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 213/451] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:21 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:21.723726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:21.727966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:21.747216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.750522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.756453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:21.757468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.758104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.759146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:21.861583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.865271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.867215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:21.867924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lazy-loading 'fault' on Instance uuid 80875faa-2587-4743-816a-d75f0599a51a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:21.935889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a642a7da224e16af27c5df40c5fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae1bc4e02c4092b0d9145917755102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:21.949284 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-362a7f07-e3b8-4be9-87d4-a0f95685cf24 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 200 len: 1309 microversion: 2.1 time: 0.243894 Oct 11 01:18:21.950955 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 239/452] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:21 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:21.993324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Calling method '.version_select at 0x7f1134a08d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:21.995399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:21.996778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:21.997780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.026844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.028616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.029370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.053036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.054041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.055088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.067358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e90ab71a-82a4-4c40-b2f6-8d266a37628a tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.285804 Oct 11 01:18:22.069067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 214/453] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:18:22.316642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6a15b08-0bff-40b1-ae9d-4f54b1f120db tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Calling method '.version_select at 0x7f1134bccdc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.319143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6a15b08-0bff-40b1-ae9d-4f54b1f120db tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8dfa25c96f384ddfa18166c2ae50d59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a69f06afe6494896e9531f1cca4729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6a15b08-0bff-40b1-ae9d-4f54b1f120db tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Request method failure captured: Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors/n-h1-772273-9/search HTTP/1.1 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRbESxUEHJn4oONp28gVbujNjD-2YdZ_LoJxuvFwvu_gnQUF2R7sx9QTubxuqff7gPCvY4Nj9XUIdk6aq04eLXHjjfYeSIqBMu0YbtlPOrqxoH_VYef458SEDEkRjg1EVuiXGWvY39ogu69GCr-lK0ozSmvR5ZnYkkH_Opy8sJoghQ Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 44a69f06afe6494896e9531f1cca4729 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:22.321339 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_44a69f06afe6494896e9531f1cca4729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 44a69f06afe6494896e9531f1cca4729 Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8dfa25c96f384ddfa18166c2ae50d59c Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 01:18:22.322594 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'n-h1-772273-9'} Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:22.323312 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 01:18:22.325303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.338433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6a15b08-0bff-40b1-ae9d-4f54b1f120db tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:22.340862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6a15b08-0bff-40b1-ae9d-4f54b1f120db tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h1-772273-9/search" status: 403 len: 117 microversion: 2.1 time: 0.264597 Oct 11 01:18:22.342003 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 240/454] 10.222.0.66 () {58 vars in 1209 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/os-hypervisors/n-h1-772273-9/search => generated 117 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:22.353031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Calling method '.version_select at 0x7f1134a08790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.354760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.355907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.356668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.365681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Request method failure captured: Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRduQF2dLv3bws2zUKRPb30azToNJfO0eFE-AU0WL3t8i54zP3F2OsinM-8rfXZ98sC2jZWdj9p2D9yixwQiWvVVr3pqGFnL17o82tUyuBMYzubL2b2H-OtPa5i6sdj2dPjRIWRxHJrP4kf-BQgxNWUaB8EUV91ceeVCyfQ9xFH-1U Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8a90e87b74c3409989022a80b11a0b55 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:22.368804 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8a90e87b74c3409989022a80b11a0b55 Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 812fb16fdd0d4bc9a5a0c54be4a25d8c Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 01:18:22.370362 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.371075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.372176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.372176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:22.372176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:22.372176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 01:18:22.372176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.374137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:22.375811 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08262499-e526-45d4-be57-5d61703e7e70 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.026339 Oct 11 01:18:22.376961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 215/455] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:22.386955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Calling method '.version_select at 0x7f1134b8bca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.389269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.389967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.390899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.408793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.410518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.411262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.426514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.427295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.427993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.436706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a3cfbd4-1e8e-475d-aee9-08b0755c9955 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054320 Oct 11 01:18:22.444755 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 241/456] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:22.451381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a319427-6184-4fd4-a972-f218aa676f2a tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Calling method '.version_select at 0x7f11349d4af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.453926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a319427-6184-4fd4-a972-f218aa676f2a tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8dfa25c96f384ddfa18166c2ae50d59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a69f06afe6494896e9531f1cca4729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a319427-6184-4fd4-a972-f218aa676f2a tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Request method failure captured: Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRbESxUEHJn4oONp28gVbujNjD-2YdZ_LoJxuvFwvu_gnQUF2R7sx9QTubxuqff7gPCvY4Nj9XUIdk6aq04eLXHjjfYeSIqBMu0YbtlPOrqxoH_VYef458SEDEkRjg1EVuiXGWvY39ogu69GCr-lK0ozSmvR5ZnYkkH_Opy8sJoghQ Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 44a69f06afe6494896e9531f1cca4729 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:22.456128 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_44a69f06afe6494896e9531f1cca4729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/44a69f06afe6494896e9531f1cca4729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 44a69f06afe6494896e9531f1cca4729 Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997 Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 8dfa25c96f384ddfa18166c2ae50d59c Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 01:18:22.457924 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1'} Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:22.458626 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 01:18:22.459789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.465060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a319427-6184-4fd4-a972-f218aa676f2a tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:22.466413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a319427-6184-4fd4-a972-f218aa676f2a tempest-HypervisorAdminNegativeUnderV252Test-1320951997 tempest-HypervisorAdminNegativeUnderV252Test-1320951997-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020751 Oct 11 01:18:22.473371 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 216/457] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:22.481062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Calling method '.version_select at 0x7f1134bcc820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.484249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.484746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.485196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.498052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] HTTP exception thrown: No hypervisor matching '03f2b965-4065-4bca-8841-7c5b647b8cd7' could be found. Oct 11 01:18:22.498708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.499552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Request method failure captured: Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors/03f2b965-4065-4bca-8841-7c5b647b8cd7/servers HTTP/1.1 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRduQF2dLv3bws2zUKRPb30azToNJfO0eFE-AU0WL3t8i54zP3F2OsinM-8rfXZ98sC2jZWdj9p2D9yixwQiWvVVr3pqGFnL17o82tUyuBMYzubL2b2H-OtPa5i6sdj2dPjRIWRxHJrP4kf-BQgxNWUaB8EUV91ceeVCyfQ9xFH-1U Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8a90e87b74c3409989022a80b11a0b55 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:18:22.499749 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a90e87b74c3409989022a80b11a0b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8a90e87b74c3409989022a80b11a0b55 Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977 Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 812fb16fdd0d4bc9a5a0c54be4a25d8c Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: exception: No hypervisor matching '03f2b965-4065-4bca-8841-7c5b647b8cd7' could be found. Oct 11 01:18:22.501296 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '03f2b965-4065-4bca-8841-7c5b647b8cd7'} Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '03f2b965-4065-4bca-8841-7c5b647b8cd7' could be found. Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.502032 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '03f2b965-4065-4bca-8841-7c5b647b8cd7' could be found. Oct 11 01:18:22.503277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:22.506224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] Returning 404 to user: No hypervisor matching '03f2b965-4065-4bca-8841-7c5b647b8cd7' could be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:22.507368 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f65f96fc-8152-4dcf-b5fd-36086c184146 tempest-HypervisorAdminNegativeUnderV252Test-1689519977 tempest-HypervisorAdminNegativeUnderV252Test-1689519977-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/03f2b965-4065-4bca-8841-7c5b647b8cd7/servers" status: 404 len: 123 microversion: 2.1 time: 0.033633 Oct 11 01:18:22.508588 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 242/458] 10.222.0.66 () {58 vars in 1281 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/os-hypervisors/03f2b965-4065-4bca-8841-7c5b647b8cd7/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:22.523417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.523888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.524329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.525041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.525686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.526283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.558422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.559067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:22.571379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.571891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.572341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.590477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.592080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.593052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.650492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:22.659163 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-691d0465-dade-48cb-8a55-3bd90d406163 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1218 microversion: 2.1 time: 0.167057 Oct 11 01:18:22.659888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 217/459] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:22.975707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:22.976330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] [instance: 80875faa-2587-4743-816a-d75f0599a51a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:22.993079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:22.995539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:22.996028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:22.998093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:23.000724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:23.004658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:23.009127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:23.019534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2688ec95-680f-498b-9d8b-09cf2f3e38c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.466106 Oct 11 01:18:23.026702 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 243/460] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:23.030727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] HTTP exception thrown: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Request method failure captured: Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a HTTP/1.1 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQXkH1BaHYxpJBY5Rm4thnKUQappKHpwvBhCwmD1FUimvL62ZEzhR_zb4ltkeeaV6aW-5CkDHC-IH8Ki2yJEf2ChAG9oHLuVsG9NZabB6opmqqrcOOE7CUuyNCb_rS74K49B38oMhqPkxID7-gpK9vosDYgT4B4RKlJRHVg5FsW69c Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9fae1bc4e02c4092b0d9145917755102 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:23.033575 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9fae1bc4e02c4092b0d9145917755102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9fae1bc4e02c4092b0d9145917755102 Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1029488119 Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-LiveMigrationNegativeTest-1029488119-project Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26a642a7da224e16af27c5df40c5fde5 Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-LiveMigrationNegativeTest-1029488119-project Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. Oct 11 01:18:23.034845 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '80875faa-2587-4743-816a-d75f0599a51a'} Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:23.035589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. Oct 11 01:18:23.036688 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:23.037864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] Returning 404 to user: Instance 80875faa-2587-4743-816a-d75f0599a51a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:23.037864 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a96ab26-53d0-4f81-bb91-f6ceef9daf07 tempest-LiveMigrationNegativeTest-1029488119 tempest-LiveMigrationNegativeTest-1029488119-project] 10.222.0.66 "GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a" status: 404 len: 111 microversion: 2.1 time: 0.065006 Oct 11 01:18:23.037864 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 218/461] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:22 2022] GET /compute/v2.1/servers/80875faa-2587-4743-816a-d75f0599a51a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:23.683991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:23.685091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:23.698980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:23.699716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:23.700434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:23.701462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:23.702099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:23.702687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:23.871065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:23.879821 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2acc147-437d-4162-af0e-9958da8b447b tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1280 microversion: 2.1 time: 0.201189 Oct 11 01:18:23.891369 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 244/462] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:23 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:24.054055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:24.055039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:24.068473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:24.069346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:24.071826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:24.072844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:24.073528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:24.075700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:24.463535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1952748138", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:24.597776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] validate_networks() for [('0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:24.667932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:24.679514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63e07495-8704-457f-83d9-487b96b04880 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1505 microversion: 2.1 time: 0.629228 Oct 11 01:18:24.686321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 219/463] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:24 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:24.905569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:24.912250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:24.926907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:24.928005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:24.928699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:24.930139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:24.931226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:24.931695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:25.147351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:25.155190 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd07830b-9c61-4495-a713-87bc783446f5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1280 microversion: 2.1 time: 0.253844 Oct 11 01:18:25.155813 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 220/464] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:24 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:25.568747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:25.569847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:25.570645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:25.571287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:25.571874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:25.583963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:25.585225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:25.585863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:25.588439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:25.589113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:25.589725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 11 01:18:25.652090 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 11 01:18:25.653285 n-d-772273-9 devstack@n-api.service[120494]: ERROR sqlalchemy.pool.impl.QueuePool Oct 11 01:18:25.654987 n-d-772273-9 devstack@n-api.service[120494]: Exception ignored in: . at 0x7f1134bd88b0> Oct 11 01:18:25.655163 n-d-772273-9 devstack@n-api.service[120494]: Traceback (most recent call last): Oct 11 01:18:25.655771 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 11 01:18:25.656291 n-d-772273-9 devstack@n-api.service[120494]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 11 01:18:25.656492 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 11 01:18:25.657030 n-d-772273-9 devstack@n-api.service[120494]: connection_record.checkin() Oct 11 01:18:25.657596 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 11 01:18:25.658065 n-d-772273-9 devstack@n-api.service[120494]: pool.dispatch.checkin(connection, self) Oct 11 01:18:25.658241 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 11 01:18:25.659486 n-d-772273-9 devstack@n-api.service[120494]: fn(*args, **kw) Oct 11 01:18:25.659998 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 11 01:18:25.669191 n-d-772273-9 devstack@n-api.service[120494]: time.sleep(0) Oct 11 01:18:25.669191 n-d-772273-9 devstack@n-api.service[120494]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 11 01:18:25.674283 n-d-772273-9 devstack@n-api.service[120494]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 01:18:25.674283 n-d-772273-9 devstack@n-api.service[120494]: AssertionError: do not call blocking functions from the mainloop Oct 11 01:18:25.707890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:25.712784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:25.713400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:25.720619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for user 870719fa1b734c078b3a215a7d77a833 and project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:25.722640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:25.723926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:25.725899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:25.726884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:25.731706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:25.732528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:25.748057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:25.754280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:25.866120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7739f464-ed8f-4aca-9d8b-efd2eefaeead tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733890 Oct 11 01:18:25.884478 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 245/465] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:18:26.032937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:26.042817 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd61d31b-0e89-419b-b57e-aef795575fc2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1495 microversion: 2.1 time: 0.334271 Oct 11 01:18:26.044735 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 221/466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:25 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1495 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:26.070994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c91366f4-2bdf-449d-9cc3-34bb2b21b968 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '.version_select at 0x7f1134bcc790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:26.074844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c91366f4-2bdf-449d-9cc3-34bb2b21b968 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.075362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c91366f4-2bdf-449d-9cc3-34bb2b21b968 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.075811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c91366f4-2bdf-449d-9cc3-34bb2b21b968 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.115049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c91366f4-2bdf-449d-9cc3-34bb2b21b968 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.048845 Oct 11 01:18:26.118813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 246/467] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:18:26 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:26.132910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:26.135416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:26.142931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.144376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.145041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.146090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.146793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.147656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.182574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:26.183188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:26.191240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:26.205176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.205690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.206673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.216320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.216894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.219386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.521304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5df154f6-923b-4234-a190-17c2ded10280 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1646 microversion: 2.1 time: 0.392673 Oct 11 01:18:26.539613 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 222/468] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:26 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1646 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:26.653893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-177592307", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:26.719505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:26.734975 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61e0bbe5-de02-42ea-b5c6-9f6393a94083 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.556618 Oct 11 01:18:26.738232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 247/469] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:26 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:26.800226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] validate_networks() for [('0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:26.849793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0bfee-ecfa-41df-a16f-b1c68f9824de", "tag": "ee0e39ce-d5a7-4a49-99b8-2799a229c368"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:26.868388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:26.871470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:26.873833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:26.903152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] Creating event network-changed:ee0e39ce-d5a7-4a49-99b8-2799a229c368 for instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de on n-h2-772273-9 Oct 11 01:18:26.919419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b6b6bad2-d2a8-4bf1-b6d7-50ad0b7842fa req-5de06bb3-16eb-4242-9c7e-bc60839b4cb3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074429 Oct 11 01:18:26.922049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 248/470] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:27.076534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-70348223", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:27.210390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] validate_networks() for [('9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:27.894948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:27.896365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:27.896937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:27.897416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:27.898021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:27.907638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:27.908469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:27.909661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:27.910726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:27.911446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:27.912251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:27.952389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:27.953042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:27.953554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:27.953995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:27.954518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:27.955075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:27.967664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for user 870719fa1b734c078b3a215a7d77a833 and project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:27.968587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:27.969064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:27.969722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:27.971388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:27.972626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:27.973061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:28.003469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:28.006394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:28.030945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:28.058718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for user ef7f0979c5764837ae474f3a09cedb7b and project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:28.079152 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2126a57-2bfa-4847-b69d-18b6133410a7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431370 Oct 11 01:18:28.080480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 223/471] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:18:28.107647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:28.108918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:28.126703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:28.134505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:28.139026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:28.139851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:28.140658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:28.142538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:28.144042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:28.145970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:28.157750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:28.246505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b7608b0-f8d8-4def-b1ee-52231803be29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175803 Oct 11 01:18:28.247692 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 249/472] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:18:28.266872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f99cda3a-97b6-456d-b6bc-b659c5cc7ca2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:28.268086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f99cda3a-97b6-456d-b6bc-b659c5cc7ca2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:28.432824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f99cda3a-97b6-456d-b6bc-b659c5cc7ca2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:28.442235 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f99cda3a-97b6-456d-b6bc-b659c5cc7ca2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1209 microversion: 2.1 time: 0.186918 Oct 11 01:18:28.446688 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 250/473] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:28 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1209 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:28.645367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:28.665810 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46655a2f-2b12-4505-926d-caa2b8ee6d49 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.583968 Oct 11 01:18:28.666406 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 224/474] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:28 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:28.678390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1909192494", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "451", "networks": [{"uuid": "0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:28.784392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] validate_networks() for [('0e0ff909-7b01-459f-8bcc-19b3ba6c0ed5', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:18:28.852303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56584477-ff3d-4224-94c8-edfa8d2e4b18 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:28.856408 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-56584477-ff3d-4224-94c8-edfa8d2e4b18 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56584477-ff3d-4224-94c8-edfa8d2e4b18 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin] Request method failure captured: Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRkCiDiVVlaijK5SARF6wymTO8JEs6zFlkljM-1nWHC__zTDov4Ef7LSzzPuWTP7uS7rT1Dm2XaWy-IHxU1c18DgzsyXZ0HRFJvhYM-HYMnqCzXEuv-Vgo6cq0WW75M9iG2W6IxE9SnE8jmHW1hAO_eU5GbQsWhsrrkKPmRvH7QXiY Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 960ad9fcf87e4064a944d4df780dff9e Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:18:28.866646 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/960ad9fcf87e4064a944d4df780dff9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_960ad9fcf87e4064a944d4df780dff9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/960ad9fcf87e4064a944d4df780dff9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/960ad9fcf87e4064a944d4df780dff9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 960ad9fcf87e4064a944d4df780dff9e Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 21b731583fc249d7928a16d0dce25b03 Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:28.868091 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid timestamp for date invalid_time Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'invalid_time'} Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:28.868841 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 11 01:18:28.870167 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:28.872297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56584477-ff3d-4224-94c8-edfa8d2e4b18 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:28.873510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56584477-ff3d-4224-94c8-edfa8d2e4b18 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254 tempest-InstanceUsageAuditLogNegativeTestJSON-1151224254-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.391393 Oct 11 01:18:28.874232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 251/475] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Oct 11 01:18:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:18:29.425873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:29.426904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:29.427496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:29.427908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:29.428367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:29.440791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.441532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.442120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:29.444058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.444837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.445433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:29.473100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:29.483520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Getting quotas for user 870719fa1b734c078b3a215a7d77a833 and project e04e37af3bc74db5bb479d8c9ccb21cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:29.513580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:29.516513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:29.558233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-661db369-fce0-4c4f-9787-71bc79f85494 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:29.567803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-661db369-fce0-4c4f-9787-71bc79f85494 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0c5b94016af34397b9a1e85bfe2621b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ab468268f64e948b135d1730655b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:29.576664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca3bb278-9936-4ec0-b48b-e5d1dcbbfc52 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908772 Oct 11 01:18:29.583687 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 225/476] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:18:29.589314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:29.590112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-661db369-fce0-4c4f-9787-71bc79f85494 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Request method failure captured: Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRgne1RZW9d0x_C5VEJ58Bv5zTGAhcS_kODAbSTrmTtpAZH9rMiq44iqlxv04O7riRFIBJB7iiWKC1G3mRAZMq2UUoy-dWzxVCpfpxZr817NeadatjYnx8j2IBRjSBwAeMNpqUl-Eoy7aLVcCDJBAvQkBqhmmcsYQqzUcBvZ-LC7Sk Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15ab468268f64e948b135d1730655b9d Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:29.593940 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ab468268f64e948b135d1730655b9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ab468268f64e948b135d1730655b9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ab468268f64e948b135d1730655b9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ab468268f64e948b135d1730655b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15ab468268f64e948b135d1730655b9d Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0c5b94016af34397b9a1e85bfe2621b3 Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project Oct 11 01:18:29.595495 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:29.596227 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 01:18:29.598039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.603322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.604054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.604645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:29.604765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-661db369-fce0-4c4f-9787-71bc79f85494 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:29.605601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.606209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.606796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:29.611787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-661db369-fce0-4c4f-9787-71bc79f85494 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.725374 Oct 11 01:18:29.622631 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 252/477] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:18:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 743 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:29.640092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c71a64f5-28ca-443c-bf67-c694a405a350 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:29.641453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c71a64f5-28ca-443c-bf67-c694a405a350 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:29.812087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:29.869920 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-201d0283-304a-4969-b5a8-37bec53ef0ec tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1205 microversion: 2.1 time: 0.281946 Oct 11 01:18:29.876336 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 226/478] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:29 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1205 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:29.890625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f921d54a-d455-4dbb-9b4f-1fa268248d61 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:29.906740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f921d54a-d455-4dbb-9b4f-1fa268248d61 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0c5b94016af34397b9a1e85bfe2621b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ab468268f64e948b135d1730655b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f921d54a-d455-4dbb-9b4f-1fa268248d61 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Request method failure captured: Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2001:18:29 HTTP/1.1 Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRgne1RZW9d0x_C5VEJ58Bv5zTGAhcS_kODAbSTrmTtpAZH9rMiq44iqlxv04O7riRFIBJB7iiWKC1G3mRAZMq2UUoy-dWzxVCpfpxZr817NeadatjYnx8j2IBRjSBwAeMNpqUl-Eoy7aLVcCDJBAvQkBqhmmcsYQqzUcBvZ-LC7Sk Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 15ab468268f64e948b135d1730655b9d Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:29.919452 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ab468268f64e948b135d1730655b9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ab468268f64e948b135d1730655b9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ab468268f64e948b135d1730655b9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ab468268f64e948b135d1730655b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 15ab468268f64e948b135d1730655b9d Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0c5b94016af34397b9a1e85bfe2621b3 Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project Oct 11 01:18:29.921974 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2022-10-11 01:18:29'} Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:29.924012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 01:18:29.927022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:29.929262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f921d54a-d455-4dbb-9b4f-1fa268248d61 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:29.929414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c71a64f5-28ca-443c-bf67-c694a405a350 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:29.929590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f921d54a-d455-4dbb-9b4f-1fa268248d61 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768 tempest-InstanceUsageAuditLogNegativeTestJSON-301899768-project] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 01:18:29" status: 403 len: 128 microversion: 2.1 time: 0.044351 Oct 11 01:18:29.929590 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 227/479] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:18:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2001%3A18%3A29 => generated 128 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:29.933591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:29.934366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:29.937632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c71a64f5-28ca-443c-bf67-c694a405a350 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1221 microversion: 2.1 time: 0.306842 Oct 11 01:18:29.951406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 253/480] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:29 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:29.951708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.951708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.951708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:29.951708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:29.952323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:29.952323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:30.148029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:30.157604 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd02075b-0e8e-4d25-a63f-e13d7ab89081 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.232902 Oct 11 01:18:30.158180 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 228/481] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:29 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:30.926823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:30.928190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:30.949067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:30.958026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:30.958807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:30.961787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:30.965340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:30.966566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:30.976779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:30.980548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:30.981368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:30.992544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:30.995903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:30.997009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:31.016682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:31.021589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:31.023012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:31.454787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:31.469357 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d858107-f1b8-4e9e-8b69-a318b4c152a4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1269 microversion: 2.1 time: 0.548237 Oct 11 01:18:31.472163 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 254/482] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:30 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1269 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:31.483373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:31.493694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ebb20dc-d055-4dd2-9eb3-4f33386c2bd1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1273 microversion: 2.1 time: 0.519825 Oct 11 01:18:31.494354 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 229/483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:30 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:31.509138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1258123-2050-4de1-af7d-a95d938edd74", "tag": "d7975398-c71c-4e53-bbd2-cf183cbc0df7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:31.539048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:31.541339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:31.541941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:31.570817 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] Creating event network-changed:d7975398-c71c-4e53-bbd2-cf183cbc0df7 for instance c1258123-2050-4de1-af7d-a95d938edd74 on n-h1-772273-9 Oct 11 01:18:31.582458 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-32dd0d90-7984-4891-8519-5404f4c239b8 req-f8ad0cf2-7d91-4488-b0ca-75d60f06b47c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081903 Oct 11 01:18:31.584099 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 230/484] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:31.594327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:31.595913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:31.611094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:31.611752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:31.612759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:31.614830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:31.616371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:31.617639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:31.948829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c030c330-1464-4283-9aef-1f15a0ca46bc tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Calling method '.version_select at 0x7f1134a7d280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:31.950781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c030c330-1464-4283-9aef-1f15a0ca46bc tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '3bf0668f75d943119ccaabfde1f8a1e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ceead3a3c54ed1be40ee6da9a9567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c030c330-1464-4283-9aef-1f15a0ca46bc tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Request method failure captured: Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRknhfm8WU4tG8L-_dA-00VEkemLVxnIgBZG6RrpltdAfLaxgY2vNBo6H1HixVkZc0N97PW6KYI6TioH9hQJcVjzHOpJdMqRIWnGXWLlNy6yl-sq6h5Z5KDu5N2u6x6U2hUmmHq--0Zt-lJcv3OiX6TZX7xk7AE6cxgDRmnMzcaQas Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:31.952862 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3bf0668f75d943119ccaabfde1f8a1e0 Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:18:31.954096 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:31.955240 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 01:18:31.956768 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.959051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c030c330-1464-4283-9aef-1f15a0ca46bc tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:31.960184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c030c330-1464-4283-9aef-1f15a0ca46bc tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.486194 Oct 11 01:18:31.966394 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 255/485] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:18:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:31.973319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1e8dd73-f68a-46d7-b5f2-94cb2a32f510 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Calling method '.version_select at 0x7f1134a63b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:31.975739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1e8dd73-f68a-46d7-b5f2-94cb2a32f510 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '3bf0668f75d943119ccaabfde1f8a1e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ceead3a3c54ed1be40ee6da9a9567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1e8dd73-f68a-46d7-b5f2-94cb2a32f510 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Request method failure captured: Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRknhfm8WU4tG8L-_dA-00VEkemLVxnIgBZG6RrpltdAfLaxgY2vNBo6H1HixVkZc0N97PW6KYI6TioH9hQJcVjzHOpJdMqRIWnGXWLlNy6yl-sq6h5Z5KDu5N2u6x6U2hUmmHq--0Zt-lJcv3OiX6TZX7xk7AE6cxgDRmnMzcaQas Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:31.978829 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3bf0668f75d943119ccaabfde1f8a1e0 Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:18:31.980383 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:31.981303 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 01:18:31.982657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:31.985527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1e8dd73-f68a-46d7-b5f2-94cb2a32f510 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:31.986605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1e8dd73-f68a-46d7-b5f2-94cb2a32f510 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018495 Oct 11 01:18:31.988305 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 256/486] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:32.000639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f55e51c-7bd1-4355-b811-094d84c872d0 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Calling method '.version_select at 0x7f1134a63ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.004366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f55e51c-7bd1-4355-b811-094d84c872d0 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '3bf0668f75d943119ccaabfde1f8a1e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ceead3a3c54ed1be40ee6da9a9567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f55e51c-7bd1-4355-b811-094d84c872d0 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Request method failure captured: Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRknhfm8WU4tG8L-_dA-00VEkemLVxnIgBZG6RrpltdAfLaxgY2vNBo6H1HixVkZc0N97PW6KYI6TioH9hQJcVjzHOpJdMqRIWnGXWLlNy6yl-sq6h5Z5KDu5N2u6x6U2hUmmHq--0Zt-lJcv3OiX6TZX7xk7AE6cxgDRmnMzcaQas Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:32.006294 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3bf0668f75d943119ccaabfde1f8a1e0 Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:18:32.007654 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:32.008521 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 01:18:32.009901 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.014772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f55e51c-7bd1-4355-b811-094d84c872d0 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:32.016343 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f55e51c-7bd1-4355-b811-094d84c872d0 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021331 Oct 11 01:18:32.017124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 257/487] 10.222.0.66 () {58 vars in 1179 bytes} [Tue Oct 11 01:18:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:18:32.253442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:32.262911 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de21814e-b395-4c72-9c21-d019b6735172 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.676630 Oct 11 01:18:32.263576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 231/488] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:31 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:32.294172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Calling method '.version_select at 0x7f1134a81c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.296589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.297407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.298352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.335442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.337459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.339912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.365995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.366358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.367388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.380271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12e76bdd-3441-4ed1-917e-ab50a358ec97 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.355587 Oct 11 01:18:32.387060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 258/489] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:32.395135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9327a89a-ed6b-497a-9a9c-a74203f19f73 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Calling method '.version_select at 0x7f1134a8faf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.397212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9327a89a-ed6b-497a-9a9c-a74203f19f73 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '3bf0668f75d943119ccaabfde1f8a1e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ceead3a3c54ed1be40ee6da9a9567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9327a89a-ed6b-497a-9a9c-a74203f19f73 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Request method failure captured: Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRknhfm8WU4tG8L-_dA-00VEkemLVxnIgBZG6RrpltdAfLaxgY2vNBo6H1HixVkZc0N97PW6KYI6TioH9hQJcVjzHOpJdMqRIWnGXWLlNy6yl-sq6h5Z5KDu5N2u6x6U2hUmmHq--0Zt-lJcv3OiX6TZX7xk7AE6cxgDRmnMzcaQas Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:32.420324 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3bf0668f75d943119ccaabfde1f8a1e0 Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1'} Oct 11 01:18:32.421557 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:32.422547 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 01:18:32.423663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.433187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9327a89a-ed6b-497a-9a9c-a74203f19f73 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:32.434233 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9327a89a-ed6b-497a-9a9c-a74203f19f73 tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.045612 Oct 11 01:18:32.434763 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 232/490] 10.222.0.66 () {58 vars in 1173 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:32.447715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3331e4da-f146-49d5-864d-38697bfe9555 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Calling method '.version_select at 0x7f1134981820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.449905 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3331e4da-f146-49d5-864d-38697bfe9555 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] HTTP exception thrown: Hypervisor with ID 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' could not be found. Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3331e4da-f146-49d5-864d-38697bfe9555 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Request method failure captured: Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hypervisors/fe968b3d-9a8f-4eb9-ab51-af6a54945064/uptime HTTP/1.1 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRmaxHFEjlYonI-cdjdYkApIrhaLv4eJSgtjbCNuOLaBbFdxEM4rzfaOZtNP9DPewCv4z7eSxIUxB1CNeLbk6aQ4KTD-CvUfV9AorKCVPkUJM2xbqTYV8GBaj0Z0jMk3JwZRAJNKcV2vWS4rlXjumkR_Hx19Jzi6RFOEzppD4YhX-0 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ca404160d40741abae0250e98239a9aa Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:32.462114 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca404160d40741abae0250e98239a9aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca404160d40741abae0250e98239a9aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca404160d40741abae0250e98239a9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca404160d40741abae0250e98239a9aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ca404160d40741abae0250e98239a9aa Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1c7fa254d8d040ebb2adc36518499241 Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: exception: Hypervisor with ID 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' could not be found. Oct 11 01:18:32.463569 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'fe968b3d-9a8f-4eb9-ab51-af6a54945064'} Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 01:18:32.464409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' could not be found. Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.465602 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' could not be found. Oct 11 01:18:32.466747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.468182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3331e4da-f146-49d5-864d-38697bfe9555 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Returning 404 to user: Hypervisor with ID 'fe968b3d-9a8f-4eb9-ab51-af6a54945064' could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:32.469192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3331e4da-f146-49d5-864d-38697bfe9555 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/fe968b3d-9a8f-4eb9-ab51-af6a54945064/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025624 Oct 11 01:18:32.470257 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 233/491] 10.222.0.66 () {58 vars in 1278 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/os-hypervisors/fe968b3d-9a8f-4eb9-ab51-af6a54945064/uptime => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:32.483490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Calling method '.version_select at 0x7f1134d30a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.485854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.486497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.487868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.508387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.509164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.509823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.539789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.540285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.540727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.550312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb0f7058-0457-4d00-915c-8aef2e0da4d3 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.073325 Oct 11 01:18:32.551760 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 234/492] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:32.558103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.558965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:32.567123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.568712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.569611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.571860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.572771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.573407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.633495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2036973248", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:32.709508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:32.726509 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7faf52ba-45b5-4a92-aa3d-a484329e7df8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1267 microversion: 2.1 time: 0.172806 Oct 11 01:18:32.726734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:32.727005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:32.727675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 235/493] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:32.740998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:32.748141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:32.748624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:32.753795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.754413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:32.766029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.766513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.766950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.774178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.774676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.774798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.775115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.775231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.775701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.775831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:32.776278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:32.776696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:32.813687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Getting quotas for project bffe103202dd4b9590dcf88a239a656f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:18:32.818981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Getting quotas for user 3b4eb1cda29248659ce2adf67696cf30 and project bffe103202dd4b9590dcf88a239a656f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:18:32.831914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:18:32.834327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:18:32.903801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60a93306-9713-4665-981c-9cdce74bd112 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.504866 Oct 11 01:18:32.905005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 259/494] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:18:32.911748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fdae7ac-141d-4f91-9195-bede3e783a5d tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Calling method '.version_select at 0x7f1134b2d8b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:32.914555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7fdae7ac-141d-4f91-9195-bede3e783a5d tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '3bf0668f75d943119ccaabfde1f8a1e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ceead3a3c54ed1be40ee6da9a9567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fdae7ac-141d-4f91-9195-bede3e783a5d tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Request method failure captured: Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRknhfm8WU4tG8L-_dA-00VEkemLVxnIgBZG6RrpltdAfLaxgY2vNBo6H1HixVkZc0N97PW6KYI6TioH9hQJcVjzHOpJdMqRIWnGXWLlNy6yl-sq6h5Z5KDu5N2u6x6U2hUmmHq--0Zt-lJcv3OiX6TZX7xk7AE6cxgDRmnMzcaQas Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:32.916463 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0ceead3a3c54ed1be40ee6da9a9567b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c0ceead3a3c54ed1be40ee6da9a9567b Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-71378952 Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3bf0668f75d943119ccaabfde1f8a1e0 Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-71378952-project Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1'} Oct 11 01:18:32.917780 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:32.918549 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 01:18:32.919686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:32.925121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fdae7ac-141d-4f91-9195-bede3e783a5d tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:32.926562 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7fdae7ac-141d-4f91-9195-bede3e783a5d tempest-HypervisorAdminNegativeTestJSON-71378952 tempest-HypervisorAdminNegativeTestJSON-71378952-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020172 Oct 11 01:18:32.927412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 260/495] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:32.938558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:32.943299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:33.050760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.068724 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a65f5d7-b3af-4a27-80dd-1709e0764591 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1279 microversion: 2.1 time: 0.320351 Oct 11 01:18:33.070985 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 236/496] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:32 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:33.078885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a08a7254-c32b-4e21-bcab-f96a4ce84e68 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Calling method '.version_select at 0x7f1134981d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:33.080736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a08a7254-c32b-4e21-bcab-f96a4ce84e68 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] HTTP exception thrown: Hypervisor with ID '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' could not be found. Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a08a7254-c32b-4e21-bcab-f96a4ce84e68 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Request method failure captured: Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-hypervisors/4c59bd17-f792-4bfd-9c80-aa2d30ae9b43 HTTP/1.1 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRmaxHFEjlYonI-cdjdYkApIrhaLv4eJSgtjbCNuOLaBbFdxEM4rzfaOZtNP9DPewCv4z7eSxIUxB1CNeLbk6aQ4KTD-CvUfV9AorKCVPkUJM2xbqTYV8GBaj0Z0jMk3JwZRAJNKcV2vWS4rlXjumkR_Hx19Jzi6RFOEzppD4YhX-0 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ca404160d40741abae0250e98239a9aa Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:33.082747 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ca404160d40741abae0250e98239a9aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ca404160d40741abae0250e98239a9aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca404160d40741abae0250e98239a9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ca404160d40741abae0250e98239a9aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ca404160d40741abae0250e98239a9aa Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393 Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1c7fa254d8d040ebb2adc36518499241 Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: exception: Hypervisor with ID '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' could not be found. Oct 11 01:18:33.084019 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43'} Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 01:18:33.084706 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:18:33.085983 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' could not be found. Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' could not be found. Oct 11 01:18:33.088377 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:33.095652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a08a7254-c32b-4e21-bcab-f96a4ce84e68 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] Returning 404 to user: Hypervisor with ID '4c59bd17-f792-4bfd-9c80-aa2d30ae9b43' could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:33.100079 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a08a7254-c32b-4e21-bcab-f96a4ce84e68 tempest-HypervisorAdminNegativeTestJSON-1762986393 tempest-HypervisorAdminNegativeTestJSON-1762986393-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/4c59bd17-f792-4bfd-9c80-aa2d30ae9b43" status: 404 len: 123 microversion: 2.1 time: 0.023252 Oct 11 01:18:33.100684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 237/497] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 01:18:33 2022] GET /compute/v2.1/os-hypervisors/4c59bd17-f792-4bfd-9c80-aa2d30ae9b43 => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:33.117782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.143625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.148067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.196680 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41d0484d-0f08-44ce-a6cc-b157b427105b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "PUT /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1359 microversion: 2.75 time: 0.267974 Oct 11 01:18:33.199912 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 261/498] 10.222.0.66 () {62 vars in 1297 bytes} [Tue Oct 11 01:18:32 2022] PUT /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:33.229110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:33.229933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:33.293760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:33.294565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:33.305403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:33.311527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:33.312320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:33.313739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:33.314523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:33.315636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:33.640319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.649193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.650651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:33.668322 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d8534e7-b59c-45fa-a6e2-28b418f79dd0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1359 microversion: 2.75 time: 0.444730 Oct 11 01:18:33.672887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 238/499] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:33 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:33.754315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:33.755169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:33.758513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:33.772542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:33.773021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:33.773466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:33.774282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:33.774865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:33.775684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:34.049633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:34.066359 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7447664a-e829-4a5b-b8ca-5b198ef25f55 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.773888 Oct 11 01:18:34.068421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 262/500] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:33 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:34.093388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:34.094006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:34.100965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:34.101689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:34.102287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:34.103160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:34.103834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:34.104423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:34.246005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:34.259407 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76678116-a3f7-43d9-9769-9762391e4914 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1279 microversion: 2.1 time: 0.169204 Oct 11 01:18:34.271585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:34.271585 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8935f45b-673d-4a6c-b381-e1f16d2df1a8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.519445 Oct 11 01:18:34.272134 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 239/501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:33 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:34.286430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 263/502] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:34 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:34.700840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:34.702140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:34.710703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:34.711827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:34.713694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:34.714894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:34.716326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:34.717954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.062000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f03654b-fbc5-4bab-b3c3-cc961d8e7df4", "tag": "1483c62f-43ff-4542-af28-f1ec8176ec47"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:35.076588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.079713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.080160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.107371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] Creating event network-changed:1483c62f-43ff-4542-af28-f1ec8176ec47 for instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 on n-h1-772273-9 Oct 11 01:18:35.121651 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-69acd609-fae9-4bb4-b0f5-7d46ac00b2a9 req-b98fc9fb-ace0-44c3-926d-fcc0133e0ba7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063054 Oct 11 01:18:35.122718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 264/503] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:18:35.135474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:35.136188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:35.143460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.144264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.144372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.145050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.145508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.145959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.160789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:35.177553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:35.189436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:35.196532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-122cbda9-1da9-4a20-844b-3e8f8e9c5da0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1411 microversion: 2.75 time: 0.500208 Oct 11 01:18:35.207554 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 240/504] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:34 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1411 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:35.219187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0bfee-ecfa-41df-a16f-b1c68f9824de", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e39ce-d5a7-4a49-99b8-2799a229c368"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:35.231382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.232052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.232700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.251101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] Creating event network-vif-plugged:ee0e39ce-d5a7-4a49-99b8-2799a229c368 for instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de on n-h2-772273-9 Oct 11 01:18:35.257196 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8ebc0102-9649-4b2b-9df6-68a57c25893b req-9367ee1c-470a-4ff7-84a0-38fe7c73302a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058280 Oct 11 01:18:35.258267 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 241/505] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:35.289065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:35.290643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:35.299750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.300832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.301348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.302539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.303072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.303606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.704829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:35.722962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d7f7bdf-ea09-4198-8a5a-71a7e26aa4c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1279 microversion: 2.1 time: 0.441401 Oct 11 01:18:35.727385 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 242/506] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:35 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1279 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:35.731059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:35.733035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:35.742033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.743110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.744586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:35.746203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:35.746903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:35.748028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:36.305230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:36.318576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90295cde-8f19-43a5-abc2-ebd84ee407fb tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 1.185250 Oct 11 01:18:36.321149 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 265/507] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:35 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:36.333472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df22e7c-51bd-4947-890e-e8ce59e9eb91", "tag": "cdbd7279-5c55-4416-b67e-b854f06e96e7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:36.345185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:36.346773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:36.354419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:36.358883 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d7b925b-b265-478d-80ad-5f00f3c369b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.633423 Oct 11 01:18:36.359920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:36.376413 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 243/508] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:35 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:36.387132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:36.390642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:36.391557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] Creating event network-changed:cdbd7279-5c55-4416-b67e-b854f06e96e7 for instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 on n-h1-772273-9 Oct 11 01:18:36.402850 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-bdf9aca0-470c-4a55-a4c7-4b119c22a425 req-928cc663-5239-4231-b404-22a5d2a0fbb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078827 Oct 11 01:18:36.404804 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 266/509] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:36.405737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:36.407181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:36.409255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:36.411453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:36.415120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:36.416858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:36.538842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:36.552998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:36.560275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:36.573075 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-baaa2ea2-c6d5-4bd5-8f13-341b66961150 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1417 microversion: 2.75 time: 0.192416 Oct 11 01:18:36.576226 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 244/510] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:36 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1417 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:36.751547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:36.752969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:36.766078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:36.771276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:36.773465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:36.775287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:36.778590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:36.780478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.099884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:37.108601 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4dfe48d4-73fc-42c0-9524-ee1a8ecce47d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.364152 Oct 11 01:18:37.109182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 267/511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:36 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:37.342752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:37.343175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:37.356788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.357357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.359717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.361148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.362581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.364271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.387716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:37.389384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:37.400263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.403820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.404443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.405348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.416093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.416785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.846361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:37.864579 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d5c74f0-eec4-471e-a8e0-8b67501f8ab9 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.526250 Oct 11 01:18:37.865170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 245/512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:37 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:37.869892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:37.870498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:37.886776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.890730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.891393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:37.892311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:37.893292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:37.893981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:38.031205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:38.044228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7bca5fe-8086-46f1-8e69-9dd6b163bb66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.659070 Oct 11 01:18:38.046341 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 268/513] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:37 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:38.081743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:38.098310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:38.100275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:38.106249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9113e38-f9de-4fc6-864c-356982b8f458 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1417 microversion: 2.75 time: 0.239890 Oct 11 01:18:38.116067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 246/514] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:37 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1417 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:38.132378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:38.133859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:38.143628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:38.144357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:38.144981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:38.145924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:38.146604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:38.147273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:38.384262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:38.397003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54ead47b-95e0-4ec3-8c18-c857691c6040 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.269115 Oct 11 01:18:38.408918 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 269/515] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:38 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:38.889481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:38.890510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:38.907646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:38.910913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:38.911401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:38.912356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:38.915653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:38.916482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.348138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Action: 'update', calling method: .version_select at 0x7f1134c0ef70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:39.456282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:39.458429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.459372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.460627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.463926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.465338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.465994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.484628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=13 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:39.524591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:39.530886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:39.537731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-974d0313-e48f-40b7-bf59-8705813d90f8 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1322 microversion: 2.1 time: 0.652296 Oct 11 01:18:39.555361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 247/516] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:38 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1322 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:39.561907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:39.562734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:39.571489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.572792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.573620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.574816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.575511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.576269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.586120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a8140c3-adda-424f-8627-510c474ae8e5 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3" status: 200 len: 148 microversion: 2.57 time: 0.541801 Oct 11 01:18:39.592232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 270/517] 10.222.0.66 () {62 vars in 1303 bytes} [Tue Oct 11 01:18:39 2022] PUT /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3 => generated 148 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:18:39.599972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:39.600616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:39.615010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.615832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.616287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.617403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:39.618197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:39.618786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:39.904590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:39.924832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:39.928354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:39.941388 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff03e257-a5e6-4fe0-a2c5-f49783bef4c3 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1417 microversion: 2.75 time: 0.352265 Oct 11 01:18:39.959040 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 271/518] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:39 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1417 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:39.976406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1258123-2050-4de1-af7d-a95d938edd74", "name": "network-vif-plugged", "status": "completed", "tag": "d7975398-c71c-4e53-bbd2-cf183cbc0df7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:40.000850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.001602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.002266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.038076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] Creating event network-vif-plugged:d7975398-c71c-4e53-bbd2-cf183cbc0df7 for instance c1258123-2050-4de1-af7d-a95d938edd74 on n-h1-772273-9 Oct 11 01:18:40.044810 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9772de33-9f51-40e4-8ad4-a31c0ed379d1 req-d73fe17b-9862-43b7-b4fc-a7bc4a45ced0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080278 Oct 11 01:18:40.046620 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 272/519] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:40.054446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:40.055612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:40.065033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.066243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.066844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.068278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.069257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.070382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.169964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:40.179216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0534e3ba-facf-4900-a0d5-c4b10f7e4f95 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.622520 Oct 11 01:18:40.180086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 248/520] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:39 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:40.184540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Calling method '.version_select at 0x7f1134981e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:40.304706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.332245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.334945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.341146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.341691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.342132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.384382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05a839be-5040-4795-8bc2-ae6131f7a548 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3/detail" status: 200 len: 463 microversion: 2.57 time: 0.203079 Oct 11 01:18:40.385420 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 249/521] 10.222.0.66 () {60 vars in 1304 bytes} [Tue Oct 11 01:18:40 2022] GET /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3/detail => generated 463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:40.464263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:40.481597 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f3a898f-1176-4354-a08c-66b19c7cb0ac tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.433501 Oct 11 01:18:40.495554 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 273/522] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:40 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:40.562254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:40.563366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:40.571452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.573447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.574703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.578276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.579739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.582440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.584640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Action: 'update', calling method: .version_select at 0x7f1134a7d040>, body: {"quota_set": {"ram": "2048"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:40.678440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.678922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.679638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.680988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.681802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.684518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.732685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:40.788846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.790393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.791048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.792014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:40.796147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:40.797134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:40.931128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6cab9bb-b83c-45a6-a910-534868a96457 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3?user_id=3d54f57319f340b1b9671d6d73ad92fb" status: 200 len: 148 microversion: 2.57 time: 0.350705 Oct 11 01:18:40.932505 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 274/523] 10.222.0.66 () {62 vars in 1384 bytes} [Tue Oct 11 01:18:40 2022] PUT /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3?user_id=3d54f57319f340b1b9671d6d73ad92fb => generated 148 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:40.953178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01cd42d7-c79d-4b54-9876-36b9bc6b6144 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] Calling method '.version_select at 0x7f1134a7dee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:41.049235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:41.057630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b392163-aa3d-4997-8e79-6d4b067e0768 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1472 microversion: 2.1 time: 0.499367 Oct 11 01:18:41.059709 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 250/524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:40 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:41.065264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:41.066154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:41.087095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.087980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.089036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.090164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.091432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.092675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.133631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01cd42d7-c79d-4b54-9876-36b9bc6b6144 tempest-QuotasAdminTestV257-516455612 tempest-QuotasAdminTestV257-516455612-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3?user_id=3d54f57319f340b1b9671d6d73ad92fb" status: 200 len: 190 microversion: 2.57 time: 0.193927 Oct 11 01:18:41.140230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 275/525] 10.222.0.66 () {60 vars in 1364 bytes} [Tue Oct 11 01:18:40 2022] GET /compute/v2.1/os-quota-sets/0c98e574ef5a4424a3d04776b751e7a3?user_id=3d54f57319f340b1b9671d6d73ad92fb => generated 190 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:18:41.141179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:41.141553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:41.149588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.150136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.150633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.152220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.152704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.153143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.186430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lazy-loading 'flavor' on Instance uuid dfc0bfee-ecfa-41df-a16f-b1c68f9824de {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:41.296955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:41.314784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:41.322295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:41.323669 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a9f04cf-1055-422f-96dc-58f9218b9c94 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de/action" status: 202 len: 0 microversion: 2.1 time: 0.186996 Oct 11 01:18:41.324858 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 276/526] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:41 2022] POST /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:41.339136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:41.341865 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ad3e98d-b541-469e-bcbc-c2aa4739cb57 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1438 microversion: 2.75 time: 0.279697 Oct 11 01:18:41.343001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:41.344093 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 251/527] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:41 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1438 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:41.359562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:41.367105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.367105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.367105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.367105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.367577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.367577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.367710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:41.382597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.383105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.383668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.384605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:41.385018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:41.385474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:41.965369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:41.977062 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85b87c05-8aef-45cc-8f9c-6431fe70a9ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.650774 Oct 11 01:18:41.978414 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 277/528] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:41 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:42.000692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:42.016047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:42.030486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.031093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.032216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.032585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.033178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.033676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.078114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:42.211435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:18:42.211874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:18:42.212287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:18:42.216939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:18:42.217487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:18:42.349092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:42.374315 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21d943b9-e55c-485f-8605-66f6b0c73ab1 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1631 microversion: 2.1 time: 1.024754 Oct 11 01:18:42.379403 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 252/529] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:41 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1631 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:42.394081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.394597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.395147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.395251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:42.395792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.396310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.396750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.397338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:42.417929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.421392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.421941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.428532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.429142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.431709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.638315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:42.667318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:42.674596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:42.702293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0fb2d3fd-3683-45bf-9fe4-a2ac45a9c033 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "POST /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a/action" status: 202 len: 1495 microversion: 2.75 time: 0.720792 Oct 11 01:18:42.711417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 278/530] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:18:41 2022] POST /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a/action => generated 1495 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 01:18:42.725597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f92a2d-aa1f-4625-8153-f37d1ba43aa7", "tag": "c64878f2-6652-48aa-b9e1-afcad599de8d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:42.775798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.785431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.786452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.818278 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] Creating event network-changed:c64878f2-6652-48aa-b9e1-afcad599de8d for instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 on n-h2-772273-9 Oct 11 01:18:42.831535 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-258ac5f1-c5ab-40b6-855c-be47e8a56db7 req-c6fac953-2d3a-4218-b85a-3ad53a0d0845 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115466 Oct 11 01:18:42.832173 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 279/531] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:42.864832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df22e7c-51bd-4947-890e-e8ce59e9eb91", "name": "network-vif-plugged", "status": "completed", "tag": "cdbd7279-5c55-4416-b67e-b854f06e96e7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:42.874528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:42.885768 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35d5eed3-a1fa-48fc-a6c7-d51c6ba21951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.504924 Oct 11 01:18:42.886368 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 253/532] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:42 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:42.903655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:42.903839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.905661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.906105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.906244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:42.930091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.930603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.931045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.934801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:42.935581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:42.940056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:42.948031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] Creating event network-vif-plugged:cdbd7279-5c55-4416-b67e-b854f06e96e7 for instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 on n-h1-772273-9 Oct 11 01:18:42.967139 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cdb4c986-e061-489c-a353-98ae515fedb8 req-369bda9b-dc16-4eae-8f35-969475fd7cf7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114308 Oct 11 01:18:42.971477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 280/533] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:43.007824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:43.008528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:43.021062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.031563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.032133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.034400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.035822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.037235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.180573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:43.195909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:43.199745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:43.213846 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87ca529c-a2bf-4415-8aa9-b79d1e51bb47 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.324951 Oct 11 01:18:43.217228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 254/534] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:42 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:43.404708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:43.406132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:43.424877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.428205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.430946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.434545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.436009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:43.436573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.438590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.447695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c3890f6-d10c-41b7-9894-488f1fcfca84 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.445823 Oct 11 01:18:43.457230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 281/535] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:43 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:43.716949 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-01fa5c56-519e-4cc3-91d4-2a018d366334 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1614 microversion: 2.1 time: 0.321157 Oct 11 01:18:43.721497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 255/536] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:43 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1614 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:43.745658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:43.746664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:43.759112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.759898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.760621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.762040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.767791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.768591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.876620 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] HTTP exception thrown: Cannot 'migrate' instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de while it is in vm_state suspended Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Request method failure captured: Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de/action HTTP/1.1 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 15 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRNO0HX7CaIdvM57qTU5x1Z5ninlc_mJjca0Ne7_Rvhr4nwQYPcfSPI3KRy6a-r2p4OdBL5uZEg1qfDRyFxRRIovBTyp7WYPvjIgp1xeIC3L6QYoBqMYQ7TKsjaONPwtEddOk6PnSHMB4i3YXtmdKeolu1yx3kWHALxpZ-9tvcIlCY Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:18:43.879004 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: daf6193545a9468eb85b10b9aa9a2688 Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: {"migrate": {}} Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:43.880909 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'migrate' instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de while it is in vm_state suspended Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'dfc0bfee-ecfa-41df-a16f-b1c68f9824de', 'body': {'migrate': {}}} Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de in vm_state suspended. Cannot resize while the instance is in this state. Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.882054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de while it is in vm_state suspended Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.883642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.885429 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:43.885429 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:43.885429 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de while it is in vm_state suspended Oct 11 01:18:43.885429 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.887192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Returning 409 to user: Cannot 'migrate' instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de while it is in vm_state suspended {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:43.888464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cdb1871a-2c82-4af1-9553-1be6766c98e5 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de/action" status: 409 len: 148 microversion: 2.1 time: 0.147623 Oct 11 01:18:43.889395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 282/537] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:43 2022] POST /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de/action => generated 148 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:43.902059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82baa14d-5ad9-4b76-8ade-1ee08c3d0fea tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82baa14d-5ad9-4b76-8ade-1ee08c3d0fea tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Request method failure captured: Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action HTTP/1.1 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 39 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRNO0HX7CaIdvM57qTU5x1Z5ninlc_mJjca0Ne7_Rvhr4nwQYPcfSPI3KRy6a-r2p4OdBL5uZEg1qfDRyFxRRIovBTyp7WYPvjIgp1xeIC3L6QYoBqMYQ7TKsjaONPwtEddOk6PnSHMB4i3YXtmdKeolu1yx3kWHALxpZ-9tvcIlCY Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:43.906249 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: daf6193545a9468eb85b10b9aa9a2688 Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: {"os-resetState": {"state": "invalid"}} Oct 11 01:18:43.907650 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '8d9c605c-02d8-4da7-a1de-a9fe8d49841e', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.909176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:18:43.910497 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 01:18:43.911633 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.913368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:43.913804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82baa14d-5ad9-4b76-8ade-1ee08c3d0fea tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:43.914125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:43.915083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82baa14d-5ad9-4b76-8ade-1ee08c3d0fea tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action" status: 400 len: 144 microversion: 2.1 time: 0.017125 Oct 11 01:18:43.915898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 256/538] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:43 2022] POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:18:43.930958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33289b2e-ae0e-4c9d-99f1-d033697c6e6a tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33289b2e-ae0e-4c9d-99f1-d033697c6e6a tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Request method failure captured: Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action HTTP/1.1 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 31 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRNO0HX7CaIdvM57qTU5x1Z5ninlc_mJjca0Ne7_Rvhr4nwQYPcfSPI3KRy6a-r2p4OdBL5uZEg1qfDRyFxRRIovBTyp7WYPvjIgp1xeIC3L6QYoBqMYQ7TKsjaONPwtEddOk6PnSHMB4i3YXtmdKeolu1yx3kWHALxpZ-9tvcIlCY Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:43.935027 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: daf6193545a9468eb85b10b9aa9a2688 Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: {"os-resetState": {"state": 1}} Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:43.936383 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '8d9c605c-02d8-4da7-a1de-a9fe8d49841e', 'body': {'os-resetState': {'state': 1}}} Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 1 Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:43.937175 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 01:18:43.940963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.942316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33289b2e-ae0e-4c9d-99f1-d033697c6e6a tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:43.942316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33289b2e-ae0e-4c9d-99f1-d033697c6e6a tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action" status: 400 len: 120 microversion: 2.1 time: 0.010775 Oct 11 01:18:43.942455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.942550 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 257/539] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:43 2022] POST /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:18:43.942638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.942638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.942638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.942638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.942916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.952539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:43.955546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Failed to fetch instance by id 999 {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:18:43.956450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Request method failure captured: Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 37 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRNO0HX7CaIdvM57qTU5x1Z5ninlc_mJjca0Ne7_Rvhr4nwQYPcfSPI3KRy6a-r2p4OdBL5uZEg1qfDRyFxRRIovBTyp7WYPvjIgp1xeIC3L6QYoBqMYQ7TKsjaONPwtEddOk6PnSHMB4i3YXtmdKeolu1yx3kWHALxpZ-9tvcIlCY Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:43.958897 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/86e990ab521e4fc4a917c6da1b17b831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 86e990ab521e4fc4a917c6da1b17b831 Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672802743 Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: daf6193545a9468eb85b10b9aa9a2688 Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672802743-project-admin Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: {"os-resetState": {"state": "error"}} Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:18:43.960581 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 999 could not be found. Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:43.961330 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 01:18:43.962651 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:43.965634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:43.966743 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d4c5080-6de0-42ec-a5b4-4b2a9353d678 tempest-ServersAdminNegativeTestJSON-1672802743 tempest-ServersAdminNegativeTestJSON-1672802743-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018776 Oct 11 01:18:43.967937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 258/540] 10.222.0.66 () {60 vars in 1179 bytes} [Tue Oct 11 01:18:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:18:43.984410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:43.987095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:43.993942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.994493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.994937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:43.995988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:43.996505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:43.996934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.039492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:18:44.177592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd7afdcb-600e-4438-a519-237f167800c5 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 204 len: 0 microversion: 2.1 time: 0.196763 Oct 11 01:18:44.186777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 259/541] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:43 2022] DELETE /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:44.200010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:44.201381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:44.228980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.230287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.232646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.235394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.237188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.239478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.241167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.243988 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8a7e508-8312-4cca-862c-da599059b0a0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.333289 Oct 11 01:18:44.245195 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 283/542] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:43 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:44.254565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:44.256460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:44.280645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.281230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.281753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.282554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.283676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.284177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.449420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.463758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.472119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.496725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d7e82c9-5994-4f5b-982b-e4843656b772 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.250232 Oct 11 01:18:44.501327 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 284/543] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:44 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:44.516081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:44.517847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:44.537484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.538344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.542197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.545146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:44.546157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:44.546814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:44.712707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.750038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7419a34d-d1b7-4f01-950d-b2718259e8b0 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1469 microversion: 2.1 time: 0.558760 Oct 11 01:18:44.753832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 260/544] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:44 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1469 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:44.833524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:44.849144 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5956b493-18fa-419b-902d-3ae941a47c3b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1309 microversion: 2.1 time: 0.344028 Oct 11 01:18:44.852045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 285/545] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:44 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1309 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:45.131477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f03654b-fbc5-4bab-b3c3-cc961d8e7df4", "name": "network-vif-plugged", "status": "completed", "tag": "1483c62f-43ff-4542-af28-f1ec8176ec47"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:45.148714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:45.150054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:45.150800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:45.169029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] Creating event network-vif-plugged:1483c62f-43ff-4542-af28-f1ec8176ec47 for instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 on n-h1-772273-9 Oct 11 01:18:45.178327 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b8a2c891-7213-40c7-93d8-d21cb2171958 req-a0e0429b-c25c-4b0a-a1bd-9eadc5ba7da6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058303 Oct 11 01:18:45.178978 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 261/546] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:45.266299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:45.266989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:45.273697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:45.274523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:45.275166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:45.276087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:45.276769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:45.277389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:45.551617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:45.563005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:45.600584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:45.601501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:45.602197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:45.603516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:45.606026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:45.610639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.056412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.070154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.073681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.089397 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0053429a-92ee-4f96-90be-a389f461724f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.558383 Oct 11 01:18:46.104402 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 262/547] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:45 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:46.116819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:46.117250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.117862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:46.124864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.125802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.126977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.128075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.128681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.129260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.132883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cb93fcd-441a-4c55-baaf-69e0fc3496e4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.870594 Oct 11 01:18:46.159689 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 286/548] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:45 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:46.171030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:46.171971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:46.179546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.180251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.180796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.181707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.182288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.182809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.834599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.846707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89b0d5ee-6c18-439c-83c4-984c7bffd28b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1492 microversion: 2.1 time: 0.683699 Oct 11 01:18:46.848660 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 287/549] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:46 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1492 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:46.856877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:46.866569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-242af076-b76f-4d71-9063-8a6657d419e3 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1469 microversion: 2.1 time: 0.760337 Oct 11 01:18:46.869460 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 263/550] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:46 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1469 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:46.877109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:46.878100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:46.896210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.899791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.901887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:46.904937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:46.905810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:46.906491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.122201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:47.123690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:47.144694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.147691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.148387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.152467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.154256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.157328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.463111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:47.472277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:47.476343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:47.492968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-404038cb-eb04-4cd6-b2b2-d882aff5d0e7 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.374675 Oct 11 01:18:47.508727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 264/551] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:47 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:18:47.521480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:47.522365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:47.532656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.533391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.533996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.534881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.535555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.536140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.684832 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78ef805c-bcbc-4ab5-a7e8-2313d91a2277 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1643 microversion: 2.1 time: 0.813319 Oct 11 01:18:47.699624 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 288/552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:46 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1643 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:47.729788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:47.731004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:47.749015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.752478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.759564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:47.762670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:47.763468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:47.765038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.197140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:48.217165 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38ea5d76-b588-4b22-aa0d-83de825ffb16 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.707070 Oct 11 01:18:48.219474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 265/553] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:47 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:48.253410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:48.254043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:48.275542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.275980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.278246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.283227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.283783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.284224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.452194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9664c422-3c3a-41ae-9ae4-2c9523212f85 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1643 microversion: 2.1 time: 0.727016 Oct 11 01:18:48.453669 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 289/554] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:47 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1643 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:48.712192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e564116-5c57-47e2-bb5d-23ff9c5a22c0 tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T01%3A18%3A48.299678&end=2022-10-12T01%3A18%3A48.299678" status: 404 len: 112 microversion: - time: 0.257401 Oct 11 01:18:48.720052 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 290/555] 10.222.0.66 () {58 vars in 1316 bytes} [Tue Oct 11 01:18:48 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T01%3A18%3A48.299678&end=2022-10-12T01%3A18%3A48.299678 => generated 112 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 01:18:48.739316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:48.766118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.767083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.767769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.771483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.772086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.773165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.873692 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-451e84c1-490e-412c-a39e-4070ac465da5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.151973 Oct 11 01:18:48.882775 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 291/556] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:18:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:48.891064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:48.902220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:48.909656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.910418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.911858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:48.919754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:48.920737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:48.921353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.133357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:49.151316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5079166a-1604-46c3-82a1-682701eaf562 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1469 microversion: 2.1 time: 0.913390 Oct 11 01:18:49.154552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 266/557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:48 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1469 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:49.166112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14f2c14b-0495-4550-a495-e3732a4d8faf tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] Calling method '.version_select at 0x7f1134a931f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:49.189049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-14f2c14b-0495-4550-a495-e3732a4d8faf tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14f2c14b-0495-4550-a495-e3732a4d8faf tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] Request method failure captured: Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-simple-tenant-usage/4edb9abbe8d54f8988680b3320416c42?start=2022-10-12T01%3A18%3A48.299678&end=2022-10-10T01%3A18%3A48.299678 HTTP/1.1 Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMR4rAksveyEd2uKqDKiQu_P5cLiaI5YDKN8XG6yeaP3gsHpl937Ud2DngZwJc5tZq6Q7jZ89cvHCfQFaRGrYmy73-Z5cqQKSXM-XXCLt48XVK7wbzMhIGnyDWVs1fXfQ93avg5DqHhp1BCFLsjL9wr6zh4bPf9-YaahFpMTJescbKY Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9109d32e15dd454385bb36dad1c848bf Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-491385936 Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:18:49.191272 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9109d32e15dd454385bb36dad1c848bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9109d32e15dd454385bb36dad1c848bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9109d32e15dd454385bb36dad1c848bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9109d32e15dd454385bb36dad1c848bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-491385936 Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9109d32e15dd454385bb36dad1c848bf Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-491385936 Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TenantUsagesNegativeTestJSON-491385936-project-admin Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: dd01eebe69434b7f90161b0d6f691d40 Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-491385936-project-admin Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid start time. The start time cannot occur after the end time. Oct 11 01:18:49.193103 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4edb9abbe8d54f8988680b3320416c42'} Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 01:18:49.193887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 11 01:18:49.195244 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.200434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14f2c14b-0495-4550-a495-e3732a4d8faf tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:49.202056 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14f2c14b-0495-4550-a495-e3732a4d8faf tempest-TenantUsagesNegativeTestJSON-491385936 tempest-TenantUsagesNegativeTestJSON-491385936-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/4edb9abbe8d54f8988680b3320416c42?start=2022-10-12T01%3A18%3A48.299678&end=2022-10-10T01%3A18%3A48.299678" status: 400 len: 111 microversion: 2.1 time: 0.046478 Oct 11 01:18:49.207881 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 267/558] 10.222.0.66 () {58 vars in 1412 bytes} [Tue Oct 11 01:18:49 2022] GET /compute/v2.1/os-simple-tenant-usage/4edb9abbe8d54f8988680b3320416c42?start=2022-10-12T01%3A18%3A48.299678&end=2022-10-10T01%3A18%3A48.299678 => generated 111 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:18:49.221732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:49.224388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:49.246575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.247314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.247947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.248831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.249602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.251174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.318705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:49.433157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55f2e266-eb5e-4e59-8c66-dad7d0340ed4 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91/action" status: 202 len: 0 microversion: 2.1 time: 0.223628 Oct 11 01:18:49.434129 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 268/559] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:49 2022] POST /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:49.512385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:49.520963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:49.528950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:49.549481 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c042570-0766-482a-a578-256b487fa50f tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.664998 Oct 11 01:18:49.555001 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 292/560] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:48 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:49.576828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:49.577455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:49.602910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.609124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.609552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.610308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.611362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.611796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.817321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa79a76b-82cb-4e7a-a09a-45dc575c927b tempest-TenantUsagesNegativeTestJSON-1294572340 tempest-TenantUsagesNegativeTestJSON-1294572340-project] Calling method '.version_select at 0x7f1134962430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:49.821257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fa79a76b-82cb-4e7a-a09a-45dc575c927b tempest-TenantUsagesNegativeTestJSON-1294572340 tempest-TenantUsagesNegativeTestJSON-1294572340-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '461238a61815422b83603d05a39130a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edb9abbe8d54f8988680b3320416c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa79a76b-82cb-4e7a-a09a-45dc575c927b tempest-TenantUsagesNegativeTestJSON-1294572340 tempest-TenantUsagesNegativeTestJSON-1294572340-project] Request method failure captured: Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T01%3A18%3A48.299678&end=2022-10-12T01%3A18%3A48.299678&detailed=1 HTTP/1.1 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMR2sX2HWVirBX5zWm0bFtJ05_e_FTfrWMgAqlGiAbb5FS28p8mfZlMSul7D5haQkCPB26gPPq9j0xFLscrKWgviCGWCuM8FgHWznUd784B-EphclQVkDEqDNXI2AUr5WnxUXnmJR3kuDu28JoPMT2tXGrHZTYs3M6YwtrYHddF0fsE Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edb9abbe8d54f8988680b3320416c42 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1294572340 Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:18:49.825618 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edb9abbe8d54f8988680b3320416c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edb9abbe8d54f8988680b3320416c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edb9abbe8d54f8988680b3320416c42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edb9abbe8d54f8988680b3320416c42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1294572340 Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edb9abbe8d54f8988680b3320416c42 Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1294572340 Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TenantUsagesNegativeTestJSON-1294572340-project Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 461238a61815422b83603d05a39130a1 Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1294572340-project Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:18:49.827277 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:18:49.828276 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:18:49.829652 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:18:49.830979 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 01:18:49.830979 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:18:49.835499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa79a76b-82cb-4e7a-a09a-45dc575c927b tempest-TenantUsagesNegativeTestJSON-1294572340 tempest-TenantUsagesNegativeTestJSON-1294572340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:49.849304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa79a76b-82cb-4e7a-a09a-45dc575c927b tempest-TenantUsagesNegativeTestJSON-1294572340 tempest-TenantUsagesNegativeTestJSON-1294572340-project] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T01%3A18%3A48.299678&end=2022-10-12T01%3A18%3A48.299678&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.404062 Oct 11 01:18:49.856993 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 269/561] 10.222.0.66 () {58 vars in 1335 bytes} [Tue Oct 11 01:18:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T01%3A18%3A48.299678&end=2022-10-12T01%3A18%3A48.299678&detailed=1 => generated 123 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:49.866184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:49.880430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:49.888953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.889699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.890290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:49.891194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:49.904714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:49.907853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:50.304712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:50.370552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:50.967991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:50.979307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd6f6c7a-5d2e-41a0-adc6-496f0228414b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 1.423114 Oct 11 01:18:50.988855 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 293/562] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:49 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:50.993546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0bfee-ecfa-41df-a16f-b1c68f9824de", "name": "network-vif-deleted", "tag": "ee0e39ce-d5a7-4a49-99b8-2799a229c368"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:51.022957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.023676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.025505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0633a370-bee1-4e10-b720-58f33953b86d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1628 microversion: 2.1 time: 1.167177 Oct 11 01:18:51.031871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 270/563] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:49 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1628 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:51.032142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.046180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:51.046310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] Creating event network-vif-deleted:ee0e39ce-d5a7-4a49-99b8-2799a229c368 for instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de on n-h2-772273-9 Oct 11 01:18:51.046794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:51.052427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cfe07727-f0ec-48db-a69d-58b51f3f2806 req-dd91ac61-1202-4b53-b4bd-181719fb080b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062026 Oct 11 01:18:51.053246 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 294/564] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:51.056734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.057227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.057662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.060658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:51.061669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:51.062010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.062491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.062928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.070179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.070977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.071730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.072617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.073287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.073867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.127747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=56 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:51.158274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.159231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.159831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.161864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lazy-loading 'fault' on Instance uuid dfc0bfee-ecfa-41df-a16f-b1c68f9824de {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:51.268824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:51.284496 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b17f4614-11ed-4a00-aa36-82e14ed5bb54 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 200 len: 1312 microversion: 2.1 time: 0.250768 Oct 11 01:18:51.287945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 271/565] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:51 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:51.314395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": true, "disk_over_commit": false}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:51.317385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:51.343329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.344134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:51.348930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.352025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.352942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:51.353599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:51.354183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:51.366835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:51.375411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:51.382922 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbc68e5d-9f30-4fcb-9da0-296dfa009035 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.328333 Oct 11 01:18:51.405606 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 295/566] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:51 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:51.443388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lazy-loading 'flavor' on Instance uuid 2df22e7c-51bd-4947-890e-e8ce59e9eb91 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:18:51.488251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120493) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:18:52.036526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:52.037669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:52.047484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:52.049026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:52.049664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:52.050992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:52.052401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:52.053209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:52.875390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:52.887611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:52.904633 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a11a7f61-0585-43b1-b8f2-48c252e32bbf tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.884509 Oct 11 01:18:52.917390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 296/567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:52 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:52.932572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:52.936207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: dfc0bfee-ecfa-41df-a16f-b1c68f9824de] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:52.966628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:52.967236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:52.967835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:52.970940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:52.973329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:52.974491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:52.994112 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] HTTP exception thrown: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Request method failure captured: Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de HTTP/1.1 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRMfAd2Z5doLJiAFfBy9KCjh2PYblHy77Cw_lhbM_FvziaJbLdHM_0Gwe-jCm7NfLNxdekj6teJCzgWvil5xpwwFO8cCqeTdw5wTxmh_z2pFtFSXjDCO9EDL81IeMWLZtD4XKl5As-jGNVgBmwBPe6t5xo5E2kNX8qbxGu4sVLQgYg Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0957aad6b14547dd892fe171de611a15 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:18:52.996393 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0957aad6b14547dd892fe171de611a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0957aad6b14547dd892fe171de611a15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0957aad6b14547dd892fe171de611a15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0957aad6b14547dd892fe171de611a15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0957aad6b14547dd892fe171de611a15 Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-1631872624-project Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 93b9e02b63f1440d9d7bddfb6aa458f4 Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1631872624-project Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. Oct 11 01:18:52.998848 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'dfc0bfee-ecfa-41df-a16f-b1c68f9824de'} Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:18:52.999708 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. Oct 11 01:18:53.000954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:18:53.006544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Returning 404 to user: Instance dfc0bfee-ecfa-41df-a16f-b1c68f9824de could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:18:53.007711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab64e01c-4222-4fe9-a596-458785f16f4e tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de" status: 404 len: 111 microversion: 2.1 time: 0.089038 Oct 11 01:18:53.009439 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 297/568] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:52 2022] GET /compute/v2.1/servers/dfc0bfee-ecfa-41df-a16f-b1c68f9824de => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:18:53.016969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:53.031594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:53.048370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:53.062608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:53.069442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:53.076998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:53.079626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:53.080486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:53.545104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:53.556278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:53.562724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:53.581341 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c11cde6-fd48-4c79-87a4-aba2b0dee1c1 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.570579 Oct 11 01:18:53.582247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 298/569] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:53 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:53.587028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:53.587581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:53.609276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:53.609920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:53.610594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:53.611792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:53.613493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:53.614501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:53.712308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:18:54.083588 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3ce65e8-802d-4ee5-a874-aed991c63287 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 204 len: 0 microversion: 2.1 time: 0.499737 Oct 11 01:18:54.084959 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 299/570] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:18:53 2022] DELETE /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:18:54.092771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f92a2d-aa1f-4625-8153-f37d1ba43aa7", "name": "network-vif-plugged", "status": "completed", "tag": "c64878f2-6652-48aa-b9e1-afcad599de8d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:54.125656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:54.126187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:54.126629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:54.138458 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] Creating event network-vif-plugged:c64878f2-6652-48aa-b9e1-afcad599de8d for instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 on n-h2-772273-9 Oct 11 01:18:54.153194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0519a20a-6a77-46d2-810f-04db3177537e req-f72a2c2b-f81d-4704-ac42-f7f013cfea28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064193 Oct 11 01:18:54.154358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 300/571] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:54.168231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:54.169402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:54.188046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:54.189923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:54.190692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:54.191887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:54.192510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:54.194371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:54.990429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:55.010157 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5e6b212-b0ee-4d78-8f93-d4f1055cb1e2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1321 microversion: 2.1 time: 0.854382 Oct 11 01:18:55.011034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 301/572] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:54 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1321 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:55.034623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:55.036137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:55.042444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.043191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.043520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.044106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.044560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.044989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.533962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-695796b3-3e92-4500-99e6-9f3ea8746750 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91/action" status: 202 len: 0 microversion: 2.1 time: 4.236943 Oct 11 01:18:55.534628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 272/573] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:18:51 2022] POST /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91/action => generated 0 bytes in 4244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:18:55.545863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:55.548385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:55.561923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.564971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.566540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.567539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.568923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.569746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.739995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:55.753217 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5ed4a25-cf85-4a69-b02b-3556ceec4ffe tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1478 microversion: 2.1 time: 0.737585 Oct 11 01:18:55.754443 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 302/574] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:55 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1478 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:55.787440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:55.796682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:55.800395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:55.845328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.846971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.847483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.848475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:55.849280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:55.849827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:55.870279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:55.889311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:55.892528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:55.909328 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c7ba409-21ab-4e8d-a7a2-be09c770da6b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.371082 Oct 11 01:18:55.912553 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 273/575] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:55 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:56.036979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:56.042003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:56.058104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.060699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.061725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:56.075692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.078480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.079768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:56.465785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:56.475093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e0a8025-cf29-4567-9b86-fcc05b763044 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.704562 Oct 11 01:18:56.483034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 303/576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:55 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:56.783287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:56.785152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:56.794275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.795183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.795888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:56.798902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.799666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.800327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:56.862107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:56.878494 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a2327f8-20fe-4642-ae23-e7246fc0ac28 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1513 microversion: 2.1 time: 0.846822 Oct 11 01:18:56.879082 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 274/577] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:56 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1513 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:56.907823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:56.909806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:56.917583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.918312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.918905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:56.919799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:56.920404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:56.921562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.470022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:57.482235 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4665f58d-e5f3-40f1-a1ca-4ac73d991c04 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1478 microversion: 2.1 time: 0.703527 Oct 11 01:18:57.495899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 304/578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:56 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1478 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:57.508089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:57.511700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:57.520918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.521651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.522235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.523122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.523768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.524677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.611588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:57.623696 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4461552-bb09-479b-a2c8-fd4b27711119 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1512 microversion: 2.1 time: 0.720651 Oct 11 01:18:57.624524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 275/579] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:56 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:18:57.655232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:57.658206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:57.669386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.670195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.671045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.676754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.677623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.678276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.721147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:57.734855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:57.736816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:57.742598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7dc178c-b75d-4414-8a08-8c8d22168af6 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.245538 Oct 11 01:18:57.743747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 305/580] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:57 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:57.772650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:57.773493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:57.784223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.785360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.789301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:57.790765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:57.791442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:57.792041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:58.799156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:58.826551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4800446-f87d-44b9-9dd4-fef5e109d832 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1511 microversion: 2.1 time: 1.068652 Oct 11 01:18:58.829785 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 306/581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:57 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1511 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:58.831681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:58.848876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df22e7c-51bd-4947-890e-e8ce59e9eb91", "name": "network-vif-unplugged", "status": "completed", "tag": "cdbd7279-5c55-4416-b67e-b854f06e96e7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:58.873568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:58.898437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3129238-a3a2-4895-9c08-0c7cc521fd19 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 1.250184 Oct 11 01:18:58.899155 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 276/582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:57 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:58.908642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:58.910083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:58.910748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:58.912903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:58.913701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:58.932829 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] Creating event network-vif-unplugged:cdbd7279-5c55-4416-b67e-b854f06e96e7 for instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 on n-h1-772273-9 Oct 11 01:18:58.942415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3cd63f18-c4cc-46a1-a192-6db615aa9e61 req-a311ece1-f032-444a-91b7-27a23590b02d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111093 Oct 11 01:18:58.943049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:58.944287 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 307/583] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:58.949555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:58.950259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:58.951151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:58.951848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:58.952425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:58.952997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:58.954429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:58.964926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:58.965848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:58.967017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:58.968662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:58.972319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:58.973374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.203076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9e02b63f1440d9d7bddfb6aa458f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0957aad6b14547dd892fe171de611a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.213973 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9533d8f1-6e8e-425c-bb13-32087c3cb7e2 tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 200 len: 1436 microversion: 2.1 time: 0.313714 Oct 11 01:18:59.216323 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 277/584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:58 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 1436 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:18:59.223094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:59.223423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.238351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.240204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.241115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:18:59.241701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.266189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:18:59.269031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce5a6346-eb52-47cc-90dd-81dba6223e16 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.322119 Oct 11 01:18:59.269955 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 308/585] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:18:58 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:18:59.274849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c605c-02d8-4da7-a1de-a9fe8d49841e", "name": "network-vif-deleted", "tag": "4b65e650-17a9-4853-9e0e-1d02e1458d50"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:18:59.279103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.279850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.280427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.281475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.293443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.294096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.302215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.311728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.316342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.346690 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] Creating event network-vif-deleted:4b65e650-17a9-4853-9e0e-1d02e1458d50 for instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e on n-h1-772273-9 Oct 11 01:18:59.360795 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-855da388-5fa5-42ba-9625-f777c2536aac req-4e17b48e-65e0-45e9-beef-6c4dd1ecbf7b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087918 Oct 11 01:18:59.362166 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 309/586] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:18:59.497794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:18:59.642750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:18:59.655859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.656261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.657244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.927007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:18:59.927902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:18:59.945863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.947744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.948466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:18:59.955742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:18:59.959404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:18:59.964707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.083949 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f6f8816-3a6d-405a-a196-141de3084444 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.866328 Oct 11 01:19:00.084626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 278/587] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:18:59 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:00.117738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:00.136537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:00.140783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1952748138', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:00.177361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.180631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.181133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.182055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.186289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.192804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.449980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:00.534005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:00.562624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4380a68-7d6a-4636-9062-1a50166fe831 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.638320 Oct 11 01:19:00.565364 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 310/588] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:18:59 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:00.587095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:00.588608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] [instance: 8d9c605c-02d8-4da7-a1de-a9fe8d49841e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:00.602426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:00.606504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.607000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.610944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.611654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.612244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.615551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.616564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.617051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.617485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.654462 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] HTTP exception thrown: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Request method failure captured: Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e HTTP/1.1 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRMfAd2Z5doLJiAFfBy9KCjh2PYblHy77Cw_lhbM_FvziaJbLdHM_0Gwe-jCm7NfLNxdekj6teJCzgWvil5xpwwFO8cCqeTdw5wTxmh_z2pFtFSXjDCO9EDL81IeMWLZtD4XKl5As-jGNVgBmwBPe6t5xo5E2kNX8qbxGu4sVLQgYg Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0957aad6b14547dd892fe171de611a15 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:19:00.659522 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0957aad6b14547dd892fe171de611a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0957aad6b14547dd892fe171de611a15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0957aad6b14547dd892fe171de611a15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0957aad6b14547dd892fe171de611a15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0957aad6b14547dd892fe171de611a15 Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1631872624 Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-1631872624-project Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 93b9e02b63f1440d9d7bddfb6aa458f4 Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1631872624-project Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. Oct 11 01:19:00.661027 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '8d9c605c-02d8-4da7-a1de-a9fe8d49841e'} Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:19:00.661922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. Oct 11 01:19:00.663284 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:19:00.664605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] Returning 404 to user: Instance 8d9c605c-02d8-4da7-a1de-a9fe8d49841e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:19:00.669957 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eba9dac2-77be-427c-8caf-4fdad3a463ca tempest-ServersAdminNegativeTestJSON-1631872624 tempest-ServersAdminNegativeTestJSON-1631872624-project] 10.222.0.66 "GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e" status: 404 len: 111 microversion: 2.1 time: 0.101243 Oct 11 01:19:00.671082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 311/589] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:00 2022] GET /compute/v2.1/servers/8d9c605c-02d8-4da7-a1de-a9fe8d49841e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:19:00.688786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:00.689453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:00.709464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.710538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.711808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:00.712834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:00.713696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:00.714276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:01.114168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:01.129843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:01.134159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:01.146498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e81e580-202c-47ee-b1b4-6505b3432b00 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.468897 Oct 11 01:19:01.178321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 312/590] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:00 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:01.231643 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-278741fb-e1a6-40a3-a3ee-7f8aa7bee05c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1952748138" status: 200 len: 1515 microversion: 2.1 time: 1.119950 Oct 11 01:19:01.233003 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 279/591] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:19:00 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1952748138 => generated 1515 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:01.266968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:01.278374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:01.279607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:01.290306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:01.291008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:01.291477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:01.292529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:01.292984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:01.293499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:01.436476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df22e7c-51bd-4947-890e-e8ce59e9eb91", "tag": "cdbd7279-5c55-4416-b67e-b854f06e96e7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:01.483270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:01.486375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:01.489232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:01.516183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:01.519044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] Creating event network-changed:cdbd7279-5c55-4416-b67e-b854f06e96e7 for instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 on n-h1-772273-9 Oct 11 01:19:01.533155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-edf20059-830f-4cf0-ab3d-98327ef34297 req-e3eb8036-d073-4ff8-ad3f-83b49ff3f35a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097860 Oct 11 01:19:01.534436 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 280/592] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:19:01.749985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:01.767020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-549231680", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "20dc106a-253b-405c-ac01-f4b2f29545d4"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:01.777466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:01.778833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:01.779468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:01.876529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] validate_networks() for [('20dc106a-253b-405c-ac01-f4b2f29545d4', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:03.219238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3043adc-6a56-469a-b2c7-9ee2361b79cd tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.959252 Oct 11 01:19:03.221067 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 313/593] 10.222.0.66 () {58 vars in 1173 bytes} [Tue Oct 11 01:19:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:03.225951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:03.226748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:03.245251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:03.252652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:03.253296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:03.254217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:03.254841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:03.261941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:03.314364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:04.119660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.129326 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0947478b-8377-47f9-b634-164ad036529b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.906997 Oct 11 01:19:04.143382 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 314/594] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:03 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:04.149762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:04.149762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:04.162141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:04.162648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:04.163080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:04.169379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:04.171201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:04.174522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:04.446503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.458822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.464713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.483716 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b93317f-e0c2-48a5-ba73-4f67f8f3abdd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.352678 Oct 11 01:19:04.505117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 315/595] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:04 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:04.517158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:04.524012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.524732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.servers [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Removing options 'limit' from query {{(pid=120494) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 01:19:04.527279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:04.540124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:04.541117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:04.541717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:04.542628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:04.543326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:04.544193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:04.686457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:04.697415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:04.698361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:04.698958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.041040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:05.042301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:05.043456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:05.044134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:05.045273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:05.057565 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-790a1ffd-d1fd-4d3a-a095-19ef2d567ac7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.547199 Oct 11 01:19:05.058686 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 316/596] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:19:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:05.062670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.063489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.064668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.066383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.067130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.068839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.087159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:05.094557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:05.096336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:05.102027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.102846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.103529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.104675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.105290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.105872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.114808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:05.119198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for user 81493fadd3b044479ce4722ce58f3235 and project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:05.145174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:19:05.147798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:05.245872 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ba267c9-b9c9-4b4d-8b02-b8aa9448b13b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.703910 Oct 11 01:19:05.251757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 281/597] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3712 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:19:05.258948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:05.264391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:05.268394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:05.285805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.292043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.292667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.300127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.300805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.302120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.356642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:05.465306 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a06f794b-fda0-4814-8a26-6e8f4f1ff5d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.381690 Oct 11 01:19:05.469140 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 317/598] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:19:05 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:05.478895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:05.487374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:05.842150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:05.863181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:05.878423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:05.896153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8a15cbf-112f-4af5-a749-ac51ecb8b494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1261 microversion: 2.25 time: 0.425648 Oct 11 01:19:05.898375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 318/599] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:05 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1261 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:05.920483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:05.926505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:05.927201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.servers [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Removing options 'limit' from query {{(pid=120494) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 01:19:05.928086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:05.936369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.937172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.938398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:05.939407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:05.940054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:05.940911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.114909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:06.131931 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5bfad844-b845-4a2c-8a5b-3ceb23af404f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.868279 Oct 11 01:19:06.137504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 282/600] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:05 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:06.165545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:06.168203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:06.208103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.212694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.220813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.222939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.223739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.226209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.405194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:06.419120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:06.423412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:06.440736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed0fd755-f6fb-461b-8eb0-d29fc0a73f53 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.301446 Oct 11 01:19:06.443480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 283/601] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:06 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:06.632999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:06.757581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4033376a-17fc-4054-93e7-ec6479124a07 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.844234 Oct 11 01:19:06.758765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 319/602] 10.222.0.66 () {58 vars in 1150 bytes} [Tue Oct 11 01:19:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:06.771105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:06.777952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:06.778756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:06.798962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.802024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.802740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.804439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.807833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.808511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.927555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:06.928212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:06.947650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.948328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.948784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:06.949535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:06.950107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:06.963235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.190676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:07.206241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:07.214024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:07.217137 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e07beac-cde1-4cb4-8d1c-21682ff1351c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1313 microversion: 2.25 time: 0.294868 Oct 11 01:19:07.223530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 320/603] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:06 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:07.230797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:07.242436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:07.267220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.269400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.271666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.273277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.289732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.293876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.654723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:07.711238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:07.737381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0c17d93-f20c-4372-adb0-60e940a30ba8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.509268 Oct 11 01:19:07.744209 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 321/604] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:07 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:07.762615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:07.765476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:07.790877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.791426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.792553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.793300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.796444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.798224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.813948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9515ac0b-08f9-4697-94be-392e5ce0d74e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 1.047299 Oct 11 01:19:07.825716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 284/605] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:19:06 2022] GET /compute/v2.1/servers => generated 1011 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:07.838904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:07.855625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:07.856740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:07.905486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.906012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.912514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:07.913839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:07.917002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:07.917672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.052784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.069399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.079529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.101211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e76de02-f575-47b8-9331-30f1f31fb08e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.353848 Oct 11 01:19:08.106122 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 322/606] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:07 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:08.192356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:08.251024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:08.255266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:08.284405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.284935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.287705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.288749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.295674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.296437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.332210 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-17928d2b-399b-42cb-9f34-03d50fb824c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.503779 Oct 11 01:19:08.342347 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 285/607] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:19:07 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:08.352236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:08.358257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.359043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.servers [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Removing options 'limit' from query {{(pid=120493) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 01:19:08.371729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:08.384525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.386694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.389574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.390958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.391727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.393092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.447279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3360ad99-2416-4d27-ae2a-39ba2acee0d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.103477 Oct 11 01:19:08.460117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 286/608] 10.222.0.66 () {58 vars in 1140 bytes} [Tue Oct 11 01:19:08 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:08.472780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:08.494272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.497529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1952748138', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:08.514157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.514656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.515086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.522133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.522941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.525420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.536148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.555868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.559852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:08.565060 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb62b703-4180-4345-9364-26f0d039ef3c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1319 microversion: 2.25 time: 0.319393 Oct 11 01:19:08.566099 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 323/609] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:08 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:08.684192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:08.768958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:08.771142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:08.786230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.787120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.789651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.792710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.806403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.807241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:08.886875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d589941f-82e3-4ed3-9138-3d96139cef7f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1952748138" status: 200 len: 346 microversion: 2.1 time: 0.425217 Oct 11 01:19:08.899996 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 287/610] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:19:08 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1952748138 => generated 346 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:08.913480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:08.925603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:08.930366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:08.931009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.106169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:19:09.227539 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f012f4c-5195-4088-b9de-2cec84ff13d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "POST /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74/action" status: 202 len: 0 microversion: 2.1 time: 0.320963 Oct 11 01:19:09.244011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 288/611] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:19:08 2022] POST /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:19:09.260508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:09.264175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:09.268631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.282553 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9ab9f1d-86e0-4ef1-a05e-682f1129baff tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.516726 Oct 11 01:19:09.290549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.298808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.304154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.305176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.308702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.309913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.329662 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 324/612] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:08 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:09.344491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:09.345121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:09.383158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.383555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.387897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.393236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.399099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.399702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.651693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.670052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.671526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.692224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90a8cd0d-bd66-41c5-a428-5475b648ba75 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1447 microversion: 2.75 time: 0.446826 Oct 11 01:19:09.698930 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 289/613] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:09 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1447 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:09.712813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:09.713512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:09.736442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.736958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.738166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.739120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:09.739775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:09.741215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:09.896101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.905979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.909386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.917171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:09.918755 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1702e083-bc4f-4dce-b929-5f98d8dbf1be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1319 microversion: 2.25 time: 0.218503 Oct 11 01:19:09.919696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3321fbbc-1ad5-4815-8a4e-49c3cb7e5f72 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1522 microversion: 2.1 time: 0.588805 Oct 11 01:19:09.921428 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 325/614] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:09 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:09.941994 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 290/615] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:09 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:10.167091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1512461623", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:10.304530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:10.328273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:10.328905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:10.339678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:10.340182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:10.340622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:10.348361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:10.373897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:10.374445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.181712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:11.182202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:11.182600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:11.183017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:11.183462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:11.201159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.205107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.205737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.206712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.210868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.211551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.264606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:11.270489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:11.289280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:19:11.297103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:11.409979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:11.414994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90239e58-f81a-4342-a05a-f96e2b2cfbb1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491627 Oct 11 01:19:11.419504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2ac90e3-0331-4d66-8e18-2fe94e70176d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 1.097860 Oct 11 01:19:11.422118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 326/616] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:19:11.427406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:11.428545 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 291/617] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:10 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:11.448114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:11.449316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:11.455753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:11.465460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.469408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.470692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.472357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.472865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.473436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.475693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.477591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.484131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.484889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.485371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.485885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.923701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:11.942878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:11.945363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:11.955943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27114dbe-858b-456f-bf66-fa8d9e0479dd tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1453 microversion: 2.75 time: 0.532266 Oct 11 01:19:11.958883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 327/618] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:11 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1453 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:11.971114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:11.972880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:11.979272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:11.984737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.985610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.986754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:11.987653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7af58725-88f3-4ac7-9df3-a4edfd19c6f4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1522 microversion: 2.1 time: 0.557845 Oct 11 01:19:11.990971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:11.991620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:11.992008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 292/619] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:11 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:11.994190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:12.002895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d473fdac-7690-49c9-a690-fd15c75e5c67 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:12.004559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d473fdac-7690-49c9-a690-fd15c75e5c67 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:12.181890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d473fdac-7690-49c9-a690-fd15c75e5c67 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:12.194044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d473fdac-7690-49c9-a690-fd15c75e5c67 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1217 microversion: 2.1 time: 0.200826 Oct 11 01:19:12.195157 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 293/620] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:11 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:12.298361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:12.310665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:12.316274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:12.318705 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-242629b6-d0d2-4c10-8353-d34d6b32f917 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 0.358165 Oct 11 01:19:12.320243 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 328/621] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:11 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:12.457912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:12.459138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:12.469846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:12.475243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:12.477300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:12.478246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:12.491194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:12.496585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:12.886938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:12.902718 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9be5f927-9259-4976-a54a-5051c315ac59 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.448549 Oct 11 01:19:12.904640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 294/622] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:12 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:12.986526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:12.987035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:12.998616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:12.999128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.002762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.003571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.004071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.004483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.026006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:13.026925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:13.040163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.040578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.041046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.041786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.042251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.042690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.285403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:13.319150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:13.328165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:13.344537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30f2c983-775b-4c4c-8720-64088a715d70 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1453 microversion: 2.75 time: 0.360876 Oct 11 01:19:13.375108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 329/623] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:12 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1453 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:13.382351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:13.389659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:13.407141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.407890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.412806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.413763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.414398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.414990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.650997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:13.662377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6534ffab-c5a1-44e4-8a1d-ff78645b39c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1269 microversion: 2.1 time: 0.285749 Oct 11 01:19:13.663588 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 330/624] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:13 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1269 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:13.669109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:13.672675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:13.689783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.690834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.692626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.694905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:13.695411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:13.697752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:13.980411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:13.995313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5899ca20-0c12-4432-afcd-b1b81251bc3d tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1522 microversion: 2.1 time: 0.982552 Oct 11 01:19:13.996562 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 295/625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:13 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1522 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:14.003766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad991591-cd0a-4007-a8a7-a3ddea88189e", "tag": "d60c6926-f8d4-47cb-9efd-43daaf733530"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:14.019141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.019925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.021564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.052860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] Creating event network-changed:d60c6926-f8d4-47cb-9efd-43daaf733530 for instance ad991591-cd0a-4007-a8a7-a3ddea88189e on n-h1-772273-9 Oct 11 01:19:14.066917 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8029ca58-d228-4715-8824-da1b83502b6f req-4430d90e-b14b-4185-9693-1a78467ac9f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067586 Oct 11 01:19:14.075193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 296/626] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:14.110906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:14.112680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:14.127625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.128602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.130220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.131796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.132481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.133138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.666452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.677447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.678921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.680266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ef3cd5b-6b02-4f05-8b68-54d6fc781a55 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 1.015404 Oct 11 01:19:14.681197 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 331/627] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:13 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:14.686001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:14.686861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:14.694574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.700789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.701275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.702459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.702610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.703004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.730541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:14.861391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.872298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.885351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.891976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-edfa40eb-5218-4f75-836c-381c8abb7c05 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1453 microversion: 2.75 time: 0.209558 Oct 11 01:19:14.893275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 332/628] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:14 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:14.902417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:14.903051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:14.916322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.917878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.921359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:14.923950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.924787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:14.925275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:14.925718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:14.931592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fe03815-2c50-4c4e-9d81-4c80378803e5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1502 microversion: 2.1 time: 0.844353 Oct 11 01:19:14.941946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 297/629] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:14 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1502 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:15.024272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:15.025536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:15.033449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.033947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.034383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:15.035260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.036774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.037220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:15.054361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:15.068240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c267c8f-b1ad-4051-aaad-30939b41c812 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1275 microversion: 2.1 time: 0.173551 Oct 11 01:19:15.072346 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 333/630] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:14 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:15.470821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:15.481828 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2dec29d4-db07-42e7-8047-d3d83561a65a tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1522 microversion: 2.1 time: 0.462198 Oct 11 01:19:15.491628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 298/631] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:15 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:15.710894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:15.720375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:15.740717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.741510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.745485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:15.746550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.748572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.757385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:15.927106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:15.930370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:15.951764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.952836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.953291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:15.954018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:15.954468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:15.954900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:16.020082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:16.245974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.268678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.274831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.284207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f34278f7-0dba-4529-8505-85e620567953 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1438 microversion: 2.75 time: 0.362234 Oct 11 01:19:16.285778 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 299/632] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:15 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1438 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:16.291714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:16.293187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:16.303145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:16.303800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:16.304380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:16.305460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:16.306313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:16.306899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:16.731185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.744160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.747129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.748345 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a122b45-85b2-4848-ab5b-0bc45e3bb763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 1.045225 Oct 11 01:19:16.748930 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 334/633] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:15 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:16.762511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:16.764648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:16.776550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:16.779481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:16.782566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:16.783388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:16.786750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:16.787511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:16.790526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:16.960557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:16.971658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a696473-6f48-4090-bca6-d359fa6158d3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1275 microversion: 2.1 time: 0.220597 Oct 11 01:19:16.975181 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 335/634] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:16 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:16.987992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:17.004982 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf5935a4-053f-4cc2-aba7-e0223aa0d0ef tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1477 microversion: 2.1 time: 0.717526 Oct 11 01:19:17.005905 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 300/635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:16 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1477 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:17.010528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:17.015389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:17.025481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.036167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.039581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.040719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.041364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.041977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.258478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:17.261769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:17.277442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.278653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.279320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.280420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.282416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.283284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.429573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:17.430128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:17.435922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:17.436599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:17.437125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:17.591076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:17.607360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.609884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.610462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.614715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.615424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.615983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.642361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:17.665252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eeb72f86-ce44-4650-9b72-ec1902cc50d4 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1499 microversion: 2.1 time: 0.657482 Oct 11 01:19:17.667918 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 301/636] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:17 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1499 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:17.687483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abb66723-9c4f-406c-a5c5-cbb919033e08 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '.version_select at 0x7f113466ca60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:17.706162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb66723-9c4f-406c-a5c5-cbb919033e08 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.706870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb66723-9c4f-406c-a5c5-cbb919033e08 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.712913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb66723-9c4f-406c-a5c5-cbb919033e08 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.769268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abb66723-9c4f-406c-a5c5-cbb919033e08 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.096371 Oct 11 01:19:17.781945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 302/637] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:19:17 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:17.794832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:17.807042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:17.807991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:17.820664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.834328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.836032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:17.838091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:17.841081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:17.841893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.030915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:18.134594 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af9b22de-0058-4aa5-92e4-92d8b59f3a3c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.351029 Oct 11 01:19:18.142786 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 303/638] 10.222.0.66 () {58 vars in 1154 bytes} [Tue Oct 11 01:19:17 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:18.148071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:18.149143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:18.156307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.157062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.157663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.158115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:18.159065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.159740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.160323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.295269 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb27cff1-e753-4eee-8a8f-3a41f71b1878 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a/action" status: 202 len: 1942 microversion: 2.75 time: 1.317973 Oct 11 01:19:18.309354 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 336/639] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:19:16 2022] POST /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a/action => generated 1942 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 01:19:18.326200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:18.326821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:18.334502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.335022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.335491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.336202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.336655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.337079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.674063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:18.685849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:18.688467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:18.690073 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8620b0c5-c015-4ba8-9632-b65e8c71770c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 0.545728 Oct 11 01:19:18.691169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 304/640] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:18 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:18.695840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:18.696813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:18.703904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.704683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.705340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.706266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.707014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.707679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.731126 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83fcad90-d9a1-406c-8fb1-d456794d4a9e tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1628 microversion: 2.1 time: 0.420538 Oct 11 01:19:18.732795 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 337/641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:18 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1628 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:18.743676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:18.755064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:18.779519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:18.780291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:18.880651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 01:19:18.973348 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a686ca87-d84a-4ef4-a62d-dcae6f1c4d3e tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "POST /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74/action" status: 202 len: 0 microversion: 2.1 time: 0.236806 Oct 11 01:19:18.975850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 338/642] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:19:18 2022] POST /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:19:19.002442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:19.004763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:19.032597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:19.043615 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-afe9e498-e2e7-4a32-ae3b-b23a3bb4a9e6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.350650 Oct 11 01:19:19.055573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.055573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.055573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.055573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.055885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.055885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.056879 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 305/643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:18 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:19.070729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b015e3e1-ad06-407d-a1db-48c677e11ab0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: .version_select at 0x7f1134c0cee0>, body: {"keypair": {"name": "tempest-keypair-1705535004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2MTZaKw+AmI4KtpV/uttPAyIu1wOXUIBRREb9vy9dJJ6N5F0T0oVln8ppMeyPIcqEWmU/yqidJWKoBw75OnIjexUxwUo24XljiqM4r3APZ9eyELf8m4HnPT9bU6YJ1bw=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:19.107831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b015e3e1-ad06-407d-a1db-48c677e11ab0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:19.127706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b015e3e1-ad06-407d-a1db-48c677e11ab0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for user ef7f0979c5764837ae474f3a09cedb7b and project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:19.168903 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b015e3e1-ad06-407d-a1db-48c677e11ab0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100402 Oct 11 01:19:19.170911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 306/644] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:19:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:19.181743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:19.183967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:19.198987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.201079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.201757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.203265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.208015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.208767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.627292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:19.664789 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6fd49e7-2bae-45a3-8d0c-5536dd5ff9f3 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.687020 Oct 11 01:19:19.673698 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 339/645] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:18 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:19.678824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d", "tag": "96ab590e-c896-4430-a6f0-d28ad6c7c891"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:19.711147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.711650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.712085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.733368 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] Creating event network-changed:96ab590e-c896-4430-a6f0-d28ad6c7c891 for instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d on n-h1-772273-9 Oct 11 01:19:19.763706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4bb78c96-413a-48db-89a2-df1a925fbf98 req-10716d35-d508-44a1-9160-13f455d09c95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088346 Oct 11 01:19:19.772847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 340/646] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:19.787658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:19.788882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:19.803081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.803637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.804079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:19.804802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:19.805262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:19.805689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:20.108758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:20.120280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f098fe6c-9808-4b5d-adfb-601f44d816c9 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1508 microversion: 2.1 time: 0.947921 Oct 11 01:19:20.144867 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 307/647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:19 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1508 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:20.153383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:20.154373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:20.174986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:20.175527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:20.175963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:20.176883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:20.177514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:20.178178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:20.631098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:20.645141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:20.648602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:20.649938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c5fd61e-6744-4375-bdb3-189ece1a8504 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 0.875211 Oct 11 01:19:20.668719 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 341/648] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:19 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:20.696965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:20.697860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:20.707909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:20.708606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:20.711087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:20.713447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:20.714091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:20.716294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:20.747485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:20.768355 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9987a042-ac80-49e2-a7ee-8900a7188f84 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.622334 Oct 11 01:19:20.784533 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 308/649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:20 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:20.987452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:21.050942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60fafa51-ec92-4d17-a7df-b7725a8cdd60 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.357727 Oct 11 01:19:21.052758 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 342/650] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:20 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:21.152539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:21.153334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:21.170369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.176952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.178691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:21.184042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.189865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.192530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:21.683312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:21.683954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:21.699183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:21.702854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:21.708489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.710960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.713409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:21.723250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.725345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.728921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:21.816415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:21.829144 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-703cb809-a782-4675-87f8-18b6be33a538 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1508 microversion: 2.1 time: 0.680962 Oct 11 01:19:21.837209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 309/651] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:21 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1508 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:21.848845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:21.853975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:21.860359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:21.893761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.895526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.896599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:21.912464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:21.913209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:21.913838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:22.336686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:22.385041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:22.400804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:22.401990 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65246aad-40e0-44e8-bcaf-118c7e897da2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 0.723186 Oct 11 01:19:22.413553 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 343/652] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:21 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:22.433512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:22.434129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:22.465278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:22.475217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:22.482030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:22.483672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:22.487954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:22.488633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:22.528114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:22.547969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a307940-a533-49f5-980b-43ea3928c046 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.706417 Oct 11 01:19:22.549796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 310/653] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:21 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:22.574586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad991591-cd0a-4007-a8a7-a3ddea88189e", "name": "network-vif-plugged", "status": "completed", "tag": "d60c6926-f8d4-47cb-9efd-43daaf733530"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:22.619980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:22.623961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:22.628682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:22.677138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] Creating event network-vif-plugged:d60c6926-f8d4-47cb-9efd-43daaf733530 for instance ad991591-cd0a-4007-a8a7-a3ddea88189e on n-h1-772273-9 Oct 11 01:19:22.694499 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-56cf69ff-88c8-4546-a5b9-2ad814be6eb0 req-15a5bacd-e2f9-4696-a900-4b7b2609a4ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142767 Oct 11 01:19:22.696949 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 311/654] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:22.769263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:22.857678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1888b98-ed98-46b6-afdf-084dbdf28ace tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.442650 Oct 11 01:19:22.864414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:22.865989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:22.890945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 344/655] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:22 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:22.898035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:22.898552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:22.908241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:22.911430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:22.911909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:22.930387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:23.441354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:23.441954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:23.466665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:23.477031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:23.477780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:23.478691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:23.479301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:23.483054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:23.497033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:23.622593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:23.632431 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca76d293-831d-42bb-a730-8864e3e07893 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1512 microversion: 2.1 time: 0.772265 Oct 11 01:19:23.641743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 312/656] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:22 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1512 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:23.657737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:23.659923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:23.683136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:23.685094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:23.688245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:23.689162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:23.690214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:23.691841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.059948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.075722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d0b2893-be6e-45f7-adc6-b37b7c79b580 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.427681 Oct 11 01:19:24.076552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 313/657] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:23 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:24.078095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.081954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:24.086956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.087717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.servers [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Removing options 'limit' from query {{(pid=120493) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 01:19:24.088742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:24.090226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.091005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.103953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.105078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.106319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.106620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.108792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.110026 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c9b17fb-0b27-4adf-ad9d-f12878875ce9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1361 microversion: 2.25 time: 0.672949 Oct 11 01:19:24.110998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 345/658] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:23 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1361 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:24.111280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.113054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b10512a0-2944-424f-a7f9-7d1a4e8507a6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.035193 Oct 11 01:19:24.113623 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 314/659] 10.222.0.66 () {58 vars in 1140 bytes} [Tue Oct 11 01:19:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:19:24.133480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:24.134300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:24.134771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:24.136042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:24.141817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.142633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.143267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.147668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.148247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.148662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.149308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.149760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.150170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.155876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.156725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.157826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.377053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:24.412160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62a44dac-1c57-4781-ad1a-2a494b1614e9 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.290570 Oct 11 01:19:24.412987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 346/660] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:24 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:24.544613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.556363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0cbb4f2e-81c3-4750-9b84-401175f5997f tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1512 microversion: 2.1 time: 0.432859 Oct 11 01:19:24.563893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 315/661] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:24 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:24.593341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:24.594200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:24.602349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.608202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.608958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.609883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.610502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.611078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.893814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:24.902330 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53800b73-1444-4003-903f-641737508da7 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1511 microversion: 2.1 time: 0.313359 Oct 11 01:19:24.909401 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 347/662] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:24 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:24.938129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:24.939708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:24.951006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.952620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.953312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:24.954399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:24.955071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:24.955707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:25.108466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:25.109943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:25.122155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:25.122936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:25.129728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:25.131865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:25.136207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:25.139570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:25.327523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.337567 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96782c99-a81b-4848-b7a9-08cdbb2d3951 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1513 microversion: 2.1 time: 0.404254 Oct 11 01:19:25.340646 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 316/663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:24 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:25.351080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:25.352113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:25.370438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:25.374315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:25.375711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:25.378570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:25.382711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:25.384352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:25.889720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.901944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d730f7d0-7aa4-4c4f-bf7a-38b214986d69 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.797258 Oct 11 01:19:25.918164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 348/664] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:25 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:25.941420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:25.958056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.968259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.970342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.972046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:25.973117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:25.980648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3aaf2198-fead-4a85-a352-b518011da66d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1557 microversion: 2.25 time: 0.638717 Oct 11 01:19:25.995743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 317/665] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:25 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1557 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:26.012990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:26.022038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:26.046498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.047387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.048334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:26.049295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.049969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.050646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:26.229113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.229764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.230387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:26.231532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.232115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.232678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:26.249970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:26.327135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:26.337031 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81ebb95c-623a-46ff-82e2-d5d05315716a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.339678 Oct 11 01:19:26.338236 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 318/666] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:25 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:26.343992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-690380870", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c"}], "security_groups": [{"name": "tempest-securitygroup--838400000"}], "key_name": "tempest-keypair-1705535004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:26.408133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:26.482301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3001a7e2-a522-4c40-9ab1-abe81e2f62d0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.552455 Oct 11 01:19:26.492183 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 349/667] 10.222.0.66 () {58 vars in 1154 bytes} [Tue Oct 11 01:19:25 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:26.549499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] validate_networks() for [('9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:26.747672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:26.747672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:26.755475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.756114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.770618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:26.771609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:26.775423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:26.776971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.079255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid ad991591-cd0a-4007-a8a7-a3ddea88189e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:27.097535 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d705e98-e934-4078-baa3-1222665428e4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 2049 microversion: 2.25 time: 0.603878 Oct 11 01:19:27.098430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 350/668] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:26 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 2049 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:27.107439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.108630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:27.127535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.127535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.127742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.128392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.128838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.129261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.240137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:27.240569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:27.241033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:27.241809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:27.242440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:27.252017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=17 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:27.253770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.254650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.255070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.256069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.256765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.257288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.267572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=17 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:27.282831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:27.294432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for user ef7f0979c5764837ae474f3a09cedb7b and project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:27.308588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:19:27.312468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:27.331485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:27.365995 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b58bfc40-b702-4b82-ae1f-867252a6c724 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1512 microversion: 2.1 time: 0.265553 Oct 11 01:19:27.368532 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 351/669] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:27.395488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.396364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:27.398105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ea2cd63-d9dc-425e-a084-de5568541395 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.057772 Oct 11 01:19:27.400865 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 319/670] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:19:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:19:27.403748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.404474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.405110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.406083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.406792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.407479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.413536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.416335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:27.444038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.444721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.445486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.446477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.447614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.448205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.682341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:27.697442 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0a38f37-f89e-4187-adfa-a34c9989fe75 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.327537 Oct 11 01:19:27.709261 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 352/671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:27.722380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.722744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:27.732057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.733246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.733955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.734894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.735785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.736441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.830366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid ad991591-cd0a-4007-a8a7-a3ddea88189e {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:27.871154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8dcd9c8a-1114-474f-8ec6-fb2a390ca37c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 2049 microversion: 2.25 time: 0.468401 Oct 11 01:19:27.883256 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 320/672] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 2049 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:27.889704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:27.902695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.903332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:27.934068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.936061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.938440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.940795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:27.942535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:27.943464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:27.944017 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b832d8e-f42a-43c2-8160-fabc3a994833 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.232417 Oct 11 01:19:27.945641 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 353/673] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:27.954056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21ac31fd-ff4a-4b4f-bd9d-950283c65d28 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:27.955575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21ac31fd-ff4a-4b4f-bd9d-950283c65d28 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:28.100722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21ac31fd-ff4a-4b4f-bd9d-950283c65d28 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:28.111312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21ac31fd-ff4a-4b4f-bd9d-950283c65d28 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1234 microversion: 2.1 time: 0.163391 Oct 11 01:19:28.119823 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 354/674] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1234 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:28.141486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:28.152490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.155630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.157267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.158092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.158566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.158997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.245664 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed978ce9-9e1e-41fa-a9d9-30d4093d5c6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123533 Oct 11 01:19:28.246292 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 355/675] 10.222.0.66 () {60 vars in 1217 bytes} [Tue Oct 11 01:19:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:19:28.278349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": "auto"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:28.284483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:28.299863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.300544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.301536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.302616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.303330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.304096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.338711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:28.351077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'flavor' on Instance uuid ad991591-cd0a-4007-a8a7-a3ddea88189e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:28.353638 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-675f6112-26d0-4ed6-b8d0-114078e5c6c3 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1511 microversion: 2.1 time: 0.462650 Oct 11 01:19:28.362634 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 321/676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:27 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:28.378137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:28.378623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:19:28.378784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:28.387674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.388171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.389301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.389841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.393242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.393952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.753976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:28.784106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a856ee9-3c1b-48a8-b7d2-1063e3f1faf8 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1513 microversion: 2.1 time: 0.409700 Oct 11 01:19:28.786282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 322/677] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:28 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1513 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:28.798702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:28.802930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:28.844342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.851180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.851747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:28.853077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:28.854946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:28.855606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.134101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:29.159808 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3c114c1-f782-4afd-8d60-99a6e89c1209 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.369700 Oct 11 01:19:29.160768 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 323/678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:28 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:29.187946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:29.193606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:29.194963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:29.201061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:29.202392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:29.203119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.204065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:29.205126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:29.205749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.335831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:29.491675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:29.504717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:29.505440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:29.506015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.820073 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96b80496-3cb8-4e21-8013-9a5b20a60f48 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.657310 Oct 11 01:19:29.820688 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 324/679] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:19:29 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:29.825739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:29.827022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:29.840595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:29.841413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:29.845212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.866609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:29.867617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:29.868251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:29.993390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:30.052775 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6de46368-5530-4c41-90af-9b0395df7665 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.230686 Oct 11 01:19:30.054586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 325/680] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:29 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:30.064268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:30.069540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:30.083009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.083862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.084502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.093885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.095926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.096555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.217280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:30.226719 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f354d51-fb2a-4b34-a2d9-c5eb7f929d62 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1304 microversion: 2.1 time: 0.169940 Oct 11 01:19:30.227692 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 326/681] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:30 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:30.237939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d", "name": "network-vif-plugged", "status": "completed", "tag": "96ab590e-c896-4430-a6f0-d28ad6c7c891"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:30.265462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.266244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.266855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.292070 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] Creating event network-vif-plugged:96ab590e-c896-4430-a6f0-d28ad6c7c891 for instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d on n-h1-772273-9 Oct 11 01:19:30.294087 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-262d2764-bdde-4a86-8cbe-fe407368fcc1 req-fafc9831-3b07-415c-b4e9-c904cf594555 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064187 Oct 11 01:19:30.301372 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 327/682] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:30.320779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:30.331772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:30.333368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:30.531643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.532475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.533160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.534548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.535213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.535655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.693980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:30.785689 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d1f3e77-e9a4-4f64-ac8f-4168a8e6eaad tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.477038 Oct 11 01:19:30.791884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 328/683] 10.222.0.66 () {58 vars in 1150 bytes} [Tue Oct 11 01:19:30 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:30.810256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:30.810256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:30.819060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.819747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.820336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.821688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:30.822192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:30.822671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:30.876166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:19:31.007301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b874241-9488-487f-97c4-87f6b051a0a9 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 204 len: 0 microversion: 2.1 time: 0.211263 Oct 11 01:19:31.033587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 329/684] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:19:30 2022] DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:19:31.053278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:31.056057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:31.070930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.074765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.075564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.076397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.079376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.082218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.420683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:31.432332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd2eb505-15dc-489e-a906-298999873f50 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1317 microversion: 2.1 time: 0.397327 Oct 11 01:19:31.433115 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 330/685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:31 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:31.443392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:31.448551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:31.449314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:31.466093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.466604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.469657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.471830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.472534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.473428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.599966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:31.727532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29511217-9bc2-46c3-bcbe-d3ef3fd9a42b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.293351 Oct 11 01:19:31.737085 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 331/686] 10.222.0.66 () {58 vars in 1212 bytes} [Tue Oct 11 01:19:31 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:31.744186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:31.744823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:31.759944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.760443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.760888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.761915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.762380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.763475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.801806 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41689886-fb91-4020-80a9-a5faba03b379 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e/action" status: 202 len: 0 microversion: 2.25 time: 3.541715 Oct 11 01:19:31.803051 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 356/687] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:19:28 2022] POST /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e/action => generated 0 bytes in 3544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:19:31.812616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1021282351", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "1334067820", "adminPass": "***", "networks": [{"uuid": "2df52ec0-0bc5-4a60-b133-32e97fce5b7a"}], "security_groups": [{"name": "tempest-securitygroup--336078661"}], "key_name": "tempest-keypair-2123105706", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:31.860414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:31.885200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:31.902635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb2138a6-1092-4c59-9f4a-6ad5ecf3b31a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.170658 Oct 11 01:19:31.916867 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 332/688] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:31 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:31.923238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:31.923912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:31.933168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.933666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.934107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.934815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:31.935742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:31.936187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:31.987099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] validate_networks() for [('2df52ec0-0bc5-4a60-b133-32e97fce5b7a', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:32.538062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:32.546146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-deeab93c-47ef-4dbb-be4f-1a32555afd81 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.628420 Oct 11 01:19:32.549893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 333/689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:31 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:32.564206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:32.573597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:32.578555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:32.592414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:32.593231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:32.593883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:32.595030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:32.595690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:32.598630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:32.771305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:32.922502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-560e1d1a-94a6-4457-b52d-e4372bb2371b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.371198 Oct 11 01:19:32.923726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 334/690] 10.222.0.66 () {58 vars in 1196 bytes} [Tue Oct 11 01:19:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:32.945845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:32.946451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:32.954070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:32.954608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:32.955226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:32.956238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:32.956641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:32.957175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.383753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:33.407863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:33.410419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:33.411685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf1c20bc-87a2-4638-9b57-74c6cc5fd10b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.483010 Oct 11 01:19:33.415485 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 335/691] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:32 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:33.421615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:33.422508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:33.430413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.430964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.431492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.432672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.432792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.433195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.636354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:33.637525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:33.640063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:33.640792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:33.642006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:33.662633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.663467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.664220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.664976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.665467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.666103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.689663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:33.694266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Getting quotas for user 8ceaad6f2134402197aa3f86afe2eb80 and project 15f8cda53a1142d39a3179751c96fc1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:33.711220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:19:33.714169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:33.769702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:33.781487 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91b1ae20-4501-4e9d-bcd2-36959f422d07 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1466 microversion: 2.1 time: 0.364835 Oct 11 01:19:33.782307 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 336/692] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:33 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1466 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:33.786793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:33.804050 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a439acc-911e-4280-9e18-4a6482e8affd tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.999353 Oct 11 01:19:33.812372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 357/693] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:19:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:19:33.818677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:33.819662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:33.822514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:33.826966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': '1952748138', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:33.829485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.830193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.830809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.832847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.833480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.834349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.835925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.837474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.841460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.842675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.843265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.843840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.939720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:33.975114 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e33dcd29-8e89-42ca-9f8d-11a17e220a9a tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.161146 Oct 11 01:19:33.977760 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 358/694] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:33 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:33.987153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:33.987987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:33.996399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.997053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:33.998261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:33.999270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:33.999894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.000536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.011568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:34.095774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36003073-df35-411a-9737-6f00f9ed476c tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=1952748138" status: 200 len: 346 microversion: 2.1 time: 0.309962 Oct 11 01:19:34.102946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 337/695] 10.222.0.66 () {58 vars in 1156 bytes} [Tue Oct 11 01:19:33 2022] GET /compute/v2.1/servers?name=1952748138 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:34.305483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:34.316605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68206532-a661-4773-8bd0-64005390d1e6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.333422 Oct 11 01:19:34.317207 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 359/696] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:33 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:34.340734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86cbef4d-a1e7-4b7c-b4d0-57e35b27e73c tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] Calling method '.version_select at 0x7f113467b820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:34.359378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86cbef4d-a1e7-4b7c-b4d0-57e35b27e73c tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.255204 Oct 11 01:19:34.369654 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 338/697] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:19:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:34.377626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db6c72cc-ea76-4ee0-ae59-4889813cd489 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:34.378636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db6c72cc-ea76-4ee0-ae59-4889813cd489 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:34.461423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db6c72cc-ea76-4ee0-ae59-4889813cd489 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:34.480229 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db6c72cc-ea76-4ee0-ae59-4889813cd489 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1265 microversion: 2.1 time: 0.107360 Oct 11 01:19:34.495455 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 339/698] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:34 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:34.495455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:34.504183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:34.512147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.512606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.532834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] Creating event network-changed:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h2-772273-9 Oct 11 01:19:34.551630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-17dbcc66-98e7-41f6-9e7f-06bbad08cd8a req-3581bdc8-c130-422f-a95d-d5f848691a25 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066342 Oct 11 01:19:34.554080 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 340/699] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:34.569426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:34.575330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:34.576769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:34.584901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:34.585893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:34.587877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:34.589829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.590205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.590931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:34.592918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.595145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.604423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:34.604921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.605348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.606082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:34.606545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:34.606998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:34.626927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:34.772027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:34.876474 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48a43683-e50d-4c68-a125-924370939c06 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.319240 Oct 11 01:19:34.888521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 341/700] 10.222.0.66 () {58 vars in 1154 bytes} [Tue Oct 11 01:19:34 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:34.906988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f00d865-cfb7-4bca-9551-d5de8811f82a tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] Action: 'update', calling method: .version_select at 0x7f113467b550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:35.077364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:35.109232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9769d958-48e4-4e68-9392-14d0d6b6cfeb tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1617 microversion: 2.1 time: 0.768687 Oct 11 01:19:35.111889 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 360/701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:34 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1617 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:35.127225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:35.128109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:35.136231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.136731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.137162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.137868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.138868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.139292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.601215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:35.614719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:35.616098 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f00d865-cfb7-4bca-9551-d5de8811f82a tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.725352 Oct 11 01:19:35.618932 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 342/702] 10.222.0.66 () {60 vars in 1206 bytes} [Tue Oct 11 01:19:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:35.620518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:35.622094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-511a8a3b-7506-411c-8713-619254f5668a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.507560 Oct 11 01:19:35.626459 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 361/703] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:35 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:35.635756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad991591-cd0a-4007-a8a7-a3ddea88189e", "name": "network-vif-unplugged", "status": "completed", "tag": "d60c6926-f8d4-47cb-9efd-43daaf733530"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:35.646011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:35.652304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:35.652994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-195274813', 'deleted': False, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:35.658718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.659218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.659819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.660647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.661115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.661571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.662722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.663589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.666122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.712142 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] Creating event network-vif-unplugged:d60c6926-f8d4-47cb-9efd-43daaf733530 for instance ad991591-cd0a-4007-a8a7-a3ddea88189e on n-h1-772273-9 Oct 11 01:19:35.724023 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f6d91dc4-dab4-47f5-8f7b-604ba80bd102 req-115cfffb-59a1-436c-ad94-de62c77d85d4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096066 Oct 11 01:19:35.730747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 362/704] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:35.749537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:35.756046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:35.758274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:35.769321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.773556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.774352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.775086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:35.775576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:35.776010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:35.922815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:35.948464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c595af73-3dee-413a-80a7-696a53630167 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.214012 Oct 11 01:19:35.949316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 363/705] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:35 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:35.955075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: .version_select at 0x7f1134c0eb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1086277356", "policies": ["affinity"]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:35.966084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:35.980651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:36.000229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:36.152768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:36.171769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:36.192099 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5c48ad5-03a8-41a3-8f5d-c0b27788d0d2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195274813" status: 200 len: 346 microversion: 2.1 time: 0.570424 Oct 11 01:19:36.196341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 343/706] 10.222.0.66 () {58 vars in 1228 bytes} [Tue Oct 11 01:19:35 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195274813 => generated 346 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:36.201428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:36.201952 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98e3cbe3-9434-4c2e-8bae-8ae059b66675 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.241483 Oct 11 01:19:36.203648 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 364/707] 10.222.0.66 () {60 vars in 1174 bytes} [Tue Oct 11 01:19:35 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:36.207330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:36.222740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:36.223695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:36.234236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.234942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.238773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.240591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.241360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.241942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.245403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.261713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.262281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.266022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.266633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.268609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.435379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:36.443895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-599077ec-914c-4077-b36f-0643f6c6cb1a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1335 microversion: 2.1 time: 0.237569 Oct 11 01:19:36.448051 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 365/708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:36 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1335 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:36.456567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3178ad59-f2fa-4c14-9d30-b9c7f4558e06 tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] Calling method '.version_select at 0x7f1134806700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:36.478125 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3178ad59-f2fa-4c14-9d30-b9c7f4558e06 tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028642 Oct 11 01:19:36.479032 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 366/709] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:19:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:36.490513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:36.504057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:36.523296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.523824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.524269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.524988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:36.527051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:36.528021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:36.586180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:19:36.616783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:36.626536 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87930d9c-3707-4b76-acb0-244db1458bc7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.428856 Oct 11 01:19:36.640927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 344/710] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:36 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:36.649086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-328727367", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ce89f7fc-bc42-410a-a72c-2aea6f3f025c"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:36.751675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ceb4e37-ce85-4da5-bc43-13960eafc323 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "DELETE /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 204 len: 0 microversion: 2.1 time: 0.270598 Oct 11 01:19:36.756149 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 367/711] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:19:36 2022] DELETE /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:19:36.760828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:36.762145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5da8ee77-37a1-45c2-b55d-d4e470daa68f tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] Action: 'update', calling method: .version_select at 0x7f11348ff8b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:36.966031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5da8ee77-37a1-45c2-b55d-d4e470daa68f tempest-QuotaClassesAdminTestJSON-1978035664 tempest-QuotaClassesAdminTestJSON-1978035664-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.209585 Oct 11 01:19:36.981293 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 368/712] 10.222.0.66 () {60 vars in 1206 bytes} [Tue Oct 11 01:19:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:36.998807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ace3d0-bfe7-4425-8305-66da94d20497", "name": "network-vif-deleted", "tag": "8f35a7d1-55b8-484a-a63c-3859df8a2516"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:37.026856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.027362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.034627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.054910 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] Creating event network-vif-deleted:8f35a7d1-55b8-484a-a63c-3859df8a2516 for instance 06ace3d0-bfe7-4425-8305-66da94d20497 on n-h2-772273-9 Oct 11 01:19:37.067637 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0927416e-1f12-49aa-ba3b-5eea59b4bf2e req-239e73b1-ee1c-4289-9572-36a9dcb5dd77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082281 Oct 11 01:19:37.069980 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 369/713] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:37.080170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.081649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:37.103488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.104853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.105635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.107086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.107911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.108626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.153482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:19:37.153943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:19:37.154419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:19:37.155038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:19:37.155668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:19:37.212878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.214133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.214739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.215719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.221639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.222720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.270408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:37.276636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:37.292267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 2 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:19:37.298258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:37.374742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120493) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 01:19:37.412934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:37.422496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:37.447314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.458641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.463381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.468557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79c3115a-445b-4dc7-8e91-9129b244f91b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.397100 Oct 11 01:19:37.471684 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 370/714] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:37.478786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.479898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:37.484423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:37.493232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:37.500414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.501409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.502550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.507088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=10,nova_api:INSERT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:37.507950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.508713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.509363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.513571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=902f7e11-9006-4dc7-a4a5-58a95068f375,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:19:37.601472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:37.608004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:37.665799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:37.672865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:37.733933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.739202 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-019fee0b-cee6-4aeb-a10a-b584c60ded7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.097054 Oct 11 01:19:37.740267 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 345/715] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:19:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:19:37.747202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.748067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:37.751510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62c8d95f-5555-4d01-be53-3d54b9637035 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1519 microversion: 2.1 time: 0.278506 Oct 11 01:19:37.763363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 371/716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:37.764245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.764245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.764245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.764521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.764621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.764712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:37.764802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.764802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.771247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.772184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.772792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.773700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:37.774496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:37.775085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:37.930265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.931785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:37.946098 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e5a9e59-c60a-474b-a070-67b5fc6e05fb tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1323 microversion: 2.1 time: 0.192509 Oct 11 01:19:37.946767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 372/717] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:37.970677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14bb54e8-b438-49f4-a9f0-3362fb58393d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.228914 Oct 11 01:19:37.971177 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 346/718] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:37.979474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.980852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:37.987064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:37.992058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:37.992728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Searching by: {'deleted': False, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:19:38.001059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.003164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.003987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.007358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.008856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.009402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.022855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.023446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.031760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.032698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.033067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.033507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.071970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:19:38.135834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51c03a02-fd42-42e4-b864-d7e703c7852a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.163410 Oct 11 01:19:38.140956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 347/719] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:38.153504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad991591-cd0a-4007-a8a7-a3ddea88189e", "tag": "d60c6926-f8d4-47cb-9efd-43daaf733530"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:38.178123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.181548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.182121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.203789 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] Creating event network-changed:d60c6926-f8d4-47cb-9efd-43daaf733530 for instance ad991591-cd0a-4007-a8a7-a3ddea88189e on n-h1-772273-9 Oct 11 01:19:38.227097 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d477967b-0ed6-4368-948e-c700b3573980 req-db1ac5c0-6f82-4618-9164-501997ae7a4a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078616 Oct 11 01:19:38.229611 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 348/720] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:38.245353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40a646b2-a400-44cc-9274-b85a3fd8f83a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:38.246532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40a646b2-a400-44cc-9274-b85a3fd8f83a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:38.377588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-40a646b2-a400-44cc-9274-b85a3fd8f83a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:38.386956 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40a646b2-a400-44cc-9274-b85a3fd8f83a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1218 microversion: 2.1 time: 0.155116 Oct 11 01:19:38.399383 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 349/721] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:38 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:38.482916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:38.498206 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2d2eb1b-6ac2-4459-a863-c1ee7ca7e06c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.544941 Oct 11 01:19:38.499148 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 373/722] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:37 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:38.500835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:38.501973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:38.518179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.518891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.520528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.523044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.523789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.524977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.777286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:38.777917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:38.788664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.789400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.790294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:38.791181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:38.792013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:38.792791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.136453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.152661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.154179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.155415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-815596fc-fa4e-40c3-9ab2-3597edcd419d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.659892 Oct 11 01:19:39.155998 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 350/723] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:38 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:39.178245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:39.179199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:39.183547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.193949 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fab7a09c-13a2-4d0f-81e6-3e2a0c605a8b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1519 microversion: 2.1 time: 0.421154 Oct 11 01:19:39.195873 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 374/724] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:38 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1519 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:39.199379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.204869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:39.205738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.206456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.207447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.208136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.208794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.209743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:39.221425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.223793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.225236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.228527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.229229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.230730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.362525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:39.414459 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5e381ca-8645-4623-bdfc-6faf1698a0f5 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.213672 Oct 11 01:19:39.416004 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 375/725] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:39 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:39.420990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:39.421879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:39.429482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.430271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.430939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.431915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.432601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.433275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.566159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.569317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:39.581052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22ed5787-2fe3-4231-ac8f-7c6e13c00c0c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1222 microversion: 2.1 time: 0.163656 Oct 11 01:19:39.581635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 376/726] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:39 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:39.584191 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac9f4f60-7308-495b-ade5-c0c20663ca4d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.414523 Oct 11 01:19:39.585664 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 351/727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:39 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:39.591166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:39.596299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:39.613699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.614587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.615251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:39.616248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:39.616927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:39.617579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:40.190794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:40.193944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:40.235396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:40.240581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:40.247779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:40.248937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:40.254827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:40.257933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:40.405054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:40.416621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08f1b896-b55b-4884-979f-a782ab723dce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.833637 Oct 11 01:19:40.432710 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 377/728] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:39 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:40.443591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:40.444407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:40.451251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:40.451963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:40.452823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:40.453529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:40.454134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:40.454705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.014100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:41.034033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:41.038006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:41.039560 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a1bb93a0-e4c4-4f0d-8808-1e504389ac16 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.858889 Oct 11 01:19:41.055364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 352/729] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:40 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:41.064388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:41.065015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:41.093055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.094418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.095633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.096533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.096997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.097471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.151804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:41.266247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:41.283165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-800b627f-9047-4431-8ee6-70935a20a41b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1519 microversion: 2.1 time: 0.842914 Oct 11 01:19:41.283886 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 378/730] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:40 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1519 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:41.296202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:41.301249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:41.321273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.323376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.324931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.328461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:41.353875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.356200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.357427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.370052 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d31caa60-6072-4492-b042-87aac5bc7d1b tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.318863 Oct 11 01:19:41.372069 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 353/731] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:41 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:41.382852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:41.384030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:41.390836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:41.404514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.405237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.405845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.406739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.407445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.408029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.568247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:41.586784 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7b8c5ebc-4cf1-44b1-9bad-672a0f9cc694 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1270 microversion: 2.1 time: 0.210262 Oct 11 01:19:41.587611 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 354/732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:41 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:41.608031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf5ead0-15e8-43be-a9c4-b354a55c2c98", "tag": "bce8237e-ef55-4faa-a277-3da517d0a045"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:41.636829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.639217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.639879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.679850 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] Creating event network-changed:bce8237e-ef55-4faa-a277-3da517d0a045 for instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 on n-h1-772273-9 Oct 11 01:19:41.693121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-235d17b4-b4e3-4f5a-86e9-592343eac775 req-f706bf43-b5f5-48be-98b9-d5b067258810 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104091 Oct 11 01:19:41.711421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 355/733] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:41.717776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:41.724371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:41.755265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.756013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.756614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:41.760261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:41.760955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:41.768225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:42.554784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:42.566018 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-202666bf-d464-4ead-b072-0159b78293d1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 1.280323 Oct 11 01:19:42.567012 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 379/734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:41 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:42.588917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f92a2d-aa1f-4625-8153-f37d1ba43aa7", "name": "network-vif-deleted", "tag": "c64878f2-6652-48aa-b9e1-afcad599de8d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:42.600020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:42.600799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:42.601505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:42.614786 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] Creating event network-vif-deleted:c64878f2-6652-48aa-b9e1-afcad599de8d for instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 on n-h2-772273-9 Oct 11 01:19:42.620608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e0db7b99-eb46-4892-942a-8f533bb9ccd4 req-0c42fa66-d2af-4c93-9d4f-3753bde65a44 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042750 Oct 11 01:19:42.621613 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 380/735] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:42.627921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:42.628944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:42.637433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:42.647828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:42.648667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:42.649648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:42.650333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:42.651004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:42.801838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:42.815750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60767377-6663-4e51-9de6-e5ffd75c6f0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 1.098473 Oct 11 01:19:42.816667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 356/736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:41 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:42.826101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:42.849355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:42.865021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:42.868824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:42.872444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:42.875586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:42.878127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:42.879923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.007957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.015656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.020801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.021469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lazy-loading 'fault' on Instance uuid 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:43.216460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:43.228205 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f0ef4ee-4a6b-403b-af28-5df95b424655 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 200 len: 1311 microversion: 2.1 time: 0.410191 Oct 11 01:19:43.230846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 357/737] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:42 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:43.248382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:43.251962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:43.271239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.272033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.272663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.273543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.274169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.274759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.324723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:43.335946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:43.338554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:43.340005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f019c3ba-000b-4809-a42e-e6a37bdcc80b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.716538 Oct 11 01:19:43.342058 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 381/738] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:42 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:43.381568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:43.385653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:43.399120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.401055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.401923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.404786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.406676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.407325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.652469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:43.680040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:43.702451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49e7e45f-a125-4e5d-bccb-a98ed58c07c4 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.468463 Oct 11 01:19:43.740973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 358/739] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:43 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:43.765596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "name": "network-vif-plugged", "status": "completed", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:43.785228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:43.786032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:43.786736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:43.816411 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] Creating event network-vif-plugged:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h2-772273-9 Oct 11 01:19:43.822161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e965b3d2-aa33-4835-9759-21d34ebbd476 req-aafee4d3-1dfa-43ab-bf0c-3cf4e58fd2de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079179 Oct 11 01:19:43.826864 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 359/740] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:44.040261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:44.044237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ed7f0ae-0e2a-44b1-91ec-54ee5e32b6ba tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f11348d4ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.048169 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f685e7a0-0e80-4a56-9040-a4c83e664557 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.704888 Oct 11 01:19:44.048766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 382/741] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:43 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:44.053233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.053847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:44.102479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.106530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.107303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.108684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.112720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.113575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.172168 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ed7f0ae-0e2a-44b1-91ec-54ee5e32b6ba tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76" status: 200 len: 371 microversion: 2.1 time: 0.343863 Oct 11 01:19:44.172873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 360/742] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:19:43 2022] GET /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76 => generated 371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:44.184905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.185947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:44.192938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.193776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.194448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.195412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.196092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.196737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.385227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:44.399754 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62073577-7c88-4b94-9595-4625214dcf27 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.349887 Oct 11 01:19:44.401125 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 383/743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:44 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:44.411174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Action: 'update', calling method: .version_select at 0x7f1134456af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:44.501435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.502388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.503073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.504339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.506509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.508711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.540341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:UPDATE=13 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:44.555590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:44.565427 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef3e7f9f-8b2a-48c8-9038-20651ba0b543 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.384363 Oct 11 01:19:44.568785 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 361/744] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:44 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:44.579584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.582080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 69f92a2d-aa1f-4625-8153-f37d1ba43aa7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:44.596885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.597779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.598456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.599407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.604118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.604583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.634017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] HTTP exception thrown: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Request method failure captured: Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 HTTP/1.1 Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRfbspeD_LuJLnsgTtOyUf6ZpHqX5dlR8hsndw_PF45j3hmbNJxbhE8yFacA2K-9h2KxYxVduGdRwSKIa3AqedrNs9yBcK19woLoUhbWXzBs3oL6H1uWrzlIPG5G2124qVL8WLn17MLfSuIV6qhivp-My6QaGl6t60WVikfxS_ddTQ Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:19:44.637280 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 870719fa1b734c078b3a215a7d77a833 Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. Oct 11 01:19:44.638757 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '69f92a2d-aa1f-4625-8153-f37d1ba43aa7'} Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:19:44.639556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. Oct 11 01:19:44.640812 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:44.643966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Returning 404 to user: Instance 69f92a2d-aa1f-4625-8153-f37d1ba43aa7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:19:44.647491 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6cced64c-77fd-48b2-bbb3-b6d5b63324e0 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7" status: 404 len: 111 microversion: 2.1 time: 0.074613 Oct 11 01:19:44.649936 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 362/745] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:44 2022] GET /compute/v2.1/servers/69f92a2d-aa1f-4625-8153-f37d1ba43aa7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:19:44.661100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.662172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:44.671317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.671645 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d770b04-3167-4bed-89ea-42b8ddde9f80 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76" status: 200 len: 328 microversion: 2.1 time: 0.268718 Oct 11 01:19:44.672116 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 384/746] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:19:44 2022] PUT /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76 => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:44.672824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.673525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.674613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.675300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.676137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.678564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:44.679065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:44.701664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.702891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.704285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.705507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:44.710618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:44.711391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:44.795495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:19:44.965796 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3118fac-0cce-40dd-b1e2-b80b6760f9bc tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 204 len: 0 microversion: 2.1 time: 0.291667 Oct 11 01:19:44.967090 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 385/747] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:19:44 2022] DELETE /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:19:44.974362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7daf726e-2cd1-478d-9a46-e22241701335 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.005350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7daf726e-2cd1-478d-9a46-e22241701335 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76" status: 202 len: 0 microversion: 2.1 time: 0.036565 Oct 11 01:19:45.007150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 386/748] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:19:44 2022] DELETE /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:19:45.015561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.016675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:45.024693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.025605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.026301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.027262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.027972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.028651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.234800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:45.265061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:45.274133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:45.275575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:45.276758 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-022b77c1-36fd-4a22-9580-84f771c79a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.625282 Oct 11 01:19:45.280516 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f8babf7-77d0-40bb-8416-2dc0b5e7649c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.271780 Oct 11 01:19:45.281397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 387/749] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:45.286669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.291293 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 363/750] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:44 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:45.298272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:45.301147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a414b74-2a30-4151-af39-aab5c1ba9599 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f113467b550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.317966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.318469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.319083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.319635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.320096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.320585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.432458 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a414b74-2a30-4151-af39-aab5c1ba9599 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76" status: 200 len: 371 microversion: 2.1 time: 0.139185 Oct 11 01:19:45.433968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 364/751] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/os-quota-sets/2621ddbae3a24e458d0c1f90526c5e76 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:45.441302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.456217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:45.469056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.469961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.470735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.472615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.473641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.474396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.828572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:45.843518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-285269d4-f0fe-418c-a564-f05b9496fe56 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1517 microversion: 2.1 time: 0.554859 Oct 11 01:19:45.844761 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 388/752] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:45.850162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd54c1bd-080d-4b3f-9a69-fe67157d184e", "tag": "2a84befb-c734-4e0e-98b6-1411d85de481"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:45.865062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:45.874307 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e473903c-627a-4864-8e6a-4e429b0ab9fe tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.438444 Oct 11 01:19:45.881315 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 365/753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:45.888070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:45.888778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:45.895176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.895781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.899718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.900291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.900812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.905377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.907725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:45.908146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:45.933417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:45.947964 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] Creating event network-changed:2a84befb-c734-4e0e-98b6-1411d85de481 for instance cd54c1bd-080d-4b3f-9a69-fe67157d184e on n-h2-772273-9 Oct 11 01:19:45.968015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2098e3f2-29f6-41f6-bbf7-e009bc41b3e0 req-10553b35-c570-4132-825b-7deaa8e1bca6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121680 Oct 11 01:19:45.979048 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 389/754] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:45.999864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:46.000363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:46.041873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.042381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.042833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.043646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.044624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.045062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.485591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:46.494994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cd2249d-4620-4859-b07d-dc212f7ef9b8 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1359 microversion: 2.1 time: 0.514230 Oct 11 01:19:46.498828 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 390/755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1359 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:46.503420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:46.512082 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-605c3bf2-8b2e-4c27-9f51-cd46ee079049 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.629689 Oct 11 01:19:46.517268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14cb60be-6d29-401a-8a81-951b8430d84c tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f1134456280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:46.528515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 366/756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:45 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:46.533475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:46.540110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:46.557425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.557744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.558366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.559310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.560026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.561425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.725727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:46.754018 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b85ca49-f51f-442d-8e34-b7f210a7f0e0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.224103 Oct 11 01:19:46.755403 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 367/757] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:46 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:46.762097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:46.763606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:46.770216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.770988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.771579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.772354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.772888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.773384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.800266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14cb60be-6d29-401a-8a81-951b8430d84c tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde/defaults" status: 200 len: 371 microversion: 2.1 time: 0.286627 Oct 11 01:19:46.801165 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 391/758] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:19:46 2022] GET /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde/defaults => generated 371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:46.933306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:46.937075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:46.985060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.985758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.986421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:46.987359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:46.992012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:46.992822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.373830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:47.391870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:47.394572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:47.396285 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6d5818b-922b-4a08-9f99-ee4f048569cd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.638953 Oct 11 01:19:47.414365 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 368/759] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:46 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:47.445542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:47.449940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:47.460678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:47.465171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.469185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.469858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.470829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.471592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.472023 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3ead039-12ac-41be-933c-08e682b00d5b tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1517 microversion: 2.1 time: 0.601183 Oct 11 01:19:47.472463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.472949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 392/760] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:46 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1517 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:47.477392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Action: 'update', calling method: .version_select at 0x7f1134806f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:47.719199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.719735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.721830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.724055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.726164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.726627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.774930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:47.785478 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ccb9966-da85-481c-b231-de1fc9d2d2a2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.350000 Oct 11 01:19:47.799956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 369/761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:47 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:47.810150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:47.811177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:47.818360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.819206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.819915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.820877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.821563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.822153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.850786 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-218c46cb-3ae5-4709-8c16-1e4faa6761c3 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921" status: 200 len: 328 microversion: 2.1 time: 0.376667 Oct 11 01:19:47.860059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 393/762] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:19:47 2022] PUT /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921 => generated 328 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:47.884211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902f7e11-9006-4dc7-a4a5-58a95068f375", "tag": "7f4e02dc-ceee-4246-b8c1-7722209fcaf0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:47.905529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.906334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.907087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.942854 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] Creating event network-changed:7f4e02dc-ceee-4246-b8c1-7722209fcaf0 for instance 902f7e11-9006-4dc7-a4a5-58a95068f375 on n-h2-772273-9 Oct 11 01:19:47.954451 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1489c9d4-55ba-4339-b956-4a5b51096e82 req-dde02a66-743f-498c-bb9e-ad17c3865998 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075674 Oct 11 01:19:47.957050 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 394/763] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:47.968005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:47.969068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:47.986371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.987510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.988186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:47.989525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:47.990355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:47.993777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.044336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.052579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=19 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:48.062492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3ff071b-0aea-4b7a-9037-bb511a06ec63 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1542 microversion: 2.1 time: 0.261028 Oct 11 01:19:48.075910 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 370/764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:47 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1542 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:48.093960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.094599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:48.102895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.107936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.108175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.108976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.109455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.111506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.289371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:48.334735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50e48d84-8b7a-45b3-8a86-bb23e979b6eb tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.257523 Oct 11 01:19:48.348963 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 371/765] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:48.351246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f11342ee5e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.390337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.404943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8e2ede1-b873-46f2-abd0-d9047aed3ef7 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.443928 Oct 11 01:19:48.405706 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 395/766] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:47 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:48.432820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f03654b-fbc5-4bab-b3c3-cc961d8e7df4", "name": "network-vif-deleted", "tag": "1483c62f-43ff-4542-af28-f1ec8176ec47"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:48.453381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:48.456963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.458537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.462555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.466069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.466876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.467645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.468596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.469216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.469897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.487070 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] Creating event network-vif-deleted:1483c62f-43ff-4542-af28-f1ec8176ec47 for instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 on n-h1-772273-9 Oct 11 01:19:48.492671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45f2c3cc-d762-489f-ac10-284a3d6e5a13 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921/detail" status: 200 len: 916 microversion: 2.1 time: 0.150739 Oct 11 01:19:48.493852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 372/767] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921/detail => generated 916 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:48.498689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c6f3ec5d-117d-49a9-bd2d-d6ca9ac48dc2 req-a29d1fc1-451c-43a6-9e39-5bee7b52f3bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075083 Oct 11 01:19:48.503600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 396/768] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:48.517473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.518518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:48.525754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.526531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.526778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.527130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.527991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.528136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:48.528631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.529069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.533424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:48.560481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.560988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.575843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.577113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.578034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.579238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.639416 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0cc2f2ec-3e12-4125-a300-e3fb481c0204 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144180 Oct 11 01:19:48.648637 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 373/769] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:48.654491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.655303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:48.665364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.665864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.666309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.667041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.667531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.667966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.752289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.753067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.753726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.754407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lazy-loading 'fault' on Instance uuid 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:48.849864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.862586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.867238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.876703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:48.878960 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfb10596-7e97-440a-abdf-0ce822ad4efe tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 200 len: 1310 microversion: 2.1 time: 0.228877 Oct 11 01:19:48.881694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 374/770] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 1310 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:48.884249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b4c5dab5-aa5f-40ed-948a-909390ffa8f6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.376286 Oct 11 01:19:48.885016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 397/771] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:48.889226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Action: 'update', calling method: .version_select at 0x7f113467b940>, body: {"quota_set": {"ram": "2048"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:48.900290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:48.901533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:48.918242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.919684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.920513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.923024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:48.926242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:48.927042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:48.999430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.000153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.000595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.001334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.001791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.002217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.054731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.055225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.056064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.056867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.057338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.057776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.120245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:49.136280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:49.140137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-17a261fe-74c2-4562-96d2-dceaf41d0feb tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921?user_id=9983404dd4804c05b0cdf0a64852b51e" status: 200 len: 328 microversion: 2.1 time: 0.257035 Oct 11 01:19:49.147497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 375/772] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:19:48 2022] PUT /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921?user_id=9983404dd4804c05b0cdf0a64852b51e => generated 328 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:49.154345 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e420893b-aa4d-429b-9f88-93291f8339c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.267825 Oct 11 01:19:49.154941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24f88f3c-c0ed-4377-8eb9-0b9466db99ef tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f1134b30d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:49.155293 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 398/773] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:48 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:49.261312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24f88f3c-c0ed-4377-8eb9-0b9466db99ef tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921?user_id=9983404dd4804c05b0cdf0a64852b51e" status: 200 len: 370 microversion: 2.1 time: 0.112207 Oct 11 01:19:49.263387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 376/774] 10.222.0.66 () {58 vars in 1323 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/os-quota-sets/32286a4d2f1342a78345cd1a6010b921?user_id=9983404dd4804c05b0cdf0a64852b51e => generated 370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:49.372824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:49.373743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:49.380473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.381209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.381812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.382834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.383560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.384150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.436236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:49.438710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:49.457619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.462997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.463720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.465334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.466279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.467024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.514126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:49.524484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:49.547273 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0de759a4-4d25-42cb-8898-5de7c752a797 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1929 microversion: 2.75 time: 0.178860 Oct 11 01:19:49.548549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 399/775] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:49.748013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:49.761719 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e37b0836-fa6c-49dc-8347-bad78b46d99c tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.332433 Oct 11 01:19:49.763714 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 377/776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:49.838818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09ec68c6-d57a-4c63-b6d6-2a2435f83538 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Calling method '.version_select at 0x7f1134bd8700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:49.846400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf5ead0-15e8-43be-a9c4-b354a55c2c98", "name": "network-vif-plugged", "status": "completed", "tag": "bce8237e-ef55-4faa-a277-3da517d0a045"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:49.891170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.891791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.892133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.907185 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] Creating event network-vif-plugged:bce8237e-ef55-4faa-a277-3da517d0a045 for instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 on n-h1-772273-9 Oct 11 01:19:49.917059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e2e0546a-b295-4bd7-958f-f791b28c5541 req-747b921d-8b93-4e55-846d-05eec7b76957 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076254 Oct 11 01:19:49.921057 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 378/777] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:49.933756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:49.939144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:49.953348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.953849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.954309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.955017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:49.955510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:49.958087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:49.991870 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] HTTP exception thrown: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Request method failure captured: Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 HTTP/1.1 Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRfbspeD_LuJLnsgTtOyUf6ZpHqX5dlR8hsndw_PF45j3hmbNJxbhE8yFacA2K-9h2KxYxVduGdRwSKIa3AqedrNs9yBcK19woLoUhbWXzBs3oL6H1uWrzlIPG5G2124qVL8WLn17MLfSuIV6qhivp-My6QaGl6t60WVikfxS_ddTQ Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:19:49.993594 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 870719fa1b734c078b3a215a7d77a833 Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. Oct 11 01:19:49.995109 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '3f03654b-fbc5-4bab-b3c3-cc961d8e7df4'} Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:19:49.996065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. Oct 11 01:19:49.998610 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:50.000523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Returning 404 to user: Instance 3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:19:50.000523 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8564af1-812a-447e-855c-269f4eb1c820 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4" status: 404 len: 111 microversion: 2.1 time: 0.072731 Oct 11 01:19:50.000523 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 379/778] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/servers/3f03654b-fbc5-4bab-b3c3-cc961d8e7df4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:19:50.011816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:50.011816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:50.027314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.028936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.029953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.032981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.033461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.033960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.261779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09ec68c6-d57a-4c63-b6d6-2a2435f83538 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde/defaults" status: 200 len: 371 microversion: 2.1 time: 0.426504 Oct 11 01:19:50.265002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 400/779] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde/defaults => generated 371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:50.286494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:50.287012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:50.302747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.303254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.303727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.304449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.304989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.307547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.380530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:19:50.530156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:50.540376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:50.563544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:50.571778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a1d4a6f-05d3-48ce-b954-87460c79c5e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.571264 Oct 11 01:19:50.593022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbbaf05f-793c-4658-9bd5-d81fe38f41c1 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 204 len: 0 microversion: 2.1 time: 0.315080 Oct 11 01:19:50.593889 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 401/781] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:19:50 2022] DELETE /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:19:50.596762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 380/781] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:49 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:50.603043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Action: 'update', calling method: .version_select at 0x7f1134bd80d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:50.603550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:50.604174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:50.615713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.616641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.617587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.619636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.620511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.621259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.723405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.729843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.730553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.732010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.732472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.732898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.948032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:50.959398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b681222d-6735-4e30-8c04-7f5bc2dd3777 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.363829 Oct 11 01:19:50.960955 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 381/782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:50 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:50.965965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:50.966580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:50.981242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.982006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.982708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.983442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:50.984020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:50.988970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:50.999168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=12,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:51.092657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:51.113439 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a06fc073-9dc2-4dff-9897-f5de88391a6c tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1935 microversion: 2.75 time: 0.151789 Oct 11 01:19:51.127364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 382/783] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:50 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1935 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:51.127364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:51.127364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:51.127364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.127833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.127833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.128195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.129069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.129577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.144837 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ceb0ed5-0dac-4a59-bc83-59abe378e394 tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde" status: 200 len: 329 microversion: 2.1 time: 0.546592 Oct 11 01:19:51.146045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 402/784] 10.222.0.66 () {60 vars in 1263 bytes} [Tue Oct 11 01:19:50 2022] PUT /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde => generated 329 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:51.153433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:51.154909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:51.163106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.163932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.164533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.165918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.166558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.167139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.468965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:51.474048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:51.484000 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b9d65dc-4fe6-49e0-a5be-bc8b99091cc8 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.336739 Oct 11 01:19:51.499395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 403/785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:51 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:51.499395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Action: 'update', calling method: .version_select at 0x7f113495fc10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:51.502294 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3d79741-f2d8-49fa-9458-383a7bb55544 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1518 microversion: 2.1 time: 0.386665 Oct 11 01:19:51.504474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 383/786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:51 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:51.512915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:51.524992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.525482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.525920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.538227 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] Creating event network-changed:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h2-772273-9 Oct 11 01:19:51.544014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-78aa4c4d-e3f5-4f66-98db-ac91ac8b35a4 req-9cfe2311-781a-41c2-bccb-1bfe9d0ccc56 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038254 Oct 11 01:19:51.544942 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 384/787] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:51.570040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.570825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.571466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.572835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.573541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.574147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.602850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:51.604013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:51.615199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.619252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.619973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.621574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:51.622205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:51.624282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:51.787456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=83 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:51.877120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:51.886020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:51.889338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:51.890601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc7cf669-d5c2-4148-a1f2-68cb3b6bc9ea tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.292989 Oct 11 01:19:51.891234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 385/788] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:51 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:51.983856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:51.984638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:51.998813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.002034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.002034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.002034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.007957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.008593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.147278 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6b985b8-cab0-4cca-997d-f0658934890a tempest-QuotasAdminTestJSON-1564438919 tempest-QuotasAdminTestJSON-1564438919-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde" status: 200 len: 329 microversion: 2.1 time: 0.659413 Oct 11 01:19:52.147997 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 404/789] 10.222.0.66 () {60 vars in 1263 bytes} [Tue Oct 11 01:19:51 2022] PUT /compute/v2.1/os-quota-sets/b3242be455ba439abc1288edb55bacde => generated 329 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:52.156025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:52.156025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:52.165117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.165712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.166251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.167675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.168246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.168750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.207218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:52.216151 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-536a7c61-176d-4f70-bc71-9b12175969c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.237557 Oct 11 01:19:52.217216 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 386/790] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:51 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:52.281028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:52.302192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc6336b3-74a1-48cf-bece-61522410426f tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1935 microversion: 2.75 time: 0.152831 Oct 11 01:19:52.303387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 405/791] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:52 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1935 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:52.516077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:52.516703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:52.526799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.532995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:52.533537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:52.545261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.545763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.546209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.546932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.547417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.547850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.550909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.551463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.552236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.552773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.553276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.865923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:52.878009 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1139f9ce-84b7-4353-8183-9ea6b17f1a98 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1518 microversion: 2.1 time: 0.349108 Oct 11 01:19:52.878628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 406/792] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:52 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:52.885894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:52.897500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cbd89fd1-4c1e-4a4b-ab5a-871f25ac408a tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1390 microversion: 2.1 time: 0.385444 Oct 11 01:19:52.899516 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 387/793] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:52 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1390 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:52.916627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:52.917231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:52.926449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.926942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.927418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:52.928203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:52.928565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:52.934295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.127777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:53.137758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:53.139192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:53.143728 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d37d38ac-7137-4a1a-9a28-3f4046fc26bd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.231063 Oct 11 01:19:53.156968 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 407/794] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:52 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:53.242706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:53.243865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:53.250363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.252573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.252573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.252573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.252573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.259350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.336577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:53.337337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:53.357061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.357611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.358055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.358781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.359451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.365899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.519860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:53.529693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aecb2e3d-d557-457b-951b-130e5fbe7ca1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.291175 Oct 11 01:19:53.536558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 388/795] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:53 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:53.627933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:53.653362 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76d8ffc7-2641-447b-aec7-2bf7d882d68d tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1935 microversion: 2.75 time: 0.320773 Oct 11 01:19:53.654578 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 408/796] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:53 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1935 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:53.722770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd54c1bd-080d-4b3f-9a69-fe67157d184e", "name": "network-vif-plugged", "status": "completed", "tag": "2a84befb-c734-4e0e-98b6-1411d85de481"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:53.749277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.749927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.750477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.792664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] Creating event network-vif-plugged:2a84befb-c734-4e0e-98b6-1411d85de481 for instance cd54c1bd-080d-4b3f-9a69-fe67157d184e on n-h2-772273-9 Oct 11 01:19:53.809626 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-10ec6234-e3c7-483b-b5c8-8e5cb89c6c39 req-19f14739-1423-442b-a7ab-4f889a9fb739 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088832 Oct 11 01:19:53.811124 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 389/797] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:53.904702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:53.905956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:53.916112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.925736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:53.926697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:53.931304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.935130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.935975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.936450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.936886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.941348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.941858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.942303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:53.950446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:53.951003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:53.951473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:54.399651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870719fa1b734c078b3a215a7d77a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04e37af3bc74db5bb479d8c9ccb21cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:54.410658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6316d04f-3f41-4d10-a893-d340ab4804b2 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 200 len: 1476 microversion: 2.1 time: 0.510821 Oct 11 01:19:54.411988 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 409/798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:53 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:54.418835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:54.419806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:54.429023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:54.430558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:54.431166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:54.432094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:54.432772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:54.433376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:54.742411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:54.753700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91855126-969a-48f6-ade5-05fcc8c684ed tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1590 microversion: 2.1 time: 0.832268 Oct 11 01:19:54.763521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 390/799] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:53 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1590 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:54.765512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1258123-2050-4de1-af7d-a95d938edd74", "name": "network-vif-deleted", "tag": "d7975398-c71c-4e53-bbd2-cf183cbc0df7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:54.799998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:54.800798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:54.801246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:54.812195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:54.830388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:54.832204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:54.835962 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4aefd0f-9c51-4fa9-ba3b-738bff34d9eb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.422617 Oct 11 01:19:54.837005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 410/800] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:54 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:54.845210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:54.849054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:54.854359 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] Creating event network-vif-deleted:d7975398-c71c-4e53-bbd2-cf183cbc0df7 for instance c1258123-2050-4de1-af7d-a95d938edd74 on n-h1-772273-9 Oct 11 01:19:54.863376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eb6277a0-4e54-4ec0-9f15-6d7c5773d3e5 req-c32bafba-a6b4-4ac0-b886-1f421b02b7f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105030 Oct 11 01:19:54.863850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:54.864115 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 391/801] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:54.864350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:54.864792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:54.865556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:54.866022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:54.866592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.018635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:55.031854 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e8d19d2-5a81-473d-941f-3581f3907ea6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.190422 Oct 11 01:19:55.032446 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 411/802] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:54 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:55.037664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:55.038879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:55.041043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=68,nova_api:UPDATE=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:55.046433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.047402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.048000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.048915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.049720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.050179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.132551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:55.150986 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94c47b23-ef11-41be-9bc0-976d1b4ee4f0 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1935 microversion: 2.75 time: 0.117285 Oct 11 01:19:55.164113 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 412/803] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:55 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1935 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:55.177780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:55.178465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:55.185331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.186008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.186632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.187777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.188407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.189009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.196854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-69c1bf05-c38d-49fa-81aa-f71c431c97ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Action: 'create', calling method: .version_select at 0x7f11349153a0>, body: {"keypair": {"name": "tempest-keypair-2023376174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BMoNsl5qGGoH2PVHjamnCsLPuT/ElwXVHFKx963oyMXUkcVxS8yytjw+UgMBclFPRpracGvGrkzBPBO/7V1NaHVEoKWby38HmZ0gbHz1h8hrOR3sZ7CE9+8JLQ4yEfA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:55.234744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-69c1bf05-c38d-49fa-81aa-f71c431c97ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Getting quotas for project a64f02fbbacc4854806187f139193dd9. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:19:55.245185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-69c1bf05-c38d-49fa-81aa-f71c431c97ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Getting quotas for user c0d3518c0db846b3818f4fe49f4837d8 and project a64f02fbbacc4854806187f139193dd9. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:19:55.294752 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-69c1bf05-c38d-49fa-81aa-f71c431c97ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.428527 Oct 11 01:19:55.302617 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 392/804] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:19:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:55.305764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7d50274-1105-4961-8efb-db866c0b1e06 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140093 Oct 11 01:19:55.306365 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 413/805] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:19:55 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:55.441867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:55.442985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] [instance: c1258123-2050-4de1-af7d-a95d938edd74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:55.452670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.455316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.456048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.458669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.459440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.460067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.482394 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] HTTP exception thrown: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Request method failure captured: Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 HTTP/1.1 Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRfbspeD_LuJLnsgTtOyUf6ZpHqX5dlR8hsndw_PF45j3hmbNJxbhE8yFacA2K-9h2KxYxVduGdRwSKIa3AqedrNs9yBcK19woLoUhbWXzBs3oL6H1uWrzlIPG5G2124qVL8WLn17MLfSuIV6qhivp-My6QaGl6t60WVikfxS_ddTQ Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:19:55.485053 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e04e37af3bc74db5bb479d8c9ccb21cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e04e37af3bc74db5bb479d8c9ccb21cc Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2045729026 Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 870719fa1b734c078b3a215a7d77a833 Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServerFiltersTestJSON-2045729026-project Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. Oct 11 01:19:55.486627 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c1258123-2050-4de1-af7d-a95d938edd74'} Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:19:55.487529 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. Oct 11 01:19:55.488944 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:19:55.493624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] Returning 404 to user: Instance c1258123-2050-4de1-af7d-a95d938edd74 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:19:55.494757 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75abd92f-f26c-41c2-bfe7-27dd567114b6 tempest-ListServerFiltersTestJSON-2045729026 tempest-ListServerFiltersTestJSON-2045729026-project] 10.222.0.66 "GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74" status: 404 len: 111 microversion: 2.1 time: 0.059758 Oct 11 01:19:55.495855 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 393/806] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:55 2022] GET /compute/v2.1/servers/c1258123-2050-4de1-af7d-a95d938edd74 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:19:55.866326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:55.867156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:55.873803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.874665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.875315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:55.876123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:55.876744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:55.877246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.054295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:56.055545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:56.066510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.070272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.072131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.073061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.077569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.078285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.342494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:56.357782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:56.359419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:56.365864 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c00dae9-7e76-473b-a39e-452f1f8f1455 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.504141 Oct 11 01:19:56.369576 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 414/807] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:55 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:56.382430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:56.383442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:56.397021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.397956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.399774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.400703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.403603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.404300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.601800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] Lazy-loading 'services' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:19:56.605856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:56.641693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c5316cf-c096-473f-9753-292fdb65ee00 tempest-ServersAdmin275Test-1862798715 tempest-ServersAdmin275Test-1862798715-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1920 microversion: 2.75 time: 0.268870 Oct 11 01:19:56.652016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 415/808] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:56 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1920 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:56.668376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:56.682724 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba45c481-f718-4e6b-8ec8-6f2650311dd7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.632393 Oct 11 01:19:56.684254 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 394/809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:56 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:19:56.711919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:56.712515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:56.736717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.737219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.737661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.738371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.739174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.739289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.768783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:19:56.917401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3778ac2c-e5ca-4a8c-9954-75936c2a2e7b tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 204 len: 0 microversion: 2.75 time: 0.233981 Oct 11 01:19:56.921490 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 416/810] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:19:56 2022] DELETE /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:19:56.926723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:56.927480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:56.934590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.935089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.938447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.940613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:56.941525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:56.942658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:56.992593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:57.104846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:57.121422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:57.125671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:57.149305 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2b3d21f-4c95-4a26-93b1-ddcf2e80ce72 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1444 microversion: 2.75 time: 0.226619 Oct 11 01:19:57.153649 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 395/811] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:56 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1444 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:57.187595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:57.188573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:57.198639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf5ead0-15e8-43be-a9c4-b354a55c2c98", "tag": "bce8237e-ef55-4faa-a277-3da517d0a045"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:57.214343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.217259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.218080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.218891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.219672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.220581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.221210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.221882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.223732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.254267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] Creating event network-changed:bce8237e-ef55-4faa-a277-3da517d0a045 for instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 on n-h1-772273-9 Oct 11 01:19:57.267602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2d13e089-56a4-4774-ad8e-b58d045aa950 req-47423bd3-09d3-4fe6-89cc-15bc0dfceafd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072473 Oct 11 01:19:57.269696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 396/812] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:19:57.395933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:57.397013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:57.408315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.415635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.416305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.417287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.418592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.419229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.896704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:57.910025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f57cff4-57d4-4745-aaa6-db54997e46ee tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1590 microversion: 2.1 time: 0.727975 Oct 11 01:19:57.913758 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 417/813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:57 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1590 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:57.924677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:57.930311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:57.940517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.941790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.944655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:57.946172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:57.947656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:57.948337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:58.039086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.058835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.060916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.062552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea14a851-00b7-4b88-af03-138b951a42be tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1567 microversion: 2.25 time: 0.670646 Oct 11 01:19:58.063120 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 397/814] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:57 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1567 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:58.180295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:58.180893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:58.197254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:58.197741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:58.198176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:58.198907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:58.199517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:58.199956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:58.372891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.376425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.384779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b53ca04-da7a-444b-baed-28fad58661e3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1318 microversion: 2.1 time: 0.469219 Oct 11 01:19:58.385252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.387105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:58.387952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 418/815] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:57 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:58.403184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b165eb5c-132f-481e-91ec-259daf6dcc5d tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1444 microversion: 2.75 time: 0.226814 Oct 11 01:19:58.403888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 398/816] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:58 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1444 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:19:59.093045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:59.094275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:59.100565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.101054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.101487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:59.102195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.102653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.103125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:59.230795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1115060513", "imageRef": "e5aef904-6c9f-425b-8e8d-71de2f15fa35", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "662bceb3-7657-4761-b02d-72c98d194383"}], "security_groups": [{"name": "tempest-securitygroup--976944562"}], "key_name": "tempest-keypair-2023376174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:19:59.239815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=7 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:59.241032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:19:59.441356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:59.452595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:59.454615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:59.456022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aef86ea5-b617-4df6-9b80-5a5bec1461ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1557 microversion: 2.25 time: 0.368029 Oct 11 01:19:59.469446 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 419/817] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:59 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1557 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:19:59.473739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] validate_networks() for [('662bceb3-7657-4761-b02d-72c98d194383', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:19:59.486330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:59.486955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:59.503438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.503946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.504394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:59.505116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.505577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.512362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:59.849878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:19:59.861486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-228896e8-2225-4ffd-bb13-567de251eb14 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1468 microversion: 2.1 time: 0.390655 Oct 11 01:19:59.865677 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 420/818] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:19:59 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1468 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:19:59.879530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:19:59.880477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:19:59.891637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.892303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.892948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:19:59.905924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:19:59.906444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:19:59.906884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:00.087078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:00.115157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:00.118809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:00.126104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1013971d-4fdc-48ae-9963-aab1ce647f26 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1444 microversion: 2.75 time: 0.257628 Oct 11 01:20:00.128257 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 421/819] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:19:59 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1444 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:00.157381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62914da8-e6ab-49a7-92da-9eef7960093a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '.version_select at 0x7f11343af0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:00.161686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62914da8-e6ab-49a7-92da-9eef7960093a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:00.162408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62914da8-e6ab-49a7-92da-9eef7960093a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:00.163022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62914da8-e6ab-49a7-92da-9eef7960093a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:00.182481 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62914da8-e6ab-49a7-92da-9eef7960093a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.036016 Oct 11 01:20:00.184901 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 422/820] 10.222.0.66 () {60 vars in 1184 bytes} [Tue Oct 11 01:20:00 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:00.199699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:00.200761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:00.210070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:00.213248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:00.214102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:00.215667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:00.216769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:00.217408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:00.984185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:01.002374 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-313f58bd-05d6-45e8-96cf-a83ab4925811 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1318 microversion: 2.1 time: 0.814040 Oct 11 01:20:01.003586 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 423/821] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:00 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:01.034244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:01.038470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:01.043996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:01.044513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:01.045504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:01.046455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:01.046958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:01.056143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.058755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.059658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.063016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.063749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.064398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.066253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.068151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.069837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.072572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.073081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.073529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.130238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Getting quotas for project a64f02fbbacc4854806187f139193dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:01.138127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Getting quotas for user c0d3518c0db846b3818f4fe49f4837d8 and project a64f02fbbacc4854806187f139193dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:01.158427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:01.164096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5aef904-6c9f-425b-8e8d-71de2f15fa35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:01.255316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98233155-acb6-4d7f-a7a8-5a94c9c1b00f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.028372 Oct 11 01:20:01.256780 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 399/822] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:19:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:20:01.262991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:01.263957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:01.274667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.275309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.276412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.276877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.277691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.278216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.377113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:01.379755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:01.380509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:01.381422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lazy-loading 'fault' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:01.482953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:01.502817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:01.507006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:01.519624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45f72bad-9e47-4192-96a8-ecf2bd3ef456 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1449 microversion: 2.75 time: 0.261385 Oct 11 01:20:01.520328 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 400/823] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:01 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1449 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:01.543183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b1710cf-ab48-4375-88f7-c0dd1260f6ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:01.544008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b1710cf-ab48-4375-88f7-c0dd1260f6ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:01.590652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:01.616307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid ad991591-cd0a-4007-a8a7-a3ddea88189e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:01.650022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-45bce124-c6ba-4a30-91f1-7057d95424be tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 2049 microversion: 2.25 time: 0.644451 Oct 11 01:20:01.650640 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 424/824] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:01 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 2049 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:01.922138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1892056590", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "20dc106a-253b-405c-ac01-f4b2f29545d4"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:01.928124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b1710cf-ab48-4375-88f7-c0dd1260f6ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:01.941333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b1710cf-ab48-4375-88f7-c0dd1260f6ea tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1246 microversion: 2.1 time: 0.416839 Oct 11 01:20:01.943269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 401/825] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:01 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1246 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:02.028977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:02.029705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:02.051138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.057132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] validate_networks() for [('20dc106a-253b-405c-ac01-f4b2f29545d4', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:02.059487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.060570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.063862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.066602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.074271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.136182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=21 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:02.625237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:02.634029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47efbd15-3b21-4940-8b73-4dbc2471f745 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1318 microversion: 2.1 time: 0.609462 Oct 11 01:20:02.639230 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 402/826] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:02 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:02.644342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f7e11-9006-4dc7-a4a5-58a95068f375", "name": "network-vif-plugged", "status": "completed", "tag": "7f4e02dc-ceee-4246-b8c1-7722209fcaf0"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:02.677386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.680779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.681341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.697012 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] Creating event network-vif-plugged:7f4e02dc-ceee-4246-b8c1-7722209fcaf0 for instance 902f7e11-9006-4dc7-a4a5-58a95068f375 on n-h2-772273-9 Oct 11 01:20:02.728531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8b91826f-62c2-4fbc-9752-369d186153f0 req-5cf97ad1-ef16-49ec-82c8-ab308c3f6e95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085325 Oct 11 01:20:02.732321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 403/827] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:02.754342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:02.755118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:02.772067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.772663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.773308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.774215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.774769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.775227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.848024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:02.848928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:02.849553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:02.850185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lazy-loading 'fault' on Instance uuid 9dff9810-ab6e-4d0a-a5b0-da9226724f7a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:03.125937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:03.142231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:03.144833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b4eb1cda29248659ce2adf67696cf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe103202dd4b9590dcf88a239a656f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:03.153658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-193743c9-30c1-40fc-b69f-f4370a3ad6f0 tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 200 len: 1449 microversion: 2.75 time: 0.417478 Oct 11 01:20:03.154591 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 404/828] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:02 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 1449 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:03.160624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:03.161500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:03.168846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.169538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.170933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.171898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.185057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.186288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.344989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:03.362742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a97f3bee-6cfc-413e-a52c-f9b87308a971 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1298 microversion: 2.1 time: 0.206643 Oct 11 01:20:03.364938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 405/829] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:03 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:03.512864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:03.513251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:03.513436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:03.513845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:03.514250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:03.533277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.533761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.546192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.550532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.551247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.551881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.614411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:03.629353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for user 81493fadd3b044479ce4722ce58f3235 and project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:03.666463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:03.670424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:03.676021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:03.688353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:03.700127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.707250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.709907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.712723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:03.718567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:03.720124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:03.865589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a362248d-0720-41ab-8507-f859a325f5dd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.947459 Oct 11 01:20:03.866248 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 425/830] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 01:20:03.896398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:03.904196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:04.342847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:04.366826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:04.372595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:04.376872 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e65598a-9a4d-4971-9c2a-0442917e056c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1262 microversion: 2.25 time: 0.498608 Oct 11 01:20:04.377808 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 426/831] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:03 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1262 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:04.390951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:04.395075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] [instance: 9dff9810-ab6e-4d0a-a5b0-da9226724f7a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:04.427258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:04.429021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:04.430000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:04.432617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:04.435399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:04.438141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:04.460409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:04.470742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75d37a45-6411-411a-aaf6-77a4bb4342b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1318 microversion: 2.1 time: 0.811802 Oct 11 01:20:04.475176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 406/832] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:03 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:04.488325 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] HTTP exception thrown: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. Oct 11 01:20:04.489394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Request method failure captured: Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a HTTP/1.1 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRnVsj_BziVvb9saUAfxhXzZ9jAg8GMfZWmDmfdrlbCdSYQYlc1w2mSZfWv7pqproQ1BqD2XApk8Vk1RWakd1UAUkXxKv5dlMc7htQNSf7_5zpI7SleBvSJ8mjoxr0KGC1jaWoUzTGBOh8ZncHUNCHfe8lWp-kwMEJoz2irYbJtmQk Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.75 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: bffe103202dd4b9590dcf88a239a656f Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdmin275Test-79591729 Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:04.490707 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bffe103202dd4b9590dcf88a239a656f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bffe103202dd4b9590dcf88a239a656f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bffe103202dd4b9590dcf88a239a656f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bffe103202dd4b9590dcf88a239a656f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdmin275Test-79591729 Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: bffe103202dd4b9590dcf88a239a656f Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdmin275Test-79591729 Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdmin275Test-79591729-project Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b4eb1cda29248659ce2adf67696cf30 Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdmin275Test-79591729-project Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. Oct 11 01:20:04.492483 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '9dff9810-ab6e-4d0a-a5b0-da9226724f7a'} Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:04.493340 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. Oct 11 01:20:04.494692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:04.497772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] Returning 404 to user: Instance 9dff9810-ab6e-4d0a-a5b0-da9226724f7a could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:04.497772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d00e78c5-7c6c-43b4-b326-63f9f23c298e tempest-ServersAdmin275Test-79591729 tempest-ServersAdmin275Test-79591729-project] 10.222.0.66 "GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a" status: 404 len: 111 microversion: 2.75 time: 0.112755 Oct 11 01:20:04.498561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 427/833] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:04 2022] GET /compute/v2.1/servers/9dff9810-ab6e-4d0a-a5b0-da9226724f7a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:20:04.499177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:04.511166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:04.516203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:04.516844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:04.517611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:04.518886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:04.519552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:04.645638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:04.657346 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7c81e48-aff1-4428-8e22-7c16f32e04da tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1304 microversion: 2.1 time: 0.180706 Oct 11 01:20:04.657884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 407/834] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:04 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1304 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:05.406260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:05.407935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:05.438518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.440552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.445083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.452199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.456466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.463815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.498529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:05.499149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:05.515088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.523264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.523973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.524744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.525214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.532128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.671443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:05.686589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:05.693963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:05.695670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e1c70cb-4368-4440-8866-1b996068cf0b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1314 microversion: 2.25 time: 0.296630 Oct 11 01:20:05.699178 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 428/835] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:05 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:05.706806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:05.712720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:05.730154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.731147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.731872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.733289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:05.736716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:05.737989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:05.975315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:05.993189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-779f769b-a2d5-49e0-a3ca-4f0b1b2091a1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1304 microversion: 2.1 time: 0.292658 Oct 11 01:20:05.998319 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 429/836] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:05 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:06.441873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:06.498486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0fd7bde1-5b91-4e04-9d4b-405f4a35cebd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1468 microversion: 2.1 time: 1.002956 Oct 11 01:20:06.503719 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 408/837] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:05 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1468 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:06.538409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:06.551723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:06.553383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Searching by: {'reservation_id': 'r-b2u1h96q', 'deleted': False, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:20:06.562078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:06.562880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:06.563588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:06.564494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:06.565174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:06.565760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:06.742011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:06.744534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:06.790270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:06.790794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:06.791236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:06.792035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:06.801978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:06.803249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:06.890790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:20:07.266175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:07.288224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:07.302677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:07.303633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:07.378061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:07.396553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:07.407504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:07.409000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3fb5c1d4-3b97-470c-98b4-141f17714024 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1314 microversion: 2.25 time: 0.677366 Oct 11 01:20:07.409751 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 409/838] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:06 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:07.429588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:07.430625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:07.463310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:07.472480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:07.472781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:07.473559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:07.474034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:07.474928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:08.562641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5015e213-961b-4e10-ab7f-c26df77ef5c2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?reservation_id=r-b2u1h96q" status: 200 len: 2929 microversion: 2.1 time: 2.040253 Oct 11 01:20:08.563936 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 430/839] 10.222.0.66 () {58 vars in 1197 bytes} [Tue Oct 11 01:20:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-b2u1h96q => generated 2929 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:08.569189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:08.574232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:08.599705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:08.600464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:08.601080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:08.607026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:08.607026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:08.607026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:08.670173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:08.684699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d1b1494-a15f-47ac-a7ca-01a89f3c51e6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 1.273639 Oct 11 01:20:08.711574 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 410/840] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:07 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:08.724594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:08.765642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_groups [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Querying cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) for 2 instances {{(pid=120493) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 01:20:08.768336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:08.770170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:08.770873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:08.865401 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb074743-aac5-459f-872c-f6ef7e796090 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/ce89f7fc-bc42-410a-a72c-2aea6f3f025c" status: 200 len: 266 microversion: 2.1 time: 0.150956 Oct 11 01:20:08.866252 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 411/841] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:20:08 2022] GET /compute/v2.1/os-server-groups/ce89f7fc-bc42-410a-a72c-2aea6f3f025c => generated 266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:08.887886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:08.899511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:08.901447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:08.901614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:08.906466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:08.909876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc95a5e9-3e73-47f5-841a-9c194cb6872f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1320 microversion: 2.25 time: 0.344671 Oct 11 01:20:08.910452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 431/842] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:08 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:08.934199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:08.935726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:08.937300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:08.940425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:08.941327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:08.942149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:09.547190 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4462fe60-e63d-4518-b679-b15deffe2753 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1619 microversion: 2.1 time: 0.660417 Oct 11 01:20:09.548292 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 412/843] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:08 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1619 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:09.575964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:09.577185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:09.588088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:09.593116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:09.593581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:09.594333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:09.594801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:09.595233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:09.717381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:09.720088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:09.740584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:09.743382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:09.744293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:09.746764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:09.747951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:09.750312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:10.164265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:10.177196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d52c0a3f-577c-43c4-b0a8-0d7592664b8c tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 200 len: 1619 microversion: 2.1 time: 0.604403 Oct 11 01:20:10.194251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:10.197414 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 432/844] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:09 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 1619 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:10.202481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:10.203108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:10.209554 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b52b89f-8099-48b1-bd16-ad8527bcab67 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.500139 Oct 11 01:20:10.212559 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 413/845] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:09 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:10.250705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:10.251625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:10.252263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:10.253828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:10.254696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:10.255297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:10.258672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: .version_select at 0x7f11346ef820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-272080548", "policies": ["anti-affinity"]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:10.339444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:10.366699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:10.444715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:10.465252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:10.472200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:10.478207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-212e916a-590f-4ffb-b112-5b56861dfff4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1320 microversion: 2.25 time: 0.279563 Oct 11 01:20:10.481424 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 433/846] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:10 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:10.504205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:10.521404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:10.582101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7b589bc4-3683-4102-819c-8b90352ecb30 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.363554 Oct 11 01:20:10.583589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 414/847] 10.222.0.66 () {60 vars in 1174 bytes} [Tue Oct 11 01:20:10 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:10.853252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1668447405", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a25b04f5-cea5-4df1-b053-60478905d1a9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:10.978440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:11.241577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:11.242343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:11.253493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:11.257583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:11.259208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:11.261111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:11.264241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:11.265483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:11.266675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:12.493086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:12.496599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:12.498087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:12.498836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:12.499601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:12.515140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:12.518644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:12.527854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2baafdd-35a6-457b-a3cf-3860087d85a9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 1.286537 Oct 11 01:20:12.528651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 415/848] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:11 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:12.557945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:12.560638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:12.576511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:12.577739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:12.579898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:12.580833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:12.583024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:12.583707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:12.624747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:12.629050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:12.629570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:12.630391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:12.633410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:12.633985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:12.706871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:12.731860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:12.802955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 2 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:12.813311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:12.987697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120494) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 01:20:13.068491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:13.075003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:13.092413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:13.153809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:13.171783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:13.199718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=17139ecc-1465-4024-82c0-9971555ad18d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:13.304666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:13.318953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:13.323965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:13.326525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:13.337045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:13.341610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30788266-3b9b-4d35-bba2-31d50b6e0c9c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.797447 Oct 11 01:20:13.349976 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 416/849] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:12 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:13.412212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:13.429171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'server_group_members'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:13.524546 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f73dbf5e-70ab-4386-9b23-52298cbf8193 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.675738 Oct 11 01:20:13.529266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 434/850] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2681 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 11 01:20:13.536624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b40f057-9cff-444d-a0be-b3fb1f75697f", "tag": "2c8cc681-968c-4fd9-8a57-c041e1e1e252"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:13.564712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:13.569855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:13.570299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:13.606675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] Creating event network-changed:2c8cc681-968c-4fd9-8a57-c041e1e1e252 for instance 9b40f057-9cff-444d-a0be-b3fb1f75697f on n-h1-772273-9 Oct 11 01:20:13.620337 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e02706a0-c155-4b76-80c2-ad4f9142dee1 req-24a5353b-750d-419d-928e-c345e3758483 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089743 Oct 11 01:20:13.624254 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 435/851] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:13.638225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:13.651864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:13.653135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Searching by: {'deleted': False, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:20:13.697000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:13.699955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:13.702422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:13.704040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:13.706898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:13.709627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:13.769196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:20:13.860664 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2af38c76-3e88-49d1-ad18-9cca1c323796 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.229602 Oct 11 01:20:13.868603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: .version_select at 0x7f113467bca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1644600964", "policies": ["affinity"]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:13.870710 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 436/852] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:20:13 2022] GET /compute/v2.1/servers => generated 1664 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:13.888618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:13.889380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:13.910438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:13.910948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:13.911417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:13.927100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:13.927714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:13.928247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:13.947219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:13.974968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:14.077994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:14.173887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:14.200786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:14.254000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f917be07-8da7-4bcb-82e9-542dc6efad97 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.902285 Oct 11 01:20:14.264969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 417/853] 10.222.0.66 () {60 vars in 1174 bytes} [Tue Oct 11 01:20:13 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:14.281722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e5be0e9-6755-48db-a531-6bf8c389f37b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:14.284008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e5be0e9-6755-48db-a531-6bf8c389f37b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:14.500125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e5be0e9-6755-48db-a531-6bf8c389f37b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:14.509910 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e5be0e9-6755-48db-a531-6bf8c389f37b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1219 microversion: 2.1 time: 0.242667 Oct 11 01:20:14.512775 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 418/854] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:14 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:14.523473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:14.540560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-334de2f3-17f3-44c7-8d0e-948e5fe56133 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.668416 Oct 11 01:20:14.542142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 437/855] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:13 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:14.556555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: .version_select at 0x7f1134300b80>, body: {"server_group": {"name": "tempest-server-group-381181776", "policies": ["affinity"]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:14.626582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:14.646721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:14.785573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:14.812275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:14.865839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-322930c9-2aee-4b47-80ca-e91aa50e47ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.316756 Oct 11 01:20:14.867409 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 438/856] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:20:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:14.884897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:14.886349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:14.912604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:14.913400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:14.914741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:14.915683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:14.918054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:14.921155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:15.282051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:15.297832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:15.302510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:15.305178 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aafe5672-7a6e-4155-8e60-2ae4287dfc37 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.436519 Oct 11 01:20:15.305766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 439/857] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:14 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:15.320548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: .version_select at 0x7f11343001f0>, body: {"server_group": {"name": "tempest-server-group-381181776", "policies": ["affinity"]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:15.396014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:15.419471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:15.443252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1905405718", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:15.668512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] validate_networks() for [('6fe43141-5ef9-4c8b-9c55-66c9cc4b4524', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:15.686573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:15.692107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:15.711585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:15.765563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d58eaf5-d0a4-4a45-9a49-6b4f91951b23 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.454411 Oct 11 01:20:15.771746 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 440/858] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:20:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:15.784242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:15.787964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:15.800738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:15.802453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:15.806918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:15.808431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:15.809095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:15.809677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:15.949908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:15.965199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba879dbe-7821-4e20-9edd-5ce1418ee95f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1223 microversion: 2.1 time: 0.190363 Oct 11 01:20:15.968452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 441/859] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:15 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:15.981964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:15.984230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:16.002194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:16.005106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:16.007361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:16.010375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:16.011165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:16.012432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:16.523392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:16.535703 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-457d79e7-11d8-4075-8257-800eb39199e1 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.565848 Oct 11 01:20:16.544383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 442/860] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:15 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:16.568495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1ccf21c-e7ee-4f7b-97c9-faa468deda82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:16.633170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1ccf21c-e7ee-4f7b-97c9-faa468deda82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/e1df333c-4dfb-4880-bd75-5d850bae084d" status: 204 len: 0 microversion: 2.1 time: 0.071782 Oct 11 01:20:16.633995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 443/861] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:16 2022] DELETE /compute/v2.1/os-server-groups/e1df333c-4dfb-4880-bd75-5d850bae084d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:16.641380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83c7632-d984-4249-aab7-f3f7a602872b", "tag": "3149c506-f06f-473d-9f4d-265670905ee1"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:16.684423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:16.687003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:16.687690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:16.714251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] Creating event network-changed:3149c506-f06f-473d-9f4d-265670905ee1 for instance f83c7632-d984-4249-aab7-f3f7a602872b on n-h1-772273-9 Oct 11 01:20:16.724182 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e5ef4e2a-2099-4824-816a-b39a40e47757 req-f9d64dd4-1a62-42a9-a603-f8580a3cc787 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088595 Oct 11 01:20:16.725450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 444/862] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:16.948246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:16.949214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:16.949867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:16.954461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:16.955147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:16.974297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:16.975156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:16.975953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:16.976878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:16.977519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:16.978148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.010668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Getting quotas for project d8950eed91dc442ba09b67cae132e0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:17.027827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Getting quotas for user d9c32eb3b6ca4570815c664e90bb36a4 and project d8950eed91dc442ba09b67cae132e0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:17.060051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:17.067783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:17.128799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.135095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.136427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.138471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.139839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.141057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.142063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.205969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4af4aec7-12e6-4098-9d1f-7d1e2775d1b8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.691187 Oct 11 01:20:17.206647 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 419/863] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:20:17.222614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.224151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:17.235648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.236517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.237142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.238074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.238695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.239278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.247315 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41a13005-e690-492e-afc5-75ae25967a8a tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.520080 Oct 11 01:20:17.263098 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 445/864] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:17.268535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b699f3ef-ac74-4487-8ad8-4ba7871114ce tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.286997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b699f3ef-ac74-4487-8ad8-4ba7871114ce tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.022564 Oct 11 01:20:17.287782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 446/865] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:17.294516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.296114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:17.304171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.304684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.305237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.306050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.306656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.310174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.577598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:17.595372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:17.615151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:17.618581 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-390d21bd-6844-45da-a89f-7486d837dbf7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.401344 Oct 11 01:20:17.623883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:17.628319 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 420/866] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:17.642252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7f5308e-6b43-4554-8e5e-5f23b14854ca tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1271 microversion: 2.1 time: 0.353248 Oct 11 01:20:17.656287 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 447/867] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:17.668778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c648180-585d-4a8b-8e78-ff65ac65c8cf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.677733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8c648180-585d-4a8b-8e78-ff65ac65c8cf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:17.681121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.698086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.704796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.705557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.709553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.710252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.715074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.797317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb63da52-241e-4035-8ec5-bbf182061597 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-772273-9" status: 200 len: 578 microversion: 2.1 time: 0.139721 Oct 11 01:20:17.798205 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 448/868] 10.222.0.66 () {58 vars in 1172 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/os-services?host=n-d-772273-9 => generated 578 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:17.811893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33842f12-164b-4b54-bd5c-154329011c3e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.865652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33842f12-164b-4b54-bd5c-154329011c3e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/df94decb-b41c-4f26-8aae-e6cba81a7d90" status: 204 len: 0 microversion: 2.1 time: 0.065025 Oct 11 01:20:17.867096 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 449/869] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:17 2022] DELETE /compute/v2.1/os-server-groups/df94decb-b41c-4f26-8aae-e6cba81a7d90 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:17.879055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.880171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:17.896268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.899161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.899762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.905611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8c648180-585d-4a8b-8e78-ff65ac65c8cf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:17.910409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.913066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.915140 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c648180-585d-4a8b-8e78-ff65ac65c8cf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1224 microversion: 2.1 time: 0.282372 Oct 11 01:20:17.917077 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 421/870] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:17.918740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.939090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:17.950342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.954467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.961341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:17.962569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:17.964707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:17.965404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:18.116570 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2408430a-368c-41f6-9704-8d184771e818 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.198082 Oct 11 01:20:18.120575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 422/871] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:18.152369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3eac8875-fb47-46e4-9ca5-df026b4af596 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:18.210743 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3eac8875-fb47-46e4-9ca5-df026b4af596 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.088778 Oct 11 01:20:18.228186 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 423/872] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:20:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:18.233004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:18.237615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:18.240179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:18.241057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:18.248439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:18.249086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:18.249797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:18.344951 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6293ebe-17b9-4866-9cc6-cb14c90921d6 tempest-ServicesAdminTestJSON-1892609382 tempest-ServicesAdminTestJSON-1892609382-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.125588 Oct 11 01:20:18.346773 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 424/873] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:18.377323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: .version_select at 0x7f112fd6e4c0>, body: {"server_group": {"name": "tempest-server-group-41657386", "policies": ["affinity"]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:18.443325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:18.479797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:18.639760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:18.661118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:18.721193 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4cca50bf-28a7-4d3d-85ba-bce4f33287f0 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.371083 Oct 11 01:20:18.727722 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 425/874] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:20:18 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:18.755877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:18.756743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:18.771381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:18.778185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:18.781427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:18.789891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:18.791543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:18.794314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:19.400990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:19.410286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f341a773-8ba0-4098-bebd-1ed64fae7d90 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 1.541937 Oct 11 01:20:19.417731 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 450/875] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:17 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:19.431731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:19.432490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:19.443078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:19.449121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:19.449121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:19.449121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:19.449121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:19.450166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:19.950851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:19.960671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ab48fb9-801a-4eaf-9cf9-6f48e88518c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1277 microversion: 2.1 time: 0.541553 Oct 11 01:20:19.979363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 451/876] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:19 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1277 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:19.979363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4da9e1b-beb2-426a-be5f-bd975ffe1365 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.056399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4da9e1b-beb2-426a-be5f-bd975ffe1365 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/63117388-f5f8-4e4e-8c49-b588b0c1d738" status: 204 len: 0 microversion: 2.1 time: 0.089199 Oct 11 01:20:20.058114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 452/877] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:19 2022] DELETE /compute/v2.1/os-server-groups/63117388-f5f8-4e4e-8c49-b588b0c1d738 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:20.070750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.072751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:20.085951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:20.093322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:20.095812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:20.096408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:20.097335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:20.098387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:20.100206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:20.104894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:20.108031 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-243e3377-d7bc-4cc2-8a0a-b745c33e118c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 1.374520 Oct 11 01:20:20.111162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 426/878] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:18 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:20.114952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:20.126856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3142d839-e88d-45ec-8730-6ecfd871dcd9 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.158301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3142d839-e88d-45ec-8730-6ecfd871dcd9 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045959 Oct 11 01:20:20.169825 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 427/879] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:20:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:20.175881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: .version_select at 0x7f112fd0bc10>, body: {"server_group": {"name": "tempest-server-group-1906041344", "policies": ["anti-affinity"]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:20.195499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=54 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:20.210861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:20.218499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:20.259227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:20.269522 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06f66b71-e737-417d-9d70-5346902ab516 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1276 microversion: 2.1 time: 0.210051 Oct 11 01:20:20.274756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 453/880] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:20 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:20.277438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:20.316223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:20.326572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:20.346427 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-060e9b2a-b348-4a6b-97a9-f4d0d5c24486 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.175395 Oct 11 01:20:20.347968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 428/881] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:20:20 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:20.359399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a3278db-6c08-4772-9692-ae50409d619a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.397018 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a3278db-6c08-4772-9692-ae50409d619a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/ab9b68d0-48ab-4843-afcd-9f6a259f73c1" status: 204 len: 0 microversion: 2.1 time: 0.041404 Oct 11 01:20:20.398440 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 454/882] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:20 2022] DELETE /compute/v2.1/os-server-groups/ab9b68d0-48ab-4843-afcd-9f6a259f73c1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:20:20.409304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f25134c-1835-432e-8c6a-5dc9bec0b940 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.430951 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f25134c-1835-432e-8c6a-5dc9bec0b940 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027484 Oct 11 01:20:20.445055 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 429/883] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:20:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:20.448632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.449434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:20.458222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:20.459019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:20.459906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:20.461021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:20.461641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:20.462213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:20.558336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-781162884", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "326af42a-787d-4902-90ee-0085cfc6c439"}]}, "os:scheduler_hints": {"group": "8dc22e2f-2e04-41e3-9191-800b65f6556d"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:20.612121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] validate_networks() for [('326af42a-787d-4902-90ee-0085cfc6c439', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:20.834470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:20.843127 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5da2406-d651-48d5-83c1-2860d861673a tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.405360 Oct 11 01:20:20.843843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 455/884] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:20 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:20.993813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:20.994891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:21.001536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.002150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.002689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.003665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.004480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.005007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.441973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:21.452644 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c027014d-53db-4b50-9b3f-0f48fc988c06 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.463306 Oct 11 01:20:21.454268 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 456/885] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:20 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:21.460036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:21.460807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:21.466915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.467641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.468258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.469151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.469617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.470048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.703643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:21.704056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:21.704529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:21.704941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:21.705358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:21.729140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.730013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.733006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.736002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.737152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.738468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.763081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:21.771929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:21.792341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:21.795556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:21.851406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:21.865026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:21.869234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:21.872660 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-391130e7-7987-4922-b796-4e2a99fbbb38 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.417049 Oct 11 01:20:21.874950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 457/886] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:21 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:21.879980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:21.881636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:21.896095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.898134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.899576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.903527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:21.903527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:21.903527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:21.922483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:21.937675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:22.039820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:22.054172 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9affb9de-3837-49f4-876e-bd6f28de9bb3 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1276 microversion: 2.1 time: 0.175521 Oct 11 01:20:22.056363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 458/887] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:21 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:22.068497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:22.069131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:22.070738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:22.078744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Getting quotas for user 74fcb15845bc4a7890edebd5d27ec18c and project 7f4d877237ef4843a3cdf994871faad6. Resources: {'server_group_members'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:22.091545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.092080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.092536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.093287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.093750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.094179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.130479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:22.157965 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-350d2b0b-11f8-420f-949e-1207754ace82 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603645 Oct 11 01:20:22.162002 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 430/888] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:20:22.183452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-931c7f94-39b8-4e71-8d73-d791c56cda7c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:22.184074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-931c7f94-39b8-4e71-8d73-d791c56cda7c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:22.438887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-931c7f94-39b8-4e71-8d73-d791c56cda7c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:22.452113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-931c7f94-39b8-4e71-8d73-d791c56cda7c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1212 microversion: 2.1 time: 0.282537 Oct 11 01:20:22.453188 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 431/889] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:22 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1212 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:22.478034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:22.479260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:22.489614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.491120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.491965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.492957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.493640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.494476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.724201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:22.736966 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-da764230-8c3d-4570-a5bf-d0afc0fa3c17 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.679331 Oct 11 01:20:22.740568 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 459/890] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:22 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:22.902532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:22.903589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:22.914422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.915309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.920280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.921273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:22.921894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:22.922480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:22.937945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:22.954080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cee47e62-c631-4e67-8f32-3928156d28ff tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.479948 Oct 11 01:20:22.972223 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 432/891] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:22 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:23.082170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:23.082793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:23.093155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.095741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.096837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.097614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.104109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.104831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.445496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:23.459100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d91302b9-9f75-4cd7-acff-9f8c5e4dc094 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1282 microversion: 2.1 time: 0.380796 Oct 11 01:20:23.463243 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 433/892] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:23 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:23.482507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:23.483828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:23.510186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.513162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.513667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.516267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.516865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.517621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.618561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:23.648427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:23.650615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:23.652036 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fdb2dec-388a-46b4-a319-9d80564a13f8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.753505 Oct 11 01:20:23.653089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 460/893] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:22 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:20:23.706116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:23.719109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2b57ebe-bb48-40ae-b927-61a389a1e1fc tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1264 microversion: 2.1 time: 0.245887 Oct 11 01:20:23.721080 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 434/894] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:23 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:23.768701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:23.769323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:23.778707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.779210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.779681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.780380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.795423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.795891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.951285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:23.955014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.957887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.958795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.959847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:23.961654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:23.963497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:23.995278 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de24a75f-ea7b-4ce6-9c44-42a1f4b97886 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.300696 Oct 11 01:20:24.004887 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 461/895] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:24.010958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.011981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:24.020127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.020995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.022775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.025108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.026350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.027040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.364461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:24.373515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf9116c2-c792-4eb8-805f-39b9da3680b6 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.609164 Oct 11 01:20:24.383697 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 435/896] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:23 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:24.400485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.404207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.404709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.405152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.409700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.410442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.413436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.470054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e1c35cf-949c-4e80-8dea-86754a9f1def tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.085160 Oct 11 01:20:24.470868 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 436/897] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:24.490287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.491435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:24.500225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.501067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.501730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.502666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.503424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.504722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.531862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:24.542272 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-feaa962b-0919-4422-96c8-ccbbd258109a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.535896 Oct 11 01:20:24.543689 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 462/898] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:24.564214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.568610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.569113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.569545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.570277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.570723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.571356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.611517 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c724a349-fe5d-4b82-a3b6-9160a317fd50 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.065901 Oct 11 01:20:24.612947 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 463/899] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:24.619626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b48ea2aa-3a84-4e8b-b069-76b3829cee32", "tag": "80621522-668f-4906-b7c7-63818e9c6053"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:24.630681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.631681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.632307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.648772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] Creating event network-changed:80621522-668f-4906-b7c7-63818e9c6053 for instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 on n-h1-772273-9 Oct 11 01:20:24.658855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-40944870-ee50-45e3-be04-0de6a45b7235 req-b744ddfc-139b-4000-bf02-de49e1f8d17d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044429 Oct 11 01:20:24.660113 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 464/900] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:24.666699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.671672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.672526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.673159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.674059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.674683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.675313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.735418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd1b562b-bcc4-451e-859b-2bc275058627 tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-772273-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.073138 Oct 11 01:20:24.737539 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 465/901] 10.222.0.66 () {58 vars in 1194 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/os-services?host=n-d-772273-9&binary=xxx => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:20:24.749061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:24.750291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:24.761713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.762981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.763653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:24.765042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:24.766423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:24.767060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.340520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:25.350333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02013753-dfd3-470e-b6e8-9ce3909d922e tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.867267 Oct 11 01:20:25.351572 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 437/902] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:25.370863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:25.371708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:25.378147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.378755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.379403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.380174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.380755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.381289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.508317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:25.516698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-adefc125-e1e1-4755-aeda-d2ce9879a89d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1270 microversion: 2.1 time: 0.159234 Oct 11 01:20:25.517383 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 438/903] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:25 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:25.522037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:25.526937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.527549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.528049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.528904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.529511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.530061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.534416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:25.544433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:25.546249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:25.547681 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-910f68c3-f6d1-48b4-a854-6b0661255958 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.805922 Oct 11 01:20:25.548626 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 466/904] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:24 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:25.554943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:25.567599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0039eab-a5cc-43e6-acb9-b8211d94598e tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048970 Oct 11 01:20:25.568530 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 439/905] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:25.573570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:25.574183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:25.580045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.580534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.580971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.581684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.582249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.582760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.583584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.584224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.584654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.594495 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] Creating event network-changed:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:20:25.599952 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4c8e9dc3-2acc-4e10-a73b-cc4240addbb0 req-ba779d40-1294-462a-89b6-0d822cb16cfc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049734 Oct 11 01:20:25.600559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 467/906] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:25.608393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:25.609352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:25.616862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.617549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.618162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.619628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:25.620263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:25.620695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:25.747364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=48 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:26.004719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:26.017884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16f35381-9d17-4536-af15-d7db8a7ea2b5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.448286 Oct 11 01:20:26.019223 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 440/907] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:25 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:26.032120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:26.035625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:26.039835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.042831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.043578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.043707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dad13b8-2dfd-408c-93bc-28053e13b6e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.441499 Oct 11 01:20:26.044698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.045437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.046062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.057120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 468/908] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:25 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:26.073441 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b92f1b6f-4827-4440-8efd-3323ffb9172c tempest-ServicesAdminNegativeTestJSON-505261463 tempest-ServicesAdminNegativeTestJSON-505261463-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.052858 Oct 11 01:20:26.074063 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 441/909] 10.222.0.66 () {58 vars in 1198 bytes} [Tue Oct 11 01:20:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:20:26.198834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04b5b351-6d1a-4d9d-b84b-833b11e17dad tempest-ServicesAdminNegativeTestJSON-883524655 tempest-ServicesAdminNegativeTestJSON-883524655-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:26.202511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-04b5b351-6d1a-4d9d-b84b-833b11e17dad tempest-ServicesAdminNegativeTestJSON-883524655 tempest-ServicesAdminNegativeTestJSON-883524655-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '6e04deb6ad944db186a15b77f0dd33a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13311ba8f1604d09b8c7bec30922201c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04b5b351-6d1a-4d9d-b84b-833b11e17dad tempest-ServicesAdminNegativeTestJSON-883524655 tempest-ServicesAdminNegativeTestJSON-883524655-project] Request method failure captured: Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTW5cCF2MLhX71xoz0yYhVFxrpubE8wAqrLWiO3CngtGsiBO9ECmBfjCF01u4xGxXqlFrkZfonShW_AU1-Fv3Xntg0WGjJdeieG2psd1zUOhotc9vXWgvXk0Xb4An9oZdiadNxnPItVciZNv8bXPC3BA8-ChRwA6vXe-ffrTAKNhWY Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 13311ba8f1604d09b8c7bec30922201c Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-883524655 Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:26.210372 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/13311ba8f1604d09b8c7bec30922201c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_13311ba8f1604d09b8c7bec30922201c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13311ba8f1604d09b8c7bec30922201c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13311ba8f1604d09b8c7bec30922201c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-883524655 Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 13311ba8f1604d09b8c7bec30922201c Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-883524655 Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServicesAdminNegativeTestJSON-883524655-project Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6e04deb6ad944db186a15b77f0dd33a4 Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-883524655-project Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:26.212153 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:20:26.212982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:26.214306 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:26.215633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04b5b351-6d1a-4d9d-b84b-833b11e17dad tempest-ServicesAdminNegativeTestJSON-883524655 tempest-ServicesAdminNegativeTestJSON-883524655-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:26.215633 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04b5b351-6d1a-4d9d-b84b-833b11e17dad tempest-ServicesAdminNegativeTestJSON-883524655 tempest-ServicesAdminNegativeTestJSON-883524655-project] 10.222.0.66 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.128906 Oct 11 01:20:26.217662 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 469/910] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:20:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:26.220570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83c7632-d984-4249-aab7-f3f7a602872b", "name": "network-vif-plugged", "status": "completed", "tag": "3149c506-f06f-473d-9f4d-265670905ee1"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:26.231121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.231886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.232561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.247620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] Creating event network-vif-plugged:3149c506-f06f-473d-9f4d-265670905ee1 for instance f83c7632-d984-4249-aab7-f3f7a602872b on n-h1-772273-9 Oct 11 01:20:26.255045 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3eddc842-e3a0-41db-9f1c-207ace7073fa req-d38ad79f-ff4b-484d-8e49-94d2fac8ba0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041208 Oct 11 01:20:26.256959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 442/911] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:20:26.373890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:26.374519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:26.382707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.383702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.384986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.385710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.386172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.388229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.542941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:26.544275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:26.553167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.553892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.554489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.555914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.556607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.557947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.882977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:26.891659 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f13c3a4-f329-4b9c-8a43-efa41fe20f85 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.521538 Oct 11 01:20:26.892376 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 470/912] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:26 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:26.897281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:26.897967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:26.904644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.905514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.906140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.906849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.907322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.907781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.924304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:26.932500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-070e303e-5ca8-4262-a934-df6567adaeb7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.395138 Oct 11 01:20:26.933470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 443/913] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:26 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:26.938398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17139ecc-1465-4024-82c0-9971555ad18d", "tag": "a790adbf-be2a-4530-882c-1678bfb4654a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:26.948442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:26.948928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:26.949356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:26.964720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] Creating event network-changed:a790adbf-be2a-4530-882c-1678bfb4654a for instance 17139ecc-1465-4024-82c0-9971555ad18d on n-h2-772273-9 Oct 11 01:20:26.969703 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ab1b827e-7d1f-412a-b582-3fda7e402d8c req-ddd9c112-d5de-445d-a634-62bad41ba1cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034907 Oct 11 01:20:26.970720 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 444/914] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:27.042261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:27.043123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:27.049722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.050435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.050922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.051752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.052448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.053104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.231988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:27.240591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:27.242068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:27.243197 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c016a244-c070-4275-a99c-a3c125f0405a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.349692 Oct 11 01:20:27.244350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 471/915] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:26 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:27.248979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:27.249698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:27.251719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:27.258709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.260010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.260636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.261355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.261821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.262246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.307788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:27.320000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcc4935d-ee86-44f1-916f-283bb0235bfc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.281944 Oct 11 01:20:27.331517 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 445/916] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:27 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:27.417305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:27.437101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66753d1a-2038-4bae-8edf-fd8ce84a847e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.191708 Oct 11 01:20:27.437686 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 472/917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:27 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:27.916824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:27.917470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:27.924229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.924719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.925165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.925862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.926322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.926752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.956815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:27.957999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:27.968672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.969525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.970040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:27.970822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:27.971389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:27.972011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.147046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.156446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d2ef618-78b2-4431-8f73-5e05cc37c063 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.244074 Oct 11 01:20:28.156605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.157263 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 446/918] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:27 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:28.164653 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d627e81-01ad-4ded-9a11-e730ae969f25 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.211668 Oct 11 01:20:28.166032 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 473/919] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:27 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:28.268667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:28.269311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:28.275767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.276255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.276689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.277379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.277833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.278255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.288152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b40f057-9cff-444d-a0be-b3fb1f75697f", "name": "network-vif-plugged", "status": "completed", "tag": "2c8cc681-968c-4fd9-8a57-c041e1e1e252"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:28.299383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.299954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.300455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.300747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:28.314231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] Creating event network-vif-plugged:2c8cc681-968c-4fd9-8a57-c041e1e1e252 for instance 9b40f057-9cff-444d-a0be-b3fb1f75697f on n-h1-772273-9 Oct 11 01:20:28.319827 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-27f55d85-abb7-4a7b-9b81-654e835a6ea8 req-15fa779d-520f-4498-a206-8e9214046c2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Oct 11 01:20:28.320520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 474/920] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:20:28.344418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:28.345165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:28.351573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.352074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.352709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.354224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.354691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.355114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.469960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.480904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.482695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.484640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-102bfe7f-82ad-4f45-91d1-b32632ee9f50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1362 microversion: 2.25 time: 0.219849 Oct 11 01:20:28.485355 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 447/921] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:28 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:28.490751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:28.492179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:28.512456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.513681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.514617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.515598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:28.516303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:28.517059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:28.521334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.530385 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a5f6224-081e-4927-9834-39351e6ecb9f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.190255 Oct 11 01:20:28.531709 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 475/922] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:28 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:28.661529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:28.678880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-10fae2b2-b0a5-4b1c-9f78-bec368bcfd77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.190177 Oct 11 01:20:28.684577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 448/923] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:28 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:29.180523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.181176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.188944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.189646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.197650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.198361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.198983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.199438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.199929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.200083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.200457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.200844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.200992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.201850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.202861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.203476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.408840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.416614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cebc5fce-c9be-40e8-9e9b-63d33da7805a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.240071 Oct 11 01:20:29.417288 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 476/924] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:29.436974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.444935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08543279-67db-4352-b5f3-b5752a30552c tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.260435 Oct 11 01:20:29.445569 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 449/925] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:29.510911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.511535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.513618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:29.519117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.519628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.520065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.520764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.521219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.521643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.544601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Action: 'update', calling method: .version_select at 0x7f113426fa60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:29.548301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.548863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.549316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.557338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.557819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.558257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.565400 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] HTTP exception thrown: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Request method failure captured: Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 HTTP/1.1 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 56 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTdzfe1oY4iThUXMlQY2oc_zux-Bl901HfsTD96Zfu0NI7ZpPZHDXzAfq5qZC1PuPyR_CYl2i5z_oQcNKjv_CZC-OVYPkYK3oX9EPBAj2IVhYlHGt0LcciDX2v1rh0u32AiBSd5Q7EmpEUAqwXykSfw8N6y74p1DarhrwSi0LLfc5k Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:20:29.567178 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e72b45e6b571499fa14d59afd883eaf1 Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:20:29.568870 n-d-772273-9 devstack@n-api.service[120494]: exception: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '028c8c64-f5d8-47db-8f86-c00d12407526', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.569824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:29.571407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Returning 404 to user: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5118bf33-ad63-46d9-a093-0a327751ab79 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526" status: 404 len: 110 microversion: 2.53 time: 0.150107 Oct 11 01:20:29.573508 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 477/926] 10.222.0.66 () {62 vars in 1309 bytes} [Tue Oct 11 01:20:29 2022] PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 => generated 110 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:20:29.579225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.579904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.585841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.586321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.586760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.587491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.587949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.588372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.788447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.805180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.807797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.809330 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3356d5dc-497b-4606-a34d-502da7b90f59 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1558 microversion: 2.25 time: 0.303198 Oct 11 01:20:29.810796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 450/927] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:20:29.816113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Action: 'update', calling method: .version_select at 0x7f112fd3daf0>, body: {"status": "disabled"} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:29.819989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.820719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.821469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.829602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.830469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.831168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.840644 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] HTTP exception thrown: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Request method failure captured: Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 HTTP/1.1 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 22 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTdzfe1oY4iThUXMlQY2oc_zux-Bl901HfsTD96Zfu0NI7ZpPZHDXzAfq5qZC1PuPyR_CYl2i5z_oQcNKjv_CZC-OVYPkYK3oX9EPBAj2IVhYlHGt0LcciDX2v1rh0u32AiBSd5Q7EmpEUAqwXykSfw8N6y74p1DarhrwSi0LLfc5k Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:20:29.843612 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: e72b45e6b571499fa14d59afd883eaf1 Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: {"status": "disabled"} Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: exception: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.844987 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '028c8c64-f5d8-47db-8f86-c00d12407526', 'body': {'status': 'disabled'}} Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.845826 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:29.847122 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:29.850172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:29.850172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:29.851359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Returning 404 to user: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:29.852472 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60e56834-6996-4764-a900-cbee429e82d8 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526" status: 404 len: 110 microversion: 2.53 time: 0.040332 Oct 11 01:20:29.853845 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 451/928] 10.222.0.66 () {62 vars in 1309 bytes} [Tue Oct 11 01:20:29 2022] PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:20:29.859735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.860711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.867378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.868907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.869574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.870548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.871232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.871928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.962567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:29.976480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6a14f2e-1414-4e9f-b365-6d0afd76f6fb tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1371 microversion: 2.1 time: 0.400764 Oct 11 01:20:29.978244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 478/929] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:29.987522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:29.988140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:29.996683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.997412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:29.998063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:29.999090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:29.999735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.000324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.582051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:30.592162 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62057ac8-d675-4cb7-a86d-4f49ac4995c7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.735539 Oct 11 01:20:30.593270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 452/930] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:30.598869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Action: 'update', calling method: .version_select at 0x7f112fd79af0>, body: {"status": "enabled"} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:30.602541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.603405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.604073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.610355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.610967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.611578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.616734 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] HTTP exception thrown: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Request method failure captured: Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 HTTP/1.1 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 21 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTdzfe1oY4iThUXMlQY2oc_zux-Bl901HfsTD96Zfu0NI7ZpPZHDXzAfq5qZC1PuPyR_CYl2i5z_oQcNKjv_CZC-OVYPkYK3oX9EPBAj2IVhYlHGt0LcciDX2v1rh0u32AiBSd5Q7EmpEUAqwXykSfw8N6y74p1DarhrwSi0LLfc5k Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:20:30.618810 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c8542d7ab884d7bb65f76fe273e621c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 2c8542d7ab884d7bb65f76fe273e621c Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902 Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: e72b45e6b571499fa14d59afd883eaf1 Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: {"status": "enabled"} Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: exception: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:30.620533 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '028c8c64-f5d8-47db-8f86-c00d12407526', 'body': {'status': 'enabled'}} Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:30.621567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:30.623103 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:30.624629 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. Oct 11 01:20:30.624629 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:30.624629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Returning 404 to user: Service 028c8c64-f5d8-47db-8f86-c00d12407526 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:30.625357 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aaa01546-7331-4c3d-8bda-c564c6d2fbb6 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526" status: 404 len: 110 microversion: 2.53 time: 0.030852 Oct 11 01:20:30.626195 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 453/931] 10.222.0.66 () {62 vars in 1309 bytes} [Tue Oct 11 01:20:30 2022] PUT /compute/v2.1/os-services/028c8c64-f5d8-47db-8f86-c00d12407526 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:20:30.635007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:30.636516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:30.642238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:30.644471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.645261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.645810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.648329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.648950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.650394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.673012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ddd7706d-4e5f-44f8-b815-a32f53a88c3a tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 2051 microversion: 2.25 time: 0.693634 Oct 11 01:20:30.673891 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 479/932] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:29 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 2051 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:30.678692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:30.679365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:30.686973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.687788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.688454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:30.689321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:30.690288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:30.690886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.032500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:31.040241 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b83ade10-5f8e-4db1-a90b-e415453111db tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.412840 Oct 11 01:20:31.040914 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 454/933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:30 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:31.045309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.048842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.049631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.050143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.051059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.051551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.054903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:31.058997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.064694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6b56a8e-63c2-4258-bdd9-105d42ba71db tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.389747 Oct 11 01:20:31.065559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 480/934] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:30 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:31.070812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.072359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.078603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.079155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.079764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.080526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.081157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.081671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.098224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:31.098514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de476bdc-2be0-48fc-938f-54b124031971 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.056494 Oct 11 01:20:31.099870 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 455/935] 10.222.0.66 () {60 vars in 1178 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:31.104577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.105419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.111791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.112286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.112726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.113433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.113890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.114314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.402606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:31.406070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:31.414724 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7209498f-51c5-4c56-85d8-6d40eaf424d9 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1557 microversion: 2.1 time: 0.313597 Oct 11 01:20:31.415783 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 456/936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1557 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:31.416588 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2e88800-a143-4d0a-b984-f92773088143 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 2051 microversion: 2.25 time: 0.349683 Oct 11 01:20:31.417206 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 481/937] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 2051 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:31.421023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.425230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.425954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.426642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.427628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.428312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.428959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.438661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.439119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.445139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.445650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.446083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.447285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.447764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.448184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.461019 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3adc0b6-053a-45a8-9818-f9125b2393f0 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043947 Oct 11 01:20:31.462575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 457/938] 10.222.0.66 () {60 vars in 1211 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:31.467177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.470703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.471403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.471989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.472757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.473219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.473848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.496915 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad074664-bad4-44af-9f71-03196574e6d2 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033120 Oct 11 01:20:31.497529 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 458/939] 10.222.0.66 () {60 vars in 1217 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:20:31.502397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.505789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.506280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.506745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.507500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.507959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.508384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.533487 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33993e93-488b-4acf-be7e-e06fdea0c282 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034925 Oct 11 01:20:31.534104 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 459/940] 10.222.0.66 () {60 vars in 1178 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:31.534104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:31.534104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.545649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.546143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.546578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.547278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.547764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.548295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.550360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a3ef521-c748-4188-8ee1-58bbc3fd8fcc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116208 Oct 11 01:20:31.551112 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 482/941] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:20:31.562456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.569052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.569549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.569992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.570740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.571791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.572454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.614447 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76f689f9-e203-49a0-9c32-c3f75d5c3262 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-772273-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056787 Oct 11 01:20:31.615085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 483/942] 10.222.0.66 () {60 vars in 1235 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services?host=n-d-772273-9&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:31.628678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc605d82-0b6e-4e1c-be56-f560e6d5419c", "tag": "77d70934-f325-4926-b3b0-863195a44cb5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:31.639253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.640377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.640824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.650527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1797a08a-3c3b-4122-8bd3-2d9c0650d2f6 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b/action" status: 202 len: 0 microversion: 2.25 time: 0.115060 Oct 11 01:20:31.652519 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] Creating event network-changed:77d70934-f325-4926-b3b0-863195a44cb5 for instance dc605d82-0b6e-4e1c-be56-f560e6d5419c on n-h2-772273-9 Oct 11 01:20:31.655956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 460/943] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:20:31 2022] POST /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:31.661149 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-82b67400-5c64-476f-8fef-1a8a5331dfc0 req-95bf69ac-3b5e-4d67-980b-855ba71b2a07 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036135 Oct 11 01:20:31.662030 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 484/944] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:31.662316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.667277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.670332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.670723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.671216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.671683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.673228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.674097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.674541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.678783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=23 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:31.684515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.685399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.685873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.686588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.687037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.687518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.712315 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3bab2f9-ecb9-4a30-bd18-8e6fd45ff50a tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049270 Oct 11 01:20:31.720275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 485/945] 10.222.0.66 () {60 vars in 1178 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:31.720275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:31.720275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:31.725389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.725679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.726084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:31.726785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:31.727242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:31.727729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.018782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:32.027931 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f98d749d-83a0-4068-b9c9-382ab6e4dfb2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.370492 Oct 11 01:20:32.041377 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 461/946] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:32.051044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:32.052447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:32.055317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.056488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.056935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.059330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.059864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.060577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.079318 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7f05ca0-1902-4a68-a914-dc055b7599de tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 2056 microversion: 2.25 time: 0.354816 Oct 11 01:20:32.090313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86754d51-7fc2-4c5c-a9f1-b29f1710e6e2 tempest-ServicesAdminNegativeV253TestJSON-2026767902 tempest-ServicesAdminNegativeV253TestJSON-2026767902-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.043421 Oct 11 01:20:32.090313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 462/947] 10.222.0.66 () {60 vars in 1239 bytes} [Tue Oct 11 01:20:32 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:32.090737 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 486/948] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:31 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 2056 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:32.104098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:32.104098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:32.110375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.111264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.111783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.112545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.113053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.113486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.268188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ce3e8a4-6825-4eeb-b5fd-8bb25028b441 tempest-ServicesAdminNegativeV253TestJSON-916395946 tempest-ServicesAdminNegativeV253TestJSON-916395946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:32.272814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ce3e8a4-6825-4eeb-b5fd-8bb25028b441 tempest-ServicesAdminNegativeV253TestJSON-916395946 tempest-ServicesAdminNegativeV253TestJSON-916395946-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '96515acfdc634f4f838d067538b86575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd20b11eb34ea6951de80f13028d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ce3e8a4-6825-4eeb-b5fd-8bb25028b441 tempest-ServicesAdminNegativeV253TestJSON-916395946 tempest-ServicesAdminNegativeV253TestJSON-916395946-project] Request method failure captured: Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTc1W0hXjDDExaUtJfzSw8_ZSmc91dHXF3v2ILYagj_SjUf3vHqJIZPoEzUWb8uHbVyLQbAjG8L5lhQJNMCJvi15Nv-WYjXcplsn16Pg3OJ7HA_l7TFPSEYdEp-DhhBnGXGQDRQ3I-TSBSbYUcuM2McEAN-cL5eNX26Rv4JHTQKOdg Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d3fd20b11eb34ea6951de80f13028d85 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-916395946 Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:32.275027 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d3fd20b11eb34ea6951de80f13028d85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d3fd20b11eb34ea6951de80f13028d85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d3fd20b11eb34ea6951de80f13028d85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d3fd20b11eb34ea6951de80f13028d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-916395946 Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d3fd20b11eb34ea6951de80f13028d85 Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-916395946 Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServicesAdminNegativeV253TestJSON-916395946-project Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 96515acfdc634f4f838d067538b86575 Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-916395946-project Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:32.276560 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:20:32.277294 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 01:20:32.278380 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:32.280843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ce3e8a4-6825-4eeb-b5fd-8bb25028b441 tempest-ServicesAdminNegativeV253TestJSON-916395946 tempest-ServicesAdminNegativeV253TestJSON-916395946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:32.281931 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ce3e8a4-6825-4eeb-b5fd-8bb25028b441 tempest-ServicesAdminNegativeV253TestJSON-916395946 tempest-ServicesAdminNegativeV253TestJSON-916395946-project] 10.222.0.66 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.175850 Oct 11 01:20:32.283046 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 487/949] 10.222.0.66 () {60 vars in 1178 bytes} [Tue Oct 11 01:20:32 2022] GET /compute/v2.1/os-services => generated 112 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:20:32.289352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:32.290744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:32.298806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.299718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.300404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.301321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.302012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.302899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.442375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:32.446096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=23 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:32.455706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93beaaf1-c339-4355-94d3-7ac09ad7c31a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.366656 Oct 11 01:20:32.457138 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 463/950] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:32 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:32.464351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17139ecc-1465-4024-82c0-9971555ad18d", "name": "network-vif-plugged", "status": "completed", "tag": "a790adbf-be2a-4530-882c-1678bfb4654a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:32.475086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.476364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.476663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.504426 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] Creating event network-vif-plugged:a790adbf-be2a-4530-882c-1678bfb4654a for instance 17139ecc-1465-4024-82c0-9971555ad18d on n-h2-772273-9 Oct 11 01:20:32.513864 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3df7f118-b6a4-4a22-913f-cd9926ea8e6e req-d7659a67-52b7-4508-9fb8-802ebee705e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055166 Oct 11 01:20:32.514695 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 464/951] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:32.582746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:32.592985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0446ae69-56c2-4a09-910f-7683f266ba9a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.308063 Oct 11 01:20:32.608104 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 488/952] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:32 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:32.799279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b40f057-9cff-444d-a0be-b3fb1f75697f", "tag": "2c8cc681-968c-4fd9-8a57-c041e1e1e252"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:32.810204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:32.810703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:32.811138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:32.825182 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] Creating event network-changed:2c8cc681-968c-4fd9-8a57-c041e1e1e252 for instance 9b40f057-9cff-444d-a0be-b3fb1f75697f on n-h1-772273-9 Oct 11 01:20:32.832790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9720b7f4-3506-4feb-82e5-89b9c8dc20f3 req-a825e5d6-4baa-4865-b567-115b7de23611 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038246 Oct 11 01:20:32.838334 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 465/953] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:33.053984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:33.054600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:33.061235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.061955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.062570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.063467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.063913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.064488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.112054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:33.112767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:33.121407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.122163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.122812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.123836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.124648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.125235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.340487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:33.351934 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59af809e-1d40-47ee-b250-7dd5df2dfec1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.301660 Oct 11 01:20:33.353968 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 489/954] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:33 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:33.407857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:33.430330 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9420e8a9-a8e5-4bcb-a51c-1f8e92a45287 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 2036 microversion: 2.25 time: 0.321889 Oct 11 01:20:33.431099 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 466/955] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:33 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 2036 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:20:33.456311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": "auto"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:33.458910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:33.466108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.466866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.467510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.468404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.469032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.469623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.486861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:33.487641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:33.494793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.495295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.495937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.496890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.497417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.497904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.506288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'flavor' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:33.522187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:20:33.680843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:33.689696 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f331b854-f903-49fb-9864-c0f373edf5ce tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.209338 Oct 11 01:20:33.690744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 467/956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:33 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:33.707305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:33.708056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:33.714893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.715720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.716344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.717335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:33.718107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:33.718724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:33.923188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:33.928410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:33.938514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e4a585e-39a6-4b1c-baf3-4caf267e2a48 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.246184 Oct 11 01:20:33.939451 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 468/957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:33 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:34.381126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:34.382100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:34.391040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.391563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.392002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.392716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.393174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.393971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.542803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:34.551027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-617e0490-d8ee-4836-af3a-660be633ca15 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.175390 Oct 11 01:20:34.551651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 469/958] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:34 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:34.575767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "name": "network-vif-plugged", "status": "completed", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}, {"server_uuid": "b48ea2aa-3a84-4e8b-b069-76b3829cee32", "name": "network-vif-plugged", "status": "completed", "tag": "80621522-668f-4906-b7c7-63818e9c6053"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:34.586425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.587488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.587912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.600535 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Creating event network-vif-plugged:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:20:34.601049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] Creating event network-vif-plugged:80621522-668f-4906-b7c7-63818e9c6053 for instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 on n-h1-772273-9 Oct 11 01:20:34.608073 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7170dcf6-bed9-4d6e-acbc-aa2b7a5afb61 req-373407e8-60f4-4219-890c-544d9d1feffc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035935 Oct 11 01:20:34.608682 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 470/959] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:20:34.716981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:34.718055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:34.727940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.730467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.731096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.733196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.734193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.735990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.896841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:34.909591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e090f19-d6d2-454b-b830-9e23d947d860 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.198494 Oct 11 01:20:34.910197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 471/960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:34 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:34.962216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:34.963047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:34.969059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.969638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.970067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:34.970769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:34.971223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:34.971679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:35.142508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:35.151490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8cd1e9b8-60fa-486c-bbec-5a7a96b65d43 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.193205 Oct 11 01:20:35.152772 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 472/961] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:34 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:35.574585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:35.575166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:35.581628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:35.582124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:35.582565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:35.583268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:35.583783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:35.584212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:35.878006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:35.912275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ae5a87a-bcc7-4d67-8a3c-1ae2db23c12c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1319 microversion: 2.1 time: 0.321475 Oct 11 01:20:35.918934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 473/962] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:35 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:35.933695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:35.934406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:35.941452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:35.942857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:35.943549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:35.944319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:35.945453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:35.946477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:36.410707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:36.424808 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-543fe99e-1029-4081-b200-d2c5315a86a1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1324 microversion: 2.1 time: 0.495380 Oct 11 01:20:36.425988 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 474/963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:35 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:36.445234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:36.445866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:36.451795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:36.452927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:36.452927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:36.453494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:36.453948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:36.454370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:36.644096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:36.654006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca50192e-c927-469b-91ac-620bec306b02 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.212498 Oct 11 01:20:36.656203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 475/964] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:36 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:36.937665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:36.938460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:36.944503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:36.945112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:36.945806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:36.947288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:36.947831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:36.948464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:37.257344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:37.269834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3fb2203a-2707-4fdb-8c76-14b9de900541 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1469 microversion: 2.1 time: 0.336237 Oct 11 01:20:37.291819 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 476/965] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:36 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:37.301594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:37.302398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:37.308611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:37.309560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:37.310481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:37.311690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:37.312613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:37.313102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:37.595218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:37.648667 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1d0b6ac-3e81-4b3f-aa89-bd541ac0316a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1319 microversion: 2.1 time: 0.350036 Oct 11 01:20:37.657448 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 477/966] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:37 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:37.679105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:37.682599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:37.713290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:37.716838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:37.717708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:37.731971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:37.735190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:37.739287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.023901 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d5e2172-559a-4805-b3f4-5d7728e22372 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b/action" status: 202 len: 0 microversion: 2.25 time: 4.571661 Oct 11 01:20:38.029164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 490/967] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:20:33 2022] POST /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b/action => generated 0 bytes in 4578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:38.037075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:38.037928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:38.057044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.068266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:38.070049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.070583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.072369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.074877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.077777 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9eb79312-4b62-408d-b51c-ec0c5c2379fb tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1520 microversion: 2.1 time: 0.415619 Oct 11 01:20:38.078536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.081871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 478/968] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:37 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:38.103264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:38.104146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:38.115634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.116133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.116573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.117284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.117770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.118192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.524519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:38.538350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-765ca7c1-616f-4d29-abb9-2cae91ba23d7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.507787 Oct 11 01:20:38.550307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 491/969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:38 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:38.566122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-672598ac-6c96-4425-8feb-7ceeb6861434 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'create', calling method: .version_select at 0x7f1134235160>, body: {"pool": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:38.651586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:38.664161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:38.665749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:38.672063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73955916-3001-4f62-aeee-2c9ccbfcf231 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.589035 Oct 11 01:20:38.673826 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 479/970] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:38 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:38.689619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc605d82-0b6e-4e1c-be56-f560e6d5419c", "name": "network-vif-plugged", "status": "completed", "tag": "77d70934-f325-4926-b3b0-863195a44cb5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:38.738110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.739325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.743856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.777402 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] Creating event network-vif-plugged:77d70934-f325-4926-b3b0-863195a44cb5 for instance dc605d82-0b6e-4e1c-be56-f560e6d5419c on n-h2-772273-9 Oct 11 01:20:38.792146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5f9990ff-2d5b-48f2-8997-d0264407a073 req-42213b8d-d612-48fc-8d41-2fd808f76ee5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113060 Oct 11 01:20:38.792741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 480/971] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:38.809086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:38.812748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:38.825029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.825529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.829079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:38.832751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:38.834675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:38.837805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:39.306200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:39.318309 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5b71e8c-216c-467c-a076-a13ee181ad34 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1468 microversion: 2.1 time: 0.523430 Oct 11 01:20:39.318925 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 481/972] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:38 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:39.336911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:39.337911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:39.352600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:39.353110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:39.355519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:39.356902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:39.357739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:39.358413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:39.409010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:20:39.533208 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0473799a-aead-49bf-aa85-c4858304a482 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 204 len: 0 microversion: 2.1 time: 0.210640 Oct 11 01:20:39.535586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 482/973] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:39 2022] DELETE /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:39.547121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:39.553280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:39.555819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Searching by: {'reservation_id': 'r-sj4e50l4', 'deleted': False, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:20:39.563584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:39.564305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:39.564895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:39.565808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:39.566408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:39.567583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:39.691173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:20:39.822557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:39.845310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:39.845904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:39.846253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.063818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e0c12fa-1844-4c30-a71b-129353ec2357 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?reservation_id=r-sj4e50l4" status: 200 len: 2930 microversion: 2.1 time: 0.523273 Oct 11 01:20:40.064139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 483/974] 10.222.0.66 () {58 vars in 1197 bytes} [Tue Oct 11 01:20:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-sj4e50l4 => generated 2930 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:40.080390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:40.081438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:40.089307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.090527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.091461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.092405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.093125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.093790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.126194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:40.442892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:40.453870 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-287f2ec2-73c1-424a-8509-d71a83ca5675 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1714 microversion: 2.1 time: 0.387084 Oct 11 01:20:40.453870 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 484/975] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:40 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1714 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:40.471491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:40.472491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:40.482831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.486614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.488155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.489404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.490231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.492282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.799895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:40.808662 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6c15b8c-c6ed-4aa5-a982-3c3ccc4de20d tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1312 microversion: 2.1 time: 0.354331 Oct 11 01:20:40.809257 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 485/976] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:40 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:40.827032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:40.827691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:40.841505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.842000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.842435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:40.843364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:40.843829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:40.844296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:41.598661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:41.636541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:41.638830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:41.640382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a30c06d-eb1f-44d7-a6c4-7575ec671bf6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.829766 Oct 11 01:20:41.662048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 486/977] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:40 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:41.664711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-672598ac-6c96-4425-8feb-7ceeb6861434 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.112951 Oct 11 01:20:41.675945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 492/978] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:20:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:41.676946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:41.683225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:41.685598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:41.705649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:41.708670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:41.710525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:41.710525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:41.710745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_groups [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Querying cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) for 2 instances {{(pid=120493) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 01:20:41.711115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:41.711643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:41.712081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:41.714768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:41.715608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:41.716633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:41.748720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-095dbd4d-ca6e-45c7-ad6c-deb0d97718c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/a25b04f5-cea5-4df1-b053-60478905d1a9" status: 200 len: 270 microversion: 2.1 time: 0.085375 Oct 11 01:20:41.750128 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 487/979] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:20:41 2022] GET /compute/v2.1/os-server-groups/a25b04f5-cea5-4df1-b053-60478905d1a9 => generated 270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:41.760374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:41.761306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:41.775013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:41.792295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:41.792831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:41.794000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:41.794625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:41.795032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:42.218732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:42.237840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37538b08-7aab-44b7-96b8-e06172513bae tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1714 microversion: 2.1 time: 0.560523 Oct 11 01:20:42.259898 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 493/980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:41 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1714 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:42.269545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:42.270174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:42.275946 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e0357b9-b88d-4d10-929f-866cc418a8aa tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1620 microversion: 2.1 time: 0.519208 Oct 11 01:20:42.276542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 488/981] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:41 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1620 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:42.288245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:42.288454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-213763452", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:42.288733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:42.289923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:42.290827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:42.291475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:42.292050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:42.384908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] validate_networks() for [('6fe43141-5ef9-4c8b-9c55-66c9cc4b4524', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:42.821326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:42.844334 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c255cc5-5545-4dd8-a75e-8b266b6e4cd6 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1497 microversion: 2.1 time: 0.581870 Oct 11 01:20:42.847445 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 494/982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:42 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1497 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:42.853729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83c7632-d984-4249-aab7-f3f7a602872b", "name": "network-vif-unplugged", "status": "completed", "tag": "3149c506-f06f-473d-9f4d-265670905ee1"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:42.872459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:42.873953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:42.874592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:42.906881 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] Creating event network-vif-unplugged:3149c506-f06f-473d-9f4d-265670905ee1 for instance f83c7632-d984-4249-aab7-f3f7a602872b on n-h1-772273-9 Oct 11 01:20:42.915130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4e68473a-3ab2-4596-9315-e84865946189 req-0a6ccda3-7134-43f7-bf17-2afed7633b7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065262 Oct 11 01:20:42.916298 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 495/983] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:42.930808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:42.931706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:42.943941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:42.944631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:42.946285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:42.947259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:42.948938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:42.949557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:43.371639 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbd33a4b-af7d-43c7-8bb0-3de07eb672df tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1619 microversion: 2.1 time: 0.453849 Oct 11 01:20:43.383490 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 496/984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:42 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1619 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:43.383490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:43.383490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:43.395013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:43.395797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:43.396427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:43.397292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:43.397914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:43.398530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:43.716128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:43.716603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:43.717026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:43.717448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:43.717862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:43.735182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:43.736298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:43.740223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:43.741308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:43.743703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:43.744327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:43.788805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=31 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:43.800261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Getting quotas for project d8950eed91dc442ba09b67cae132e0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:43.856424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:43.857739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Getting quotas for user d9c32eb3b6ca4570815c664e90bb36a4 and project d8950eed91dc442ba09b67cae132e0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:43.869629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:43.880241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:43.881699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:43.881953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:43.884501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efd0a4fe-0f65-437b-a0fb-9b5fdfaf291d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.509255 Oct 11 01:20:43.886386 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 497/985] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:43 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:43.911950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:43.915493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:43.984366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.server_groups [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Querying cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) for 1 instances {{(pid=120494) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 01:20:43.985347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:43.988968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:43.990120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:44.006030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa1e9661-896a-4a46-bc2d-35e1ec8a6542 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721371 Oct 11 01:20:44.006713 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 489/986] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:20:44.022594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:44.033812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:44.056930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:44.057432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:44.057880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:44.063905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:44.064475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:44.064934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:44.129252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60ff637c-93be-4867-916d-00c4bf6060d2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d" status: 200 len: 222 microversion: 2.1 time: 0.226154 Oct 11 01:20:44.134049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 498/987] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:20:43 2022] GET /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d => generated 222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:44.157069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1330995504", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:44.285553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:45.196567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:45.205814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81f4707e-2890-4c02-b61f-2ed65c62f9da tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1647 microversion: 2.1 time: 1.198030 Oct 11 01:20:45.206412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 490/988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:44 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1647 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:45.227453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:45.233107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:45.246166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.246979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.247690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.248550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.256067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.256705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.461740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:45.473064 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd449e7d-cbbb-4e86-8343-3adc7014ea2d tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1219 microversion: 2.1 time: 0.256421 Oct 11 01:20:45.473670 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 491/989] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:45 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:45.494215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:45.494796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:45.505789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.509881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.510643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.513338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.514715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.518624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.589671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:20:45.629855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:45.630349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:45.630811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:45.631219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:45.631728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:45.649202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.649907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.650520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.651598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.652327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.652934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.706529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:45.718506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:45.749478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:45.754394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:45.871917 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5a863c1-d9ed-436f-a0ee-e460e97b9e62 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 204 len: 0 microversion: 2.1 time: 0.396749 Oct 11 01:20:45.872740 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 492/990] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:45 2022] DELETE /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:45.886820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:45.887722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:45.896697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.897471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.898073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.899546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.903546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.917237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:45.927296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2c62a8b-3d1c-4270-9bb1-35c9869e3903 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.792047 Oct 11 01:20:45.931467 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 499/991] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:20:45.944941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83c7632-d984-4249-aab7-f3f7a602872b", "tag": "3149c506-f06f-473d-9f4d-265670905ee1"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:45.993997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:45.996936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:45.999918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.031684 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] Creating event network-changed:3149c506-f06f-473d-9f4d-265670905ee1 for instance f83c7632-d984-4249-aab7-f3f7a602872b on n-h1-772273-9 Oct 11 01:20:46.049515 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ef740b14-938f-43d4-b518-a3f43cebbdae req-1f4d6c98-7d26-49f0-ae1b-7b0685606df9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115823 Oct 11 01:20:46.053544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 500/992] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:46.071548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:46.073573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:46.093315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.096062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.099813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.100748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.102102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.102770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.207134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.233308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.241717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.244431 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-487aa04a-a38f-40c9-831a-84942a061001 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.369429 Oct 11 01:20:46.245633 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 493/993] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:45 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:46.250783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e88c6df-66a7-4735-9db1-42f269012b53 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:46.251915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e88c6df-66a7-4735-9db1-42f269012b53 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:46.379412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e88c6df-66a7-4735-9db1-42f269012b53 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.399965 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e88c6df-66a7-4735-9db1-42f269012b53 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1217 microversion: 2.1 time: 0.150745 Oct 11 01:20:46.401651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 494/994] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:46 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:46.407814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:46.409532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:46.440463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.444301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.447032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.448712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.450582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.453016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.563717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.565661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.567145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.569384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lazy-loading 'fault' on Instance uuid ccf5ead0-15e8-43be-a9c4-b354a55c2c98 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:46.705558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.717176 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53d9dd5b-03cc-41bb-8bb0-c78b96543a21 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1503 microversion: 2.1 time: 0.660148 Oct 11 01:20:46.723607 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 501/995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:46 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:46.758580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:46.759609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:46.772792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.778030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.779085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.780271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:46.782255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:46.783938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:46.794301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:46.808719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ceaad6f2134402197aa3f86afe2eb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f8cda53a1142d39a3179751c96fc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:46.841382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3ff3b41-1dca-4c9e-9235-e4c986272a43 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 200 len: 1355 microversion: 2.1 time: 0.435752 Oct 11 01:20:46.843442 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 495/996] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:46 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 1355 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:47.118359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:47.136747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c469acb-59d7-4097-9156-80d9dc3ed8b4 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1293 microversion: 2.1 time: 0.389944 Oct 11 01:20:47.137368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 502/997] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:46 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1293 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:47.280230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:47.280861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:47.296492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.297241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.297848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.298725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.301314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.302267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.427132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:47.429072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:47.455297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.459191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.459891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.461394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.469361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.470081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.754202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:47.770025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:47.771331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:47.790753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-177838ce-fc01-4307-a566-a07b04cdd095 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.505072 Oct 11 01:20:47.791695 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 496/998] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:47 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:47.800640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:47.801373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:47.805019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:47.810405 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d66a7037-3fc5-4107-9d73-f331db3b121f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1221 microversion: 2.1 time: 0.387020 Oct 11 01:20:47.813484 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 503/999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:47 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1221 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:47.823585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.827863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.827863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.827863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.833096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.833810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.868944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:47.869782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:47.881485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.882294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.883479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.884417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.885407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.886031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.922978 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 HTTP/1.1 Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:47.927235 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:47.928888 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ccf5ead0-15e8-43be-a9c4-b354a55c2c98'} Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:47.929933 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:47.931485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:47.934432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:47.935583 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f8cd069-e594-4fbc-bfc9-c82198b8508f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 404 len: 111 microversion: 2.1 time: 0.070998 Oct 11 01:20:47.936954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 504/1000] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:47 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:20:47.955595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:47.956370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:47.968991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.969685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.970602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.971785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:47.972676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:47.973063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:47.992828 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 HTTP/1.1 Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:47.999554 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.000927 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '06ace3d0-bfe7-4425-8305-66da94d20497'} Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:48.001771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.002952 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.011056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:48.012204 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd7baafd-5bae-470b-a5cc-194966afd6b1 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 404 len: 111 microversion: 2.1 time: 0.071681 Oct 11 01:20:48.013329 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 505/1001] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:47 2022] DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:48.033023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:48.034006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:48.063917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.064421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.064865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.065611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.066069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.066493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.122118 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 HTTP/1.1 Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:48.123711 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.125198 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '06ace3d0-bfe7-4425-8305-66da94d20497'} Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:48.125927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:48.127683 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:48.129196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:48.129196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa571a12-0a6a-4ff5-a22b-ffd87ab869ad tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 404 len: 111 microversion: 2.1 time: 0.105757 Oct 11 01:20:48.133091 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 506/1002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:48 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:48.141396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf5ead0-15e8-43be-a9c4-b354a55c2c98", "name": "network-vif-deleted", "tag": "bce8237e-ef55-4faa-a277-3da517d0a045"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:48.162869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.163393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.163853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.190990 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] Creating event network-vif-deleted:bce8237e-ef55-4faa-a277-3da517d0a045 for instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 on n-h1-772273-9 Oct 11 01:20:48.206927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c99b324f-76ce-47c0-8dde-d2ad1633d5db req-28dfaa50-92f9-44d6-986d-54b87361d081 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072533 Oct 11 01:20:48.215938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 507/1003] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:48.222898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-013f5320-4325-4dca-80a7-fbbc41789460 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '.version_select at 0x7f11341f0a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:48.261652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-013f5320-4325-4dca-80a7-fbbc41789460 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123105706" status: 202 len: 0 microversion: 2.1 time: 0.044391 Oct 11 01:20:48.262847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 508/1004] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123105706 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:20:48.267853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:48.268594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:48.284222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.284636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.285074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.285793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.286248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.286680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.374516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:48.387882 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8310a9bf-53b1-4cde-8b40-00d6e03176aa tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1503 microversion: 2.1 time: 0.591472 Oct 11 01:20:48.388625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 497/1005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:47 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1503 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:48.458607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:48.475401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5c9b923-9286-49bc-8fe8-da988c824f78 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1281 microversion: 2.1 time: 0.211265 Oct 11 01:20:48.476001 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 509/1006] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:48 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:48.760914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d914876-2c08-4a1b-ade2-a71a6ad1544e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Action: 'create', calling method: .version_select at 0x7f112fc9c280>, body: {"keypair": {"name": "tempest-keypair-765369175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9r8XnviA2nsnCshYljd58Tfktg7wFdHnhMSoX1OXwboT/vyjFTGzAXF8AfxHBLKGhJQqaQyKrLwhbne9b4DzqJ1oj7rEToch/W84HfT0tJmFUPPsmrMzWUlcsYNhBE4g=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:48.794701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1d914876-2c08-4a1b-ade2-a71a6ad1544e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for project 633278094b7b443cbe24a4be4e4501d8. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:48.815297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1d914876-2c08-4a1b-ade2-a71a6ad1544e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for user 925177e3f3a94d8b90fc6beb4114fd7a and project 633278094b7b443cbe24a4be4e4501d8. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:48.817650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:48.818261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:48.828486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.828972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.829403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.830108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.830565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.830987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.887450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d914876-2c08-4a1b-ade2-a71a6ad1544e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.495645 Oct 11 01:20:48.888840 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 498/1007] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:20:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:48.898617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:48.899603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:48.909152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.912069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.912760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:48.916250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:48.917013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:48.918986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:49.266481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:49.279901 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5650b659-332e-4060-953b-564e61c837a1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1269 microversion: 2.1 time: 0.387322 Oct 11 01:20:49.281228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 499/1008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:48 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1269 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:49.412126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:49.412742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:49.420408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:49.421353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:49.422159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:49.423079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:49.423790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:49.424434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:49.682239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:49.694320 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5b84f09-2b6e-475f-bb11-81605c32cbeb tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1461 microversion: 2.1 time: 0.285907 Oct 11 01:20:49.695226 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 500/1009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:49 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1461 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:49.702606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:49.703474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:49.720695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:49.722649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:49.723388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:49.725873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:49.728299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:49.728957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:49.796006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:49.811466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:49.820724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:49.829577 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62231702-fd6c-4697-8afa-457d5549c3ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 1.015729 Oct 11 01:20:49.830928 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 510/1010] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:48 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:50.242542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc605d82-0b6e-4e1c-be56-f560e6d5419c", "name": "network-vif-deleted", "tag": "77d70934-f325-4926-b3b0-863195a44cb5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:50.274503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.275120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.276494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.291776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] Creating event network-vif-deleted:77d70934-f325-4926-b3b0-863195a44cb5 for instance dc605d82-0b6e-4e1c-be56-f560e6d5419c on n-h2-772273-9 Oct 11 01:20:50.314931 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-85eae420-3e72-4239-8bdb-8691afc0b2fb req-cbfbc302-98ee-4669-be2e-39a65e320be0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075669 Oct 11 01:20:50.318153 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 511/1011] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:50.328210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:50.338447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:50.357025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.357868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.358433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.359469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.360083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.360603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.361473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:50.371685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db2d2ad6-6d8f-4655-bc08-4e4023edbdf7 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.675187 Oct 11 01:20:50.372277 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 501/1012] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:49 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:50.518113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4515575a-620e-413d-b489-897cdef0a13d", "tag": "ad287b9a-28db-43cc-87b1-9987c7eaf967"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:50.539808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.540758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.541354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.546798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:50.560241 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] Creating event network-changed:ad287b9a-28db-43cc-87b1-9987c7eaf967 for instance 4515575a-620e-413d-b489-897cdef0a13d on n-h1-772273-9 Oct 11 01:20:50.572594 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-74257724-11f4-4394-b9af-123c4f04fde3 req-69626ca7-9877-40be-a124-fd7a8bdb6bf7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061118 Oct 11 01:20:50.577562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:50.591225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 502/1013] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:20:50.594213 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae349c57-10cd-4a5d-b80e-79692ac1f32f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1275 microversion: 2.1 time: 0.273615 Oct 11 01:20:50.595044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 512/1014] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:50 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:50.722408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:50.723359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:50.730282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.731031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.731883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.732757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.733467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.734043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.801282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.804001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.805435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.807164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lazy-loading 'fault' on Instance uuid dc605d82-0b6e-4e1c-be56-f560e6d5419c {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:20:50.870211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:50.872441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:50.896214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:50.905801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fcb15845bc4a7890edebd5d27ec18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d877237ef4843a3cdf994871faad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:50.907429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.908550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.909245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.911231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:50.912806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:50.917526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:50.920122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e86d73ea-9f1c-4cea-a677-402dfaf840ba tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 200 len: 1302 microversion: 2.1 time: 0.202537 Oct 11 01:20:50.923929 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 503/1015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:50 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:51.395155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:51.396763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:51.410321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:51.412325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:51.415458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:51.418455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:51.419830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:51.420792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:51.923587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:51.934487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:51.936031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:51.937116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:51.938818 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d35379e-d2c6-4048-8a5b-48e0b0c18813 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 1.081568 Oct 11 01:20:51.940747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 513/1016] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:50 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:51.946962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-468f50f8-17d2-4feb-aaf6-93b5512a2383 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.556616 Oct 11 01:20:51.960883 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 504/1017] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:51 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:51.960883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32cc86c1-e5af-4854-a942-7738deba91f8 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:51.962950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:51.967822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:51.985713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:51.986070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:51.988642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:51.989638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:51.991063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:51.992794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:51.996928 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32cc86c1-e5af-4854-a942-7738deba91f8 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1754149565" status: 202 len: 0 microversion: 2.1 time: 0.046513 Oct 11 01:20:51.998253 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 505/1018] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:20:51 2022] DELETE /compute/v2.1/flavors/1754149565 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:20:52.007019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.012681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.021052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.021512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.022145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.023214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.023938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.024664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.067694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c HTTP/1.1 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:20:52.069719 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.071950 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'dc605d82-0b6e-4e1c-be56-f560e6d5419c'} Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.073793 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.075571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.079050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.081012 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de318b75-4cf2-4df5-90a9-fce78e17cb0a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 404 len: 111 microversion: 2.1 time: 0.081772 Oct 11 01:20:52.087416 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 506/1019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:51 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.092922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f589319d-c492-4383-831f-9fc82b8e5b0e tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.120911 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f589319d-c492-4383-831f-9fc82b8e5b0e tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.031597 Oct 11 01:20:52.122101 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 507/1020] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:52.126888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.154215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_groups [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Querying cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) for 1 instances {{(pid=120493) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 01:20:52.155059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.155940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.157331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.170899 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a19db8f-80c8-4d5e-b979-9ddde161df32 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.047443 Oct 11 01:20:52.172841 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 508/1021] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:52.178315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58fb73d7-2381-4f9f-bcd4-240dcc7797e6 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.218328 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58fb73d7-2381-4f9f-bcd4-240dcc7797e6 tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1334067820" status: 202 len: 0 microversion: 2.1 time: 0.040802 Oct 11 01:20:52.223872 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 509/1022] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/flavors/1334067820 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:20:52.231710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.250924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_groups [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Querying cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) for 1 instances {{(pid=120493) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 01:20:52.251709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.252204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.252637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.268397 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9be362db-1890-4b66-8fa5-04262cdb99d8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d" status: 200 len: 184 microversion: 2.1 time: 0.042345 Oct 11 01:20:52.269708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 510/1023] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d => generated 184 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:52.280058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af66f18e-1ef6-41dc-a010-4cd16e1ec16f tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.313900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af66f18e-1ef6-41dc-a010-4cd16e1ec16f tempest-ServersWithSpecificFlavorTestJSON-2132857924 tempest-ServersWithSpecificFlavorTestJSON-2132857924-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042919 Oct 11 01:20:52.314789 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 511/1024] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:52.320005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.320713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.343155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.343937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.344535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.345255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.346245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.346699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.361704 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c HTTP/1.1 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:20:52.363779 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.365053 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'dc605d82-0b6e-4e1c-be56-f560e6d5419c'} Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.365785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.367567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.368737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.368737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3fb384b3-06a3-416c-991b-d8f0e42b8aa8 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 404 len: 111 microversion: 2.1 time: 0.048934 Oct 11 01:20:52.368737 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 512/1025] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.372589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1396156304", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "676615c4-e99d-4e90-8f33-c020aacefe96"}], "security_groups": [{"name": "tempest-securitygroup--182755664"}], "key_name": "tempest-keypair-765369175", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:52.398765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:52.409243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2167dd47-a216-4a7c-bdca-2e5fda2c8a40 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.467260 Oct 11 01:20:52.411060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 514/1026] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:51 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:52.417943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.418387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.465786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.466786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.467272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.468135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.468646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.469141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.483863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 HTTP/1.1 Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.485556 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.486922 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ccf5ead0-15e8-43be-a9c4-b354a55c2c98'} Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.487827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.489866 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.493393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.493393 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-672d7b66-799c-4c56-9644-c3f6fcf1df7f tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 404 len: 111 microversion: 2.1 time: 0.074465 Oct 11 01:20:52.493393 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 515/1027] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.501068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.501893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] [instance: dc605d82-0b6e-4e1c-be56-f560e6d5419c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.510918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.511722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.512336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.513204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.513808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.514379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.529551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c HTTP/1.1 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.531621 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.532949 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'dc605d82-0b6e-4e1c-be56-f560e6d5419c'} Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.533706 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. Oct 11 01:20:52.534895 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.536813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance dc605d82-0b6e-4e1c-be56-f560e6d5419c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.537883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac8179d6-b884-4a61-8904-e4dd7d315fd7 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c" status: 404 len: 111 microversion: 2.1 time: 0.043514 Oct 11 01:20:52.539941 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 516/1028] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/servers/dc605d82-0b6e-4e1c-be56-f560e6d5419c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.544911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.545799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: ccf5ead0-15e8-43be-a9c4-b354a55c2c98] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.552787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.553775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.555064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.556654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.557369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.557996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.574295 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 HTTP/1.1 Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.575899 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.577282 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ccf5ead0-15e8-43be-a9c4-b354a55c2c98'} Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.578037 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. Oct 11 01:20:52.579252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.582727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance ccf5ead0-15e8-43be-a9c4-b354a55c2c98 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.583706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1d2412a-d710-4eda-a56b-0ad44da70396 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98" status: 404 len: 111 microversion: 2.1 time: 0.042554 Oct 11 01:20:52.588372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 517/1029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/servers/ccf5ead0-15e8-43be-a9c4-b354a55c2c98 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.596331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-095a50eb-eec9-4d15-951f-32c8383d689a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.603739 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-095a50eb-eec9-4d15-951f-32c8383d689a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. Oct 11 01:20:52.608869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] validate_networks() for [('676615c4-e99d-4e90-8f33-c020aacefe96', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-095a50eb-eec9-4d15-951f-32c8383d689a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-server-groups/ab9b68d0-48ab-4843-afcd-9f6a259f73c1 HTTP/1.1 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.616393 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. Oct 11 01:20:52.618161 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ab9b68d0-48ab-4843-afcd-9f6a259f73c1'} Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.618917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. Oct 11 01:20:52.620407 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.623971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-095a50eb-eec9-4d15-951f-32c8383d689a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance group ab9b68d0-48ab-4843-afcd-9f6a259f73c1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.625207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-095a50eb-eec9-4d15-951f-32c8383d689a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/ab9b68d0-48ab-4843-afcd-9f6a259f73c1" status: 404 len: 117 microversion: 2.1 time: 0.035506 Oct 11 01:20:52.627705 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 518/1030] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/os-server-groups/ab9b68d0-48ab-4843-afcd-9f6a259f73c1 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.633967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.634730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.643078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.643891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.644567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.645466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.646087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.646738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.664612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 HTTP/1.1 Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.666684 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.668285 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '06ace3d0-bfe7-4425-8305-66da94d20497'} Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.669184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.672250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.675286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.676578 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cf91b81-dd1f-404d-9f52-f72734a99278 tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 404 len: 111 microversion: 2.1 time: 0.046495 Oct 11 01:20:52.677628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 519/1031] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.683244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f903556-6790-4562-bf42-1a6ad0651ce2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.690634 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7f903556-6790-4562-bf42-1a6ad0651ce2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f903556-6790-4562-bf42-1a6ad0651ce2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-server-groups/63117388-f5f8-4e4e-8c49-b588b0c1d738 HTTP/1.1 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.692474 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. Oct 11 01:20:52.693819 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '63117388-f5f8-4e4e-8c49-b588b0c1d738'} Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.694554 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. Oct 11 01:20:52.695770 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.696803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f903556-6790-4562-bf42-1a6ad0651ce2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance group 63117388-f5f8-4e4e-8c49-b588b0c1d738 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.696803 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f903556-6790-4562-bf42-1a6ad0651ce2 tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/63117388-f5f8-4e4e-8c49-b588b0c1d738" status: 404 len: 117 microversion: 2.1 time: 0.015699 Oct 11 01:20:52.696803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 520/1032] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/os-server-groups/63117388-f5f8-4e4e-8c49-b588b0c1d738 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.702999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.703697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] [instance: 06ace3d0-bfe7-4425-8305-66da94d20497] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.713813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.714829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.715285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.716405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.717622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.718853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.756416 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] HTTP exception thrown: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Request method failure captured: Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 HTTP/1.1 Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQS2OKPWNnRfjMnpH94rASszyYYf89aTwPjaOHzve3jsC8P3MpvegOlsZ58-EMnUaCW-bnR30RniXurw1fd-TE_F_tioK9P-xACbi2iogm0okZO2kGDxmNHz78b4aioLQN2yEqPsyj6dfLOPQNE-zObzmKzfb6inPFk0YUgL4WL17E Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.761588 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f8cda53a1142d39a3179751c96fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 15f8cda53a1142d39a3179751c96fc1a Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823 Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8ceaad6f2134402197aa3f86afe2eb80 Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1998872823-project Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.763287 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '06ace3d0-bfe7-4425-8305-66da94d20497'} Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.764223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. Oct 11 01:20:52.765730 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.768718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] Returning 404 to user: Instance 06ace3d0-bfe7-4425-8305-66da94d20497 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.768718 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b38c68b-07e1-40b2-b074-17300247eb1d tempest-ServersWithSpecificFlavorTestJSON-1998872823 tempest-ServersWithSpecificFlavorTestJSON-1998872823-project] 10.222.0.66 "GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497" status: 404 len: 111 microversion: 2.1 time: 0.070122 Oct 11 01:20:52.773373 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 521/1033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/servers/06ace3d0-bfe7-4425-8305-66da94d20497 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.779089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-453a50d7-2dea-4b98-ad39-464d9b8b0b8e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.788269 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-453a50d7-2dea-4b98-ad39-464d9b8b0b8e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-453a50d7-2dea-4b98-ad39-464d9b8b0b8e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-server-groups/df94decb-b41c-4f26-8aae-e6cba81a7d90 HTTP/1.1 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.790775 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. Oct 11 01:20:52.792173 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'df94decb-b41c-4f26-8aae-e6cba81a7d90'} Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.792928 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. Oct 11 01:20:52.794077 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.802607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-453a50d7-2dea-4b98-ad39-464d9b8b0b8e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance group df94decb-b41c-4f26-8aae-e6cba81a7d90 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.804641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-453a50d7-2dea-4b98-ad39-464d9b8b0b8e tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/df94decb-b41c-4f26-8aae-e6cba81a7d90" status: 404 len: 117 microversion: 2.1 time: 0.029629 Oct 11 01:20:52.806640 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 522/1034] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/os-server-groups/df94decb-b41c-4f26-8aae-e6cba81a7d90 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.818866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efb9a1de-37c1-4eab-80fd-8d61c02c2b7a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.833296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-efb9a1de-37c1-4eab-80fd-8d61c02c2b7a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] HTTP exception thrown: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efb9a1de-37c1-4eab-80fd-8d61c02c2b7a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Request method failure captured: Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-server-groups/e1df333c-4dfb-4880-bd75-5d850bae084d HTTP/1.1 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTMZGfGkH-PY6beYW_77Yd0jDZntXc9g2KmWhc0vQBwOa4Yz-gbt1ViFfw69MzC0OPYYuVNzAsSzMXVEaE7xC-J_izJNL8QMAsaCB6U2rZrucfiWYWM-b50bM-3uWQFR6F533w0LKMN69UF9zkcSig7LhGxtk1JJXCWLnfI4H3PAuA Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:20:52.835174 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f4d877237ef4843a3cdf994871faad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f4d877237ef4843a3cdf994871faad6 Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199441900 Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 74fcb15845bc4a7890edebd5d27ec18c Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerGroupTestJSON-1199441900-project Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. Oct 11 01:20:52.837116 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e1df333c-4dfb-4880-bd75-5d850bae084d'} Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.837861 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. Oct 11 01:20:52.839036 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:20:52.847034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efb9a1de-37c1-4eab-80fd-8d61c02c2b7a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Returning 404 to user: Instance group e1df333c-4dfb-4880-bd75-5d850bae084d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:20:52.848200 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efb9a1de-37c1-4eab-80fd-8d61c02c2b7a tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/e1df333c-4dfb-4880-bd75-5d850bae084d" status: 404 len: 117 microversion: 2.1 time: 0.037447 Oct 11 01:20:52.848952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 523/1035] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/os-server-groups/e1df333c-4dfb-4880-bd75-5d850bae084d => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:20:52.863135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8fe4cfc-e15d-47fd-912e-8a4d2414661b tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.899683 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8fe4cfc-e15d-47fd-912e-8a4d2414661b tempest-ServerGroupTestJSON-1199441900 tempest-ServerGroupTestJSON-1199441900-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d" status: 204 len: 0 microversion: 2.1 time: 0.040788 Oct 11 01:20:52.900277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 524/1036] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:20:52 2022] DELETE /compute/v2.1/os-server-groups/8dc22e2f-2e04-41e3-9191-800b65f6556d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:20:52.969137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:52.969753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:52.981517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.982308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.982934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:52.983835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:52.984445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:52.985033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:53.782866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:53.799767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:53.801675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:53.803233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcacd8fa-8fb9-4a72-8b8f-616ecea3a494 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.838063 Oct 11 01:20:53.805024 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 525/1037] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:52 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:53.810524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:53.811356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:53.820224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:53.820963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:53.821570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:53.822635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:53.823290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:53.823933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:53.872932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:54.207958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:20:54.208389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:20:54.208869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:20:54.209275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:20:54.210014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:20:54.221159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.221655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.222089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.222813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.223264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.223745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.254511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for project 633278094b7b443cbe24a4be4e4501d8. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:20:54.257432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:54.263100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for user 925177e3f3a94d8b90fc6beb4114fd7a and project 633278094b7b443cbe24a4be4e4501d8. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:20:54.286524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:20:54.294360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:20:54.299123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:54.311108 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-baa99441-63e4-4388-a7e8-a859e828d6c2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.504365 Oct 11 01:20:54.328702 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 526/1038] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:53 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:54.338378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:54.342557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:54.350493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.352170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.353175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.354341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.355718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.356691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.384878 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35937363-fbe8-4da3-9ec3-4029e0441416 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.018066 Oct 11 01:20:54.386254 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 513/1039] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:20:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:20:54.401003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81fdc11b-26ae-4c09-9257-72ce24d90df7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:54.402065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81fdc11b-26ae-4c09-9257-72ce24d90df7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:54.544320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81fdc11b-26ae-4c09-9257-72ce24d90df7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:54.554494 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81fdc11b-26ae-4c09-9257-72ce24d90df7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1241 microversion: 2.1 time: 0.160810 Oct 11 01:20:54.555564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 514/1040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:54 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:54.688618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514ed873-8c70-481a-802c-1310a15857d4", "tag": "448419e2-b69f-4aac-8488-5b55b906f97f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:54.715518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.716081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.716529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.735216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] Creating event network-changed:448419e2-b69f-4aac-8488-5b55b906f97f for instance 514ed873-8c70-481a-802c-1310a15857d4 on n-h2-772273-9 Oct 11 01:20:54.748750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-730905a9-9b32-4da0-83e2-1623c1b83816 req-40508cce-9315-4276-a31d-281ba6522cdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064423 Oct 11 01:20:54.751654 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 515/1041] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:54.834672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:54.836709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:54.845141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.846047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.846886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:54.849026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:54.850354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:54.851074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:55.232031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.259505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05d09452-0caa-4d0d-bcea-0fddb627a2f3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.922647 Oct 11 01:20:55.262456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 527/1042] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:54 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:55.335765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:55.336497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:55.348483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:55.352964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:55.353586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:55.355452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:55.358564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:55.360595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:55.630639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.642290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.647397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.658080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c0021264-d2d8-46e4-9f0f-16938d256d9f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.820676 Oct 11 01:20:55.660658 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 516/1043] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:54 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:55.676096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:55.682700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:55.684374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:55.705585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:55.706344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:55.707864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:55.708855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:55.709556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:55.710746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:55.733555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:55.855646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.866990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-166cd5f2-b38d-4092-9939-b0a6cfcae772 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1293 microversion: 2.1 time: 0.202799 Oct 11 01:20:55.868573 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 517/1044] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:55 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1293 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:55.909496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:55.922374 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5eb543c9-94a3-4e5c-985e-4d0a1b65fd75 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.591513 Oct 11 01:20:55.923969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 528/1045] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:55 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:56.283981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:56.284889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:56.292961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.294153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.299090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.300801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.301449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.302093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.474751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:56.484385 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-161c1074-14be-4ee1-8470-2e085df93416 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.204130 Oct 11 01:20:56.485308 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 518/1046] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:56 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:56.687371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:56.687999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:56.695488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.696111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.696410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.697394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.697894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.698372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.839018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:56.848477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:56.850165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:56.851523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-234477f2-b660-4155-a620-e823e1dac4d2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.168495 Oct 11 01:20:56.863092 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 529/1047] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:56 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:56.889951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:56.890563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:56.898223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.898709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.899138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.899876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.900321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.900736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.947329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:56.947974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:56.954431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.955208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.955917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.956870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:56.957543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:56.958205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:56.965599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:56.974146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ae30e79-ac75-466b-8ccc-1a9585fc0f6b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1301 microversion: 2.1 time: 0.088003 Oct 11 01:20:56.974705 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 519/1048] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:56 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:57.145717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:57.157287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e1d8a53-c8a6-477c-9c1e-6deacbd42fbf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.213384 Oct 11 01:20:57.169359 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 530/1049] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:56 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:57.509032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:57.509958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:57.516578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:57.517376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:57.518140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:57.519160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:57.519964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:57.520614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:57.681708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:57.690478 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd2ba84f-bff4-4727-bfe0-443d2a93cc03 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.185483 Oct 11 01:20:57.692326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 520/1050] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:57 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:57.877335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:57.878864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:57.886696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:57.887756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:57.888419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:57.889407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:57.889926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:57.890415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:57.907382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:20:58.000964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:58.001760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:58.017265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.018487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.019940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.022126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.023122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.023937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.037026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.046884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.048999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.051407 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce0c61e3-4a24-4622-93b0-b4bddaf1f714 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.178266 Oct 11 01:20:58.052010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 531/1051] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:57 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:58.145824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.154593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a747d2e9-627d-43e0-91d2-c914a5e1f9b6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1301 microversion: 2.1 time: 0.157425 Oct 11 01:20:58.155197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 521/1052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:57 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1301 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:58.180664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:58.181370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:58.188307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.188907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.189405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.194093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.195141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.195612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.371433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.379972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a71824ac-9915-485b-ad8f-8c67a65769ca tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.203599 Oct 11 01:20:58.380563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 532/1053] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:58 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:58.434416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4515575a-620e-413d-b489-897cdef0a13d", "name": "network-vif-plugged", "status": "completed", "tag": "ad287b9a-28db-43cc-87b1-9987c7eaf967"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:20:58.444879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.445640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.446233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.458816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] Creating event network-vif-plugged:ad287b9a-28db-43cc-87b1-9987c7eaf967 for instance 4515575a-620e-413d-b489-897cdef0a13d on n-h1-772273-9 Oct 11 01:20:58.464979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6389328f-03af-4926-9125-f3bacff01b9a req-ce680ce9-5f06-4cb1-acb4-96dae7cbe42d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Oct 11 01:20:58.466412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 522/1054] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:20:58.714699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:58.715314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:58.724506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.725005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.725995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.726980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:58.727461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:58.727901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:58.965318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:58.980808 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aca6bb4f-2d2f-45c6-9fce-37da2ec9ebf8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.269823 Oct 11 01:20:58.986451 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 533/1055] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:58 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:20:59.085528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:59.086530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:59.107453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.113503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.113999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.114759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.115232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.115687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.178352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:59.179658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:59.186206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.186699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.187619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.188548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.189013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.189444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.283110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:59.292773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcfcae65-a175-4fa6-920c-3850e3ad801d tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1301 microversion: 2.1 time: 0.118700 Oct 11 01:20:59.304790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 534/1056] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:59 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1301 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:20:59.375695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:59.404973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:20:59.405619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:20:59.406295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:59.408246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:59.410178 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a39b95a-aa35-4f07-8fc7-0e345f3a5512 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1568 microversion: 2.25 time: 0.329350 Oct 11 01:20:59.411546 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 523/1057] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:20:59 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:20:59.454021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.454529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.454976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.455803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:20:59.456267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:20:59.459754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:20:59.959517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:20:59.968089 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8da453e4-494e-48af-ae3c-74a629a57c8a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1323 microversion: 2.1 time: 0.567441 Oct 11 01:20:59.983954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 535/1058] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:20:59 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1323 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:00.006103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:00.006936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:00.015689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.016579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.017220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.018093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.018557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.019106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.317718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:00.318714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:00.327990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.330060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.332448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.333524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.336905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.337563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.470991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:00.499872 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-756b7557-fa1f-4fc4-9690-893f3205ca77 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1299 microversion: 2.1 time: 0.185711 Oct 11 01:21:00.504715 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 536/1059] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:00 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:00.516709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:00.527884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00393268-89bf-4bf9-9ebe-4aa6d73bef3e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.525556 Oct 11 01:21:00.530602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:00.531437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:00.534895 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 524/1060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:00 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:00.555893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.557097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.558661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.559636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.560329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:00.560876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:00.906382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:00.938979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:00.941873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:00.947275 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0cb515f4-1f7f-487a-a9de-befd8c7b1840 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1543 microversion: 2.25 time: 0.441454 Oct 11 01:21:00.948971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 537/1061] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:00 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1543 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:00.979820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ce34f84-37e0-45c9-a39a-bc4f6a333d07 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '.version_select at 0x7f113488a040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:00.985069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ce34f84-37e0-45c9-a39a-bc4f6a333d07 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:00.999751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:01.001386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:01.011055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ce34f84-37e0-45c9-a39a-bc4f6a333d07 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:01.015203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ce34f84-37e0-45c9-a39a-bc4f6a333d07 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:01.022921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:01.028604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:01.031246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:01.035855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:01.040242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:01.040992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:01.058206 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ce34f84-37e0-45c9-a39a-bc4f6a333d07 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.084449 Oct 11 01:21:01.068218 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 525/1062] 10.222.0.66 () {60 vars in 1184 bytes} [Tue Oct 11 01:21:00 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:01.101602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:01.102458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:01.123774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:01.124269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:01.124704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:01.125412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:01.125863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:01.126282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:01.992970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:02.000710 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8837cf7-e142-4cae-b867-fd4d179d7246 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 200 len: 1519 microversion: 2.1 time: 1.012079 Oct 11 01:21:02.004319 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 538/1063] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:00 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 1519 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:02.009333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:02.010585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:02.010991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid f83c7632-d984-4249-aab7-f3f7a602872b {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:02.024845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.025647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.026250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.027143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.027703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.028342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.032855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78b6917e-ab41-4169-a3d2-eb58a4123485 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 2036 microversion: 2.25 time: 0.946594 Oct 11 01:21:02.034196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 526/1064] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:01 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 2036 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:02.043263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:02.044364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:02.060618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.061360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.062778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.064103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.064877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.065820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.128272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:02.136781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb5cb0c5-4eec-433a-b7c4-245087e0de0a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1299 microversion: 2.1 time: 0.131006 Oct 11 01:21:02.137377 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 539/1065] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:02 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:02.304501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1180863446", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:02.348110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:02.371120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a77f631f-b99e-4cf3-8014-ec680f4551a9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.334263 Oct 11 01:21:02.373774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 527/1066] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:02 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:02.389471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: .version_select at 0x7f1136b113a0>, body: {"addFloatingIp": {"address": "172.25.3.241"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:02.395439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:02.413453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.418872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:02.419300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:02.419770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.421143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.421290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:02.421633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:02.422051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:02.426505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.427965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.428723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.481314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.485591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.486237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.487285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.489053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.491281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.534791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Getting quotas for project fdf110bfa837417da176b7cf6cce2708. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:02.556618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Getting quotas for user 5dfb056e8f2141b79c553ab5eff1e55d and project fdf110bfa837417da176b7cf6cce2708. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:02.589820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:21:02.591731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:02.595790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquired lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:21:02.599680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:02.713565 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2559c0f0-a7a0-48dc-a965-391bd495a89c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.573463 Oct 11 01:21:02.714564 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 540/1067] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:21:02.721270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38f6ef1b-f489-42f0-b9be-725018d40b74 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: .version_select at 0x7f11341b2ca0>, body: {"keypair": {"name": "tempest-keypair-1111960981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9WfVhqThBZNA5FnHucnIGVgT4hvONP7WzQQiG1OKTge8naoflr8/CprG/mtVIQKwea71U+/v3huW5/ffXk7Wu3LOkGhI5YBg/crhknqMwBluvzPHvVcOSFJYbceHPZHQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:02.775064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-38f6ef1b-f489-42f0-b9be-725018d40b74 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for project 6af68227080040c7845ed9f9ebb758af. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:02.784675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-38f6ef1b-f489-42f0-b9be-725018d40b74 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for user 81493fadd3b044479ce4722ce58f3235 and project 6af68227080040c7845ed9f9ebb758af. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:02.836920 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38f6ef1b-f489-42f0-b9be-725018d40b74 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.120484 Oct 11 01:21:02.837978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 541/1068] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:21:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:21:02.845686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ed873-8c70-481a-802c-1310a15857d4", "name": "network-vif-plugged", "status": "completed", "tag": "448419e2-b69f-4aac-8488-5b55b906f97f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:02.872848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:02.873286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:02.876536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:02.903912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] Creating event network-vif-plugged:448419e2-b69f-4aac-8488-5b55b906f97f for instance 514ed873-8c70-481a-802c-1310a15857d4 on n-h2-772273-9 Oct 11 01:21:02.922752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2f0e830c-b1d9-4c69-863f-ee17a3f23036 req-47626d80-91e1-4025-9a0b-35a189c49d45 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082680 Oct 11 01:21:02.924305 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 542/1069] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:02.930705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:02.947827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:03.243027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:03.267493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:03.268999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:03.270132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51a498c9-51c0-4fbd-a1bd-d2a5d75d85a9 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1278 microversion: 2.54 time: 0.344836 Oct 11 01:21:03.271226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 543/1070] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:02 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:03.276448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:03.277473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:03.284407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:03.285093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:03.285824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:03.286793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:03.287974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:03.288613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:03.824538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:03.846373 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-735d0150-dc2b-4647-aa13-1edf55ed6e55 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.573797 Oct 11 01:21:03.850897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 544/1071] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:03 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:03.861456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:03.862139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:03.871427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:03.872284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:03.872741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:03.873448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:03.873911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:03.874333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:04.244550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:04.391309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:04.404047 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f23c8d5-c52d-4044-ab49-968f2e629199 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1317 microversion: 2.1 time: 0.550646 Oct 11 01:21:04.404639 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 545/1072] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:03 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:04.417663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:04.418500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:04.432376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:04.432875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:04.434113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:04.435003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:04.435683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:04.437006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:04.551609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=22 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:04.652938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:04.662087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:04.664500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:04.665966 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27b15741-8163-4f87-98ac-6da89344f87d tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1338 microversion: 2.54 time: 0.260342 Oct 11 01:21:04.666714 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 546/1073] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:04 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1338 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:04.874569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:04.875997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:04.878373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:04.884922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:04.885903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:04.886639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:04.887415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:04.887882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:04.888312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:05.427702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:05.445173 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e8e4e33-d26e-449b-a238-a171b9f4eae9 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.573663 Oct 11 01:21:05.461737 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 547/1074] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:04 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:05.478563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466b8790-0063-4112-b494-0f56de3aef94", "tag": "4574072d-6b59-4849-9ec5-351524511edc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:05.493828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:05.494702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:05.495471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:05.510088 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] Creating event network-changed:4574072d-6b59-4849-9ec5-351524511edc for instance 466b8790-0063-4112-b494-0f56de3aef94 on n-h2-772273-9 Oct 11 01:21:05.518491 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2280a67c-b211-4cc5-8c31-4b9628cad677 req-bdd3cd13-2fc7-4dd5-9ec8-c6add3449b45 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043412 Oct 11 01:21:05.519788 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 548/1075] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:05.531297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:05.534463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:05.543707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:05.545055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:05.545707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:05.546988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:05.547730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:05.548226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:05.908574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:05.917295 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-45d230ef-e9f5-4220-b1fe-494f884c66f9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1467 microversion: 2.1 time: 0.395535 Oct 11 01:21:05.931991 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 549/1076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:05 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1467 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:05.931991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:05.931991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:05.931991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:05.931991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:05.932498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:05.932498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:05.932498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:05.932498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:06.062319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:06.106417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:06.109011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:06.111774 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf074eda-2b5d-41c5-861c-299b1241eb9c tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1336 microversion: 2.54 time: 0.192370 Oct 11 01:21:06.131072 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 550/1077] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:05 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1336 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:06.131072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:06.131072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:06.136624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:06.137126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:06.137566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:06.138286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:06.138730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:06.139147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:06.175603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Building network info cache for instance {{(pid=120493) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:06.577021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75c01d6e-e187-413d-895b-5d57e82be2a3 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1618 microversion: 2.1 time: 0.460500 Oct 11 01:21:06.581355 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 551/1078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:06 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1618 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:06.586909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:06.590907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:06.599169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:06.600543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:06.603522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:06.604548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:06.605234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:06.611891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:06.624386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:06.931826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:06.941686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c916f54c-ff07-4f0e-b387-966bf65df32c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.358954 Oct 11 01:21:06.943844 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 552/1079] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:06 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:06.961849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-546987655", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d"]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:07.062709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:21:07.508557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Updating instance_info_cache with network_info: [{"id": "d8de69db-0cc0-4485-9261-5184d59e9500", "address": "fa:16:3e:39:33:31", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8de69db-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120493) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:07.514024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:07.542938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Releasing lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:21:07.544157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99339359-5895-4d9a-b125-003e2d17fd5f tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action" status: 202 len: 0 microversion: 2.1 time: 5.169054 Oct 11 01:21:07.545364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 528/1080] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:02 2022] POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action => generated 0 bytes in 5170 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:21:07.556655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-718757382", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "20dc106a-253b-405c-ac01-f4b2f29545d4"}], "security_groups": [{"name": "tempest-securitygroup--1641830845"}], "key_name": "tempest-keypair-1111960981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:07.632826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:07.633255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:07.633588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:07.633988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:07.634398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:07.646888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.647732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.648170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:07.649365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.649955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.650390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:07.685370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:07.694492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:07.714685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] validate_networks() for [('20dc106a-253b-405c-ac01-f4b2f29545d4', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:21:07.717867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:07.720900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:07.777725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-495e6603-ed39-478a-a351-e9148d2b5683 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832546 Oct 11 01:21:07.778379 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 553/1081] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:21:07.783838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:07.784698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:07.793668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.794172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.794614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:07.795325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.795809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.796238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:07.919124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:07.935009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:07.937129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:07.938531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8d79efb-a779-43d3-a5f1-ee35e8f01d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1357 microversion: 2.54 time: 0.159221 Oct 11 01:21:07.939693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 554/1082] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:07 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:07.946008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: .version_select at 0x7f1136ad6ca0>, body: {"addFloatingIp": {"address": "172.25.3.241"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:07.948674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:07.965891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.966741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.967519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:07.968454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:07.969168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:07.970064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.152340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:21:08.153611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquired lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:21:08.378318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:08.378829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:08.379392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:08.379886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:08.380276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:08.389625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.390156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.390626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.391377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.391839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.392248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.414064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:08.419402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for user 81493fadd3b044479ce4722ce58f3235 and project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:08.431676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:08.434229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:08.481602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d95e69b4-484f-4085-ac2e-d3cdde064af9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.935075 Oct 11 01:21:08.482427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 529/1083] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:21:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:21:08.487182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:08.497628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.498281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.498721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.510279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] Creating event network-changed:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:21:08.515227 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bd18f333-8244-447a-aa9c-89f076ecd712 req-f3b65083-bd26-4d67-bf9c-98b93ce5a9b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Oct 11 01:21:08.516143 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 530/1084] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:08.521140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:08.522416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:08.528581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.529069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.529502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.530194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.530846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.531575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.630069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:08.638321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f10dfb49-78b0-40ce-9022-2ffc359a6f9d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1220 microversion: 2.1 time: 0.120921 Oct 11 01:21:08.654296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 531/1085] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:08 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:08.663230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:08.663877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:08.670782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.671359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.672073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:08.673257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:08.673945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:08.674376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.323038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:09.331961 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b263bfca-f5ed-48ff-bbc2-5d17e3e29073 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.691637 Oct 11 01:21:09.343066 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 532/1086] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:08 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:09.343066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4317e96-8050-4c1a-93f5-f9c5064124d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Action: 'create', calling method: .version_select at 0x7f112fbcb8b0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-555386958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVtPS+4AIJ0vhF0QCFEnxvy37cl68dTZU+4L0fXD31Rjueb7LSq4YvcRaOhU79cYcCe6pUeyKzEKEdQnQZ0pBoEAqbGoodeYvlnza7hlhuhk/HUsQqBl+pf6SREH5V29w=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:09.356731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f4317e96-8050-4c1a-93f5-f9c5064124d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Getting quotas for project fdf110bfa837417da176b7cf6cce2708. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:09.362263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f4317e96-8050-4c1a-93f5-f9c5064124d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Getting quotas for user 5dfb056e8f2141b79c553ab5eff1e55d and project fdf110bfa837417da176b7cf6cce2708. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:09.387324 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4317e96-8050-4c1a-93f5-f9c5064124d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.053628 Oct 11 01:21:09.393850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 533/1087] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:21:09 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:21:09.506330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5645860a-121e-400c-ab4f-1126bf69126b tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-763980991", "id": 1253223500, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:09.526947 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5645860a-121e-400c-ab4f-1126bf69126b tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.137951 Oct 11 01:21:09.527920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 534/1088] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:09 2022] POST /compute/v2.1/flavors => generated 429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:09.532405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:09.533009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:09.539932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.540650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.541078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.541767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.542216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.542639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.641641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:09.650997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:09.652507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:09.653647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c59e4113-9562-4126-9ccf-b44d9c9c30c9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1337 microversion: 2.25 time: 0.124790 Oct 11 01:21:09.654218 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 535/1089] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:09 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1337 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:09.660611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-555386958", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:09.664118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:09.671489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.672193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.672805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.673666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.675179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.675935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.812436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:09.813158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:09.815221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:09.816943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:09.817780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:09.938624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:09.946788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.947295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.947831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:09.948474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:09.949194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:09.949683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.075598 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ea2068f-6b33-473f-9345-601b5ce6b57a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "POST /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37/action" status: 202 len: 1139 microversion: 2.54 time: 0.420304 Oct 11 01:21:10.076381 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 536/1090] 10.222.0.66 () {62 vars in 1320 bytes} [Tue Oct 11 01:21:09 2022] POST /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37/action => generated 1139 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 01:21:10.081080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f83713b-dbd9-4aa3-ba17-2834feab9ca2 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:10.112104 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0f83713b-dbd9-4aa3-ba17-2834feab9ca2 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1253223500" status: 202 len: 0 microversion: 2.1 time: 0.034717 Oct 11 01:21:10.114828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 537/1091] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:10 2022] DELETE /compute/v2.1/flavors/1253223500 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:10.120923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:10.121668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:10.130991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.131382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.131846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.132606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.133065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.133493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.309048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:10.319601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3114dc6a-3fdd-4787-a0e8-5cdc04d06ce3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1268 microversion: 2.1 time: 0.202689 Oct 11 01:21:10.331769 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 538/1092] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:10 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:10.331769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:10.331769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:10.333521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:10.336050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.336620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.336989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.337680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.338137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.338564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.486751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:10.502064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:10.503462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:10.504868 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b876727-7988-4e37-8aab-603122b183bf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.182639 Oct 11 01:21:10.506675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 539/1093] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:10 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:10.513421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9808344-c3fb-4a20-9e82-5f530a07e216 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:10.539182 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9808344-c3fb-4a20-9e82-5f530a07e216 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029386 Oct 11 01:21:10.551368 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 540/1094] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:10.560726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:10.561416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:10.573358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.574207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.575282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:10.576185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:10.576977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:10.577704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:11.426190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:11.438175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32097d98-4f16-451f-940c-6d0f4ad2aa14 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.889308 Oct 11 01:21:11.440388 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 541/1095] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:10 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:11.458283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cde1883-4a87-4703-8f49-a73201e260e1 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-184178450", "id": 765281378, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:11.492923 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cde1883-4a87-4703-8f49-a73201e260e1 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.050960 Oct 11 01:21:11.493980 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 542/1096] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:11.503486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:11.505467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:11.517335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:11.519219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:11.520432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:11.521567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:11.522381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:11.524347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:11.854167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:11.864711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:11.867725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:11.869115 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-462aab19-a388-4c4c-89d5-82c86228127c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.372883 Oct 11 01:21:11.879709 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 543/1097] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:11 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:11.893662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:11.894628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:11.902265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:11.902787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:11.903499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:11.904275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:11.904743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:11.905317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.015840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:12.029739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5cc2dfb-8601-4b03-8a8b-3916c534e924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1274 microversion: 2.1 time: 0.148683 Oct 11 01:21:12.031744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 544/1098] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:11 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.039899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0b2bdd7-0e6e-48eb-839c-31f6ac452e6a tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.070890 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0b2bdd7-0e6e-48eb-839c-31f6ac452e6a tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.037797 Oct 11 01:21:12.071527 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 545/1099] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.077197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.077866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:12.085090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.085657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.086476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.087183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.087670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.088093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.174885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:12.187116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.neutron [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] re-assign floating IP 172.25.3.241 from instance 5bd26f5c-7801-4597-b57d-82b73123112e Oct 11 01:21:12.187761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:12.189297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:12.191987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-226a448d-ba1d-4a35-828a-7d72475236e6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.119461 Oct 11 01:21:12.200014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 546/1100] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:12.211697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:12.226954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.227527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.227956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.239068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] Creating event network-changed:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h1-772273-9 Oct 11 01:21:12.244957 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8e8f5bbf-ef8f-4001-bd69-6f69940be04e req-6587becc-5e5e-4c38-a392-e6ff955ed71c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043654 Oct 11 01:21:12.246480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 547/1101] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:12.252577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:12.260411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Building network info cache for instance {{(pid=120494) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:12.272764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.273245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.273804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.286396 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] Creating event network-changed:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:21:12.295209 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-872e92e1-e68e-4de0-823d-5e23916ba7cb req-705365cf-7167-463c-bea0-a5486d2d815b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046494 Oct 11 01:21:12.296208 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 548/1102] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:12.302061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4d60fb7-a3a9-4994-b015-f21458f566a1 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.324654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4d60fb7-a3a9-4994-b015-f21458f566a1 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/765281378" status: 202 len: 0 microversion: 2.1 time: 0.026767 Oct 11 01:21:12.328330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 549/1103] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:21:12 2022] DELETE /compute/v2.1/flavors/765281378 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:12.335377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-427971fc-0046-418b-80a0-9359b1304b86 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.368324 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-427971fc-0046-418b-80a0-9359b1304b86 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037663 Oct 11 01:21:12.369264 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 550/1104] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.388753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39e4033c-3a18-4fe1-968d-bc65226170dc tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1961042937", "id": 211487323, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:12.411112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39e4033c-3a18-4fe1-968d-bc65226170dc tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.026167 Oct 11 01:21:12.415534 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 551/1105] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:12 2022] POST /compute/v2.1/flavors => generated 426 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:12.426120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-621c7417-104d-4ac2-ac02-bb5e8c0d1b30 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.444341 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-621c7417-104d-4ac2-ac02-bb5e8c0d1b30 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/211487323" status: 202 len: 0 microversion: 2.1 time: 0.023286 Oct 11 01:21:12.448697 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 552/1106] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:21:12 2022] DELETE /compute/v2.1/flavors/211487323 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:12.453681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5b96683-6f87-426c-a45b-73d989343c63 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.475415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5b96683-6f87-426c-a45b-73d989343c63 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024952 Oct 11 01:21:12.487246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 553/1107] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.496144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.497034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:12.503741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.504399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.505096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.507037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.507823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.508259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.791824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:12.800826 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2a04a6f-ca0a-4bd0-8b7f-372c981a72a6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.309617 Oct 11 01:21:12.801727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 554/1108] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.807467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4dd1810f-fdeb-40a3-a860-19171fd44286 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-415842412", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:12.835644 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4dd1810f-fdeb-40a3-a860-19171fd44286 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.032376 Oct 11 01:21:12.836588 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 555/1109] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:12 2022] POST /compute/v2.1/flavors => generated 506 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:12.849682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eabe4e9e-a930-474b-b60d-25ae104c9ae0 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.872477 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eabe4e9e-a930-474b-b60d-25ae104c9ae0 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/621a26f2-f3b5-49a4-943f-26040493e3f3" status: 202 len: 0 microversion: 2.1 time: 0.026495 Oct 11 01:21:12.874343 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 556/1110] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:12 2022] DELETE /compute/v2.1/flavors/621a26f2-f3b5-49a4-943f-26040493e3f3 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:21:12.883243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d10db197-4d9d-4b78-8b54-60032b96c08f tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.919280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d10db197-4d9d-4b78-8b54-60032b96c08f tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040092 Oct 11 01:21:12.919768 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 557/1111] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:12.924894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:12.925508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:12.937282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.938924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.939404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:12.940317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:12.940785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:12.941213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:13.278172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:13.286654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:13.292397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:13.297846 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad549814-0f6d-485c-ba9d-5e5fc4d7c6de tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.376908 Oct 11 01:21:13.298720 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 558/1112] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:12 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:13.311386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d57e0ec-00c8-479f-bd04-b1ddee5ac04b tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2124122950", "id": "ab1ad969-d50d-41f8-8d22-1f68d14bb201", "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:13.331029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d57e0ec-00c8-479f-bd04-b1ddee5ac04b tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.023446 Oct 11 01:21:13.340070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 559/1113] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:13 2022] POST /compute/v2.1/flavors => generated 507 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:13.346234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:13.347286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:13.354052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:13.354697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:13.355243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:13.356073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:13.356631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:13.357157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:13.374982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:13.425001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Updating instance_info_cache with network_info: [{"id": "d8de69db-0cc0-4485-9261-5184d59e9500", "address": "fa:16:3e:39:33:31", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8de69db-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:13.446009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Building network info cache for instance {{(pid=120494) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:13.784349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:13.795891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-43b511b6-ae13-4310-a14e-b80feae055e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.454485 Oct 11 01:21:13.807410 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 560/1114] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:13 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:13.807410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:13.807410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:13.821996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:13.822277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:13.822729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:13.827757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:13.829477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:13.834130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:14.038157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:14.051229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:14.052861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:14.059611 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d302e20-d38f-406d-8260-621046df6483 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.262067 Oct 11 01:21:14.061813 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 561/1115] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:13 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:14.067436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39413264-54e6-46f9-969a-ac8c5a7821b8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:14.107727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39413264-54e6-46f9-969a-ac8c5a7821b8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/ab1ad969-d50d-41f8-8d22-1f68d14bb201" status: 202 len: 0 microversion: 2.1 time: 0.044751 Oct 11 01:21:14.108269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 562/1116] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:14 2022] DELETE /compute/v2.1/flavors/ab1ad969-d50d-41f8-8d22-1f68d14bb201 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:14.114003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466b8790-0063-4112-b494-0f56de3aef94", "name": "network-vif-plugged", "status": "completed", "tag": "4574072d-6b59-4849-9ec5-351524511edc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:14.125021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:14.125552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:14.125977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:14.139044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] Creating event network-vif-plugged:4574072d-6b59-4849-9ec5-351524511edc for instance 466b8790-0063-4112-b494-0f56de3aef94 on n-h2-772273-9 Oct 11 01:21:14.144330 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-abb08c99-e343-46f5-b4f0-90d9f1801b26 req-7d0362f0-8357-45a6-8b38-20ef03433089 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Oct 11 01:21:14.148612 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 563/1117] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:14.155754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:14.156416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:14.162826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:14.163583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:14.163780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:14.164606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:14.165106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:14.165506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:14.945971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:14.953930 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a60bcdfc-4870-449a-8079-2770a5049ba8 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.804117 Oct 11 01:21:14.954521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 564/1118] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:14 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:14.972712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f6f598e8-db26-4390-a241-94fbb99e6ac2 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.002897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f6f598e8-db26-4390-a241-94fbb99e6ac2 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047273 Oct 11 01:21:15.003896 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 565/1119] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:15.008453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.009207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:15.015485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.017939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.018387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.019120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.019678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.020116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.363319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Updating instance_info_cache with network_info: [{"id": "ad287b9a-28db-43cc-87b1-9987c7eaf967", "address": "fa:16:3e:8e:48:1e", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad287b9a-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:15.376376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Releasing lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:21:15.378228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47140c03-716f-48db-8376-259d9d741baf tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d/action" status: 202 len: 0 microversion: 2.1 time: 7.436751 Oct 11 01:21:15.378998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 555/1120] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:07 2022] POST /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d/action => generated 0 bytes in 7438 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:21:15.385686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4515575a-620e-413d-b489-897cdef0a13d", "tag": "ad287b9a-28db-43cc-87b1-9987c7eaf967"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:15.390204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.396805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.397282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.397898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.399801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.401318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.402691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85de6b88-c394-4a76-9a32-3921cd35bbd2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.397851 Oct 11 01:21:15.413029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 566/1121] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:15.413029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.413029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:15.413402 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] Creating event network-changed:ad287b9a-28db-43cc-87b1-9987c7eaf967 for instance 4515575a-620e-413d-b489-897cdef0a13d on n-h1-772273-9 Oct 11 01:21:15.416843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.417413 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-186e3fc6-1e77-47e2-b4bc-edd511bcd6bf req-ba949d45-0478-491c-9f93-2bb0289b7b5a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036747 Oct 11 01:21:15.417536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.418197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.418572 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 556/1122] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:15.419151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.419759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.420243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.426085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6719ff57-5ead-4f72-8c8f-5a19c43f3ca7 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-419736477", "id": 402668972, "os-flavor-access:is_public": "True"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:15.446437 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6719ff57-5ead-4f72-8c8f-5a19c43f3ca7 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.026633 Oct 11 01:21:15.448045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 557/1123] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:15 2022] POST /compute/v2.1/flavors => generated 410 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:15.452102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.452849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:15.461216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.461714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.462154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.463387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.463787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.464219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.596451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.604784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.606337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.607695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25b6861c-f502-4a4b-9f5a-948ab657e1e7 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.159247 Oct 11 01:21:15.617602 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 558/1124] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:15.617602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: .version_select at 0x7f1136ad6dc0>, body: {"removeFloatingIp": {"address": "172.25.3.241"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:15.795475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:15.803665 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2d13e85-d881-4004-9cfa-ecb213ed25f1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.398932 Oct 11 01:21:15.804291 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 567/1125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:15.809042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63985a01-c767-408b-b52d-b3f8cb108d1d tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.815974 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63985a01-c767-408b-b52d-b3f8cb108d1d tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/402668972" status: 200 len: 410 microversion: 2.1 time: 0.010269 Oct 11 01:21:15.816183 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 568/1126] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/flavors/402668972 => generated 410 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:15.848939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:15.855441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.856008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.856515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.857355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:15.857878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:15.858371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:15.932597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07571e02-1b8d-4a4e-8226-7f76c87764d6 tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.956113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07571e02-1b8d-4a4e-8226-7f76c87764d6 tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.131051 Oct 11 01:21:15.956901 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 569/1127] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:15.974437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67be720d-9093-42e7-a581-36919d3b8f59 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:15.993569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67be720d-9093-42e7-a581-36919d3b8f59 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/402668972" status: 202 len: 0 microversion: 2.1 time: 0.022732 Oct 11 01:21:15.994489 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 570/1128] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:21:15 2022] DELETE /compute/v2.1/flavors/402668972 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:21:15.999526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.000143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:16.006646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.007134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.007594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.008294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.008893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.009797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.282580 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] HTTP exception thrown: Floating IP 172.25.3.241 is not associated with instance 5bd26f5c-7801-4597-b57d-82b73123112e. Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Request method failure captured: Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action HTTP/1.1 Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 49 Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTNbkUOmcWW03Yrtv0px5iOo0EbqLd_V80xQnJuMjDpbgiyeHi4uZdZexPhm_OCYBewedltVqmFI7Aj6I7pZtuEHHLBGpkwjwpjHneDl6CsrctHFeEislUEhsHxaZzfESePJIST1_adDgk-8wgeJDj24Y2hHtcY7gDLAy43i8OkUrI Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:16.289816 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d9c32eb3b6ca4570815c664e90bb36a4 Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: {"removeFloatingIp": {"address": "172.25.3.241"}} Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:21:16.291456 n-d-772273-9 devstack@n-api.service[120494]: exception: Floating IP 172.25.3.241 is not associated with instance 5bd26f5c-7801-4597-b57d-82b73123112e. Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5bd26f5c-7801-4597-b57d-82b73123112e', 'body': {'removeFloatingIp': {'address': '172.25.3.241'}}} Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.241 is not associated with instance 5bd26f5c-7801-4597-b57d-82b73123112e. Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.292651 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.241 is not associated with instance 5bd26f5c-7801-4597-b57d-82b73123112e. Oct 11 01:21:16.294147 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.295757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Returning 409 to user: Floating IP 172.25.3.241 is not associated with instance 5bd26f5c-7801-4597-b57d-82b73123112e. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:16.297639 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2b20a4b-10e5-4b1e-bfcd-3f2876acfdbe tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action" status: 409 len: 146 microversion: 2.1 time: 0.687455 Oct 11 01:21:16.298727 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 559/1129] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:15 2022] POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action => generated 146 bytes in 690 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:21:16.304573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29775855-c279-4356-8c18-9fd17221f372 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.328929 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29775855-c279-4356-8c18-9fd17221f372 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028752 Oct 11 01:21:16.329530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 560/1130] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:16.335484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.241"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:16.365270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.374781 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-608e9448-f09c-4a5e-837b-fa46cb765c47 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1366 microversion: 2.1 time: 0.378594 Oct 11 01:21:16.387908 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 571/1131] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:15 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:16.393935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1bdf668-f940-456e-99cc-443a8928c9b6 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-573086934", "id": 1044396627, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:16.408779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:16.417899 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1bdf668-f940-456e-99cc-443a8928c9b6 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.028197 Oct 11 01:21:16.418813 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 572/1132] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:16 2022] POST /compute/v2.1/flavors => generated 429 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:16.433323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.433963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:16.440392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.440905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.441543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.442240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.442547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.443069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.644122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:16.650932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.651483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.652310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.653027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.653487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.653923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.717931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.727444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.729831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.731468 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f27ae3aa-7cbd-4a51-b6e1-1df4fffbff15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.304129 Oct 11 01:21:16.732417 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 573/1133] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:16 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:16.737222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e90fa18-37c0-48d1-ab74-d12c525e766d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "1044396627"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:16.748013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4e90fa18-37c0-48d1-ab74-d12c525e766d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] HTTP exception thrown: Flavor 1044396627 could not be found. Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e90fa18-37c0-48d1-ab74-d12c525e766d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Request method failure captured: Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 107 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMUDuZuO1DPPmISW5pK6YpU5xN_CdD_4JioLQHZKXyoi4RRPzAH1VOkhRWIppAj6t2YDq9SAgpteV9C12px_WAewKsGUv5eAuN78Qfm7cTBt1EyKfvAWt0fBab2r4xSfQAHxHXDpDwYoAO4fKLipBRVRLYA828N1vXg9V9wR4dBpL60 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f650f277d61f4dbda6a0d7fac5856f07 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsAdminTestJSON-780032724 Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:21:16.760089 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f650f277d61f4dbda6a0d7fac5856f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f650f277d61f4dbda6a0d7fac5856f07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f650f277d61f4dbda6a0d7fac5856f07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f650f277d61f4dbda6a0d7fac5856f07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsAdminTestJSON-780032724 Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f650f277d61f4dbda6a0d7fac5856f07 Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-780032724 Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsAdminTestJSON-780032724-project Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: eda7f4303e8d4e5bae67a932eb559d22 Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsAdminTestJSON-780032724-project Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "test", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "1044396627"}} Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:21:16.761696 n-d-772273-9 devstack@n-api.service[120493]: exception: Flavor 1044396627 could not be found. Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '1044396627'}}} Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1044396627 could not be found. Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.762620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1044396627 could not be found. Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:16.767163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1044396627 could not be found. Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e90fa18-37c0-48d1-ab74-d12c525e766d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Returning 400 to user: Flavor 1044396627 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e90fa18-37c0-48d1-ab74-d12c525e766d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.028547 Oct 11 01:21:16.768504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 574/1134] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:16 2022] POST /compute/v2.1/servers => generated 81 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:21:16.771729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.772348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:16.779274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.779869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.780375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.781100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:16.781762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:16.782349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:16.924268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.938608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.941496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:16.945243 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a1c255a-1c00-47b7-a097-97ff677b0a3b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.181574 Oct 11 01:21:16.959427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 575/1135] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:16 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:16.969486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65fa7314-0b34-4bd9-a566-e5c9a6fb4119 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.989121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65fa7314-0b34-4bd9-a566-e5c9a6fb4119 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1044396627" status: 202 len: 0 microversion: 2.1 time: 0.028488 Oct 11 01:21:16.989928 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 576/1136] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:16 2022] DELETE /compute/v2.1/flavors/1044396627 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:16.997799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:16.998412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:17.004714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:17.005767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:17.006747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:17.007510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:17.008170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:17.008599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:17.018105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:21:17.018516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquired lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:21:17.602618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:17.610794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2b825b4-000a-48d0-af58-67449e04b84d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.616966 Oct 11 01:21:17.611613 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 577/1137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:16 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:17.615933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4734f911-db26-488c-bd43-8c216203778e tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:17.642630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4734f911-db26-488c-bd43-8c216203778e tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030152 Oct 11 01:21:17.643234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 578/1138] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:17.648609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:17.649392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:17.655578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:17.656248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:17.656845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:17.657728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:17.658423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:17.658857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:17.659117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:17.707078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=18 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:17.919430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:17.927409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aea11597-4bea-4097-affc-de3c1e622eca tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1557 microversion: 2.1 time: 0.282818 Oct 11 01:21:17.939362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 579/1139] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:17 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:17.939362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0", "tag": "53d3810b-5f81-4360-8a24-8df3b45f30c4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:17.945027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:17.945027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:17.945027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:17.956202 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] Creating event network-changed:53d3810b-5f81-4360-8a24-8df3b45f30c4 for instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 on n-h2-772273-9 Oct 11 01:21:17.961980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e7a13120-be23-442a-831d-f10dad9839ee req-ae4ac461-b1d2-4506-9c18-72bf2b72db88 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Oct 11 01:21:17.962857 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 580/1140] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:17.968132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-195bd821-82f0-4a9e-95ad-58bca336e986 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-717527130", "id": 1729130402, "os-flavor-access:is_public": "False"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:17.986498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-195bd821-82f0-4a9e-95ad-58bca336e986 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022418 Oct 11 01:21:17.995109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 581/1141] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:17.998697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:17.999485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:18.006137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.006632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.007077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.007799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.008256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.008687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.214900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.223375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.224825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.225961 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8dba87b-71a8-43c5-9d26-0ff42ced97e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.237234 Oct 11 01:21:18.226937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 582/1142] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:17 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:18.231375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:18.231968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:18.237789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.238277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.238724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.239963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.240414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.240842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.340965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Building network info cache for instance {{(pid=120494) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:18.356825 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b34ae299-9869-4eb2-b95f-4620bec22f42 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128877 Oct 11 01:21:18.357645 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 583/1143] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:21:18 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:18.363190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:18.363984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:18.370568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.371127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.371512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.372234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.372971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.373242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.409337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:18.497611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.528820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.532346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:18.539331 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e9f5b9c-ec5a-4300-84d8-d86e2e6154d4 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.180835 Oct 11 01:21:18.540472 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 584/1144] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:18 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:18.550982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ca6d5f0-1091-4806-aa0d-c085078d0ec0 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2121466444", "id": 2016980512, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:18.588976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ca6d5f0-1091-4806-aa0d-c085078d0ec0 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047189 Oct 11 01:21:18.590267 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 585/1145] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:18.598585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "name": "network-vif-plugged", "status": "completed", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:18.639496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.640708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.641367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.659008 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] Creating event network-vif-plugged:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h1-772273-9 Oct 11 01:21:18.666324 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7235e8ec-f1c5-47d5-911c-8f359f363ad3 req-0f89b2d1-ac23-4318-8c4d-53feaab188eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074559 Oct 11 01:21:18.667599 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 586/1146] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:18.673821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-900f0c33-2145-41c2-85a3-bc14ab2105b3 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:18.696356 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-900f0c33-2145-41c2-85a3-bc14ab2105b3 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.027163 Oct 11 01:21:18.697634 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 587/1147] 10.222.0.66 () {58 vars in 1169 bytes} [Tue Oct 11 01:21:18 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:18.703638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:18.704631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:18.711980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.712772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.713476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:18.714400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:18.715111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:18.715781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:19.130655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:19.141757 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d6585ba-6f8d-4428-99d7-daaf940c2909 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.442845 Oct 11 01:21:19.144052 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 588/1148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:18 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:19.151015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a1c4d7b7-3163-403e-a7a0-1a2d789aba68 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.168784 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a1c4d7b7-3163-403e-a7a0-1a2d789aba68 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.025368 Oct 11 01:21:19.174145 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 589/1149] 10.222.0.66 () {58 vars in 1177 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:19.189138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-efb00fe8-0562-4cb5-ada4-decda08e5613 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.217126 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-efb00fe8-0562-4cb5-ada4-decda08e5613 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.031987 Oct 11 01:21:19.218798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 590/1150] 10.222.0.66 () {58 vars in 1171 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:19.234523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12c26711-38cb-4845-baa6-f60557237a88 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.257314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12c26711-38cb-4845-baa6-f60557237a88 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.027058 Oct 11 01:21:19.258518 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 591/1151] 10.222.0.66 () {58 vars in 1169 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:19.264528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.265437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:19.274593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:19.275666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:19.276308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:19.277249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:19.277905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:19.278539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:19.369845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:19.644331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:19.655949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:19.657697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:19.659430 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d795967-87e1-41be-a2e3-bd2036c7a6f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.398617 Oct 11 01:21:19.672397 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 592/1152] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:19.684707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1086d533-067b-4164-a84c-5d0d10e7c519 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.714510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1086d533-067b-4164-a84c-5d0d10e7c519 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.040781 Oct 11 01:21:19.715534 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 593/1153] 10.222.0.66 () {58 vars in 1169 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:19.720084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:19.720882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:19.729322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:19.729972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:19.730499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:19.731706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:19.732058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:19.732737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.093620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:20.102039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:20.103546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:20.104730 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83608eee-50b8-4c3a-a371-fcb7ef7002c6 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.388383 Oct 11 01:21:20.105303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 594/1154] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:19 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:20.110339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "201f9338-1d0a-429b-bec4-80e4ff8003b2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:20.112978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:20.119491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.119933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.120367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.121073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.121523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.122436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.136323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:20.145208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Updating instance_info_cache with network_info: [{"id": "ad287b9a-28db-43cc-87b1-9987c7eaf967", "address": "fa:16:3e:8e:48:1e", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad287b9a-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:20.161366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Releasing lock "refresh_cache-4515575a-620e-413d-b489-897cdef0a13d" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:21:20.162722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24330137-557c-42d9-ace3-3bf17fbebd14 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d/action" status: 202 len: 0 microversion: 2.1 time: 3.831201 Oct 11 01:21:20.163730 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 561/1155] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:16 2022] POST /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d/action => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:21:20.171067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e99a0c8-8073-440c-becc-30a1546419ff tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.195832 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e99a0c8-8073-440c-becc-30a1546419ff tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.030810 Oct 11 01:21:20.196430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 562/1156] 10.222.0.66 () {58 vars in 1175 bytes} [Tue Oct 11 01:21:20 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:20.200993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4515575a-620e-413d-b489-897cdef0a13d", "tag": "ad287b9a-28db-43cc-87b1-9987c7eaf967"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:20.221146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.221768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.222399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.241863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] Creating event network-changed:ad287b9a-28db-43cc-87b1-9987c7eaf967 for instance 4515575a-620e-413d-b489-897cdef0a13d on n-h1-772273-9 Oct 11 01:21:20.248247 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e3fa82b8-ea92-49ff-95b9-eef5eb99f91d req-d0cbc431-feea-4174-9f4e-6719aa91ed87 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050649 Oct 11 01:21:20.248855 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 563/1157] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:20.254511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.255739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:20.262914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.263663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.264305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.265171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.265865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.266463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.500174 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-64da3383-20ce-4334-841f-f51aa0da26f8 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "POST /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393631 Oct 11 01:21:20.504231 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 595/1158] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:21:20 2022] POST /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:20.506457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.507046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:20.514424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.514930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.515386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.516093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.516758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.517008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.550215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:20.628693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c76aad4-d012-4433-9f81-2600432660d0 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 204 len: 0 microversion: 2.1 time: 0.126464 Oct 11 01:21:20.629578 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 596/1159] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:20 2022] DELETE /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:21:20.639653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62e0fe8e-45c6-41a8-aa41-4bce48e61600 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.662173 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62e0fe8e-45c6-41a8-aa41-4bce48e61600 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.026416 Oct 11 01:21:20.662819 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 597/1160] 10.222.0.66 () {58 vars in 1173 bytes} [Tue Oct 11 01:21:20 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:20.667362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.241"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:20.669824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:20.676616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.677945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.678634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.679455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.679921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.680351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.707739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:21:20.708144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquired lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:21:20.789409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:20.798015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf1193f8-ac50-4be8-91e4-972d3cc9f5b8 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.547547 Oct 11 01:21:20.798783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 564/1161] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:20 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:20.805244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-064e626a-15d2-4fcf-951c-d1352bb6e399 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.844156 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-064e626a-15d2-4fcf-951c-d1352bb6e399 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.043927 Oct 11 01:21:20.851497 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 565/1162] 10.222.0.66 () {58 vars in 1169 bytes} [Tue Oct 11 01:21:20 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:20.862609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:20.865236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:20.875923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.886965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.887556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:20.888517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:20.888991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:20.889418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:21.350844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.359233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.360713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.361850 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d42081f0-7be8-44fb-a454-99e02c9c9c1a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1411 microversion: 2.25 time: 0.508862 Oct 11 01:21:21.362412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 566/1163] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:20 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1411 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:21.378577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2ac9a4c-efec-4043-9f2f-47270c364ea8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.399276 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2ac9a4c-efec-4043-9f2f-47270c364ea8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2016980512" status: 202 len: 0 microversion: 2.1 time: 0.035537 Oct 11 01:21:21.400159 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 567/1164] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:21 2022] DELETE /compute/v2.1/flavors/2016980512 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:21.406556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.407283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:21.413557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:21.414272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:21.415499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:21.416450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:21.417100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:21.417673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:21.523616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.533423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.535107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:21.537196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c8438f5-e01a-4f93-96c3-89071ef86d48 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.135142 Oct 11 01:21:21.545176 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 568/1165] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:21.549510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1deea37d-62f3-4bd8-9773-bf37f6a02a6a tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.574860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1deea37d-62f3-4bd8-9773-bf37f6a02a6a tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035979 Oct 11 01:21:21.575817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 569/1166] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:21.594265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e17d262b-77a2-4263-8cc8-bf8f195fa557 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.620538 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e17d262b-77a2-4263-8cc8-bf8f195fa557 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1729130402" status: 202 len: 0 microversion: 2.1 time: 0.029864 Oct 11 01:21:21.621590 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 570/1167] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:21 2022] DELETE /compute/v2.1/flavors/1729130402 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:21:21.631367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6e367a6-274b-45eb-8a3d-46ebb914271e tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.657129 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6e367a6-274b-45eb-8a3d-46ebb914271e tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030583 Oct 11 01:21:21.658247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 571/1168] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:21.680210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ba34bb2-5489-4594-a77c-ae466fd4465c tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-868987715", "id": 1783805588, "os-flavor-access:is_public": "False"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:21.698466 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ba34bb2-5489-4594-a77c-ae466fd4465c tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022295 Oct 11 01:21:21.699180 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 572/1169] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:21 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:21.716869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9769b92-a38b-4e3b-a3c7-f31a724c5622 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.738134 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9769b92-a38b-4e3b-a3c7-f31a724c5622 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024817 Oct 11 01:21:21.744935 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 573/1170] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:21.757933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-859c940b-12ff-4905-8fef-7ab4144ad02d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.779470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-859c940b-12ff-4905-8fef-7ab4144ad02d tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025766 Oct 11 01:21:21.780062 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 574/1171] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:21.798354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e351767b-274b-4433-930e-f942c03109e9 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.818235 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e351767b-274b-4433-930e-f942c03109e9 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1783805588" status: 202 len: 0 microversion: 2.1 time: 0.022431 Oct 11 01:21:21.818235 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 575/1172] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:21 2022] DELETE /compute/v2.1/flavors/1783805588 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:21.824950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:21.825704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:21.832651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:21.834013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:21.834570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:21.835620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:21.836224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:21.836754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:22.163994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:22.171848 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63e41609-242e-40d5-afd9-4dbb327fe9e7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.351373 Oct 11 01:21:22.172769 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 576/1173] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:21 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:22.192065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-030b640b-e619-47f9-88a9-f7994cabcc5c tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:22.211720 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-030b640b-e619-47f9-88a9-f7994cabcc5c tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023225 Oct 11 01:21:22.212387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 577/1174] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:22.231496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccce642a-23f4-46cc-acf9-3cd0a96ae9d8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-320167740", "id": 811995586, "os-flavor-access:is_public": "True"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:22.248294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccce642a-23f4-46cc-acf9-3cd0a96ae9d8 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.020362 Oct 11 01:21:22.248882 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 578/1175] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:22 2022] POST /compute/v2.1/flavors => generated 410 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:22.260793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fea32f8-b824-4ba2-8b6e-c911d08d9724 tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:22.268169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:22.282294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fea32f8-b824-4ba2-8b6e-c911d08d9724 tempest-FlavorsAdminTestJSON-780032724 tempest-FlavorsAdminTestJSON-780032724-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.024990 Oct 11 01:21:22.283164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 579/1176] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:22 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:22.288061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466b8790-0063-4112-b494-0f56de3aef94", "tag": "4574072d-6b59-4849-9ec5-351524511edc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:22.298241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:22.298724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:22.299148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:22.310325 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] Creating event network-changed:4574072d-6b59-4849-9ec5-351524511edc for instance 466b8790-0063-4112-b494-0f56de3aef94 on n-h2-772273-9 Oct 11 01:21:22.315309 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4e254e42-314c-4d3f-89dd-109a5d94a225 req-80adcaab-71db-4737-b197-b233306fc2ce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030959 Oct 11 01:21:22.316093 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 580/1177] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:22.321210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9726b0b7-53cc-48d7-9979-de03961d92df tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:22.340373 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9726b0b7-53cc-48d7-9979-de03961d92df tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/811995586" status: 202 len: 0 microversion: 2.1 time: 0.023260 Oct 11 01:21:22.340951 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 581/1178] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:21:22 2022] DELETE /compute/v2.1/flavors/811995586 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:22.348640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2615e27-afa5-404d-80f0-4950bbef0fa3 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:22.367669 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2615e27-afa5-404d-80f0-4950bbef0fa3 tempest-FlavorsAdminTestJSON-6490923 tempest-FlavorsAdminTestJSON-6490923-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022465 Oct 11 01:21:22.368358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 582/1179] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:22.390253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:22.391018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:22.397918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:22.398460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:22.398892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:22.399625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:22.400214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:22.400639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:22.650616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Building network info cache for instance {{(pid=120493) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:23.105383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.118436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.119917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.121116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85fae0a9-203e-4e9b-9e80-218df185f190 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1606 microversion: 2.25 time: 0.734930 Oct 11 01:21:23.127368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 583/1180] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:22 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1606 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:23.132550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:23.133167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:23.150753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.151243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.152159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:23.156126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.156610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.157051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:23.308859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.324923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.326375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:23.327651 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b2d080b-6997-4954-955b-5b9f5bacff61 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.199328 Oct 11 01:21:23.328518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 584/1181] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:23 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:23.338133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:23.338890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:23.357998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.358744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.359923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:23.360814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.362561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.367455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:23.399131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:23.640233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7184544a-89d4-4d7b-a75e-dc0bb8f22af3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.309642 Oct 11 01:21:23.641764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 585/1182] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:21:23 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-interface => generated 284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:21:23.647543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:23.648533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:23.673267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.674059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.674668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:23.675583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:23.676219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:23.677357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:24.504275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:24.517248 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5a2ec44-c22e-4c2f-ad49-1c6bf8db9b7c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.874120 Oct 11 01:21:24.518017 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 586/1183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:23 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:24.531006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4515575a-620e-413d-b489-897cdef0a13d", "name": "network-vif-deleted", "tag": "ad287b9a-28db-43cc-87b1-9987c7eaf967"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:24.542116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:24.542893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:24.544514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:24.562757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] Creating event network-vif-deleted:ad287b9a-28db-43cc-87b1-9987c7eaf967 for instance 4515575a-620e-413d-b489-897cdef0a13d on n-h1-772273-9 Oct 11 01:21:24.569370 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cf0a51d7-3307-49db-b699-d36d1b4a2959 req-36e67de3-5be9-4adc-b5a5-43e19e861a77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050175 Oct 11 01:21:24.570618 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 587/1184] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:24.576921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:24.577854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:24.585798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:24.586876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:24.587595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:24.588866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:24.589589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:24.590375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:24.815470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:24.837636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:24.841250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:24.843174 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-842527e8-65b7-483f-90ee-eb244ff0ae6e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.271136 Oct 11 01:21:24.845361 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 588/1185] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:24 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:24.866818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:24.908737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:24.910337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:24.925496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:24.942814 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] Creating event network-changed:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:21:24.950712 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-93ff0b4e-324e-40f3-968a-0d5a2db720b0 req-5f447cfc-ba4c-45dc-a985-bc80c3a9196d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098536 Oct 11 01:21:24.951986 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 589/1186] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:25.551134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:25.553537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:25.569544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:25.570448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:25.571562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:25.573998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:25.574798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:25.575555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:25.604004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Updating instance_info_cache with network_info: [{"id": "d8de69db-0cc0-4485-9261-5184d59e9500", "address": "fa:16:3e:39:33:31", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8de69db-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120493) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:25.630884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Releasing lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:21:25.632772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5da09383-24c0-4000-aaaa-74a7b767ba39 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action" status: 202 len: 0 microversion: 2.1 time: 4.968780 Oct 11 01:21:25.634141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 598/1187] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:20 2022] POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action => generated 0 bytes in 4971 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:21:25.649686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5ce156b-ff1c-47c9-a03a-16c4629649d6 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '.version_select at 0x7f112f9fa550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:26.417014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:26.426222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d56c68dc-5705-48ba-9a62-12c6e7eb7a9f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.886645 Oct 11 01:21:26.445038 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 590/1188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:25 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:26.450979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:26.452000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:26.460308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:26.461025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:26.461870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:26.462850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:26.463375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:26.464149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:26.592331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:26.606463 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5ce156b-ff1c-47c9-a03a-16c4629649d6 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/df3b4adc-1eba-4e9e-be40-a0da2aecf637" status: 200 len: 184 microversion: 2.1 time: 0.967338 Oct 11 01:21:26.607068 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 599/1189] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:21:25 2022] GET /compute/v2.1/os-floating-ips/df3b4adc-1eba-4e9e-be40-a0da2aecf637 => generated 184 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:26.607802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:26.609780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:26.611264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b635c4c-76b0-436b-b793-bec279471d75 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.164759 Oct 11 01:21:26.624537 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 591/1190] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:26 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:26.630899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Action: 'action', calling method: .version_select at 0x7f1136b11430>, body: {"removeFloatingIp": {"address": "172.25.3.241"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:26.849198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b42f5bc-251d-4ade-9cd8-3afec1afd2a6 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-575536326", "ram": 512, "vcpus": 1, "disk": 10, "id": 1767997852, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:26.869258 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b42f5bc-251d-4ade-9cd8-3afec1afd2a6 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.185984 Oct 11 01:21:26.869859 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 592/1191] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:26 2022] POST /compute/v2.1/flavors => generated 415 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:26.875295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0", "name": "network-vif-plugged", "status": "completed", "tag": "53d3810b-5f81-4360-8a24-8df3b45f30c4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:26.886711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:26.887203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:26.887672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:26.899739 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] Creating event network-vif-plugged:53d3810b-5f81-4360-8a24-8df3b45f30c4 for instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 on n-h2-772273-9 Oct 11 01:21:26.905144 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1a8e58d8-1f77-475b-b189-fb7610659a20 req-96f523d7-d4e2-4300-91ff-2451fceb2838 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033950 Oct 11 01:21:26.905817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 593/1192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:26.934742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:26.941557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:26.942597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:26.943029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:26.943757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:26.944741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:26.945323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:27.083534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f75d50dd-6066-4976-a8e7-26ddd3f42992 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.090860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f75d50dd-6066-4976-a8e7-26ddd3f42992 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] HTTP exception thrown: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f75d50dd-6066-4976-a8e7-26ddd3f42992 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Request method failure captured: Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUV4semrC60nw80yUsLOrLsMz_7i8XccFk-0AXpCnb6Ad1tPJ5ecw_H1zc3FNpnTw8xYT94mGg3lypaPm3npHqRHYR_XCEU-ozvpRKBjjMvD9MuSVVuu2wRd8Poh86s2c2C4yzFZVjsZ7soRAgkvMnQlk4ASP8XOJduv6HRQJmTU-8 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:27.094685 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b57492519f414707a1736a1b36c7a934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b57492519f414707a1736a1b36c7a934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 88b40a518ca04bab98bcd4d5dc81e92a Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.096281 n-d-772273-9 devstack@n-api.service[120494]: exception: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:cpu_thread_policy'} Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.097072 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f75d50dd-6066-4976-a8e7-26ddd3f42992 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Returning 404 to user: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.098690 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f75d50dd-6066-4976-a8e7-26ddd3f42992 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] 10.222.0.66 "GET /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.189008 Oct 11 01:21:27.101194 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 594/1193] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:21:26 2022] GET /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:27.106621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc5ad32a-0d6e-4262-adbf-340ab3d6cd2a tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.112607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cc5ad32a-0d6e-4262-adbf-340ab3d6cd2a tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '88b40a518ca04bab98bcd4d5dc81e92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57492519f414707a1736a1b36c7a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc5ad32a-0d6e-4262-adbf-340ab3d6cd2a tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Request method failure captured: Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/flavors/1767997852/os-extra_specs HTTP/1.1 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 66 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUV4semrC60nw80yUsLOrLsMz_7i8XccFk-0AXpCnb6Ad1tPJ5ecw_H1zc3FNpnTw8xYT94mGg3lypaPm3npHqRHYR_XCEU-ozvpRKBjjMvD9MuSVVuu2wRd8Poh86s2c2C4yzFZVjsZ7soRAgkvMnQlk4ASP8XOJduv6HRQJmTU-8 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:27.114954 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b57492519f414707a1736a1b36c7a934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b57492519f414707a1736a1b36c7a934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 88b40a518ca04bab98bcd4d5dc81e92a Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 11 01:21:27.116393 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:21:27.122345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 01:21:27.123701 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.125007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc5ad32a-0d6e-4262-adbf-340ab3d6cd2a tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.125007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cc5ad32a-0d6e-4262-adbf-340ab3d6cd2a tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] 10.222.0.66 "POST /compute/v2.1/flavors/1767997852/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014107 Oct 11 01:21:27.125007 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 595/1194] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:21:27 2022] POST /compute/v2.1/flavors/1767997852/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:27.131018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e277597-2ab2-4e95-968e-4e56bb7d6cce tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.167159 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e277597-2ab2-4e95-968e-4e56bb7d6cce tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1767997852/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044494 Oct 11 01:21:27.168029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 596/1195] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:21:27 2022] POST /compute/v2.1/flavors/1767997852/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:21:27.179488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d94f016-59c3-4e6f-972a-d2554d13a4bc tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.182420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2d94f016-59c3-4e6f-972a-d2554d13a4bc tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '88b40a518ca04bab98bcd4d5dc81e92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57492519f414707a1736a1b36c7a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d94f016-59c3-4e6f-972a-d2554d13a4bc tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Request method failure captured: Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUV4semrC60nw80yUsLOrLsMz_7i8XccFk-0AXpCnb6Ad1tPJ5ecw_H1zc3FNpnTw8xYT94mGg3lypaPm3npHqRHYR_XCEU-ozvpRKBjjMvD9MuSVVuu2wRd8Poh86s2c2C4yzFZVjsZ7soRAgkvMnQlk4ASP8XOJduv6HRQJmTU-8 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:27.183861 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b57492519f414707a1736a1b36c7a934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b57492519f414707a1736a1b36c7a934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 88b40a518ca04bab98bcd4d5dc81e92a Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.185216 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:numa_nodes'} Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:21:27.185935 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.187875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d94f016-59c3-4e6f-972a-d2554d13a4bc tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.188941 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d94f016-59c3-4e6f-972a-d2554d13a4bc tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] 10.222.0.66 "DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010496 Oct 11 01:21:27.191606 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 597/1196] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:21:27 2022] DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:21:27.197535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f60445e6-ef4e-4e9a-9b34-accbf76cb628 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.225837 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f60445e6-ef4e-4e9a-9b34-accbf76cb628 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1767997852/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031772 Oct 11 01:21:27.232166 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 598/1197] 10.222.0.66 () {60 vars in 1224 bytes} [Tue Oct 11 01:21:27 2022] POST /compute/v2.1/flavors/1767997852/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:21:27.238160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-519bfdfc-766f-4bb9-8cd5-cbdf970760eb tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.243846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-519bfdfc-766f-4bb9-8cd5-cbdf970760eb tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '88b40a518ca04bab98bcd4d5dc81e92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57492519f414707a1736a1b36c7a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-519bfdfc-766f-4bb9-8cd5-cbdf970760eb tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Request method failure captured: Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 22 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUV4semrC60nw80yUsLOrLsMz_7i8XccFk-0AXpCnb6Ad1tPJ5ecw_H1zc3FNpnTw8xYT94mGg3lypaPm3npHqRHYR_XCEU-ozvpRKBjjMvD9MuSVVuu2wRd8Poh86s2c2C4yzFZVjsZ7soRAgkvMnQlk4ASP8XOJduv6HRQJmTU-8 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:27.247456 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b57492519f414707a1736a1b36c7a934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b57492519f414707a1736a1b36c7a934"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b57492519f414707a1736a1b36c7a934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: b57492519f414707a1736a1b36c7a934 Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 88b40a518ca04bab98bcd4d5dc81e92a Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: {"hw:numa_nodes": "1"} Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.248832 n-d-772273-9 devstack@n-api.service[120494]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:21:27.249738 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 01:21:27.250883 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.252149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-519bfdfc-766f-4bb9-8cd5-cbdf970760eb tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.252149 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-519bfdfc-766f-4bb9-8cd5-cbdf970760eb tempest-FlavorsExtraSpecsNegativeTestJSON-506585742 tempest-FlavorsExtraSpecsNegativeTestJSON-506585742-project] 10.222.0.66 "PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015728 Oct 11 01:21:27.256609 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 599/1198] 10.222.0.66 () {60 vars in 1265 bytes} [Tue Oct 11 01:21:27 2022] PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:27.262245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba051e22-e3d1-4457-b629-7a48a436dbba tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.271551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ba051e22-e3d1-4457-b629-7a48a436dbba tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] HTTP exception thrown: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba051e22-e3d1-4457-b629-7a48a436dbba tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Request method failure captured: Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUWlfmtVvB2OtJdI4Crzz0T9DSuNpwx7U8a9X0mZYUfhOkudZUkJ9e9hPL-cyIJq6tLaX7cesChLuliAarIJQxiOymi86mMMfmuMpjc1y5up9t7oaMheCnQOwVDBZczd825ZBnxNJGgzNtA_bJfvwiwF9q8d38rzxbJ7_cphrluxBU Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:21:27.273055 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d6eec082169d41538ee231c93823a690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d6eec082169d41538ee231c93823a690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d169f8fa2c5743b5a7670ae340be91b8 Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.274512 n-d-772273-9 devstack@n-api.service[120494]: exception: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:cpu_thread_policy'} Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.275256 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba051e22-e3d1-4457-b629-7a48a436dbba tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Returning 404 to user: Flavor 1767997852 has no extra specs with key hw:cpu_thread_policy. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.276884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba051e22-e3d1-4457-b629-7a48a436dbba tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016737 Oct 11 01:21:27.293089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 600/1199] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:21:27 2022] DELETE /compute/v2.1/flavors/1767997852/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:27.298860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.315652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:27.316151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:27.316644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:27.330197 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] Creating event network-changed:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h1-772273-9 Oct 11 01:21:27.335557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8d6222b4-6c6c-48a2-bbd6-a93f8bb4ef6d req-342511f7-94df-44c3-93a4-17b1144d088f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041164 Oct 11 01:21:27.336598 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 601/1200] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:27.341999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85f694d4-09ad-4d5c-8ea0-89460b5bb46d tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.346483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:21:27.347198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquired lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:21:27.357067 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-85f694d4-09ad-4d5c-8ea0-89460b5bb46d tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85f694d4-09ad-4d5c-8ea0-89460b5bb46d tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Request method failure captured: Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 27 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUWlfmtVvB2OtJdI4Crzz0T9DSuNpwx7U8a9X0mZYUfhOkudZUkJ9e9hPL-cyIJq6tLaX7cesChLuliAarIJQxiOymi86mMMfmuMpjc1y5up9t7oaMheCnQOwVDBZczd825ZBnxNJGgzNtA_bJfvwiwF9q8d38rzxbJ7_cphrluxBU Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:21:27.358857 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d6eec082169d41538ee231c93823a690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d6eec082169d41538ee231c93823a690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d169f8fa2c5743b5a7670ae340be91b8 Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: {"hw:cpu_policy": "shared"} Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.360567 n-d-772273-9 devstack@n-api.service[120494]: exception: Request body and URI mismatch Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.367882 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85f694d4-09ad-4d5c-8ea0-89460b5bb46d tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85f694d4-09ad-4d5c-8ea0-89460b5bb46d tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022458 Oct 11 01:21:27.369412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 602/1201] 10.222.0.66 () {60 vars in 1265 bytes} [Tue Oct 11 01:21:27 2022] PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:21:27.372067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296f744-615d-485f-997c-0c63259c7e9a tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296f744-615d-485f-997c-0c63259c7e9a tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Request method failure captured: Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 49 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUWlfmtVvB2OtJdI4Crzz0T9DSuNpwx7U8a9X0mZYUfhOkudZUkJ9e9hPL-cyIJq6tLaX7cesChLuliAarIJQxiOymi86mMMfmuMpjc1y5up9t7oaMheCnQOwVDBZczd825ZBnxNJGgzNtA_bJfvwiwF9q8d38rzxbJ7_cphrluxBU Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:21:27.377440 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d6eec082169d41538ee231c93823a690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d6eec082169d41538ee231c93823a690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d6eec082169d41538ee231c93823a690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d6eec082169d41538ee231c93823a690 Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d169f8fa2c5743b5a7670ae340be91b8 Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 11 01:21:27.379093 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'flavor_id': '1767997852', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance: Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 11 01:21:27.385443 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.387637 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296f744-615d-485f-997c-0c63259c7e9a tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2296f744-615d-485f-997c-0c63259c7e9a tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010490 Oct 11 01:21:27.389156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 603/1202] 10.222.0.66 () {60 vars in 1265 bytes} [Tue Oct 11 01:21:27 2022] PUT /compute/v2.1/flavors/1767997852/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:21:27.397946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26fe4e45-1664-4f58-99b4-f592ea94d311 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.422932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26fe4e45-1664-4f58-99b4-f592ea94d311 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1767997852" status: 202 len: 0 microversion: 2.1 time: 0.035219 Oct 11 01:21:27.424033 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 604/1203] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:21:27 2022] DELETE /compute/v2.1/flavors/1767997852 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:27.432895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2945463-5e60-472f-92aa-6edb9e4bcacd tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.466241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2945463-5e60-472f-92aa-6edb9e4bcacd tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382 tempest-FlavorsExtraSpecsNegativeTestJSON-1525919382-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036965 Oct 11 01:21:27.467461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 605/1204] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:21:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:27.496081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.496846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:27.503646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:27.504122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:27.504802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:27.505680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:27.506306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:27.506896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:27.914871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:27.924886 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39f84a9c-b230-4db4-8458-19562d3ebc1a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.456100 Oct 11 01:21:27.940349 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 606/1205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:27 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:27.949841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:27.950918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:27.957672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:27.958184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:27.958631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:27.959370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:27.962877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:27.963329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:28.194426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:28.210517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:28.212898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:28.214459 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27633abb-8820-47e7-9e26-6b194f24e353 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.272788 Oct 11 01:21:28.215232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 607/1206] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:27 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:28.833606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Building network info cache for instance {{(pid=120493) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:21:28.955462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:28.956419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:28.969391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:28.986205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:28.987043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:28.988746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:28.990369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:28.994665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:29.578213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:29.587669 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d624532-be52-4b07-aae6-37d202bddeb5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1316 microversion: 2.1 time: 0.638076 Oct 11 01:21:29.588449 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 608/1207] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:28 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:29.614647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:29.620851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:29.627643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:29.628361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:29.628965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:29.630810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:29.631595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:29.632188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:29.722449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:29.731970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:29.734159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:29.735942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24973533-2ce7-4363-96d3-a6270a79862e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.132780 Oct 11 01:21:29.737890 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 609/1208] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:29 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:29.761116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:29.773533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:29.774330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:29.775912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:29.789841 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] Creating event network-changed:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:21:29.795179 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-aea4a572-6b48-4c0a-bc24-36e3b97b4153 req-eb97e353-1530-4700-b252-14374a803bb0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047333 Oct 11 01:21:29.796245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 610/1209] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:30.043789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Updating instance_info_cache with network_info: [{"id": "d8de69db-0cc0-4485-9261-5184d59e9500", "address": "fa:16:3e:39:33:31", "network": {"id": "6fe43141-5ef9-4c8b-9c55-66c9cc4b4524", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1924126413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d8950eed91dc442ba09b67cae132e0bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8de69db-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120493) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:21:30.061633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Releasing lock "refresh_cache-5bd26f5c-7801-4597-b57d-82b73123112e" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:21:30.063111 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7713397e-30a5-4fa9-87d3-c37d2f6e871a tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action" status: 202 len: 0 microversion: 2.1 time: 3.438195 Oct 11 01:21:30.063766 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 600/1210] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:26 2022] POST /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e/action => generated 0 bytes in 3440 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 11 01:21:30.074046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:30.074633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:30.087721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.088225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.088669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.089448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.089919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.090352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.110055 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] HTTP exception thrown: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Request method failure captured: Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d HTTP/1.1 Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTNbkUOmcWW03Yrtv0px5iOo0EbqLd_V80xQnJuMjDpbgiyeHi4uZdZexPhm_OCYBewedltVqmFI7Aj6I7pZtuEHHLBGpkwjwpjHneDl6CsrctHFeEislUEhsHxaZzfESePJIST1_adDgk-8wgeJDj24Y2hHtcY7gDLAy43i8OkUrI Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:30.111370 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d9c32eb3b6ca4570815c664e90bb36a4 Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.112758 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4515575a-620e-413d-b489-897cdef0a13d'} Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:30.113616 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.114968 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.116523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Returning 404 to user: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:30.116523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8a6f15f-7469-4c0e-a9fc-1bb6f255d41b tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 404 len: 111 microversion: 2.1 time: 0.044118 Oct 11 01:21:30.124223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:30.124846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 4515575a-620e-413d-b489-897cdef0a13d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:30.127576 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 611/1211] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:30 2022] DELETE /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:30.132728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.133242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.133813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.134741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.135200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.135652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.154321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] HTTP exception thrown: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Request method failure captured: Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d HTTP/1.1 Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTNbkUOmcWW03Yrtv0px5iOo0EbqLd_V80xQnJuMjDpbgiyeHi4uZdZexPhm_OCYBewedltVqmFI7Aj6I7pZtuEHHLBGpkwjwpjHneDl6CsrctHFeEislUEhsHxaZzfESePJIST1_adDgk-8wgeJDj24Y2hHtcY7gDLAy43i8OkUrI Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:21:30.156533 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d9c32eb3b6ca4570815c664e90bb36a4 Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.158279 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4515575a-620e-413d-b489-897cdef0a13d'} Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:30.159192 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. Oct 11 01:21:30.161370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:30.162586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Returning 404 to user: Instance 4515575a-620e-413d-b489-897cdef0a13d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:30.162586 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61b748e8-f7a9-4c02-a73e-77c00ac24766 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d" status: 404 len: 111 microversion: 2.1 time: 0.038077 Oct 11 01:21:30.168729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e1c350e-4031-4995-a9ca-7f8d1b2720f1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '.version_select at 0x7f1134255790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:30.175543 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 601/1212] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:30 2022] GET /compute/v2.1/servers/4515575a-620e-413d-b489-897cdef0a13d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:30.616402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:30.617210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:30.626118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.626704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.627214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.628210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.628877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.629350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.905844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:30.914265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-10b6496f-112f-4bc6-9b32-04f95d51bf82 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1466 microversion: 2.1 time: 0.303835 Oct 11 01:21:30.931776 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 602/1213] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:30 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1466 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:30.931776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:30.931776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:30.931776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.931776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.932309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:30.932309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:30.932309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:30.932309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.023294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:31.032748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:31.033792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:31.034980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d59f8f03-e66d-4fbb-888f-3f7ccb5045ab tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.119187 Oct 11 01:21:31.036334 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 603/1214] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:30 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:31.159928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e6845fb-188b-43c8-a699-de954be3c3b9 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2119495380", "id": 511504430, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:31.178264 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e6845fb-188b-43c8-a699-de954be3c3b9 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.139416 Oct 11 01:21:31.179102 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 604/1215] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:21:31 2022] POST /compute/v2.1/flavors => generated 446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:21:31.184559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.185232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:31.191427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.191954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.192452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.193156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.193631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.194305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.214615 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e1c350e-4031-4995-a9ca-7f8d1b2720f1 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/df3b4adc-1eba-4e9e-be40-a0da2aecf637" status: 202 len: 0 microversion: 2.1 time: 1.051095 Oct 11 01:21:31.215206 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 612/1216] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:21:30 2022] DELETE /compute/v2.1/os-floating-ips/df3b4adc-1eba-4e9e-be40-a0da2aecf637 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:31.219672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.220293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:31.227896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.228393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.228839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.229566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.230179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.230614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.384276 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82adb74b-b462-4e94-9576-41295753a016 tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1617 microversion: 2.1 time: 0.203972 Oct 11 01:21:31.394537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06611fdc-e803-4f6d-8ca9-4e64d83050bf tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1812 microversion: 2.1 time: 0.178266 Oct 11 01:21:31.396295 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 613/1217] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1812 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:31.407749 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 605/1218] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1617 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:31.422024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.430743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:31.444617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.445124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.445555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.446266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.446894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.447324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.477009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:31.520070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b2e9b69-3c14-45a6-a87d-c7beff946bad tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.528136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b2e9b69-3c14-45a6-a87d-c7beff946bad tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] 10.222.0.66 "GET /compute/v2.1/flavors/511504430" status: 200 len: 446 microversion: 2.55 time: 0.123275 Oct 11 01:21:31.538074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 606/1219] 10.222.0.66 () {60 vars in 1196 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/flavors/511504430 => generated 446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:21:31.538074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.538074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.538074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.538527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.538822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.539287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.539736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.557861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91366f51-c65c-40c0-ad73-5a7990716793 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 204 len: 0 microversion: 2.1 time: 0.139867 Oct 11 01:21:31.559432 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 614/1220] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:31 2022] DELETE /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:21:31.565884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-542443789", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:31.569720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aaacd2d1-e5c5-4a7b-98e3-6e6cb5079eb6 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040004 Oct 11 01:21:31.570348 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 607/1221] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:31.575504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0dfd1f4b-1d44-43a2-91a1-59958a78ad05 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] Action: 'update', calling method: .version_select at 0x7f11362b7c10>, body: {"flavor": {"description": "new"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:31.620425 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0dfd1f4b-1d44-43a2-91a1-59958a78ad05 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/511504430" status: 200 len: 447 microversion: 2.55 time: 0.048975 Oct 11 01:21:31.621259 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 608/1222] 10.222.0.66 () {62 vars in 1216 bytes} [Tue Oct 11 01:21:31 2022] PUT /compute/v2.1/flavors/511504430 => generated 447 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:21:31.628690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:21:31.633625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.634423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:31.642065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.642730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.643170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.643903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.644365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.644829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.858503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:31.866873 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d6b4651-3fdc-4087-8f6b-def067a2c3d2 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1526 microversion: 2.1 time: 0.238514 Oct 11 01:21:31.867797 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 609/1223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1526 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:31.872861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c0d6dfb-9552-4046-bfc5-06d056cec5de tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.896807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c0d6dfb-9552-4046-bfc5-06d056cec5de tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.027794 Oct 11 01:21:31.897407 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 610/1224] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:31.917499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67d28d37-8643-42fe-9df7-520a8ac578a7 tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.923251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:31.941083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67d28d37-8643-42fe-9df7-520a8ac578a7 tempest-FlavorsV255TestJSON-935975517 tempest-FlavorsV255TestJSON-935975517-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.027688 Oct 11 01:21:31.942387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 611/1225] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:21:31.942826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:31.943546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:31.944112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:31.944657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:31.945472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:31.956892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.957547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.958263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.959093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:31.959654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:31.960158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:31.960389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f03f2a16-e1f8-4811-9b55-09c1b6ce35a4 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:31.974890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:31.982595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:31.984113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f03f2a16-e1f8-4811-9b55-09c1b6ce35a4 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/511504430" status: 202 len: 0 microversion: 2.55 time: 0.028558 Oct 11 01:21:31.985071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 612/1226] 10.222.0.66 () {60 vars in 1199 bytes} [Tue Oct 11 01:21:31 2022] DELETE /compute/v2.1/flavors/511504430 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:21:31.994314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Getting quotas for user 3b34359d8c5a4ed2ab3cba5de60cd4aa and project 8f58fbb4e51e4b0eb4dcdd8569c1e9e6. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:31.994750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c028be65-5cbd-4e3d-bc50-6951eebd00d1 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:32.015269 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c028be65-5cbd-4e3d-bc50-6951eebd00d1 tempest-FlavorsV255TestJSON-838006063 tempest-FlavorsV255TestJSON-838006063-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.024328 Oct 11 01:21:32.016246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 613/1227] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:21:31 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:32.016384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:32.018953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:32.062666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:32.063590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:32.070138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:32.070825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:32.071515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:32.072373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:32.074887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:32.075835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:32.085069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34bbc514-fba6-4338-9bae-12e589dabcde tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522729 Oct 11 01:21:32.086647 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 615/1228] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:21:32.102030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0637437-ff3f-4cdf-9a95-0a1e6e35e48d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:32.103380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0637437-ff3f-4cdf-9a95-0a1e6e35e48d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:32.190777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0637437-ff3f-4cdf-9a95-0a1e6e35e48d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:32.199743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0637437-ff3f-4cdf-9a95-0a1e6e35e48d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1216 microversion: 2.1 time: 0.105641 Oct 11 01:21:32.200711 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 616/1229] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:32 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:32.218433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:32.227777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:32.229393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:32.230483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2888241f-efe7-4ff9-ab3b-7a7c424328fb tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.172451 Oct 11 01:21:32.231076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 614/1230] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:32 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:21:32.892160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:32.893149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:32.900605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:32.901225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:32.901930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:32.902861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:32.903600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:32.904061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.093403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:33.102916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3a552d1-6fcd-4437-bbe0-284ae9602696 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1526 microversion: 2.1 time: 0.215271 Oct 11 01:21:33.103726 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 617/1231] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:32 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1526 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:33.222504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:33.223293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:33.233478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.233872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.237880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.241447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.242099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.242723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.262257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:33.263551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:33.279422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.279967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.280416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.281145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.281604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.282033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.397214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:33.405941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:33.406181 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f547a26-2355-4ab3-a543-51b8f528ed9b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1268 microversion: 2.1 time: 0.187708 Oct 11 01:21:33.420567 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 615/1232] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:33 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:33.429749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37e1fd99-9007-4cca-8184-669b00f35b8b", "device": "/dev/xvdb"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:33.433836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:33.436178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:33.438764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:33.440947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.441297 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfb99295-1a25-424e-b8fd-45aa8c51f64a tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.183895 Oct 11 01:21:33.442360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.442979 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 618/1233] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:33 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:33.452913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.454102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.455176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.455176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.843942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd26f5c-7801-4597-b57d-82b73123112e", "name": "network-vif-deleted", "tag": "d8de69db-0cc0-4485-9261-5184d59e9500"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:33.860517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:33.861555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:33.862125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:33.874668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] Creating event network-vif-deleted:d8de69db-0cc0-4485-9261-5184d59e9500 for instance 5bd26f5c-7801-4597-b57d-82b73123112e on n-h1-772273-9 Oct 11 01:21:33.880869 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0bf6f711-344f-4568-92fd-bfe7c82ce110 req-a76db19f-c497-429f-ba36-d86f100a7e3e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043165 Oct 11 01:21:33.881836 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 619/1234] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:33.905854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:33.940590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2af6efe-c2a7-415f-bc6e-fad9a80c74d5 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517918 Oct 11 01:21:33.942043 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 616/1235] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:21:33 2022] POST /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:34.131555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:34.132641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:34.146650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.147157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.154735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.155938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.162167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.163053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.174282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:34.220062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.220660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.221174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.221696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lazy-loading 'fault' on Instance uuid 5bd26f5c-7801-4597-b57d-82b73123112e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:34.291288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:34.300509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3dfbf6b2-80db-4b7a-bb5d-9b1487b758cc tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1314 microversion: 2.1 time: 0.175055 Oct 11 01:21:34.302304 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 620/1236] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:34 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:34.434479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:34.435187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:34.442571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.443066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.443712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.444615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.445292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.445881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.467536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:34.468159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:34.480034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.481019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.481467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.482372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:34.482837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:34.483281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:34.530807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:34.543180 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b74f5e9c-1181-441f-8902-da5a0f218ae3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1274 microversion: 2.1 time: 0.114175 Oct 11 01:21:34.543820 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 617/1237] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:34 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:34.571848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:34.581173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:34.583428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:34.584806 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f85577c6-1ef8-43fa-98dd-e7a9cbe2cd6b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.121464 Oct 11 01:21:34.585548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 621/1238] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:34 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:21:35.324620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.325780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:35.337479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.338034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.338481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.339181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.339875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.340299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.377947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.378436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.379132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.379799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lazy-loading 'fault' on Instance uuid 5bd26f5c-7801-4597-b57d-82b73123112e {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:35.450256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c32eb3b6ca4570815c664e90bb36a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8950eed91dc442ba09b67cae132e0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:35.459004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ddf1045-d599-495e-987c-211bfa7992d8 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 200 len: 1314 microversion: 2.1 time: 0.138144 Oct 11 01:21:35.472043 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 618/1239] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:35.513089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f11343df280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.517487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.518082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.518527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.519264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.520432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.520861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.551587 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e7d4557-8b74-413e-ae4d-7044f69ece32 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.214553 Oct 11 01:21:35.558883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 622/1240] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:35.564169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f112f9b1160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.567791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.568274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.568887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.569037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.569916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:35.570062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.570656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.571242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.576645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.577226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.577737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.578518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.579046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.579740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.596978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d68a4d61-886a-4066-881c-4333dd960618 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.036598 Oct 11 01:21:35.598440 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 619/1241] 10.222.0.66 () {58 vars in 1139 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:35.609711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f112f9ac700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.616030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.616552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.616997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.617836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.618304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.618969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.648554 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dce2a10f-c76a-473a-94d7-83d8eca38d45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.042627 Oct 11 01:21:35.649519 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 620/1242] 10.222.0.66 () {58 vars in 1145 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:21:35.661079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.662068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:35.669032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.669857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.670499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.671457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.672139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.672767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.775998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:35.786543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:35.788431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:35.789639 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6809eb92-5cca-453e-a1df-174a0fe99200 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.138996 Oct 11 01:21:35.790509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 621/1243] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:35.792978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:35.801820 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-990fc07b-1430-4469-8e0a-0ce5e5413d77 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.236948 Oct 11 01:21:35.802571 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 623/1244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:35.807571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f112f9ddc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.811096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.811695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.812140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.812862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.813611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.814195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.839266 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f43fda9-2f65-4097-8811-cb25ab278dad tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.047518 Oct 11 01:21:35.839910 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 622/1245] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:35.851388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f1134c0eb80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.854516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.854988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.855447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.856189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.856644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.857070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.880917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7de4eeb8-fac4-4842-958a-a484bfe9425d tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.034193 Oct 11 01:21:35.881866 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 624/1246] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:35.892671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f112f9b14c0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.896614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.897103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.897544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.898277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.898734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.899158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.922285 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec195ce8-559e-4f15-a773-1ccf31f59984 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.033222 Oct 11 01:21:35.922892 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 623/1247] 10.222.0.66 () {58 vars in 1128 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:35.933367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f11343163a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:35.940137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.940626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.941070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.954596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:35.955086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:35.955558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:35.994249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94840967-f1e8-42a3-8a9e-74357cf7143b tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-h1-772273-9" status: 200 len: 991 microversion: 2.1 time: 0.064711 Oct 11 01:21:35.994761 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 625/1248] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts/n-h1-772273-9 => generated 991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:36.005063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Calling method '.version_select at 0x7f112f9ce8b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:36.012178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.012682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.013129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.028046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.028534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.028974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.067594 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3935e999-2a53-415d-a78b-f2569cc30e45 tempest-HostsAdminTestJSON-1289565644 tempest-HostsAdminTestJSON-1289565644-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-h2-772273-9" status: 200 len: 866 microversion: 2.1 time: 0.066629 Oct 11 01:21:36.068203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 624/1249] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:21:35 2022] GET /compute/v2.1/os-hosts/n-h2-772273-9 => generated 866 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:36.483833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:36.484731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] [instance: 5bd26f5c-7801-4597-b57d-82b73123112e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:36.492330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.492848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.493309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.494122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.494914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.495678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.519369 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] HTTP exception thrown: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Request method failure captured: Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e HTTP/1.1 Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTNbkUOmcWW03Yrtv0px5iOo0EbqLd_V80xQnJuMjDpbgiyeHi4uZdZexPhm_OCYBewedltVqmFI7Aj6I7pZtuEHHLBGpkwjwpjHneDl6CsrctHFeEislUEhsHxaZzfESePJIST1_adDgk-8wgeJDj24Y2hHtcY7gDLAy43i8OkUrI Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:36.521960 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d8950eed91dc442ba09b67cae132e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: d8950eed91dc442ba09b67cae132e0bf Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-869567359 Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d9c32eb3b6ca4570815c664e90bb36a4 Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-869567359-project Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. Oct 11 01:21:36.523437 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5bd26f5c-7801-4597-b57d-82b73123112e'} Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:36.524232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. Oct 11 01:21:36.525540 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:36.526702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] Returning 404 to user: Instance 5bd26f5c-7801-4597-b57d-82b73123112e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:36.526702 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28892650-4ab9-4fb0-87ed-451da86af827 tempest-FloatingIPsAssociationTestJSON-869567359 tempest-FloatingIPsAssociationTestJSON-869567359-project] 10.222.0.66 "GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e" status: 404 len: 111 microversion: 2.1 time: 0.043531 Oct 11 01:21:36.526702 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 626/1250] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:36 2022] GET /compute/v2.1/servers/5bd26f5c-7801-4597-b57d-82b73123112e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:36.828453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:36.829568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:36.833171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:36.835280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:36.845756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.846330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.846864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.847150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.847311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.848103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.848299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.849127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.849742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.850103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:36.850797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:36.851487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:36.985515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:37.017561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:37.020661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:37.022150 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a656a25-b72d-41b0-aa86-2bc408bc7a76 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.195630 Oct 11 01:21:37.043445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 625/1251] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:36 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:37.069161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:37.071834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:37.078813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:37.079642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:37.082825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:37.084105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:37.084776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:37.085404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:37.124144 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99b70a26-043a-440c-8c3f-539981505c02 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059531 Oct 11 01:21:37.125665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 626/1252] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:21:37 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:37.137210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:37.138024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:37.146494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:37.147901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:37.148701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:37.149717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:37.150456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:37.151574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:37.190935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:37.214219 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88976209-21e6-450c-a36e-97437f227ae5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.390527 Oct 11 01:21:37.217611 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 627/1253] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:36 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:37.360627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lazy-loading 'services' on Instance uuid 9b40f057-9cff-444d-a0be-b3fb1f75697f {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:37.452376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bea15cb-ae24-47b1-bc90-62fd04da420c", "tag": "04596811-defa-4323-be44-7964a19406bd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:37.469108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:37.477465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:37.478191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:37.503811 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] Creating event network-changed:04596811-defa-4323-be44-7964a19406bd for instance 5bea15cb-ae24-47b1-bc90-62fd04da420c on n-h1-772273-9 Oct 11 01:21:37.516972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-271b1f63-b3e6-43cf-b2d7-cb1e1977ce3d req-8a55d8ca-a0b8-4552-86c8-7e81b534fedb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068202 Oct 11 01:21:37.518286 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 628/1254] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:37.590219 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0411e102-4eb7-4c53-93ad-30d01af804dc tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments/201f9338-1d0a-429b-bec4-80e4ff8003b2" status: 202 len: 0 microversion: 2.1 time: 0.457080 Oct 11 01:21:37.591475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 627/1255] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:21:37 2022] DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments/201f9338-1d0a-429b-bec4-80e4ff8003b2 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:38.054115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:38.054638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:38.064493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:38.066544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:38.067322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:38.068933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:38.069773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:38.071540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:38.243504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:38.244384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:38.262511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:38.263315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:38.264022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:38.264988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:38.265678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:38.266372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:38.552871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:38.568562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:38.573160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:38.575607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9cac0c48-c962-464e-8e7d-93288cf43f73 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.528584 Oct 11 01:21:38.577580 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 629/1256] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:38 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:38.740384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:38.749464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0236d0b4-39cd-41df-a994-884a72325c13 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.510869 Oct 11 01:21:38.765920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 628/1257] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:38 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:39.603003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:39.603648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:39.641453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:39.643040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:39.643586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:39.645145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:39.647498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:39.648806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:39.742043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:39.762650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:39.764960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:39.767621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46fcc91f-32e1-404b-88fc-ef24f31f7d29 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.167628 Oct 11 01:21:39.773128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:39.774465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:39.791115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 630/1258] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:39 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:39.794516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:39.796250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:39.796569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:39.797301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:39.797764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:39.798196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:40.015371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:40.028936 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21947cad-4123-42be-bdec-3f661f44c2c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.259880 Oct 11 01:21:40.032848 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 629/1259] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:39 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:40.819979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:40.820449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:40.835415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:40.836251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:40.836887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:40.838054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:40.838760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:40.851073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:40.961382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:40.972877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:40.975620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:40.977033 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08521ed5-1ebb-48e3-8efa-0e3dcf96ffda tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.173428 Oct 11 01:21:40.992590 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 631/1260] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:40 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:41.059322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:41.060061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:41.069644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:41.071323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:41.071803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:41.072641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:41.073105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:41.073539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:41.360837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93839c2d-1c8e-4bd3-8f3c-a974440121bb tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] Calling method '.version_select at 0x7f1134c0e3a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:41.363592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:41.371967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c812d64-37c7-44b5-823f-ada7cb6be82a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.317640 Oct 11 01:21:41.377877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 630/1261] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:41 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:41.504605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93839c2d-1c8e-4bd3-8f3c-a974440121bb tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks" status: 200 len: 7420 microversion: 2.1 time: 0.429254 Oct 11 01:21:41.505533 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 632/1262] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:21:41 2022] GET /compute/v2.1/os-networks => generated 7420 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:41.513835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9306dbdd-f0c4-4a23-b8c8-89cc5ca4cb10 tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] Calling method '.version_select at 0x7f112f94da60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:41.632347 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9306dbdd-f0c4-4a23-b8c8-89cc5ca4cb10 tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks/b8dd60d3-adec-4df7-ab56-a2028419c3bc" status: 200 len: 652 microversion: 2.1 time: 0.122245 Oct 11 01:21:41.633573 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 631/1263] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:21:41 2022] GET /compute/v2.1/os-networks/b8dd60d3-adec-4df7-ab56-a2028419c3bc => generated 652 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:41.645571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47449adb-74b0-42d8-9439-f891d09d38ab tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] Calling method '.version_select at 0x7f1134218160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:41.802019 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47449adb-74b0-42d8-9439-f891d09d38ab tempest-NetworksTest-2615959 tempest-NetworksTest-2615959-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks" status: 200 len: 7420 microversion: 2.1 time: 0.161029 Oct 11 01:21:41.802879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 633/1264] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:21:41 2022] GET /compute/v2.1/os-networks => generated 7420 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:42.005583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:42.006400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:42.017971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:42.019818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:42.020495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:42.021679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:42.022157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:42.022584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:42.110062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:42.120234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:42.121682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:42.122860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66dba1e0-0fa6-4dde-8c0e-fc90ea98d3b1 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1408 microversion: 2.54 time: 0.122234 Oct 11 01:21:42.134448 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 632/1265] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:41 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:42.401259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:42.402495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:42.411515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:42.423819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:42.426596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:42.427283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:42.429249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:42.430620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:42.432782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:42.749280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:42.760470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8ad4d82-f3c0-40fa-84e0-21320163cd9a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.369360 Oct 11 01:21:42.761789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 634/1266] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:42 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:43.151369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:43.152045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:43.161877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:43.163019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:43.163990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:43.165214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:43.166114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:43.167119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:43.433273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:43.445061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:43.447021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:43.448451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af22c564-3eb2-4a19-9c82-93bd932c2b80 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1414 microversion: 2.54 time: 0.301425 Oct 11 01:21:43.449354 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 633/1267] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:43 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1414 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:43.787007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:43.788432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:43.796625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:43.797389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:43.797899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:43.798626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:43.799434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:43.799761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:43.986118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:44.009553 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffc26424-3a7d-4d90-9bdb-f117b5c5b55b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.228091 Oct 11 01:21:44.024579 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 635/1268] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:43 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:44.478258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:44.479432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:44.493322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:44.494022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:44.496427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:44.497356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:44.499635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:44.501740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:44.640549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:44.666020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:44.672372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:44.678992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e856b9bb-1503-49bc-9ec0-08c094202974 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1414 microversion: 2.54 time: 0.205058 Oct 11 01:21:44.688176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 634/1269] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:44 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1414 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:44.897800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bea15cb-ae24-47b1-bc90-62fd04da420c", "name": "network-vif-plugged", "status": "completed", "tag": "04596811-defa-4323-be44-7964a19406bd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:44.928059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:44.930022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:44.931525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:44.958506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] Creating event network-vif-plugged:04596811-defa-4323-be44-7964a19406bd for instance 5bea15cb-ae24-47b1-bc90-62fd04da420c on n-h1-772273-9 Oct 11 01:21:44.971623 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4e761fbb-7685-41df-8276-664985b451d9 req-619306a3-79a9-41c7-ba6b-a1af655ba0a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079252 Oct 11 01:21:44.975626 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 636/1270] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:45.035252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.035928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:45.042863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.047976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.051080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.052127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.053025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.053783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.509138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:45.513742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:45.525049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f6f1b9ec-8ea1-48d6-9d1e-a621dd5d4924 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.494778 Oct 11 01:21:45.537532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 635/1271] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:45 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:45.681854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.684460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:45.694211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.696179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.696834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.697774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.698027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.702819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.716312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.717414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:45.728152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.729440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.729887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.730617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.735983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.736645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.772663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-956fe04b-9e9c-4148-9f07-990f930de8a5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095915 Oct 11 01:21:45.774068 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 637/1272] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:21:45 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:21:45.828104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:45.841981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:45.843832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:45.845450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9fe8dc9-bfe4-40ac-9179-b085454fb10e tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1399 microversion: 2.54 time: 0.133124 Oct 11 01:21:45.846035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 636/1273] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:45 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1399 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:21:45.872158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.873291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7a62325-9e3e-4224-be63-cf96bd74ce7f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '.version_select at 0x7f112f8f6f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.875312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:45.877456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:45.890838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.891834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.892176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.893113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.894395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.895009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.898214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7a62325-9e3e-4224-be63-cf96bd74ce7f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-555386958" status: 204 len: 0 microversion: 2.54 time: 0.028607 Oct 11 01:21:45.899168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 637/1274] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-555386958 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:21:45.915378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:45.916081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:45.922018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:45.928686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.929524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.930242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.931554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:45.932172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:45.932900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:45.943131 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52c8eb29-f5de-4cab-a759-5ce7b11a98e0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075848 Oct 11 01:21:45.944706 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 638/1275] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:21:45 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:21:45.981478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:46.107412 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa5918a3-3364-465b-9f3a-6ae958f4096b tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 204 len: 0 microversion: 2.54 time: 0.198833 Oct 11 01:21:46.108599 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 638/1276] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:21:45 2022] DELETE /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:21:46.114888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:46.115513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:46.122726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.123669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.124353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.125307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.125926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.126515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.161737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:46.164404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1958285538", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:46.239527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:21:46.283070 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6ea4173-792d-4452-9e48-72bfb168250e tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 204 len: 0 microversion: 2.1 time: 0.172434 Oct 11 01:21:46.283828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 639/1277] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:46 2022] DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:21:46.295448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:46.296167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:46.302859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.303403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.303842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.304552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.305005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.305682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.434361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:46.443032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:46.444515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:46.445691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aa832ee1-c27f-48e9-a132-7335a6034b22 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1405 microversion: 2.54 time: 0.155739 Oct 11 01:21:46.446607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 640/1278] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:46 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:46.458684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:46.459720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:46.468591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.469216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.469682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.470374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.471242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.471242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.734088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:46.742640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66d5fe9a-2522-47f2-970f-a89a7f620360 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1681 microversion: 2.1 time: 0.288434 Oct 11 01:21:46.743497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 641/1279] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:46 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:46.748347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:46.749123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:46.758523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:46.758843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:46.759332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:46.759750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:46.760172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:46.764454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.765258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.765913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.767170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.767906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.768564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.769786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.770111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.770845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.771773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:46.772790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:46.773229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:46.790983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:46.797442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for user 825933c38eef4b7792bfe66e5a07ae88 and project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:46.811955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:46.814658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:46.865262 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6f1a736-0d05-437a-bde5-d08b95ad0ed5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863190 Oct 11 01:21:46.866231 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 639/1280] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:21:46.926432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2029820580", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:46.984492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:21:47.005773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:47.018262 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7b6269ff-0eb2-4c4c-8775-81fa4966df16 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1316 microversion: 2.1 time: 0.273354 Oct 11 01:21:47.019894 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 642/1281] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:46 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:47.272484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:21:47.273235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:21:47.274561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:21:47.275439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:21:47.276036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:21:47.288533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.289352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.290003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.290942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.291597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.292251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.315080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:21:47.321264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for user 825933c38eef4b7792bfe66e5a07ae88 and project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:21:47.338165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:21:47.340705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:21:47.403951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccc9d339-0183-4060-9ecd-fc678c7b2030 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481759 Oct 11 01:21:47.405363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 640/1282] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:21:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:21:47.419630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0677764d-2e5c-4748-b5c5-5be870239cb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:47.420357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0677764d-2e5c-4748-b5c5-5be870239cb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:47.473617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:47.474426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:47.486771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.487738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.511066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.513877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0677764d-2e5c-4748-b5c5-5be870239cb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:47.515761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.517885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.522891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.524607 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0677764d-2e5c-4748-b5c5-5be870239cb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1214 microversion: 2.1 time: 0.109257 Oct 11 01:21:47.525741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 643/1283] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:47 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:47.638827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:47.650315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:47.652056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:47.653975 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4ac665e-42d0-466d-8593-d22d6856eef0 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1405 microversion: 2.54 time: 0.185169 Oct 11 01:21:47.655323 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 641/1284] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:47 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:21:47.769347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:47.771564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:47.787368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.795865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.796536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.799045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.802264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.802915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.908087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:47.909648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:47.920704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.931656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.932219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:47.932999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:47.933478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:47.933919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.305933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:48.316011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ea1e1ec-2c67-441d-86f3-196a011def83 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1681 microversion: 2.1 time: 0.551913 Oct 11 01:21:48.316675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 644/1285] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:47 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1681 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:48.329982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:48.330603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:48.334607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:48.338857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.339808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.341167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.342529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.343908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.345333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.358980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dd2d673-339a-4e54-8cd5-37379641329d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1858 microversion: 2.1 time: 0.457590 Oct 11 01:21:48.359990 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 642/1286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:47 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1858 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:48.386626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-772273-9", "block_migration": true, "disk_over_commit": false}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:48.392515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:48.399058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:48.410362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.412401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.414420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.415369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.418227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.418899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.432782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:48.464928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lazy-loading 'flavor' on Instance uuid 72e51375-b088-4724-ba57-79280f142f80 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:48.478411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Going to try to live migrate instance to n-h1-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:21:48.564223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:48.574143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1004eef3-8e30-41fe-a40c-ffafed28a171 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1465 microversion: 2.1 time: 0.253124 Oct 11 01:21:48.575211 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 645/1287] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:48 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1465 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:48.595503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:48.597396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:48.604090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.605416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.606023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.607554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.608034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.608627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.686503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:48.705247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-801f29dd-a6c3-477e-b0e0-0672ef35710c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1210 microversion: 2.1 time: 0.128033 Oct 11 01:21:48.706757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 646/1288] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:48 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:48.728173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:48.728990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:48.736559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.737831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.738601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.739545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.740160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.740748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.903081 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-883a29ff-761c-4a50-8c44-91e0aab2087e tempest-ServersOnMultiNodesTest-1789261608 tempest-ServersOnMultiNodesTest-1789261608-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1616 microversion: 2.1 time: 0.178569 Oct 11 01:21:48.904474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 647/1289] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:48 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1616 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:48.910585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:48.911622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:48.917646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.918370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.918972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:48.919874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:48.920488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:48.921334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.023175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.037541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.040371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.043547 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4374b04c-5af0-46c9-909a-f040477bf2c8 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1405 microversion: 2.54 time: 0.137863 Oct 11 01:21:49.045812 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 648/1290] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:48 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:49.073213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:49.074063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:49.084586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.086192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.086638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.087379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.088036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.088661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.127906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:49.197826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:49.262970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e46d3e23-ef7c-4eca-9666-25ea76df48e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 204 len: 0 microversion: 2.1 time: 0.215541 Oct 11 01:21:49.263699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 649/1291] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:49 2022] DELETE /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:21:49.273200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:49.273913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:49.285198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.285824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.286344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.287139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.287703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.288272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.487809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.504382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d18f583-0fb1-4fc1-b7ef-1cbc8cc1ff23 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1471 microversion: 2.1 time: 0.235808 Oct 11 01:21:49.506853 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 650/1292] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:49 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:49.524974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:49.528493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:49.541560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.542581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.542979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.543807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.544428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.545063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.630569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.642414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4d1ad02-bd79-4b6e-8f2f-3b531bbae7a0 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1614 microversion: 2.1 time: 0.133814 Oct 11 01:21:49.643765 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 651/1293] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:49 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:49.734904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:49.735638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:49.752300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.753912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.754610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.755588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.756361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.757161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:49.831135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:49.840420 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6917e912-f3b2-44b0-b3ac-f2a21bf7462a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1210 microversion: 2.1 time: 0.111365 Oct 11 01:21:49.856344 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 652/1294] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:49 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:49.979031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b40f057-9cff-444d-a0be-b3fb1f75697f", "name": "network-vif-deleted", "tag": "2c8cc681-968c-4fd9-8a57-c041e1e1e252"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:49.997221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:49.998038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:49.998699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.019822 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] Creating event network-vif-deleted:2c8cc681-968c-4fd9-8a57-c041e1e1e252 for instance 9b40f057-9cff-444d-a0be-b3fb1f75697f on n-h1-772273-9 Oct 11 01:21:50.025393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-adb07162-f49c-4ad9-a8a5-2bf60bfadab8 req-f111b8cb-331f-4c8e-b0ef-17fd942ab0d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055482 Oct 11 01:21:50.026800 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 653/1295] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:21:50.077645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:50.079856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:50.086880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.087493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.088004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.089225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.091769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.094530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.189979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:50.204057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:50.205719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:50.206935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-101643e4-d650-442c-b936-81126e0b72cf tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1405 microversion: 2.54 time: 0.135869 Oct 11 01:21:50.207907 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 654/1296] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:50 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:50.561539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e46a672d-9493-4c0a-aad0-c9c7284ba7c1 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Calling method '.version_select at 0x7f112f8e5430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:50.625415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e46a672d-9493-4c0a-aad0-c9c7284ba7c1 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.125493 Oct 11 01:21:50.628563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 655/1297] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:21:50 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:21:50.633551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:50.634168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:50.640898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.641400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.641844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.642553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.643009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.643994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.797046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:50.806004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc279448-b96c-42fd-842e-5257b1c0fb3b tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1471 microversion: 2.1 time: 0.176191 Oct 11 01:21:50.808035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 656/1298] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:50 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:50.813340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7258d57-5f1e-477a-bba0-56b88cd53fbe tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Action: 'create', calling method: .version_select at 0x7f112f8e5700>, body: {"pool": "non_exist_pool"} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:50.845301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e7258d57-5f1e-477a-bba0-56b88cd53fbe tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] HTTP exception thrown: Floating IP pool not found. Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7258d57-5f1e-477a-bba0-56b88cd53fbe tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Request method failure captured: Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 26 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMUuYl3qvTMh6JVwwcTbZAcy_5JlhypANSjN47ucmAGRd2r18iCYlD_77RTXargVv4GVhkzNufQfmRJy78RlJF49W6r7VfYllIuvVofLP0T2VJInkJeucWheQxNGAP8eIvUhppDJJo3onG1JLmeCOfEkWo5oCLpnU2BCxKWxqfUC2FM Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 03d42a53d2ca461781ab734d9d639413 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:21:50.864310 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_03d42a53d2ca461781ab734d9d639413"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 03d42a53d2ca461781ab734d9d639413 Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsNegativeTestJSON-1641944328-project Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c7f53fe0d2494e24bf621ff298a7ed78 Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1641944328-project Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: {"pool": "non_exist_pool"} Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: exception: Floating IP pool not found. Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 11 01:21:50.865821 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:50.866792 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7258d57-5f1e-477a-bba0-56b88cd53fbe tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Returning 404 to user: Floating IP pool not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:50.868121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7258d57-5f1e-477a-bba0-56b88cd53fbe tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.056468 Oct 11 01:21:50.872197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 657/1299] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:21:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:21:50.878063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:50.878676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:50.885871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.886363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.886805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.887538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:50.888127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:50.888556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:50.972392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:50.981969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57c0f504-26af-48d7-8dcf-ee3607f8075f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1327 microversion: 2.1 time: 0.108430 Oct 11 01:21:50.982969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 658/1300] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:50 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:51.012769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:51.014153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:51.034467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.035249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.035914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.036659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.041494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.042281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.182871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:51.214752 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77fc948a-fc01-425c-99c8-f3aa07362ef6 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1210 microversion: 2.1 time: 0.230493 Oct 11 01:21:51.221353 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 659/1301] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:50 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:51.233399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Calling method '.version_select at 0x7f112fc861f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:51.328516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a08f1f7e-259e-42f5-b816-53e4e89ed6d7 could not be found", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:21:51.329224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] HTTP exception thrown: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Request method failure captured: Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-floating-ips/a08f1f7e-259e-42f5-b816-53e4e89ed6d7 HTTP/1.1 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMUuYl3qvTMh6JVwwcTbZAcy_5JlhypANSjN47ucmAGRd2r18iCYlD_77RTXargVv4GVhkzNufQfmRJy78RlJF49W6r7VfYllIuvVofLP0T2VJInkJeucWheQxNGAP8eIvUhppDJJo3onG1JLmeCOfEkWo5oCLpnU2BCxKWxqfUC2FM Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 03d42a53d2ca461781ab734d9d639413 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:21:51.341166 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_03d42a53d2ca461781ab734d9d639413"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/03d42a53d2ca461781ab734d9d639413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 03d42a53d2ca461781ab734d9d639413 Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1641944328 Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsNegativeTestJSON-1641944328-project Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c7f53fe0d2494e24bf621ff298a7ed78 Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1641944328-project Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: exception: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7 Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'a08f1f7e-259e-42f5-b816-53e4e89ed6d7'} Oct 11 01:21:51.342786 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:21:51.344030 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a08f1f7e-259e-42f5-b816-53e4e89ed6d7 could not be found Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f678118-3ff4-4140-82e2-4f53293c7ee2'] Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7. Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:51.345424 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7 Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:51.347074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:51.348632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7 Oct 11 01:21:51.348632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:51.351160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] Returning 404 to user: Floating IP not found for ID a08f1f7e-259e-42f5-b816-53e4e89ed6d7 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:51.351160 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d0246521-55ce-4745-b0f0-ffbb125f8522 tempest-FloatingIPsNegativeTestJSON-1641944328 tempest-FloatingIPsNegativeTestJSON-1641944328-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/a08f1f7e-259e-42f5-b816-53e4e89ed6d7" status: 404 len: 111 microversion: 2.1 time: 0.123291 Oct 11 01:21:51.351752 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 660/1302] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:21:51 2022] DELETE /compute/v2.1/os-floating-ips/a08f1f7e-259e-42f5-b816-53e4e89ed6d7 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:51.356661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:51.357628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:51.379729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.388021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.388466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.389210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.389666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.390092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.456425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.457187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.458394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.459702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lazy-loading 'fault' on Instance uuid b72ae92c-dced-4ed5-a73a-12dca9095e37 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:51.542820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:51.553736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:51.559224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:51.563787 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1b04478-438f-4764-a4a1-c4ebaa1ccb14 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1410 microversion: 2.54 time: 0.210678 Oct 11 01:21:51.564510 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 661/1303] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:51 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1410 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:51.833724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:51.836683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:51.855600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.856664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.858504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:51.859633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:51.891707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:51.891707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.319454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e306432-40d4-448f-b094-ae03150250b0 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/action" status: 202 len: 0 microversion: 2.1 time: 3.937105 Oct 11 01:21:52.320202 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 643/1304] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:21:48 2022] POST /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/action => generated 0 bytes in 3939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:52.329331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:52.330292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:52.343438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.344056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.344598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.345579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.346309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.346962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.400078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.402356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.403046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.409225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lazy-loading 'fault' on Instance uuid 9b40f057-9cff-444d-a0be-b3fb1f75697f {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:52.480674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:52.482343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:52.489284 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-53e50742-00fc-45ea-9bad-8f403b986fd4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1471 microversion: 2.1 time: 0.662977 Oct 11 01:21:52.491518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72334560-65b0-4cb9-8d6d-338969adb0ca tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1332 microversion: 2.1 time: 0.170168 Oct 11 01:21:52.500441 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 662/1305] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:51 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1471 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:52.515932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:52.516629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:52.521388 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 644/1306] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:52 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1332 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:52.524071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.524798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.525407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.526515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.527551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.528253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.530627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:52.532708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:52.551253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.551934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.552400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.553318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.557136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.557683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.661385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:52.691080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37d29b70-244e-4948-bf9c-68e6e34f73df tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1266 microversion: 2.1 time: 0.188982 Oct 11 01:21:52.693326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 663/1307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:52 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:52.704982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bea15cb-ae24-47b1-bc90-62fd04da420c", "name": "network-vif-deleted", "tag": "04596811-defa-4323-be44-7964a19406bd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:52.733955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.747583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.749664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.782610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] Creating event network-vif-deleted:04596811-defa-4323-be44-7964a19406bd for instance 5bea15cb-ae24-47b1-bc90-62fd04da420c on n-h1-772273-9 Oct 11 01:21:52.792939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f13daa7e-227b-4740-82a1-1dfcc432d185 req-e33afde1-80ed-4176-bea4-20659a31c819 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095188 Oct 11 01:21:52.793969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 664/1308] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:52.803162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:52.811687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:52.837380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.839455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.840413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.844476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.848817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.851575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.966906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:52.979215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:52.982033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:52.982497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:52.982956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lazy-loading 'fault' on Instance uuid b72ae92c-dced-4ed5-a73a-12dca9095e37 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:52.985942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b87c1a8-c940-4ce4-93f3-63209ace99c6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.458579 Oct 11 01:21:53.020745 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 645/1309] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:52 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:53.086153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:53.097816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:53.102448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:53.106923 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66a0f9a2-96ce-4bac-9d07-52985f32108f tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1410 microversion: 2.54 time: 0.310632 Oct 11 01:21:53.119566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 665/1310] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:52 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1410 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:53.526912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:53.527576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:53.535351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.535855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.536503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.537226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.537688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.538113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.548118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:53.548878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:53.569383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.570241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.570856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.571879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.572339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.572769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.605314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.606152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.606879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.607532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid 5bea15cb-ae24-47b1-bc90-62fd04da420c {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:53.631956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.633296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.634020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.635164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lazy-loading 'fault' on Instance uuid 9b40f057-9cff-444d-a0be-b3fb1f75697f {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:53.794294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:53.832665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d3518c0db846b3818f4fe49f4837d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64f02fbbacc4854806187f139193dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:53.842368 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37520a33-f3f9-4746-8657-e4fed1a0723c tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 200 len: 1332 microversion: 2.1 time: 0.298197 Oct 11 01:21:53.842967 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 666/1311] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:53 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 1332 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:53.844364 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b26e394a-c6d5-4a11-8df7-3ef7c541c9c1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1306 microversion: 2.1 time: 0.310599 Oct 11 01:21:53.845933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 646/1312] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:53 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1306 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:53.863533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:53.872812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:53.907761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.912201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.913139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:53.919320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:53.920164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:53.921036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.034911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:54.035757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:54.049770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.050731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.051379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.052260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.052882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.053475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.149573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:54.167083 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5450ab0b-0ccd-4d05-afd7-090a9b648784 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1272 microversion: 2.1 time: 0.312450 Oct 11 01:21:54.167716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 647/1313] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:53 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:54.227458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:54.228091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:54.234699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.235622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.238808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.239804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.240657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.241250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.289529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.290023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.290464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.290918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lazy-loading 'fault' on Instance uuid b72ae92c-dced-4ed5-a73a-12dca9095e37 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:54.381702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:54.395768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:54.397223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dfb056e8f2141b79c553ab5eff1e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf110bfa837417da176b7cf6cce2708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:54.398470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-87f865f8-5f7c-4f47-9ab6-c4d5e6f6db91 tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 200 len: 1410 microversion: 2.54 time: 0.210509 Oct 11 01:21:54.428055 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 648/1314] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:54 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 1410 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:21:54.547636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:54.566794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14b8c8a5-5f64-4776-a825-b417834eaf66 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.546148 Oct 11 01:21:54.568609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 667/1315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:54 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:54.866851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:54.869270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:54.883054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:54.884752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:54.892050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.892551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.893534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.894262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.894722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.895165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.900341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.901281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.903513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.904461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.906599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.909226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.932314 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] HTTP exception thrown: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Request method failure captured: Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f HTTP/1.1 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSJnis4X5AHzMtFNFmjJHuuJhtNLkEEy2YO1y8qrII4MaKpn2PJKVZ9hDZKyW_m9lJ94RrJwy1bqkYvaXQhaUHiXaVK6Xjq1HFFzYho0rZl9HFDyCdMX7rJ2-GBV0GmutIDYod-bNGyMEMVNjqksSsn3fTq4No1KcXfNZUNyXd5GxM Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:54.934973 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a64f02fbbacc4854806187f139193dd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: c0d3518c0db846b3818f4fe49f4837d8 Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:21:54.936751 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '9b40f057-9cff-444d-a0be-b3fb1f75697f'} Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:54.937783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:21:54.939217 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:54.946160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Returning 404 to user: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:54.947361 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82aaf3ca-7b18-4b40-972f-a23a7834994f tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 404 len: 111 microversion: 2.1 time: 0.085468 Oct 11 01:21:54.950139 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 649/1316] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:54 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:54.960514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-039282be-f8ff-485e-955f-30db5752bbd5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '.version_select at 0x7f1134c0e1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:54.982853 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-039282be-f8ff-485e-955f-30db5752bbd5 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023376174" status: 202 len: 0 microversion: 2.1 time: 0.026292 Oct 11 01:21:54.984271 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 650/1317] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:21:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023376174 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:21:54.998037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:54.998463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:54.998911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:54.999396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid 5bea15cb-ae24-47b1-bc90-62fd04da420c {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:21:55.123406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:55.131940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c371e379-66b4-44b7-be5c-16d636e7d5b3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 200 len: 1306 microversion: 2.1 time: 0.260636 Oct 11 01:21:55.134665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 668/1318] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:54 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 1306 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:55.204664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:55.205950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:55.226937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.232531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.234678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:55.243933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.245023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.245708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:55.441836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:55.442445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] [instance: b72ae92c-dced-4ed5-a73a-12dca9095e37] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:55.454346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.454838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.455819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:55.456960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.457426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.458230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:55.466634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:55.495008 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] HTTP exception thrown: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Request method failure captured: Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 HTTP/1.1 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMT90a60iL1GgGcpDjMo4AOqtY0cYIeoQZTYD9BFUs1MlVoh0XtVd8xLbwzKGZWWoogXSDy2tJxsGOp1u-ohqkmDd1BVAguJtHAvOGqYMFyqV9gs80j7QvIS58DrnNUMcfMPDKpSpcbjquCkO2idgCV6eiZd40BVW8OXaLXCAb3R9T8 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.54 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: fdf110bfa837417da176b7cf6cce2708 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerShowV254Test-229564440 Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:21:55.498756 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fdf110bfa837417da176b7cf6cce2708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fdf110bfa837417da176b7cf6cce2708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fdf110bfa837417da176b7cf6cce2708"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fdf110bfa837417da176b7cf6cce2708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerShowV254Test-229564440 Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: fdf110bfa837417da176b7cf6cce2708 Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerShowV254Test-229564440 Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerShowV254Test-229564440-project Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5dfb056e8f2141b79c553ab5eff1e55d Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerShowV254Test-229564440-project Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. Oct 11 01:21:55.502063 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b72ae92c-dced-4ed5-a73a-12dca9095e37'} Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:55.503387 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. Oct 11 01:21:55.504663 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:21:55.506966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] Returning 404 to user: Instance b72ae92c-dced-4ed5-a73a-12dca9095e37 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:55.508596 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e2fbcd9-2000-4079-992d-fc67d7ec0caa tempest-ServerShowV254Test-229564440 tempest-ServerShowV254Test-229564440-project] 10.222.0.66 "GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37" status: 404 len: 111 microversion: 2.54 time: 0.070419 Oct 11 01:21:55.510160 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 669/1319] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:21:55 2022] GET /compute/v2.1/servers/b72ae92c-dced-4ed5-a73a-12dca9095e37 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:21:55.595372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:55.597460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:55.630622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.632155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.633896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:55.636496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:55.638746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:55.639431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.021611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:56.035147 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-814577e1-8001-4e3d-a308-7958fa9821ce tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.843156 Oct 11 01:21:56.043253 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 651/1320] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:55 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:56.159965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:56.160597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 5bea15cb-ae24-47b1-bc90-62fd04da420c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:56.173837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.174568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.175015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.175970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.176593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.177438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.218046 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c HTTP/1.1 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:21:56.221760 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. Oct 11 01:21:56.223264 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5bea15cb-ae24-47b1-bc90-62fd04da420c'} Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:21:56.224621 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. Oct 11 01:21:56.226279 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:21:56.227880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance 5bea15cb-ae24-47b1-bc90-62fd04da420c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:21:56.227880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fd26f8cc-030e-4192-892e-a0b582447931 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c" status: 404 len: 111 microversion: 2.1 time: 0.072031 Oct 11 01:21:56.229364 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 652/1321] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:56 2022] GET /compute/v2.1/servers/5bea15cb-ae24-47b1-bc90-62fd04da420c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:21:56.237619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:56.238633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:56.245134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.245890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.246649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.247572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.248395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.249099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.279506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:56.281890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:21:56.292209 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c29bc2d0-9f58-4a8f-9353-f5ac6cfff84e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.701276 Oct 11 01:21:56.301613 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 670/1322] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:55 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:56.436014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-760748a2-1604-43a4-91b5-aad1cc7999b7 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 204 len: 0 microversion: 2.1 time: 0.202100 Oct 11 01:21:56.440735 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 653/1323] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:21:56 2022] DELETE /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:21:56.448491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:56.449125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:56.460141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.460925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.461657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.462546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:56.463221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:56.465816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:56.843195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:56.863894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c45d8db8-4d58-47b0-b17c-ab7fc661dd86 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1472 microversion: 2.1 time: 0.418644 Oct 11 01:21:56.866170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 671/1324] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:56 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1472 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:57.072301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:57.073217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:57.086652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.089433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.092542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.094153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.094787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.096732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.306139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:57.326123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:57.326856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:57.331813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:57.340183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.342046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.342500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.343235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.346878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.347358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.498889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:57.517092 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-86851559-67de-4a3e-b0c6-0ab1dea9da16 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.453614 Oct 11 01:21:57.523968 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 654/1325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:57 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:57.524951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:21:57.546833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:21:57.582592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.583086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.583576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.645215 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] Creating event network-changed:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:21:57.669609 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-007989ec-ec63-4716-9060-829f5db22fca req-1de70d8d-dfd3-4c43-b84e-4b17891eb6c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139187 Oct 11 01:21:57.672137 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 655/1326] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:21:57.893070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:57.894940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:57.906314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.908782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.910960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:57.912699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:57.918138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:57.919844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:58.538359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:58.554088 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-064a762c-0e7d-4d96-89e9-0123af7093ac tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 1.233751 Oct 11 01:21:58.557170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 672/1327] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:57 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:21:58.568493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:58.569126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:58.593040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:58.593560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:58.594028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:58.595889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:58.596366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:58.596803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:58.699002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:58.712496 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f867a3f1-c405-4402-abf2-42d207d37669 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1472 microversion: 2.1 time: 0.822263 Oct 11 01:21:58.728832 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 656/1328] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:57 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1472 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:59.570551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:21:59.583111 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21bb57ca-cb5b-4b70-badb-4ce97df0bef9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 1.024429 Oct 11 01:21:59.586432 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 673/1329] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:58 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:21:59.620080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:21:59.621271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:21:59.638017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:59.638747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:59.643372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:59.646010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:21:59.646861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:21:59.648815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:21:59.761447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d353883b-3fc1-4ecc-bc5e-3625194ad7e7 tempest-ComputeTenantNetworksTest-4496454 tempest-ComputeTenantNetworksTest-4496454-project] Calling method '.version_select at 0x7f11341cf4c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:00.299802 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d353883b-3fc1-4ecc-bc5e-3625194ad7e7 tempest-ComputeTenantNetworksTest-4496454 tempest-ComputeTenantNetworksTest-4496454-project] 10.222.0.66 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.791264 Oct 11 01:22:00.301270 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 657/1330] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:21:59 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:00.306392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fb84e7-8a64-4b1c-90d5-c1b8738600a7", "tag": "0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:00.327320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:00.332804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:00.333568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:00.354074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] Creating event network-changed:0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c for instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 on n-h1-772273-9 Oct 11 01:22:00.373294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f63b7aae-e235-4921-94b6-c4181ee8f40f req-8abc1175-c808-4081-b116-7cf3d4440fed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070474 Oct 11 01:22:00.373916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 658/1331] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:00.379575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:00.387786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:00.403405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:00.404210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:00.404828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:00.406469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:00.407662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:00.408864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:00.422652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:00.433899 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7d1f9e0-e618-4948-8d66-7de561a84974 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.844795 Oct 11 01:22:00.448869 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 674/1332] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:21:59 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:00.458008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a126454a-31e6-4399-adca-6ec940c69117 tempest-ComputeTenantNetworksTest-4496454 tempest-ComputeTenantNetworksTest-4496454-project] Calling method '.version_select at 0x7f112f9b14c0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:00.876455 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a126454a-31e6-4399-adca-6ec940c69117 tempest-ComputeTenantNetworksTest-4496454 tempest-ComputeTenantNetworksTest-4496454-project] 10.222.0.66 "GET /compute/v2.1/os-tenant-networks/4861b301-2b88-4234-9719-9632d90e254a" status: 200 len: 140 microversion: 2.1 time: 0.425997 Oct 11 01:22:00.878967 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 675/1333] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:22:00 2022] GET /compute/v2.1/os-tenant-networks/4861b301-2b88-4234-9719-9632d90e254a => generated 140 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:00.884109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:00.884932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:00.895998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:00.897286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:00.897907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:00.900492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:00.901149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:00.903063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:01.047658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:01.075792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:01.084147 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c64f73a-a831-4b36-b254-9cd96c4664e4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1472 microversion: 2.1 time: 0.708999 Oct 11 01:22:01.089549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 659/1334] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:00 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1472 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:01.284316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:01.305996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5f09aac1-163f-4ea2-8d2f-c08b4fb3c904 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.425691 Oct 11 01:22:01.324930 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 676/1335] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:00 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:01.461167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:01.462115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:01.472497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:01.473217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:01.474045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:01.475007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:01.475672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:01.476260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:01.698311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:01.708199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d2f8a0e-010e-48a2-bfa6-1a804c5dd56c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.251409 Oct 11 01:22:01.724883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 660/1336] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:01 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:02.112771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:02.113419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:02.128085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.129082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.129692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.130599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.131066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.131562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.202677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.203532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.204352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.205756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:02.310519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:02.322061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55d77a68-f855-43e6-8742-fbe753a1e9bc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 200 len: 1306 microversion: 2.1 time: 0.213915 Oct 11 01:22:02.322668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 677/1337] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:02 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 1306 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:02.334475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:02.335360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:02.347782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.348297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.348748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.349603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.355614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.356163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.415425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0", "name": "network-vif-deleted", "tag": "53d3810b-5f81-4360-8a24-8df3b45f30c4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:02.434954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.435766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.436393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.450460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] Creating event network-vif-deleted:53d3810b-5f81-4360-8a24-8df3b45f30c4 for instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 on n-h2-772273-9 Oct 11 01:22:02.455806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1a46c22c-3605-46fb-b14c-e0da817f4333 req-04b8ba6b-b3cf-40eb-be6b-2e5d28c3e42a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044949 Oct 11 01:22:02.457095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 678/1338] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:02.677673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:02.690732 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae3cef86-8fd6-4059-90cd-8352399ac0f2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.360885 Oct 11 01:22:02.709732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 661/1339] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:02 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:02.736751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:02.738005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:02.751388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.754002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.756563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:02.757746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:02.759639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:02.760637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.102515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:03.119454 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d699e1e-fdfb-4404-9b1c-824747bbbfbd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.388933 Oct 11 01:22:03.137525 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 679/1340] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:02 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:03.356091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:03.356798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:03.376663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.377661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.379605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.380431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.385048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.388919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.408724 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 HTTP/1.1 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:03.411032 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. Oct 11 01:22:03.412831 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0'} Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:03.413666 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. Oct 11 01:22:03.414914 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:03.417209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:03.417209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-747183e9-bf45-49a6-aa9e-781804d2634f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0" status: 404 len: 111 microversion: 2.1 time: 0.067194 Oct 11 01:22:03.417209 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 662/1341] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:03 2022] GET /compute/v2.1/servers/ba72471b-6ad5-4ce7-9b8c-46cabb5ab3e0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:03.421642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:03.422142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:03.432919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.433452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.434034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.434906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.435393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.435822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.466664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:03.533349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:03.534377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:03.548621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.550707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.551863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.553322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.556616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.557338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.611991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f8929e58-0911-4655-ad33-56a54a24b8e2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 204 len: 0 microversion: 2.1 time: 0.193175 Oct 11 01:22:03.612848 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 680/1342] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:03 2022] DELETE /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:03.622040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:03.622795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:03.636680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.637183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.637740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:03.638748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:03.642840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:03.643564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.272991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:04.285319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9df6d5cb-0703-44f2-914e-5c9b888e9eba tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1473 microversion: 2.1 time: 0.667989 Oct 11 01:22:04.287801 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 681/1343] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:03 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1473 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:04.296715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:04.300752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:04.314544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.317824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.318561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.319503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.322292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.322916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.355423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:04.381312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-497f8a6c-f017-4ce7-9a2b-6808ce512da9 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 2343 microversion: 2.25 time: 0.852849 Oct 11 01:22:04.382687 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 663/1344] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:03 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 2343 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:04.387779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:04.388395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:04.395311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.396388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.397076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.398601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.399692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.400138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.554629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:04.571919 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b4fb26e4-8db3-47b8-95eb-0eb20fddf3f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.281591 Oct 11 01:22:04.591287 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 682/1345] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:04 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:04.727086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:04.737935 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-13358c5a-b7e5-4378-b07e-9a6331df7450 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.351695 Oct 11 01:22:04.738874 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 664/1346] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:04 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:04.750596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:04.757972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.761403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.763907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.765113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.770219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.771008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.843175 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ead445c8-5551-4ae8-b533-76f29ec781f4 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.102715 Oct 11 01:22:04.844313 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 665/1347] 10.222.0.66 () {60 vars in 1217 bytes} [Tue Oct 11 01:22:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:22:04.849948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "name": "network-vif-plugged", "status": "completed", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:04.886463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:04.889688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:04.891952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:04.920909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] Creating event network-vif-plugged:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:22:04.934873 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a9b354c4-446f-4f8f-ab23-8608b67b954a req-c317202c-60ad-44d3-bf0c-dab1645fd6fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088263 Oct 11 01:22:04.937511 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 666/1348] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:05.184329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9eda71a0-42c9-46f5-a3a2-5f01e141d621 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f112f9dd0d0>, body: {"keypair": {"name": "tempest-keypair-571868744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrJww4cwMVcJdHFYpLMY8asTEU36eIy2a8pO3KAW3af6BCXKlW2eKfquA60Q7LhW3smiznkSWLLWYIEVWB1fFs+ZFUcj4eFG2pwnMpDNNKYYHm22fegow56NO8LTNpa2Q=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:05.255875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9eda71a0-42c9-46f5-a3a2-5f01e141d621 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:05.279303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9eda71a0-42c9-46f5-a3a2-5f01e141d621 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:05.313393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:05.314604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:05.328617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:05.331755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:05.333312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:05.334777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:05.336259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:05.338393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:05.352117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:05.376705 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9eda71a0-42c9-46f5-a3a2-5f01e141d621 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.782396 Oct 11 01:22:05.381500 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 683/1349] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:05.404839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c214fa4-b5d8-4b55-be0f-a5573fdd3411 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f79f790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:05.481821 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c214fa4-b5d8-4b55-be0f-a5573fdd3411 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-571868744" status: 200 len: 497 microversion: 2.1 time: 0.092167 Oct 11 01:22:05.483452 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 684/1350] 10.222.0.66 () {58 vars in 1215 bytes} [Tue Oct 11 01:22:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-571868744 => generated 497 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:05.512272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2af8441-0c94-46d6-8e2b-e8735dc27640 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f8f0160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:05.602782 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2af8441-0c94-46d6-8e2b-e8735dc27640 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571868744" status: 202 len: 0 microversion: 2.1 time: 0.105191 Oct 11 01:22:05.605573 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 685/1351] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:22:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571868744 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:05.633025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:05.644347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:05.708352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:05.708890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:05.709331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:05.713244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:05.717188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:05.717668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:05.958629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:05.970987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f908de7-2997-4436-b908-0460bc63ddd2 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1473 microversion: 2.1 time: 0.659859 Oct 11 01:22:05.971948 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 667/1352] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:05 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1473 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:05.981283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8eee6df6-9cc7-4692-8b76-75e3bd2144e8 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f11341cfd30>, body: {"keypair": {"name": "tempest-keypair-1857772934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGS3OvtUP+XSXc1Y33foWNlK4/1aobHZy7yvJc9HW8XKEDS8neytmOZK1bXdFYsaiEnffYxNX0VHpRHAsR0vP4VtODSNFZ3TRXyIuK/jcB0q0/z9jbQ6HXxREFCEpo2SsQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:06.018705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-8eee6df6-9cc7-4692-8b76-75e3bd2144e8 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:06.029051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-8eee6df6-9cc7-4692-8b76-75e3bd2144e8 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:06.092052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8eee6df6-9cc7-4692-8b76-75e3bd2144e8 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119016 Oct 11 01:22:06.093045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 668/1353] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:06.101697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.103061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:06.117688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.118370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.118975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.121524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.122160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.125767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.141730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:06.153786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eaa206c3-48b4-4e3c-ae55-dc1549fdcebf tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.546645 Oct 11 01:22:06.156301 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 686/1354] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:05 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:06.175066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73e2cda2-518b-4c5b-9e7c-82102e34e6b6 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f93c8b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.228501 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73e2cda2-518b-4c5b-9e7c-82102e34e6b6 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857772934" status: 202 len: 0 microversion: 2.1 time: 0.070956 Oct 11 01:22:06.229471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 687/1355] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857772934 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:06.240742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38cef323-878a-4e03-ad71-c95f4238208e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f112f9cec10>, body: {"keypair": {"name": "tempest-keypair-2028782788", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:06.281271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-38cef323-878a-4e03-ad71-c95f4238208e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:06.297469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-38cef323-878a-4e03-ad71-c95f4238208e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:06.348309 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38cef323-878a-4e03-ad71-c95f4238208e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.111674 Oct 11 01:22:06.349763 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 688/1356] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:06 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:06.364484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34d10315-1e97-471e-806c-37c00e32763e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f8f0af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.399777 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34d10315-1e97-471e-806c-37c00e32763e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028782788" status: 202 len: 0 microversion: 2.1 time: 0.040607 Oct 11 01:22:06.400638 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 689/1357] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028782788 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:22:06.419361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c2fc1cc-7e6e-453a-84ea-2c0af23d49a7 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f112f8214c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1973323464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmpoIAGrxjowxzwKMq7eG5ZGTyx/bxLfG91ph3ukWpdG2ASJ7lqs+1rSqLe0PaXxSPIB4V+dfk60Lzy7clzYrWFz1BHBQ1SssmL4EnXA93iKX8URt6lA1ilJ6UsfbA5ew=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:06.466893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1c2fc1cc-7e6e-453a-84ea-2c0af23d49a7 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:06.483241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1c2fc1cc-7e6e-453a-84ea-2c0af23d49a7 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:06.556780 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c2fc1cc-7e6e-453a-84ea-2c0af23d49a7 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.141508 Oct 11 01:22:06.557669 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 690/1358] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:06.581483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ed18d7b-d619-4c91-a818-8d2009bbcd13 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f112f7e7ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-34859685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCbpARK+RktNpSVtN5qXnFkTNYbcnVlmC+qB/duDmBZHyaimicQ0kEOH5FtCm24ZpLeRnRrx1Dmf3hxjIfI20GM4SrDJBre6XNNFIJV/8poY/3F60gF4U9AwnINatP6gw=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:06.616391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ed18d7b-d619-4c91-a818-8d2009bbcd13 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:06.630756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ed18d7b-d619-4c91-a818-8d2009bbcd13 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:06.683098 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ed18d7b-d619-4c91-a818-8d2009bbcd13 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.107378 Oct 11 01:22:06.684370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 691/1359] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:06.692246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.694990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:06.712186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.713000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.713677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.714623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.716645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.717305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.719075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:06.737069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2128cfb-eefc-491c-b498-63cdbb066b1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.638360 Oct 11 01:22:06.737741 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 669/1360] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:06 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:06.743515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] HTTP exception thrown: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Request method failure captured: Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f HTTP/1.1 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMSJnis4X5AHzMtFNFmjJHuuJhtNLkEEy2YO1y8qrII4MaKpn2PJKVZ9hDZKyW_m9lJ94RrJwy1bqkYvaXQhaUHiXaVK6Xjq1HFFzYho0rZl9HFDyCdMX7rJ2-GBV0GmutIDYod-bNGyMEMVNjqksSsn3fTq4No1KcXfNZUNyXd5GxM Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:06.745801 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a64f02fbbacc4854806187f139193dd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c0d3518c0db846b3818f4fe49f4837d8 Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.747202 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9b40f057-9cff-444d-a0be-b3fb1f75697f'} Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:06.748012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.749236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.760104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a597e39-2293-4f68-a4e5-35c605523253 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Action: 'create', calling method: .version_select at 0x7f1134218280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-854210769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5Xfkjm2bxVKe8XdpgIX/j9n0959U4HzjMvDjqpz00GD0qr1vOghSCIFRjiZix/khVJBoGwMGFi8435i6ABWvEXLkT45EHCPJlthnVkcbH3xte8E2caj9QoMr1pPde/A=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:06.773764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Returning 404 to user: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:06.775096 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6ab833b-0b53-4c69-8a91-b6cfd2772295 tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 404 len: 111 microversion: 2.1 time: 0.089502 Oct 11 01:22:06.776013 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 692/1361] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:06 2022] DELETE /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:06.787270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.788210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] [instance: 9b40f057-9cff-444d-a0be-b3fb1f75697f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:06.800057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.800291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.800708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.801406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:06.801860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:06.802284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:06.842322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7a597e39-2293-4f68-a4e5-35c605523253 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:06.848155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] HTTP exception thrown: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Request method failure captured: Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f HTTP/1.1 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMSJnis4X5AHzMtFNFmjJHuuJhtNLkEEy2YO1y8qrII4MaKpn2PJKVZ9hDZKyW_m9lJ94RrJwy1bqkYvaXQhaUHiXaVK6Xjq1HFFzYho0rZl9HFDyCdMX7rJ2-GBV0GmutIDYod-bNGyMEMVNjqksSsn3fTq4No1KcXfNZUNyXd5GxM Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:06.851428 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a64f02fbbacc4854806187f139193dd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a64f02fbbacc4854806187f139193dd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a64f02fbbacc4854806187f139193dd9 Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1790364586 Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: c0d3518c0db846b3818f4fe49f4837d8 Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1790364586-project Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.852813 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9b40f057-9cff-444d-a0be-b3fb1f75697f'} Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:06.853571 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. Oct 11 01:22:06.854929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:06.857010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7a597e39-2293-4f68-a4e5-35c605523253 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Getting quotas for user 50f160d8414b40f599dd00fb07bec29a and project 1c8e460d1a6a4578bbb41628ae1ae592. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:06.858475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] Returning 404 to user: Instance 9b40f057-9cff-444d-a0be-b3fb1f75697f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:06.860488 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a467cb7-49f6-409a-ba70-582c7aa349af tempest-AttachSCSIVolumeTestJSON-1790364586 tempest-AttachSCSIVolumeTestJSON-1790364586-project] 10.222.0.66 "GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f" status: 404 len: 111 microversion: 2.1 time: 0.080080 Oct 11 01:22:06.862672 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 693/1362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:06 2022] GET /compute/v2.1/servers/9b40f057-9cff-444d-a0be-b3fb1f75697f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:22:06.963892 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a597e39-2293-4f68-a4e5-35c605523253 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.222524 Oct 11 01:22:06.965601 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 670/1363] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:22:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:06.984300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c117088-9d89-4d49-ae12-8881318e6300 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f9ce3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:06.992576 n-d-772273-9 devstack@n-api.service[120493]: WARNING oslo_db.sqlalchemy.utils [None req-5c117088-9d89-4d49-ae12-8881318e6300 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 01:22:07.013772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c117088-9d89-4d49-ae12-8881318e6300 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.033286 Oct 11 01:22:07.018930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.019210 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 694/1364] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:22:06 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:07.019980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:07.032200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.038846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.041394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.044130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.044790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6df44d8b-bba8-4cd9-b44a-bf3f28775be3 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f7e7d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.045859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.049206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.117677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6df44d8b-bba8-4cd9-b44a-bf3f28775be3 tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-854210769" status: 202 len: 0 microversion: 2.1 time: 0.082164 Oct 11 01:22:07.118893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 695/1365] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-854210769 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:07.137806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-788260a6-05d8-4f46-b336-e92b376e893e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f112f8f0820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.209548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-788260a6-05d8-4f46-b336-e92b376e893e tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-34859685" status: 202 len: 0 microversion: 2.1 time: 0.084451 Oct 11 01:22:07.212636 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 696/1366] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-34859685 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:22:07.232985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.233615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:07.253402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.253992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.255186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.257257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.258799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.259281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.405455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:07.417140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d0b9e8f-df9a-4ea4-b694-258d062d7ced tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1431 microversion: 2.1 time: 0.404944 Oct 11 01:22:07.421561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 671/1367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:07 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1431 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:07.429480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-720e2dd1-089e-4987-9fc5-ac96ca74c5dc tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] Calling method '.version_select at 0x7f11349c4f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.538164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-720e2dd1-089e-4987-9fc5-ac96ca74c5dc tempest-KeyPairsV2TestJSON-698970843 tempest-KeyPairsV2TestJSON-698970843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1973323464" status: 202 len: 0 microversion: 2.1 time: 0.115224 Oct 11 01:22:07.544506 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 672/1368] 10.222.0.66 () {58 vars in 1278 bytes} [Tue Oct 11 01:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1973323464 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:07.571790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ed873-8c70-481a-802c-1310a15857d4", "name": "network-vif-deleted", "tag": "448419e2-b69f-4aac-8488-5b55b906f97f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:07.608977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.609863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.610497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.635655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] Creating event network-vif-deleted:448419e2-b69f-4aac-8488-5b55b906f97f for instance 514ed873-8c70-481a-802c-1310a15857d4 on n-h2-772273-9 Oct 11 01:22:07.653459 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-952ef98c-bb47-4f3d-a312-f11b8f836185 req-dea65865-43fe-48db-8289-3eef574624bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107023 Oct 11 01:22:07.656666 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 673/1369] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:07.667935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fb84e7-8a64-4b1c-90d5-c1b8738600a7", "name": "network-vif-plugged", "status": "completed", "tag": "0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:07.690212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:07.693741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.694242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.694676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.732133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] Creating event network-vif-plugged:0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c for instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 on n-h1-772273-9 Oct 11 01:22:07.745770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f0a29f92-93cc-439e-9909-b9270675b92d req-395150d9-5128-4504-9235-075fd3added1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083138 Oct 11 01:22:07.747127 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 674/1370] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:07.802756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:07.803932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:07.846402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.846899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.847444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.848404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:07.853699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:07.855356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:07.856577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:07.867916 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba832a3b-c540-4c96-a5c8-8b22c1804d7a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.651592 Oct 11 01:22:07.889491 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 697/1371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:07 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:08.353753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:08.363542 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf3fd723-4eea-4d6d-9c97-d0174a59fd40 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.574257 Oct 11 01:22:08.365574 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 675/1372] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:07 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:08.466664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:08.467318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:08.491260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:08.491856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:08.492312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:08.493072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:08.493531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:08.493962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:08.566061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:08.638031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:08.638536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:08.643516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:08.644054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid 514ed873-8c70-481a-802c-1310a15857d4 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:08.897237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:08.898222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:08.910690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:08.911565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:08.912189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:08.914367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:08.914848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:08.915315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:09.177003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:09.185628 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11d37a0a-833b-402e-a135-e392a13941dd tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 200 len: 1307 microversion: 2.1 time: 0.723134 Oct 11 01:22:09.202996 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 698/1373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:08 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 1307 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:09.202996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c003e43-241a-460c-9966-ff9574d4a5e3", "device": "/dev/xvdb"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:09.202996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:09.210189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:09.210696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:09.211138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:09.212559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:09.213033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:09.213466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:09.548693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c17536b-babd-4cbe-82a5-56f07b35c711 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.358728 Oct 11 01:22:09.549803 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 699/1374] 10.222.0.66 () {62 vars in 1364 bytes} [Tue Oct 11 01:22:09 2022] POST /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:22:09.557848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:09.564600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:09.568692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:09.574668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-196a27f3-1282-4de4-ba07-8a4f1b7da872 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1314 microversion: 2.1 time: 0.681182 Oct 11 01:22:09.575820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 676/1375] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:08 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:09.584887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:09.585419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:09.586003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:09.586725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:09.587181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:09.587643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:09.837975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:09.847571 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9958b3cd-7f47-418f-a623-f845757b6c2c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.295791 Oct 11 01:22:09.848520 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 700/1376] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:09 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:10.215041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:10.216616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 514ed873-8c70-481a-802c-1310a15857d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:10.231008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.233686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.234252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.236558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.237135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.238423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.283776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 HTTP/1.1 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:10.289348 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. Oct 11 01:22:10.291026 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '514ed873-8c70-481a-802c-1310a15857d4'} Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:10.291977 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. Oct 11 01:22:10.293451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:10.300181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance 514ed873-8c70-481a-802c-1310a15857d4 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:10.304485 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5090766-5808-4694-a5b9-4ba4ae81ec6a tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4" status: 404 len: 111 microversion: 2.1 time: 0.094532 Oct 11 01:22:10.307280 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 677/1377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:10 2022] GET /compute/v2.1/servers/514ed873-8c70-481a-802c-1310a15857d4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:10.317622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:10.318634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:10.331751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.334652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.335679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.336859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.338600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.339584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.374256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:10.583049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-84e75120-5121-4b2a-9bcc-feb5be0c7b57 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 204 len: 0 microversion: 2.1 time: 0.271065 Oct 11 01:22:10.584700 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 701/1378] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:10 2022] DELETE /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:10.601297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:10.602116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:10.605276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:10.606008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:10.612243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.613964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.615223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.616365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.617073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.618201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.626191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.626699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.627146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.627888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.628350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.628777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.708228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:10.859976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-457e51e7-08a5-4b97-9290-d6932a3c86e9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 204 len: 0 microversion: 2.1 time: 0.270298 Oct 11 01:22:10.862887 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 678/1379] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:10 2022] DELETE /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:10.871920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:10.878032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:10.885045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.885658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.886317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:10.887810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:10.888516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:10.889600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:11.067485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:11.082910 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-44adfa98-bd71-4b2b-8fa1-9b23bb555e98 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1464 microversion: 2.1 time: 0.484314 Oct 11 01:22:11.086474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 702/1380] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:10 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1464 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:11.091263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:11.097920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:11.104970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:11.105457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:11.106074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:11.106930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:11.107789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:11.108418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:11.289500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:11.297492 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10afe8d0-19d5-47f2-8414-d22dbb8563af tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1474 microversion: 2.1 time: 0.429910 Oct 11 01:22:11.298110 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 679/1381] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:10 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:11.323506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:11.324125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:11.342754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:11.343532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:11.344159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:11.345072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:11.345710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:11.346287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:11.684659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:11.705321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07624af1-f0fd-45c8-bf8d-4d41f385819e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.617671 Oct 11 01:22:11.706370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 703/1382] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:11 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:11.876573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:11.892711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23107376-dab3-471a-a8e6-bdd716aa85d3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1464 microversion: 2.1 time: 0.572951 Oct 11 01:22:11.893521 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 680/1383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:11 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1464 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:12.314160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-991359126", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4d60df1f-1573-4625-a01a-f528e9418492"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:12.325283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:12.325892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:12.348889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:12.349605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:12.350973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:12.353085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:12.354146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:12.355135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:12.413962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:12.451032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:22:13.236296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:13.251781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c080068b-4d9e-49dc-9fbb-030a513cce8d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1474 microversion: 2.1 time: 0.931576 Oct 11 01:22:13.254025 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 681/1384] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:12 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1474 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:13.264624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:13.267634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:13.283981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:13.284861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:13.285545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:13.286463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:13.288612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:13.289596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:13.485517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:22:13.486094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:22:13.486417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:22:13.486836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:22:13.487450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:22:13.510188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:13.511123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:13.512468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:13.516024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:13.517442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:13.520140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:13.578300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:13.598451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Getting quotas for user 825933c38eef4b7792bfe66e5a07ae88 and project c3f2320ac975413cb4401b9c082c6a1a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:13.646756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:13.650500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:22:13.657289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:22:13.769940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a98a33f-a3cf-41c0-a170-ce0bd9f6d281 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460095 Oct 11 01:22:13.779470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 704/1385] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:22:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:22:13.786107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6710e235-1529-423f-b9ce-0b2c0275f297 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:13.796517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6710e235-1529-423f-b9ce-0b2c0275f297 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:13.984165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6710e235-1529-423f-b9ce-0b2c0275f297 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:13.996552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6710e235-1529-423f-b9ce-0b2c0275f297 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1213 microversion: 2.1 time: 0.215196 Oct 11 01:22:13.998735 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 705/1386] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:13 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1213 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:14.280787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:14.281861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:14.285606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:14.293360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:14.295660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:14.296227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:14.298881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:14.299803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:14.301078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:14.303151 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ae31266-7410-4731-9022-49d20c3a151c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 1.047827 Oct 11 01:22:14.306905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 682/1387] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:13 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:14.341870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17139ecc-1465-4024-82c0-9971555ad18d", "name": "network-vif-deleted", "tag": "a790adbf-be2a-4530-882c-1678bfb4654a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:14.369208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:14.369759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:14.375131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:14.409754 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] Creating event network-vif-deleted:a790adbf-be2a-4530-882c-1678bfb4654a for instance 17139ecc-1465-4024-82c0-9971555ad18d on n-h2-772273-9 Oct 11 01:22:14.422308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-54c2020b-c896-41ff-a276-1802b65a2ab6 req-3b7c3b0f-7e5b-4ab6-a621-670fbfc5164b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084135 Oct 11 01:22:14.425972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 683/1388] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:14.760832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "name": "network-vif-unplugged", "status": "completed", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:14.817383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:14.835147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:14.837376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:14.838134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:14.838276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:14.844327 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-156f563a-dd3d-4e11-b192-5ec857ba1014 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 200 len: 1432 microversion: 2.1 time: 0.567611 Oct 11 01:22:14.865100 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 706/1389] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:14 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 1432 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:14.923605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] Creating event network-vif-unplugged:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h2-772273-9 Oct 11 01:22:14.929473 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b0331cd6-9c80-4d02-8ef1-cf27ccefc621 req-6823d02a-ad66-4a9a-b25c-8986509e4d5d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173661 Oct 11 01:22:14.930285 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 684/1390] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:15.029346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-448a55e9-1223-462a-a827-c070bf3b303e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:15.030236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-448a55e9-1223-462a-a827-c070bf3b303e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:15.335371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:15.340404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-448a55e9-1223-462a-a827-c070bf3b303e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:15.348407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:15.355204 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-448a55e9-1223-462a-a827-c070bf3b303e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1213 microversion: 2.1 time: 0.329874 Oct 11 01:22:15.355853 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 707/1391] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:15 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:15.372695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:15.373207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:15.373652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:15.374385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:15.374845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:15.375283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:15.870391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:15.871156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 17139ecc-1465-4024-82c0-9971555ad18d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:15.891114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:15.896512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:15.896983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:15.897749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:15.904136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:15.904602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:15.956369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d HTTP/1.1 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:15.961764 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. Oct 11 01:22:15.963375 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '17139ecc-1465-4024-82c0-9971555ad18d'} Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:15.964275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. Oct 11 01:22:15.965789 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:15.967104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance 17139ecc-1465-4024-82c0-9971555ad18d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:15.967104 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a46627cf-e37c-49d3-9245-708cddc58a7d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d" status: 404 len: 111 microversion: 2.1 time: 0.096845 Oct 11 01:22:15.970700 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 708/1392] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:15 2022] GET /compute/v2.1/servers/17139ecc-1465-4024-82c0-9971555ad18d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:15.981386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:15.982267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:16.005826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:16.011232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:16.020329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:16.020791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:16.021566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:16.021782 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd310e1c-1291-4636-9c8d-72ccc7f0a1c9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.691171 Oct 11 01:22:16.022047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:16.024364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:16.056007 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 685/1393] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:15 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:16.127221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:16.145978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f924446-6e7f-436b-a29a-6f03453f42c6 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1304 microversion: 2.1 time: 0.163346 Oct 11 01:22:16.146655 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 709/1394] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:15 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:16.380437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:16.381663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:16.398526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:16.399031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:16.399518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:16.400233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:16.402997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:16.409476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:16.441050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b48ea2aa-3a84-4e8b-b069-76b3829cee32", "name": "network-vif-deleted", "tag": "80621522-668f-4906-b7c7-63818e9c6053"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:16.463570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:16.464062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:16.464498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:16.507997 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] Creating event network-vif-deleted:80621522-668f-4906-b7c7-63818e9c6053 for instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 on n-h1-772273-9 Oct 11 01:22:16.521322 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d7fb72f8-c6ee-4ee3-8082-9a3664412ba0 req-445e0c8e-dd0b-46ad-8f2b-3216013efa52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084685 Oct 11 01:22:16.522679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 710/1395] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:16.557867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:16.575821 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8f6a0ae-da20-4559-9c29-cc8e2402561a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1265 microversion: 2.1 time: 0.200247 Oct 11 01:22:16.578126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 686/1396] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:16 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:17.077584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:17.079905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:17.111860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.112377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.115688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.116487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.116969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.117411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.169226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:17.170324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:17.175203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:17.187870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.191153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.192619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.194392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.195727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.203206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.302077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.302608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.303037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.303785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid b48ea2aa-3a84-4e8b-b069-76b3829cee32 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:17.402902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:17.422889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5bd3b935-c22d-45fa-a64f-ca203f052ba9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 200 len: 1309 microversion: 2.1 time: 0.256975 Oct 11 01:22:17.426846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 687/1397] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:17 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:17.532229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:17.545987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-741e5830-7b5d-4215-8a3f-fa695006e0fe tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.473053 Oct 11 01:22:17.549584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 711/1398] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:17 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:17.602132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:17.602761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:17.611242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.620359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.620833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.621609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:17.622090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:17.622531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:17.854419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:17.868165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f7a8962-dedf-4c9f-96f9-596d7431baf0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1271 microversion: 2.1 time: 0.269741 Oct 11 01:22:17.886699 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 688/1399] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:17 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:18.456913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:18.458227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: b48ea2aa-3a84-4e8b-b069-76b3829cee32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:18.468907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.469953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.470405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.471128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.476953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.477599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.510561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:18.527188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.527704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.528138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.531081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 HTTP/1.1 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:18.541152 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. Oct 11 01:22:18.542762 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b48ea2aa-3a84-4e8b-b069-76b3829cee32'} Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:18.543551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. Oct 11 01:22:18.544995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:18.546353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance b48ea2aa-3a84-4e8b-b069-76b3829cee32 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:18.546353 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e43118df-6583-4d7b-af1b-2f78407297fc tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32" status: 404 len: 111 microversion: 2.1 time: 0.090598 Oct 11 01:22:18.546530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 689/1400] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:18 2022] GET /compute/v2.1/servers/b48ea2aa-3a84-4e8b-b069-76b3829cee32 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:18.555388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1068871c-da8d-4932-bcb0-55d38786170c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:18.581228 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] Creating event network-changed:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h2-772273-9 Oct 11 01:22:18.593247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4890f852-ce20-4b3f-ba11-4a87fa5ba6dc req-e2a3dfe1-1ba7-4aa9-99fe-0054ea839d73 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403780 Oct 11 01:22:18.593884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 712/1401] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:18.603835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:18.604627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:18.618894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.621520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.622013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.623992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.624476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.627107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.633567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1068871c-da8d-4932-bcb0-55d38786170c tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/a25b04f5-cea5-4df1-b053-60478905d1a9" status: 204 len: 0 microversion: 2.1 time: 0.085985 Oct 11 01:22:18.634459 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 690/1402] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:22:18 2022] DELETE /compute/v2.1/os-server-groups/a25b04f5-cea5-4df1-b053-60478905d1a9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:18.642367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:18.642869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:18.657757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.658688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.659302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.660258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.660885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.661654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.714583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:18.879693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb785229-9b8d-44df-acf9-d9988cd5853f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 204 len: 0 microversion: 2.1 time: 0.240210 Oct 11 01:22:18.884348 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 691/1403] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:18 2022] DELETE /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:22:18.896545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:18.897581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:18.926929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.931442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.932171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:18.937172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:18.937920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:18.938555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:19.005999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:19.174160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03d679f7-2a2f-41a3-a94d-ec259f5df2c4 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 204 len: 0 microversion: 2.1 time: 0.287807 Oct 11 01:22:19.180216 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 692/1404] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:18 2022] DELETE /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:19.191696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:19.192788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:19.213713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:19.214239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:19.214668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:19.216010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:19.216470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:19.216916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:19.556062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:19.576011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fc2f9f9-c5bc-4c9b-bf8d-8697d621cd29 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.979946 Oct 11 01:22:19.602876 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 713/1405] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:18 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:19.603198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:19.604162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:19.613366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:19.615049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:19.615534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:19.616370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:19.617079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:19.617521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:19.756955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:19.771040 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca066616-e117-4e32-b755-f6f1dc02cf74 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.589175 Oct 11 01:22:19.771683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 693/1406] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:19 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:19.975969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:19.987987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a0ad8d7-0fd9-4baa-be87-e6b3f19204e5 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1474 microversion: 2.1 time: 0.394978 Oct 11 01:22:19.989529 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 714/1407] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:19 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:20.614315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:20.614940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:20.622620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:20.623286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:20.623936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:20.624918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:20.625948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:20.626549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:20.673575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69a6004-0cce-4e57-97e1-838d447161d7", "tag": "5b2da5b2-404f-4e29-be04-f5d5f63904bc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:20.689422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:20.690717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:20.691952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:20.715422 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] Creating event network-changed:5b2da5b2-404f-4e29-be04-f5d5f63904bc for instance e69a6004-0cce-4e57-97e1-838d447161d7 on n-h1-772273-9 Oct 11 01:22:20.722945 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-22fe86e5-f54c-4269-935e-1b2320307713 req-cd60d2e7-b3ed-409c-9b21-e60142a8984a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056308 Oct 11 01:22:20.724781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 715/1408] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:20.794772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:20.796135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:20.819294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:20.821969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:20.825362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:20.826321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:20.827084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:20.827704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:21.081282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:21.093041 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ffb9055-89e0-4833-a3f9-ed197b3dcb79 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.302757 Oct 11 01:22:21.093669 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 716/1409] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:20 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:21.130420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:21.131149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:21.147919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:21.148438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:21.148889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:21.149628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:21.150091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:21.150521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:21.203355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:21.603707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:21.613713 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d826937a-1fc0-49f6-bca8-85a292b2f5b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 1.003795 Oct 11 01:22:21.614323 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 694/1410] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:20 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:21.757377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:21.770771 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad5c5471-4a68-4552-a900-b5937acd5fa3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1474 microversion: 2.1 time: 0.657097 Oct 11 01:22:21.774801 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 717/1411] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:21 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1474 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:22.120814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:22.122727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:22.132346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.134212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.136546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:22.139090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.145485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.145971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:22.541700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:22.553711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46f1271b-ef52-4805-a277-d3d1cb75bd3a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.436157 Oct 11 01:22:22.555474 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 695/1412] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:22 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:22.642592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:22.644065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:22.658302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.659098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.659726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:22.661694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.667758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.668455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:22.802167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:22.803738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:22.811618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.812538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.813743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:22.814702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:22.815539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:22.816817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:23.078939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:23.088290 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5946c245-23c0-4c80-a086-faba5f9248a1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.451897 Oct 11 01:22:23.093696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 718/1413] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:22 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:23.181989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:23.196299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1083935c-b550-4e33-87ae-01c1362bcd8f tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1474 microversion: 2.1 time: 0.397955 Oct 11 01:22:23.219595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 696/1414] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:22 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1474 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:23.324239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f7e11-9006-4dc7-a4a5-58a95068f375", "name": "network-vif-deleted", "tag": "7f4e02dc-ceee-4246-b8c1-7722209fcaf0"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:23.338722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:23.339436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:23.340181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:23.354138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] Creating event network-vif-deleted:7f4e02dc-ceee-4246-b8c1-7722209fcaf0 for instance 902f7e11-9006-4dc7-a4a5-58a95068f375 on n-h2-772273-9 Oct 11 01:22:23.361001 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-92c5ed37-2ec3-4251-903b-7d108fbb66a2 req-25aec062-d720-4a26-b08d-fc85250be9b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041754 Oct 11 01:22:23.361831 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 719/1415] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:23.589074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:23.589816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:23.605922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:23.606695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:23.608518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:23.611281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:23.611991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:23.613582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:23.656929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:24.115671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:24.122659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:24.123868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:24.142223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:24.143119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:24.144259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:24.148943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:24.150262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:24.153657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:24.581189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:24.598827 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9d70b0f-4117-4543-9212-9c6b6a30afb7 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 1.022640 Oct 11 01:22:24.618942 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 697/1416] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:23 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:24.627254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:24.628274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:24.642383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:24.646087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:24.646842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:24.652311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:24.653660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:24.659048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:24.794619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:24.809957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:24.811104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:24.813165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid 902f7e11-9006-4dc7-a4a5-58a95068f375 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:25.162186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:25.176613 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e55d0416-12ee-45f1-bad9-d8cc3f63b0c3 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 200 len: 1308 microversion: 2.1 time: 0.555389 Oct 11 01:22:25.180987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 698/1417] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:24 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:25.196500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd54c1bd-080d-4b3f-9a69-fe67157d184e", "name": "network-vif-deleted", "tag": "2a84befb-c734-4e0e-98b6-1411d85de481"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:25.210943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:25.213152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:25.214886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:25.235616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] Creating event network-vif-deleted:2a84befb-c734-4e0e-98b6-1411d85de481 for instance cd54c1bd-080d-4b3f-9a69-fe67157d184e on n-h2-772273-9 Oct 11 01:22:25.241835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-78f447ab-e8db-4163-9104-a78afdfcfd9f req-fba5a93d-40d6-4b5c-8ed1-20a34c659988 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056117 Oct 11 01:22:25.243213 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 699/1418] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:25.344719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=26 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:25.608263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bf9a1d5-89f9-46a4-bed9-f3186b5a9aac tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f11349f9790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1028804244", "description": "tempest-description-1541112849"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:26.045660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:26.061450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da60c3ba-78df-431a-b9cc-1b536919b821 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 1.946974 Oct 11 01:22:26.081039 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 720/1419] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:24 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:26.087871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:26.088849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:26.096313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.097090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.097784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.099194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.099927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.102755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.588762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:26.627658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e12f7f0d-8e29-4bfb-bc3c-f5eaf3a561d7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 2421 microversion: 2.25 time: 0.542386 Oct 11 01:22:26.629465 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 721/1420] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:26 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 2421 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:26.641591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:26.642559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:26.661000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.663818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.664776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.665794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.667979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.672225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.716641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bf9a1d5-89f9-46a4-bed9-f3186b5a9aac tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.471790 Oct 11 01:22:26.717833 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 700/1421] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:25 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:26.723726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:26.724710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 902f7e11-9006-4dc7-a4a5-58a95068f375] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:26.744481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.745719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.748222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.749167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.749857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.750479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.770969 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 HTTP/1.1 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:26.774322 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. Oct 11 01:22:26.775975 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '902f7e11-9006-4dc7-a4a5-58a95068f375'} Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:26.776789 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. Oct 11 01:22:26.778237 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:26.782300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance 902f7e11-9006-4dc7-a4a5-58a95068f375 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:26.783968 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a25dce47-b007-456f-8e45-cc4cc8a4f638 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375" status: 404 len: 111 microversion: 2.1 time: 0.063790 Oct 11 01:22:26.785020 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 701/1422] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:26 2022] GET /compute/v2.1/servers/902f7e11-9006-4dc7-a4a5-58a95068f375 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:26.794572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": "auto"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:26.806562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:26.825953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.826833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.827475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.832260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:26.833033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:26.833775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:26.877820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'flavor' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:26.896273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:22:26.943461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:26.951753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85a26f8e-547c-43ab-bdd6-4c2b9ab7672c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.320927 Oct 11 01:22:26.953706 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 722/1423] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:26 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:26.961725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8195bfba-64ac-46cd-8d46-7655c1605521 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112f794820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-789505958", "description": "tempest-description-822117959"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:27.204941 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8195bfba-64ac-46cd-8d46-7655c1605521 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.249293 Oct 11 01:22:27.206439 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 723/1424] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:27.227370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:27.228734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: cd54c1bd-080d-4b3f-9a69-fe67157d184e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:27.236299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:27.236977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:27.237611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:27.239003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:27.239764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:27.240383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:27.269879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e HTTP/1.1 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:27.277637 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. Oct 11 01:22:27.279647 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'cd54c1bd-080d-4b3f-9a69-fe67157d184e'} Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:27.280601 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. Oct 11 01:22:27.282656 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:27.288008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance cd54c1bd-080d-4b3f-9a69-fe67157d184e could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:27.290832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-680d6633-981c-451e-84ca-95cec99a707d tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e" status: 404 len: 111 microversion: 2.1 time: 0.082515 Oct 11 01:22:27.297197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 724/1425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:27 2022] GET /compute/v2.1/servers/cd54c1bd-080d-4b3f-9a69-fe67157d184e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:27.308879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:27.314931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:27.331120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:27.333560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:27.334192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:27.336351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:27.339095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:27.340004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:27.551179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:27.569564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ba09ca7-0a96-48ba-b0e0-efce74ba6ea6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.269075 Oct 11 01:22:27.571885 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 725/1426] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:27 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:27.578666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2cea9dbb-b8e4-4695-bfe3-1e18f41dae79 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:27.635576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2cea9dbb-b8e4-4695-bfe3-1e18f41dae79 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/ce89f7fc-bc42-410a-a72c-2aea6f3f025c" status: 204 len: 0 microversion: 2.1 time: 0.062041 Oct 11 01:22:27.639881 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 726/1427] 10.222.0.66 () {58 vars in 1266 bytes} [Tue Oct 11 01:22:27 2022] DELETE /compute/v2.1/os-server-groups/ce89f7fc-bc42-410a-a72c-2aea6f3f025c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:27.659756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-659814409", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "920a046a-0b3e-45d8-976e-a5a69b80241e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:27.814294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] validate_networks() for [('920a046a-0b3e-45d8-976e-a5a69b80241e', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:22:28.723176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:22:28.723780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:22:28.724092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:22:28.725177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:22:28.725601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:22:28.744361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:28.745521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:28.746214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:28.747366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:28.748051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:28.749087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:28.794382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Getting quotas for project 8e1e7c3ccbe1403fb5330faf6bb0d86a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:28.802589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Getting quotas for user f380eb4fd2b84ba9bfcb037a74dc2a9a and project 8e1e7c3ccbe1403fb5330faf6bb0d86a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:28.838457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:22:28.845415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:22:28.912926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33a82258-c084-4c54-95c6-938c83570c10 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270804 Oct 11 01:22:28.913919 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 727/1428] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:22:28.920246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:28.920489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:28.933028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:28.933528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:28.935244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:28.936388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:28.936929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:28.938088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:28.979393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:22:29.061793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afe3fad5-de8d-4fc5-b1a4-b801cc927c98 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/action" status: 202 len: 0 microversion: 2.25 time: 2.275199 Oct 11 01:22:29.066809 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 702/1429] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:22:26 2022] POST /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/action => generated 0 bytes in 2281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:29.072286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:29.073416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:29.098648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:29.099197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:29.102057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:29.104160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:29.104657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:29.106844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:29.316005 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d71f23c-ac01-4116-ba16-cf5bd5f95672 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 204 len: 0 microversion: 2.1 time: 0.400708 Oct 11 01:22:29.317273 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 728/1430] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:22:28 2022] DELETE /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:29.330446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:29.333198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:29.353145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:29.353979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:29.354920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:29.356323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:29.356889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:29.357326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:29.799664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:29.811153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26a6f34f-d65e-496f-8c15-24383cfb8700 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.742662 Oct 11 01:22:29.812503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 703/1431] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:29 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:29.822442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3d9f5fe-8634-4da7-8368-5ab2687a9baf tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:29.823160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3d9f5fe-8634-4da7-8368-5ab2687a9baf tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:29.962105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3d9f5fe-8634-4da7-8368-5ab2687a9baf tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:29.994116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:29.999877 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3d9f5fe-8634-4da7-8368-5ab2687a9baf tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1215 microversion: 2.1 time: 0.167784 Oct 11 01:22:30.002244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 704/1432] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:29 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:30.002613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dae954e8-d0de-4029-98cb-ae1fff74a2dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.683283 Oct 11 01:22:30.003514 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 729/1433] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:29 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:30.027002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:30.029416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:30.040664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:30.043473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.043646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:30.044175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.049766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.050852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.053797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.054503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.056768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.057326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.076620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.077501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.078798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.080197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.529067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:30.539971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fbd9d0c-623e-405f-83b6-8a56b8f5cf5e tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1472 microversion: 2.1 time: 0.518692 Oct 11 01:22:30.546008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 730/1434] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:30 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1472 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:30.559246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:30.571998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:30.576727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:30.580060 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa016d6b-2fe1-402d-8390-9f3ad52a180c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.574174 Oct 11 01:22:30.582422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 705/1435] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:30 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:30.848376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:30.851601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:30.876294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.877356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.878355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.880782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.881550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.883729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:30.966486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69a6004-0cce-4e57-97e1-838d447161d7", "name": "network-vif-plugged", "status": "completed", "tag": "5b2da5b2-404f-4e29-be04-f5d5f63904bc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:30.984309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:30.987215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:30.989809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.007522 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] Creating event network-vif-plugged:5b2da5b2-404f-4e29-be04-f5d5f63904bc for instance e69a6004-0cce-4e57-97e1-838d447161d7 on n-h1-772273-9 Oct 11 01:22:31.018345 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-64e37666-28db-4b71-a466-29ac5b10aedc req-2dc3f182-a92c-4814-a570-ac2c96270d41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470671 Oct 11 01:22:31.020057 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 731/1436] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:31.036604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:31.039232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:31.048314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.049931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.051118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.052107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.053222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.054199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.461455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:31.475671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c111e1b-eaeb-4b3c-a68e-5aebdc3ef623 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.639959 Oct 11 01:22:31.476284 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 706/1437] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:30 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:31.499857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:31.501372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:31.528712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.536508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.537224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.538977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.541677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.543726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.611501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:31.618473 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1218ef67-77c0-49ba-ab71-375d4ae2ae99 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.595424 Oct 11 01:22:31.619059 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 732/1438] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:31 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:31.636864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:31.637575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:31.645001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.645496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.645928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.646633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.647085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.647561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.790082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:31.801393 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0bbc39f0-79c2-4237-8318-45b417f7466b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1273 microversion: 2.1 time: 0.307312 Oct 11 01:22:31.803164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 707/1439] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:31 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:31.809456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:31.810671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:31.819052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.819920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.820632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:31.821605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:31.822369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:31.823029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:32.190489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:32.206122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86fd01aa-f386-4952-a454-0a5402b071e1 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1472 microversion: 2.1 time: 0.579116 Oct 11 01:22:32.206819 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 733/1440] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:31 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1472 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:32.273721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:32.287812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:32.290888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:32.292215 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c44ad8b-8a23-44a5-92ff-a3cc3d985cff tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.487154 Oct 11 01:22:32.292796 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 708/1441] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:31 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:32.503743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:32.504364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:32.513212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:32.513742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:32.514168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:32.515440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:32.515909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:32.521154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:32.644677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:32.645877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:32.658610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:32.661258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:32.663962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:32.664792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:32.665714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:32.667283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:32.671471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.008101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.038460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5570de6a-7868-4399-b9ef-ed2a7f1dcb8d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1313 microversion: 2.1 time: 0.538208 Oct 11 01:22:33.064212 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 734/1442] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:32 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:33.071562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d", "name": "network-vif-deleted", "tag": "96ab590e-c896-4430-a6f0-d28ad6c7c891"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:33.088659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.089446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.090087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.119235 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] Creating event network-vif-deleted:96ab590e-c896-4430-a6f0-d28ad6c7c891 for instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d on n-h1-772273-9 Oct 11 01:22:33.133453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c6d1addd-c4a3-45e1-80ed-c70db9c8caa0 req-11ced4a5-01d1-4aab-9eb0-4efe57cd82a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063672 Oct 11 01:22:33.144618 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 735/1443] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:33.158525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:33.172678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:33.186030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.187358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.187997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.198513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.200016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.200631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.413010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.425953 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dd9b0fb-13b0-429d-827d-a5da2c89b8c7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1717 microversion: 2.1 time: 0.787303 Oct 11 01:22:33.426913 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 709/1444] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:32 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1717 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:33.457369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:33.458030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:33.474380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.474890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.475361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.476082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.476887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.477325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.569397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.570189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.570806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.571632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lazy-loading 'fault' on Instance uuid 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:33.580292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.601943 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32492682-0934-4f9b-832f-d7a7d8105189 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.454955 Oct 11 01:22:33.603309 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 736/1445] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:33 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:33.623401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:33.625735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:33.630112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b34359d8c5a4ed2ab3cba5de60cd4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f58fbb4e51e4b0eb4dcdd8569c1e9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.638359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.639116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.639866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.640966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:33.641662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:33.642313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:33.643903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a53a5d62-9766-46de-89dd-a6dcc46bfdeb tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 200 len: 1307 microversion: 2.1 time: 0.213463 Oct 11 01:22:33.644516 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 710/1446] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:33 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:33.646387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:33.835498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.847823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.850353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:33.851892 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f33038b2-26a0-40a8-9cb6-27c3952cdd5b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.247056 Oct 11 01:22:33.853096 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 737/1447] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:33 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:34.066438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:34.067937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:34.075512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.076383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.077088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.078214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.078902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.079674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.354637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:34.364323 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e44c89c-e79a-4423-bd73-e8b6d93b520f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1463 microversion: 2.1 time: 0.302309 Oct 11 01:22:34.366627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 711/1448] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:34 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:34.454745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:34.455894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:34.464170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.465140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.465924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.466900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.467581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.468843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.735131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:34.745216 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5d8d978-3c76-4fa4-9def-48c39778f0fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1707 microversion: 2.1 time: 0.294894 Oct 11 01:22:34.759971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 712/1449] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:34 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1707 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:34.770718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:34.771658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:34.787798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.789783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.790418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.791654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.793917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.794564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.836784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:34.842167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'deleted': False, 'project_id': '6615c4c9a71b4099a5e7796e902074a1'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:34.855951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:34.861184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.866793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.867465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.868287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.868883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.869318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.923210 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-245e7844-e11e-4bee-a5ff-963de06d8d9c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.532261 Oct 11 01:22:34.924365 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 738/1450] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:22:34 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:34.943415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:34.949960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] [instance: 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:34.968786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.969786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.970452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.971664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:34.972369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:34.973231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:34.994289 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] HTTP exception thrown: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Request method failure captured: Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d HTTP/1.1 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMSLXKj5lDNL-oJx1LLYUxBE4ymz2K9zc0FRCfm06DEQvVhz1YSnC7z5OBANIXinPFHbFy2ARmVIUNuhdL7kL-IYdYYap-ICtgOfbQZAyTYfyB6EGmoUY5pMmR_208Z8Y_1EZ-wxr2jfM06OaUs83MUDfvyyfXDMYbES9341qM2AmRA Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:34.996649 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8f58fbb4e51e4b0eb4dcdd8569c1e9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8f58fbb4e51e4b0eb4dcdd8569c1e9e6 Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1615206646 Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3b34359d8c5a4ed2ab3cba5de60cd4aa Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersOnMultiNodesTest-1615206646-project Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. Oct 11 01:22:34.998111 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d'} Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:34.998927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. Oct 11 01:22:35.000783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:35.003358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] Returning 404 to user: Instance 8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:35.005186 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f229d4a-fa4d-463c-a308-3c9d34f2e0d9 tempest-ServersOnMultiNodesTest-1615206646 tempest-ServersOnMultiNodesTest-1615206646-project] 10.222.0.66 "GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d" status: 404 len: 111 microversion: 2.1 time: 0.079724 Oct 11 01:22:35.005961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 739/1451] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:34 2022] GET /compute/v2.1/servers/8bb0f9cb-1e0c-4ebb-8d0f-fb7c4138164d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:35.013785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f525297d-c7dc-41d3-87dd-765946c9b137 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '.version_select at 0x7f112f7b6c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:35.018399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f525297d-c7dc-41d3-87dd-765946c9b137 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:35.019211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f525297d-c7dc-41d3-87dd-765946c9b137 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:35.019945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f525297d-c7dc-41d3-87dd-765946c9b137 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:35.034723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f525297d-c7dc-41d3-87dd-765946c9b137 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.027338 Oct 11 01:22:35.036179 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 740/1452] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:22:35 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:35.051444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:35.054503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:35.064543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:35.065823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:35.066632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:35.067723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:35.068551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:35.070624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.010952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:36.020980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51eb244b-ff29-44b6-807f-aeece4cb2aa9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 1.259823 Oct 11 01:22:36.043115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 713/1453] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:34 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:36.058581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:36.072400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'deleted': False} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:36.088247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.088747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.089188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.089934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.090393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.090819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.121541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:36.141414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:36.142845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:36.144076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-899c4550-5d18-4c1b-af42-03753878b1fb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 1.106019 Oct 11 01:22:36.146712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 741/1454] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:35 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:36.173635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:36.177083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:36.190911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.201945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.202423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.203175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.203662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.204082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.266312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:22:36.297000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:36.417519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.418019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.418463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.561032 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7be71d7-31b2-4893-8762-782d49db1661 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1858 microversion: 2.1 time: 0.412627 Oct 11 01:22:36.562526 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 742/1455] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:36 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1858 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:36.568855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d782405a-8208-412d-af5b-0393f8078bdb", "tag": "de506e57-456e-439f-b896-b3ca9f95fbec"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:36.604085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.606180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.608298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.635674 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] Creating event network-changed:de506e57-456e-439f-b896-b3ca9f95fbec for instance d782405a-8208-412d-af5b-0393f8078bdb on n-h2-772273-9 Oct 11 01:22:36.649976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-92adda6e-f6c3-4577-a219-71d189c697f0 req-72565e87-4a80-4cf3-bd12-6a8c80d347b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083773 Oct 11 01:22:36.651799 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 743/1456] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:36.664648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:36.667040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:36.682233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.684148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.685178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.686311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:36.688195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:36.690248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:36.993885 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7f80f7a-978d-43a4-abb0-238cabe6bf04 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1858 microversion: 2.1 time: 0.340743 Oct 11 01:22:37.004335 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b18c678-b11c-4c33-9a03-9769444fca94 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 18392 microversion: 2.1 time: 0.958829 Oct 11 01:22:37.004938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 714/1457] 10.222.0.66 () {58 vars in 1171 bytes} [Tue Oct 11 01:22:36 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 18392 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:22:37.005385 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 744/1458] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:36 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1858 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:37.049204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:37.050421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:37.051096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:37.056657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'deleted': False, 'project_id': '6615c4c9a71b4099a5e7796e902074a1'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:37.056965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.057461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.057905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.058615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.059285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.067690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.072015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.072710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.073429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.074387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.075010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.075640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.134962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b29d1ec-06a6-45a5-8daf-97083cabad79 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?tenant_id=c3f2320ac975413cb4401b9c082c6a1a" status: 200 len: 15 microversion: 2.1 time: 0.087428 Oct 11 01:22:37.155965 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 745/1459] 10.222.0.66 () {58 vars in 1231 bytes} [Tue Oct 11 01:22:37 2022] GET /compute/v2.1/servers/detail?tenant_id=c3f2320ac975413cb4401b9c082c6a1a => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:37.163234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:37.163977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:37.172041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.172748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.173360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.174234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.174846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.175461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.301699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lazy-loading 'services' on Instance uuid 72e51375-b088-4724-ba57-79280f142f80 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:22:37.357529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:37.378112 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe7d0207-0722-490c-9704-63e966188f1f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.331419 Oct 11 01:22:37.381019 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 715/1460] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:37 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:37.391995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:37.414517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'tenant_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'deleted': False} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:37.431723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.434185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.434652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.436276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.437185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.443515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.457891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-202b0b26-4f7b-4cf7-969c-35f59b124f1d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments/37e1fd99-9007-4cca-8184-669b00f35b8b" status: 202 len: 0 microversion: 2.1 time: 0.300320 Oct 11 01:22:37.461389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 746/1461] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:22:37 2022] DELETE /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments/37e1fd99-9007-4cca-8184-669b00f35b8b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:37.468948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:37.469929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:37.477593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.479163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.479815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.481189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.481823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.483572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:37.542170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:22:37.714842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:37.715775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:37.716442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.034314 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a7da726-53a2-4e62-a538-6cf3e6d4dcc2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c3f2320ac975413cb4401b9c082c6a1a" status: 200 len: 4827 microversion: 2.1 time: 0.651381 Oct 11 01:22:38.036181 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 716/1462] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 01:22:37 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c3f2320ac975413cb4401b9c082c6a1a => generated 4827 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:38.041231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.043663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:38.061378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:38.068254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.068791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.069166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.069877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.070324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.076341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:38.078585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:38.080179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.081566 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-762055b7-a0b5-4889-8555-bba3bd6496cb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.618443 Oct 11 01:22:38.082730 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 747/1463] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:37 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:38.095629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.104014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'tenant_id': '6615c4c9a71b4099a5e7796e902074a1', 'deleted': False} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:38.112795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.113967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.114609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.115824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.116448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.117529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.166371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c94e2945-de5f-47b2-b72b-773d331614fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128894 Oct 11 01:22:38.175933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 717/1464] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:38.229139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5807f040-4e2c-40e7-82d9-e926885080b3 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6615c4c9a71b4099a5e7796e902074a1" status: 200 len: 15 microversion: 2.1 time: 0.144753 Oct 11 01:22:38.247085 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 748/1465] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6615c4c9a71b4099a5e7796e902074a1 => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:38.257060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2308b452-1734-444c-a013-5ff525f4873c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.262997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2308b452-1734-444c-a013-5ff525f4873c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009731 Oct 11 01:22:38.270821 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 718/1466] 10.222.0.66 () {58 vars in 1189 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:38.302708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:38.306608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:38.317416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.317989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.318446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.319171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.321869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.327800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.404910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.406523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:38.418206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.419029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.420332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.422783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.426734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.427805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.501400 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96778e84-0bc0-4c1d-8aec-ff2b140cf96e tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 0 microversion: 2.1 time: 0.204084 Oct 11 01:22:38.502071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 749/1467] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:38 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:38.510248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.523822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:38.524902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:38.537828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.539913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.540732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.546305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.547177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.547833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.588033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:22:38.629731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d4ecf48-5f02-4849-837f-50d3f662705c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.123044 Oct 11 01:22:38.630841 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 750/1468] 10.222.0.66 () {58 vars in 1150 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:38.645071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:38.652369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:38.663652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.665328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.665991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.667799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.668635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.669279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.783707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-68dcefec-ff04-4057-9f12-7cf72708ac32 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 0 microversion: 2.1 time: 0.144885 Oct 11 01:22:38.787490 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 751/1469] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:38 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:22:38.797233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:38.797454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:38.797926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:38.806518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.807081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.807556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.808853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:38.809323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:38.809827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:38.810820 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b155592-ecb4-486b-a886-fdd361e5ac96 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.407803 Oct 11 01:22:38.812234 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 719/1470] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:38.838093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:38.980086 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbbe30e7-2bf9-48e4-8474-1775bb4a4680 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1615 microversion: 2.1 time: 0.190829 Oct 11 01:22:38.980739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 752/1471] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:38 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1615 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:39.008676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.009400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:39.021059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.021809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.022462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.028530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.029104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.029552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.114759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.115403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:39.125402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.125907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.126345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.145289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.150179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.150972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.327653 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-744a78cf-d73f-4fe0-8a06-fdb8057c898a tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1615 microversion: 2.1 time: 0.323287 Oct 11 01:22:39.332002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 720/1472] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1615 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:39.367157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.376664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:39.394901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.395590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.396043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.396948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.397231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.397653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.443413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:39.445871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:39.446184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a07f08cb-b0a3-4fee-8706-e96cc4bfb764 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099863 Oct 11 01:22:39.448604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 721/1473] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:39.453933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.454420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:39.460462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:39.461798 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8a00612-a447-4ba4-9b49-c33259ffcf41 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.352145 Oct 11 01:22:39.462029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'host': 'n-h1-772273-9', 'deleted': False} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:39.462319 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 753/1474] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:22:39.468398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.469053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.469959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.470847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.471999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.472613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.594304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:22:39.684776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c8412f2-9d9d-44bc-9d52-8445b183c780 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers?host=n-h1-772273-9&all_tenants=1" status: 200 len: 1647 microversion: 2.1 time: 0.234439 Oct 11 01:22:39.686201 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 722/1475] 10.222.0.66 () {58 vars in 1190 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers?host=n-h1-772273-9&all_tenants=1 => generated 1647 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:39.698839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.704658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:22:39.721467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.721961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.722397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.723131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.723669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.724103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.843505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:39.845929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:39.870673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.873063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.876341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.877117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.885128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.887622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.919919 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc5b148c-7aae-4ac4-9b71-e24849b12ead tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.224967 Oct 11 01:22:39.922219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 754/1476] 10.222.0.66 () {58 vars in 1196 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:39.937977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:39.941974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:39.953778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.954568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.955163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:39.956546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:39.957172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:39.958535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.158189 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2bb3aa8e-b431-422f-8665-f47be3f8f1c2 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 0 microversion: 2.1 time: 0.227586 Oct 11 01:22:40.159584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 755/1477] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:39 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:40.278630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:40.289768 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7a7567c-6bda-4132-8e0d-a857ddb633f7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.454478 Oct 11 01:22:40.305759 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 723/1478] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:39 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:40.319773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:40.332352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:40.352390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.353107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.354255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.356682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.359652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.360293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.477727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8873711b-1479-4aac-96ce-64c85c26a3cc tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:40.488742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8873711b-1479-4aac-96ce-64c85c26a3cc tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.327745 Oct 11 01:22:40.504899 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 756/1479] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:22:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:40.516835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:40.521563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:40.544981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.546381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.546984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.547931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.548542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.554436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:22:40.554866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:22:40.555370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:22:40.555676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.555804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:22:40.556186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:22:40.619940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-374ecc74-18c4-4c9b-aa50-59279cc1bedf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113756 Oct 11 01:22:40.623200 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 757/1480] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:40 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:40.631127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:40.632110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:40.652366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.652852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.654072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.655534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.656245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.656671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.724347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:40.753560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.755791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.756270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.757039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.757515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.758358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.856602 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-141c5cd0-66e1-46be-943d-f4f2cca749fc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 1068 microversion: 2.1 time: 0.528835 Oct 11 01:22:40.859088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 724/1481] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:40 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 1068 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 01:22:40.890362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:40.894884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:40.908722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.909485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.910002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:40.911931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:40.912493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:40.914240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:41.026244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:41.041085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:41.043265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:41.044773 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07703f65-79d8-4bd3-933b-86164319b418 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.419478 Oct 11 01:22:41.047680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 758/1482] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:40 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:41.316667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:41.317453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:41.330910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:41.336884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:41.340586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:41.341490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:41.344388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:41.347476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:41.399954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:41.422971 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bac7a77f-08ee-4097-97b8-bb6e1b11dd36 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.544862 Oct 11 01:22:41.426502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 725/1483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:40 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:41.633874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:41.636345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:41.662020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:41.663109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:41.663731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:41.664475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:41.667363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:41.668007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:41.679653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:41.688414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-43159584-0ae5-4d89-a4f8-df427cda7d97 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.375425 Oct 11 01:22:41.703889 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 759/1484] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:41 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:41.756030 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab1853dc-3be4-486d-ab09-cf53f108c4c0 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126745 Oct 11 01:22:41.761608 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 726/1485] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:41 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:41.876080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-175224025", "imageRef": "1a31cea4-6796-4e12-b252-41565a100d5a", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:41.960199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:22:42.082500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:42.083795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:42.095686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.096341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.096905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.098320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.103920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.104563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.448839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:42.461158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:42.470756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:42.475086 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e7e4395-fc28-4ac1-b92c-e733af7e30d9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.397581 Oct 11 01:22:42.492411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 727/1486] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:42 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:42.492411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:42.492411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:42.505306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.507663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.509179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.510044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.511768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.512591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.528654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] Request method failure captured: Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 142 Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVfER51q2Ypdv2doBUn1adhGVATxERYb4KXhDXMY47G38GwnvIQjAWAdPMZC5KJLs0FwypX2Nfp3MXDqJdYhSQMglVvk-0OLhARtGgly_pF54OMFSat443Oy0PQ9bWNAuTFU9endAb17y8mEKzSk-fYhDIrcamQVL6Z9Lekf7qv1Ck Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0eed1e78289a475190587349216b88fe Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FlavorsV2NegativeTest-1243607060 Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:22:42.532425 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0eed1e78289a475190587349216b88fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0eed1e78289a475190587349216b88fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0eed1e78289a475190587349216b88fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0eed1e78289a475190587349216b88fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FlavorsV2NegativeTest-1243607060 Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0eed1e78289a475190587349216b88fe Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1243607060 Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FlavorsV2NegativeTest-1243607060-project Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a21612758f884c569455f7c2aaa9b73a Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FlavorsV2NegativeTest-1243607060-project Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-175224025", "imageRef": "1a31cea4-6796-4e12-b252-41565a100d5a", "flavorRef": "452"}} Oct 11 01:22:42.534235 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: exception: Flavor's memory is too small for requested image. Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-175224025', 'imageRef': '1a31cea4-6796-4e12-b252-41565a100d5a', 'flavorRef': '452'}}} Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:42.535245 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:42.536925 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:42.538654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96f96a59-a920-418e-9ddd-9e62768e14c8 tempest-FlavorsV2NegativeTest-1243607060 tempest-FlavorsV2NegativeTest-1243607060-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.662981 Oct 11 01:22:42.547201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 760/1487] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:22:41 2022] POST /compute/v2.1/servers => generated 93 bytes in 677 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:22:42.794343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:42.801092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:42.805049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-140e11d4-45d2-425d-b21d-36c47398cf6e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.320159 Oct 11 01:22:42.805954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 728/1488] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:42 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:42.820178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:42.821138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:42.830502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.831529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.832175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.833213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:42.833839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:42.834431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:42.989287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1130879314", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "ec2803f9-65d2-4e5c-bb77-a1a4d224527a"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:43.054025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:43.065586 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bdf61573-78d4-42fa-bc68-787515f46240 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.257754 Oct 11 01:22:43.067795 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 729/1489] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:42 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:43.098050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:43.100511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] validate_networks() for [('ec2803f9-65d2-4e5c-bb77-a1a4d224527a', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:22:43.107371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:43.123187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.126535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.128174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:43.129948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.132863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.134495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:43.205230 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ddfcd1d2-7c22-4617-8bec-d259dcbea9a7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135365 Oct 11 01:22:43.207548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 730/1490] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:43 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:43.515652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:43.516248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:43.528669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.529159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.529592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:43.530832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.531287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.531725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:43.777827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:43.793891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:43.798599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:43.805761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39cacd69-a72d-4458-9159-2ba3751392e4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.293644 Oct 11 01:22:43.808972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 731/1491] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:43 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:43.833331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:43.834855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:43.852829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.853520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.854442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:43.855326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:43.857269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:43.858430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.060801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:22:44.061885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:22:44.062383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:22:44.062797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:22:44.063962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:22:44.090481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:44.093079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.097406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.098154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.099876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09b91bd5-3f98-4006-8059-421bd83f8e89 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.273653 Oct 11 01:22:44.100392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.101219 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 732/1492] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:43 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:44.107056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:44.108436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:44.115206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.115878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.116533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.117242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.117688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.118311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.118701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.119381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.147221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Getting quotas for project a562b4ae4c314fc68294c57951b16b80. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:44.153364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Getting quotas for user aa0e566965f34dfab25d749e46dfac1d and project a562b4ae4c314fc68294c57951b16b80. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:44.184892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:22:44.187148 n-d-772273-9 devstack@n-api.service[120493]: WARNING nova.utils [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1130879314 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-113087931 Oct 11 01:22:44.188150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:22:44.268588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6149e4a9-76cd-4e41-8a5d-c9e4601b065d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565335 Oct 11 01:22:44.281835 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 761/1493] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:22:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:22:44.301678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:44.305462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:44.314663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.315427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.316094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.317541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.318531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.319157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.360955 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa0fe017-2cf1-49f6-92f6-73bc76cee940 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076652 Oct 11 01:22:44.362246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 762/1494] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:44 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:44.370031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-064a0d00-38ec-4c60-8358-42cf699e8aea tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:44.370936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-064a0d00-38ec-4c60-8358-42cf699e8aea tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:44.480648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-064a0d00-38ec-4c60-8358-42cf699e8aea tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:44.493072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:44.502695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cc02167-fe54-4ab7-af04-f3c07c14d685 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.400250 Oct 11 01:22:44.503275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 733/1495] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:44 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:44.506580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-064a0d00-38ec-4c60-8358-42cf699e8aea tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1232 microversion: 2.1 time: 0.142937 Oct 11 01:22:44.521859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 763/1496] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:44 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1232 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:44.572717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d782405a-8208-412d-af5b-0393f8078bdb", "name": "network-vif-plugged", "status": "completed", "tag": "de506e57-456e-439f-b896-b3ca9f95fbec"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:44.589993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.590535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.591067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.615016 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] Creating event network-vif-plugged:de506e57-456e-439f-b896-b3ca9f95fbec for instance d782405a-8208-412d-af5b-0393f8078bdb on n-h2-772273-9 Oct 11 01:22:44.634585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6d9ac90d-bd60-4ff0-ba9c-90ad48eb31f2 req-d68c4fc8-b01d-46b4-8250-d816771152f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065339 Oct 11 01:22:44.635120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 734/1497] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:44.834677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:44.835535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:44.850672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.851583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.853219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:44.855630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:44.863434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:44.864442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.118593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.130169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.131834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:45.131970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.132535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:45.133490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34112b5a-ba94-46f6-a1a9-7b8dc799f0a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.303020 Oct 11 01:22:45.139497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 764/1498] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:44 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:45.142940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.143644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.144411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.145262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.145856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.146419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.375813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:45.379675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:45.390578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.390808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.395299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.395794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.396545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.398472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.400298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.401177 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61411694-bf1e-4585-a20a-a30906d08a0b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.274830 Oct 11 01:22:45.416091 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 735/1499] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:45 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:45.463244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b7bdc96-286a-435e-a39e-e0ae49534677 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093069 Oct 11 01:22:45.464257 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 765/1500] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:45 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:22:45.526965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:45.527826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:45.535677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:45.536304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:45.546790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.547294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.547760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.548480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.548939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.549372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.560882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.563003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.564853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.565983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:45.575244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:45.575937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:45.744177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.759188 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9717eb7b-c4e4-41c4-8339-d35f3870c10a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1228 microversion: 2.1 time: 0.226136 Oct 11 01:22:45.760551 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 766/1501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:45 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1228 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:22:45.782771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:45.797076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17813397-b30b-4eab-ae0e-a73b1e2cd700 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1315 microversion: 2.1 time: 0.274025 Oct 11 01:22:45.811811 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 736/1502] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:45 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:46.171216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.171966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:46.181825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.184642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.185177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.188382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.189059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.189689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.406431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:46.415633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:46.417318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:46.418698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd8cebbf-1b40-489d-80b4-260e89719f7e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.258055 Oct 11 01:22:46.419381 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 767/1503] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:46.427959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.428589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:46.435266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.436631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.437371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.438240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.438849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.439546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.640105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5f0a4a1-f9ae-4778-a519-55651e9a2c64 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11341c9af0>, body: {"keypair": {"name": "tempest-keypair-507779956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgps9l/IExRCZpxjwIC//+TwAoCR/q3R26ajlVqe/MBAoP8PDUltG6hiFrYLvYjI/R78/SzQaRc8Yl7L0aEhvRSvQHVMOyhyF+e9BXbegGXOJOZb2l+CVY4kpM0EqPJ4w=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:46.666761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f5f0a4a1-f9ae-4778-a519-55651e9a2c64 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:46.668388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:46.679558 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e2b14f5-ac2f-467b-a555-c58a81177670 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.255093 Oct 11 01:22:46.680773 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 768/1504] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:46.685005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-f5f0a4a1-f9ae-4778-a519-55651e9a2c64 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:46.687439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.690527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:46.698068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.698676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.702107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.703424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.704106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.705066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.739981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5f0a4a1-f9ae-4778-a519-55651e9a2c64 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.416129 Oct 11 01:22:46.741539 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 737/1505] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 420 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 11 01:22:46.753329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a6c8211-eb7f-4865-9e6b-3d26a3e3c1ef tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f11341c90d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.770475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a6c8211-eb7f-4865-9e6b-3d26a3e3c1ef tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-507779956" status: 200 len: 512 microversion: 2.2 time: 0.021853 Oct 11 01:22:46.776412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 738/1506] 10.222.0.66 () {60 vars in 1255 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-507779956 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:46.789270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.791172 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e0fc236-a14d-456a-b1b9-ce0187ddf0ed tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109021 Oct 11 01:22:46.796638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:46.797968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 769/1507] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:46.804278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1889f8c3-fe1b-4912-9487-61fc0608d07e tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f6fe280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.824926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.825549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.825646 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1889f8c3-fe1b-4912-9487-61fc0608d07e tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507779956" status: 204 len: 0 microversion: 2.2 time: 0.025984 Oct 11 01:22:46.825941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.826182 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 770/1508] 10.222.0.66 () {60 vars in 1258 bytes} [Tue Oct 11 01:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507779956 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:46.827460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.827460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.827763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.842606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:46.843154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:46.859252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.860571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.861226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.862768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:46.863711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:46.865052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:46.907970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:46.919474 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5624e03-f860-45ac-8006-4d6a2750555c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1284 microversion: 2.1 time: 0.138415 Oct 11 01:22:46.939280 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 739/1509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:46.949341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c974ce53-bba7-46d8-8c90-f3046993bd45 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11341c98b0>, body: {"keypair": {"name": "tempest-keypair-1470113051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNErgveQkpu4JrzrImZhY7hlSBZCM1VJK9K6pSYOQtn8PROu61KcwkDplh71bYVhgf2x8mLE6YOA7gIOKBpVnIe7kXuiMUDlGEpCMvs19lTxiwqJRdOBJin7nC1cmvidYg=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:46.974300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c974ce53-bba7-46d8-8c90-f3046993bd45 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:46.980984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c974ce53-bba7-46d8-8c90-f3046993bd45 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:47.029851 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c974ce53-bba7-46d8-8c90-f3046993bd45 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.082125 Oct 11 01:22:47.029851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 740/1510] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:22:47.040720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8da15b04-4f67-48c7-ab49-4513accee5df tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f11341b2dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:47.065534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8da15b04-4f67-48c7-ab49-4513accee5df tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470113051" status: 204 len: 0 microversion: 2.2 time: 0.029353 Oct 11 01:22:47.066862 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 741/1511] 10.222.0.66 () {60 vars in 1261 bytes} [Tue Oct 11 01:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470113051 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:22:47.082174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3cac4fd-570e-4c26-b750-506009be3c25 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f113407ec10>, body: {"keypair": {"name": "tempest-keypair-623646294", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:47.084642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:47.095090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03b7ed47-5869-40d8-abe7-fb78c0af1afd tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1502 microversion: 2.1 time: 0.264932 Oct 11 01:22:47.100565 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 771/1512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:46 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:47.107405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d3cac4fd-570e-4c26-b750-506009be3c25 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:47.115753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:47.119640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d3cac4fd-570e-4c26-b750-506009be3c25 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:47.121645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1028804244"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:47.122335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:47.130063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:47.130751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:47.131198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:47.132140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:47.132642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:47.133066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:47.160871 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3cac4fd-570e-4c26-b750-506009be3c25 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.087486 Oct 11 01:22:47.163651 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 742/1513] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:47 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:22:47.178476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7bb1d96-0d6f-47e2-969f-e41e19beb31b tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f113416f670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:47.209959 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7bb1d96-0d6f-47e2-969f-e41e19beb31b tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-623646294" status: 204 len: 0 microversion: 2.2 time: 0.040970 Oct 11 01:22:47.210895 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 743/1514] 10.222.0.66 () {60 vars in 1258 bytes} [Tue Oct 11 01:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-623646294 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:47.222874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1490ea21-29cf-49d0-ac77-daecd580fec9 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11341f0790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-573323357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgDEIorEAx+kfzVrfYHplpGw0Cs8YrosyxVpd9128/GvXXmcZx+GMO7jtI37d3hep5j+qdN2HY3LamptkbDHDOtHlV8hQtcrlc4krb7JpIKucD12QtGjR48WR73WDY1lQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:47.243062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1490ea21-29cf-49d0-ac77-daecd580fec9 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:47.252679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1490ea21-29cf-49d0-ac77-daecd580fec9 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:47.290137 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1490ea21-29cf-49d0-ac77-daecd580fec9 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.071262 Oct 11 01:22:47.291182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 744/1515] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:22:47.327941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99250194-843b-49c3-a79c-0285aefcabd6 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11343d15e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-668227063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVTvlaOLugZJSeT7Zy29It09X7DMejqQ056qvyMLMaUbhN1veZX7cjE/7bK61CEfQI2V4sn1NJfKC1T4xcvDc7EL9ydQkWonDdwNEhN/5N+vC5aDsXoH98SLNG7N7VBuQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:47.356862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Adding security group 41e69103-7169-4411-8cdb-a6c3619db3a0 to port de506e57-456e-439f-b896-b3ca9f95fbec Oct 11 01:22:47.382207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-99250194-843b-49c3-a79c-0285aefcabd6 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:47.390147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-99250194-843b-49c3-a79c-0285aefcabd6 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:47.426255 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99250194-843b-49c3-a79c-0285aefcabd6 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.125087 Oct 11 01:22:47.437927 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 745/1516] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:22:47.445902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07bbf0d0-19fd-4697-a533-a140faa8604a tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f113407e280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-962310068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN6LSKyAM8G6oPNnbJyxlGqtifx0Q54oAJkihhD9O1L6IWy76r9gZ6azGUs6J/YGs+T1c4DOMyfQhtvNQux+O3vXAtQshyvVgguJ/4ZMrm3ctjBPnXjyhlH/IKKZdLZdw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:47.481559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-07bbf0d0-19fd-4697-a533-a140faa8604a tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:47.491421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-07bbf0d0-19fd-4697-a533-a140faa8604a tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:47.526307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07bbf0d0-19fd-4697-a533-a140faa8604a tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.084303 Oct 11 01:22:47.534685 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 746/1517] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 11 01:22:47.565349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:47.568335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:47.597292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:47.597794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:47.598234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:47.598946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:47.599440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:47.599869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:47.943438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:47.959132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:47.961885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:47.965264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b39dc980-9185-4800-9ed9-08c766f8b6d8 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.434994 Oct 11 01:22:47.968100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 747/1518] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:47 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:47.974447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e821f80-cc58-4626-954d-624cc51574fd tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f11341c9af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:47.978408 n-d-772273-9 devstack@n-api.service[120494]: WARNING oslo_db.sqlalchemy.utils [None req-7e821f80-cc58-4626-954d-624cc51574fd tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 01:22:47.989420 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e821f80-cc58-4626-954d-624cc51574fd tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.019979 Oct 11 01:22:47.990124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 748/1519] 10.222.0.66 () {60 vars in 1177 bytes} [Tue Oct 11 01:22:47 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:47.995604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:47.996569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:48.006761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.007669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.008077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.008944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.009547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.011199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.095061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55a65977-bf8e-47ad-9667-22c842270c04 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/action" status: 202 len: 0 microversion: 2.1 time: 0.978624 Oct 11 01:22:48.095788 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 772/1520] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:47 2022] POST /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/action => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:22:48.103463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:48.106236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:48.120569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.130398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.131813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.132821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.133553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.142984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.202465 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc3d3a31-044d-40d6-997f-f7beb2d5196c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105104 Oct 11 01:22:48.203847 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 773/1521] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:48 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:48.210438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:48.211368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:48.227910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.230269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.244111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.244879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.245554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.246150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.270721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:48.405845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:48.419409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf6c0df1-88f6-4a74-931f-a4d40cc9e5a0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1302 microversion: 2.1 time: 0.214004 Oct 11 01:22:48.420528 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 774/1522] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:48 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:48.448837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75c87b4c-2d46-415c-ab5d-d62c8f0e806c tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f757e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:48.500733 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75c87b4c-2d46-415c-ab5d-d62c8f0e806c tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-962310068" status: 204 len: 0 microversion: 2.2 time: 0.057445 Oct 11 01:22:48.501774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 775/1523] 10.222.0.66 () {60 vars in 1318 bytes} [Tue Oct 11 01:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-962310068 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:48.511673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-789505958"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:48.513146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:48.521687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:48.524506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.525755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.526656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.527894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.528520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.530079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.569708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:48.584219 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b1868738-ad32-4019-97dd-d87dbd8b67db tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.592765 Oct 11 01:22:48.585070 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 749/1524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:47 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:48.812013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Adding security group cc08d4cd-55a6-4143-8721-5ca49f31cafa to port de506e57-456e-439f-b896-b3ca9f95fbec Oct 11 01:22:48.923766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d782405a-8208-412d-af5b-0393f8078bdb", "tag": "de506e57-456e-439f-b896-b3ca9f95fbec"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:48.936432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:48.937531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:48.938163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:48.964807 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] Creating event network-changed:de506e57-456e-439f-b896-b3ca9f95fbec for instance d782405a-8208-412d-af5b-0393f8078bdb on n-h2-772273-9 Oct 11 01:22:48.973263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-015e0c28-b58d-4943-94bf-03baca56d08f req-81aa93e9-3333-4d75-bcae-8968f0adfd91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384082 Oct 11 01:22:48.973914 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 750/1525] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:48.986505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6caf805-fe43-4abc-8a03-91325c376538 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f113426f1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:49.018945 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6caf805-fe43-4abc-8a03-91325c376538 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-668227063" status: 204 len: 0 microversion: 2.2 time: 0.041906 Oct 11 01:22:49.020773 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 751/1526] 10.222.0.66 () {60 vars in 1318 bytes} [Tue Oct 11 01:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-668227063 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:49.032251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "name": "network-vif-unplugged", "status": "completed", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:49.043389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:49.044094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:49.044806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:49.061389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] Creating event network-vif-unplugged:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h1-772273-9 Oct 11 01:22:49.067793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-dc43f3ae-7584-49fc-b6f5-5671d60ae588 req-46b3b6f8-176c-4b15-833c-5b46b9b87add service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045144 Oct 11 01:22:49.068748 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 752/1527] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:49.074380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:49.075311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:49.083541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:49.084293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:49.084896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:49.087002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:49.087695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:49.088340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:49.533150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:49.924355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:49.933561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:49.935023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:49.936779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5555c150-0674-4ffb-bca4-482026515c5c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.866737 Oct 11 01:22:49.953398 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 753/1528] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:49 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:49.962890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee9e6e4a-79fb-4240-89a9-858dc0986b95 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f113401baf0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:49.983402 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee9e6e4a-79fb-4240-89a9-858dc0986b95 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-573323357" status: 204 len: 0 microversion: 2.2 time: 0.023867 Oct 11 01:22:49.984286 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 754/1529] 10.222.0.66 () {60 vars in 1318 bytes} [Tue Oct 11 01:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-573323357 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:50.140505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a126eaea-c0a8-4051-9a6c-03d374a07577 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/action" status: 202 len: 0 microversion: 2.1 time: 1.636253 Oct 11 01:22:50.142785 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 776/1530] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:22:48 2022] POST /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/action => generated 0 bytes in 1640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:50.151276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.152569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:50.165108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.166836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.167686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.169187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.170759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.171466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.292173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.294652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:50.303446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:50.305263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.306072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.306545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.307304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.307970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.308837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.321076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f947cee-5f41-4e75-8909-9fcc35d43af8 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1290 microversion: 2.1 time: 0.175982 Oct 11 01:22:50.322285 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 777/1531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:50 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1290 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:50.331398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.332932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:50.346042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.347631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.349217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.350343 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-428b23e3-c485-44af-9eb0-883164db3cd4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.364775 Oct 11 01:22:50.351064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.351573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.352000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.357791 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 755/1532] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:22:49 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80/os-volume_attachments => generated 25 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:22:50.363582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28c73788-83f2-428a-bc69-5424e84e08a4 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11341c9700>, body: {"keypair": {"name": "tempest-keypair-1653146324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH0i3owJfpsFSkToeqss23IodbsQcKvdY/cxGLA4mI9H2y3APEZL5PkI4tuB+z7isVgH+mhpb1mKbEOrD4c8N3Kq1Wx3byqpG2F1zBbpxGOiwdd7MrGcSlFjF+QFddhPg=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:50.384121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-28c73788-83f2-428a-bc69-5424e84e08a4 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:50.391802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-28c73788-83f2-428a-bc69-5424e84e08a4 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:50.419382 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28c73788-83f2-428a-bc69-5424e84e08a4 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.060193 Oct 11 01:22:50.420022 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 756/1533] 10.222.0.66 () {62 vars in 1199 bytes} [Tue Oct 11 01:22:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:22:50.440109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.441268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:50.449101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.449885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.450520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.452359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.453414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:50.455008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:50.885038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:50.898215 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-810c3a29-111c-47ef-bb6a-f43bd6b58e9a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.574151 Oct 11 01:22:50.899745 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 778/1534] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:50 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:50.917132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba7b5210-5802-4442-bf69-93be147b16c5 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f6fcaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.956105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba7b5210-5802-4442-bf69-93be147b16c5 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-1653146324" status: 200 len: 513 microversion: 2.2 time: 0.054403 Oct 11 01:22:50.956716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 779/1535] 10.222.0.66 () {60 vars in 1258 bytes} [Tue Oct 11 01:22:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1653146324 => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:50.976906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:50.978106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:50.995985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:50.997676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.000063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:51.001785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:51.002841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.003287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:51.115615 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f4b335f-fb7b-4469-8ab5-2e4c8f10b117 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.694110 Oct 11 01:22:51.116806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 757/1536] 10.222.0.66 () {58 vars in 1293 bytes} [Tue Oct 11 01:22:50 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb/os-security-groups => generated 1157 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:51.121583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e4b3e3f-aec3-4610-a44b-a448c39c0172 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f113407e310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:51.130408 n-d-772273-9 devstack@n-api.service[120494]: WARNING oslo_db.sqlalchemy.utils [None req-1e4b3e3f-aec3-4610-a44b-a448c39c0172 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 01:22:51.142822 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e4b3e3f-aec3-4610-a44b-a448c39c0172 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.024874 Oct 11 01:22:51.149349 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 758/1537] 10.222.0.66 () {60 vars in 1177 bytes} [Tue Oct 11 01:22:51 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:51.163948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d782405a-8208-412d-af5b-0393f8078bdb", "tag": "de506e57-456e-439f-b896-b3ca9f95fbec"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:51.186522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:51.189193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.190213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:51.232896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] Creating event network-changed:de506e57-456e-439f-b896-b3ca9f95fbec for instance d782405a-8208-412d-af5b-0393f8078bdb on n-h2-772273-9 Oct 11 01:22:51.241394 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3c7efd5a-10d6-4863-ae53-22d3d06795ed req-c41cbf54-c1d5-46ab-8941-f6a8b1f0dcc1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090186 Oct 11 01:22:51.246084 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 759/1538] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:51.258811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4744a620-462a-4b86-bff2-7f2048971ff0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f11341b2280>, body: {"security_group": {"name": " tempest-securitygroup -1946813506 ", "description": "tempest-description-2109170885"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:51.687479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:51.699989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:51.701819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:51.703087 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6770730b-1539-4f25-9a19-e05c09c91dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.738630 Oct 11 01:22:51.704220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 780/1539] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:50 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:51.709538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db29f409-4839-48b7-8216-e7ef04f97153 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f6e2b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:51.755590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db29f409-4839-48b7-8216-e7ef04f97153 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653146324" status: 204 len: 0 microversion: 2.2 time: 0.050090 Oct 11 01:22:51.756288 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 781/1540] 10.222.0.66 () {60 vars in 1261 bytes} [Tue Oct 11 01:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653146324 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:51.762352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:51.779217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:51.780622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.781350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:51.800727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] Creating event network-changed:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h1-772273-9 Oct 11 01:22:51.816076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-38f7804c-72af-4b64-85e4-9bea9076a078 req-0bd0d125-7ae6-4b52-8bab-858637204853 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058214 Oct 11 01:22:51.820363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 782/1541] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:51.838618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:51.839384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:51.847266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:51.847798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.848469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:51.849950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:51.850767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:51.851403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:52.138412 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4744a620-462a-4b86-bff2-7f2048971ff0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.890941 Oct 11 01:22:52.147027 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 760/1542] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:51 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:52.150827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Action: 'create', calling method: .version_select at 0x7f11341f04c0>, body: {"keypair": {"name": "tempest-keypair-1425714227", "type": "x509"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:52.188855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:52.195421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:52.226010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.processutils [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpwojqhk_j/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwojqhk_j/temp.key -subj /CN=e324f02ee2a74f22899d7f2bd9651403 -extensions v3_req_client {{(pid=120494) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 01:22:52.526115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:52.534029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.processutils [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpwojqhk_j/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwojqhk_j/temp.key -subj /CN=e324f02ee2a74f22899d7f2bd9651403 -extensions v3_req_client" returned: 0 in 0.308s {{(pid=120494) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 01:22:52.535543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.processutils [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpwojqhk_j/temp.key -password pass: {{(pid=120494) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 01:22:52.560487 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d6eb4ac8-ce40-436d-a258-823277ee2564 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.738455 Oct 11 01:22:52.578788 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 783/1543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:51 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:52.586279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:52.587588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:52.602315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.processutils [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpwojqhk_j/temp.key -password pass:" returned: 0 in 0.065s {{(pid=120494) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 01:22:52.628602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:52.632426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:52.632894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:52.642096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:52.643541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:52.644219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:52.681413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:52.728317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:22:52.738790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Getting quotas for user e324f02ee2a74f22899d7f2bd9651403 and project 1e3574d7625c4a83b8699198430dae4e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:22:52.776693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9758894c-bd42-4f39-9a5d-d3d5f7b5b963 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.635657 Oct 11 01:22:52.785632 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 761/1544] 10.222.0.66 () {62 vars in 1198 bytes} [Tue Oct 11 01:22:52 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 646 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:52.795093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5cfc25d-dfe4-4e42-ad71-fc92f27f55db tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f11341b2b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:53.057193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5cfc25d-dfe4-4e42-ad71-fc92f27f55db tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed" status: 200 len: 224 microversion: 2.1 time: 0.269232 Oct 11 01:22:53.058069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 762/1545] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:22:52 2022] GET /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed => generated 224 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:53.075886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:53.077486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:53.090266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:53.091228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:53.092225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:53.093615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:53.094449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:53.094954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:53.249351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:53.276360 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c7b446b-3e9d-4382-8eda-368506ea4b69 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.694762 Oct 11 01:22:53.283139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 784/1546] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:52 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:53.296395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-291c51b8-2d31-481c-b90b-ae75806d34bb tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f6e2a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:53.331306 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-291c51b8-2d31-481c-b90b-ae75806d34bb tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-1425714227" status: 200 len: 1534 microversion: 2.2 time: 0.052081 Oct 11 01:22:53.331951 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 785/1547] 10.222.0.66 () {60 vars in 1258 bytes} [Tue Oct 11 01:22:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1425714227 => generated 1534 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:53.362288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d27c9dfd-fc7c-402b-96c0-07205712a230 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f739ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:53.481566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:53.499963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:53.501626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:53.503020 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d33808cd-ea57-47e7-865b-2e960b8d29b6 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.433502 Oct 11 01:22:53.506935 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 763/1548] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:53 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:53.527218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12097ea0-4066-4aa0-952d-77f4448a5fba tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f1134296820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:53.532082 n-d-772273-9 devstack@n-api.service[120494]: WARNING oslo_db.sqlalchemy.utils [None req-12097ea0-4066-4aa0-952d-77f4448a5fba tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 01:22:53.573167 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12097ea0-4066-4aa0-952d-77f4448a5fba tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.064732 Oct 11 01:22:53.573938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 764/1549] 10.222.0.66 () {60 vars in 1177 bytes} [Tue Oct 11 01:22:53 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:53.584512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6987401-4240-45fc-a9be-28e5978a5f8e"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:53.605561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:53.626303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:53.627739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:53.629396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:53.630351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:53.631022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:53.631748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:53.958064 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d27c9dfd-fc7c-402b-96c0-07205712a230 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed" status: 202 len: 0 microversion: 2.1 time: 0.602696 Oct 11 01:22:53.959098 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 786/1550] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:22:53 2022] DELETE /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:53.970859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-620a776c-12d4-4056-8cf1-22c4e4061e70 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] Calling method '.version_select at 0x7f112f7390d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:54.018728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-620a776c-12d4-4056-8cf1-22c4e4061e70 tempest-KeyPairsV22TestJSON-1284964397 tempest-KeyPairsV22TestJSON-1284964397-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425714227" status: 204 len: 0 microversion: 2.2 time: 0.058326 Oct 11 01:22:54.019961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 787/1551] 10.222.0.66 () {60 vars in 1261 bytes} [Tue Oct 11 01:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425714227 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:22:54.026264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:54.026525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:54.049103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.049857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.050480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.051668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.052468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.053061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.137586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:54.253111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:54.297392 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8724770-6ffd-45da-8e69-302c90a91d92 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "POST /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717450 Oct 11 01:22:54.305269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 765/1552] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:22:53 2022] POST /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:54.321646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96646e71-84fd-47c7-bad4-1f751668da4f", "tag": "9744eee6-d394-4ea2-86ce-d48e7d27c746"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:54.351656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.352154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.352641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.393432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] Creating event network-changed:9744eee6-d394-4ea2-86ce-d48e7d27c746 for instance 96646e71-84fd-47c7-bad4-1f751668da4f on n-h2-772273-9 Oct 11 01:22:54.411383 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-81759a64-8873-4ce7-9c27-1fb8c6c2da41 req-63ce6445-3758-471c-88dc-dae0867acd18 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101569 Oct 11 01:22:54.414354 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 766/1553] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:54.430121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f11387d9e50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:54.484826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:22:54.547993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:22:54.549197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group bdb07b95-0036-4f8e-a252-5a52ebda41ed not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:22:54.549944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.549944 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed HTTP/1.1 Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:54.565971 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.567878 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'bdb07b95-0036-4f8e-a252-5a52ebda41ed'} Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:54.568879 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:22:54.570515 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.572024 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] Oct 11 01:22:54.573827 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:54.576690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:22:54.576690 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-8dc2cb80-38d4-4b5a-b318-02730f33e96c'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:54.577589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8f6bafe-b053-4a3e-800c-24ac39e706af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed" status: 404 len: 194 microversion: 2.1 time: 0.160442 Oct 11 01:22:54.579477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 767/1554] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:22:54 2022] GET /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:54.588401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:54.589208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:54.599093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.599892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.600498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.601191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.601890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.602424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.691995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:54.704446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ccf0214-728a-4a70-99e4-2392a8b42fd5 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.683135 Oct 11 01:22:54.705350 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 788/1555] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:54 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:54.709928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:54.715673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:54.727183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.727792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.728411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:54.729204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:54.729735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:54.730232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:55.000081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:55.014078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63b1696e-6a0c-43f3-8ba9-47ca5a4888e0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.433428 Oct 11 01:22:55.014693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 768/1556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:54 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:55.031832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ed81dfc-830b-4a4c-98e9-8fa18b741c68 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f11387758b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-783523959", "description": "tempest-description-1221979604"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:55.478478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:55.495644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:55.501010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:55.502867 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1dcf5ab4-8728-4534-abaa-6c9f4e5120d1 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.796565 Oct 11 01:22:55.511498 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 789/1557] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:54 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:22:55.727656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:55.728268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:55.738792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:55.745684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:55.746407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:55.747453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:55.751011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:55.751691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:55.915899 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ed81dfc-830b-4a4c-98e9-8fa18b741c68 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.899586 Oct 11 01:22:55.916906 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 769/1558] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:55.930851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aecd3878-1fca-4511-bdff-b98aecdc2a9d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112fa8ea60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1584675600", "description": "tempest-description-660338997"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:56.114378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:56.126312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ffa9dd2-832f-4075-8236-458ec7f55d7d tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.402359 Oct 11 01:22:56.131412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 790/1559] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:55 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:56.143870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:56.145821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:56.162679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:56.164094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:56.164622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:56.165498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:56.166348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:56.167377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:56.348457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aecd3878-1fca-4511-bdff-b98aecdc2a9d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.422032 Oct 11 01:22:56.349072 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 770/1560] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:56.362299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-417293e9-2f09-4ff7-b6c9-21fcfa7edf87 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112fa94b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-666827517", "description": "tempest-description-1293492560"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:22:56.416576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:56.425665 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c59fee6-8106-4ca1-aa50-f9da6d17ed91 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.292057 Oct 11 01:22:56.429244 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 791/1561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:56 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:56.533891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:56.535173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:56.543579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:56.550664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:56.551495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:56.552303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:56.552833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:56.553422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:56.779564 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-417293e9-2f09-4ff7-b6c9-21fcfa7edf87 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.420935 Oct 11 01:22:56.781381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 771/1562] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:22:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:22:56.797578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-325101a8-5f5e-4e13-9709-eb26f640ee40 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fa8a9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:57.452716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:57.462713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:57.468633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:57.473013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd401c22-dec8-4d11-85ee-7b1aeeb526bf tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.943406 Oct 11 01:22:57.487524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 792/1563] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:56 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:22:57.507469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:57.508357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:57.516932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:57.517639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:57.518242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:57.519998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:57.520777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:57.525493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:57.709614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-325101a8-5f5e-4e13-9709-eb26f640ee40 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.917593 Oct 11 01:22:57.710442 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 772/1564] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:22:56 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:57.729317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:57.730381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:57.757968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:57.758476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:57.759267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:57.764646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:57.768452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:57.769728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:58.115304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:58.124655 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba554eac-1f93-49f6-9e30-e40ac01f23d9 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.624900 Oct 11 01:22:58.125245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 793/1565] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:57 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:58.136129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0878d3e4-5794-4362-a142-20135cc22fd4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f7785e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:58.263934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:58.277430 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ecd592b8-de65-4c0e-80a2-f98c67f602b9 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1472 microversion: 2.1 time: 0.560838 Oct 11 01:22:58.278266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 773/1566] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:57 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1472 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:22:58.505012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:58.505881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:58.518065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:58.518564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:58.519004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:58.519746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:58.520202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:58.520629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:59.187444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0878d3e4-5794-4362-a142-20135cc22fd4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962" status: 202 len: 0 microversion: 2.1 time: 1.055030 Oct 11 01:22:59.192054 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 794/1567] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:22:58 2022] DELETE /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:22:59.197411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:59.198274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:59.214482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:59.215257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:59.218258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:59.219199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:59.220353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:59.230137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:59.330043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:59.356597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:59.362126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:22:59.367963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e7b8d00-2ea1-4420-9f44-40a1148bfafb tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.865311 Oct 11 01:22:59.385701 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 774/1568] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:22:58 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:22:59.395444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112faa0b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:59.698073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:22:59.698687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 4b446ae7-40bd-4335-9261-b90a19f66962 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:22:59.699208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.699208 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962 HTTP/1.1 Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:22:59.701954 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.703721 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4b446ae7-40bd-4335-9261-b90a19f66962'} Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:59.704813 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:22:59.706079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.707263 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] Oct 11 01:22:59.710520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:22:59.714635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:22:59.714635 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-d0b7ab61-a671-42ea-b368-677506e94137'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:22:59.714635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-549afa04-d67f-41db-b3d8-d16c1cf5b7d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962" status: 404 len: 194 microversion: 2.1 time: 0.326542 Oct 11 01:22:59.714635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 775/1569] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:22:59 2022] GET /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962 => generated 194 bytes in 328 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:22:59.724896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:22:59.728251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:22:59.746182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:59.747775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:59.749744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:22:59.750959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:22:59.753302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:22:59.758472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:00.186808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:00.198668 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-76aa40f8-92b8-4d9e-bae7-756aa1dfecbb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 1.005193 Oct 11 01:23:00.206229 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 795/1570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:59 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:00.242709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7204b969-3b7e-49cf-8399-a99a025f898b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f6cfca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:00.817801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:00.833877 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16ac7132-168f-4e19-ba38-6f15f289306a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 1.112360 Oct 11 01:23:00.834896 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 776/1571] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:22:59 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:00.844603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:00.848114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:00.869018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:00.871477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:00.873372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:00.877911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:00.879230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:00.880692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:01.267690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:01.286928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:01.294598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:01.297456 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-399eef7e-a0f4-4f4a-9302-aae040bfb26c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.460996 Oct 11 01:23:01.320110 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 777/1572] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:00 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:01.329523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:01.334442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:01.349477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:01.351636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:01.354253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:01.355310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:01.357516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:01.358198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:01.646550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7204b969-3b7e-49cf-8399-a99a025f898b tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da" status: 202 len: 0 microversion: 2.1 time: 1.420017 Oct 11 01:23:01.648646 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 796/1573] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:00 2022] DELETE /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:01.659264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f6fe040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:02.468989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:02.469963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 946dd6d6-27e6-410d-9bde-a1deee1e69da not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:23:02.470756 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.470756 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da HTTP/1.1 Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:02.474413 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.475955 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '946dd6d6-27e6-410d-9bde-a1deee1e69da'} Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:02.476872 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:23:02.478297 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.479501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] Oct 11 01:23:02.480850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:02.493525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:23:02.493525 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a7b06976-827d-43ef-9cb4-839681b8239a'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:02.500123 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a52c3e3c-a8c1-410a-b84a-c25c5f200d99 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da" status: 404 len: 194 microversion: 2.1 time: 0.844862 Oct 11 01:23:02.501045 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 797/1574] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:23:01 2022] GET /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da => generated 194 bytes in 848 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:02.534152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:02.542719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:02.557321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:02.575252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:02.576880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:02.580426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:02.581336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:02.583299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:02.710633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:02.723809 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa55a316-6e71-4535-b6f3-b9c423f655bd tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 1.401979 Oct 11 01:23:02.725944 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 778/1575] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:01 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:02.742033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:02.747775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:02.782728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=42 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:02.799652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:02.802489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:02.804798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:02.808255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:02.811265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:02.813110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:03.194541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:03.211840 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ebdeea4f-becb-4140-9474-df013812ffa0 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 0.701531 Oct 11 01:23:03.213017 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 798/1576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:02 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:03.224860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c38978c-4314-4f1d-84f4-816ec65c7862 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f1134ce80d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:03.266794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:03.282384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:03.285851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:03.287985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-049b0f62-5cce-4c27-9785-1c339261399a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.559546 Oct 11 01:23:03.294583 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 779/1577] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:02 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:03.725449 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c38978c-4314-4f1d-84f4-816ec65c7862 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212" status: 202 len: 0 microversion: 2.1 time: 0.510812 Oct 11 01:23:03.726059 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 799/1578] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:03 2022] DELETE /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:03.734179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fa459d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:03.760280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:03.761536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:03.783953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:03.785157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:03.785603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:03.786431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:03.788071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:03.789990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:03.844187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:03.845212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:23:03.845983 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.845983 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 HTTP/1.1 Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:23:03.848904 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.850372 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '7f1b644c-d04d-4e70-b5b8-ed6f6ce38212'} Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:03.851242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:23:03.852531 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.853749 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] Oct 11 01:23:03.855126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:03.860740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:23:03.860740 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ea74eb11-a109-42dc-8954-8fbba7ee5836'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:03.862301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-64fb62c2-c8dc-442a-bdd9-6a9fcd183783 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212" status: 404 len: 194 microversion: 2.1 time: 0.132093 Oct 11 01:23:03.863458 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 780/1579] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:23:03 2022] GET /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:03.879236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-288ed64e-7d83-463f-acf8-b7fbcf27816e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f1138775670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:04.365445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:04.382963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d047c4c9-2e9c-4ccf-b8df-ddc1b4b4d909 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.638153 Oct 11 01:23:04.384336 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 800/1580] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:03 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:04.390782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:04.391784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:04.403475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:04.404396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:04.405323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:04.406412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:04.407271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:04.407960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:04.640745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-288ed64e-7d83-463f-acf8-b7fbcf27816e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.773366 Oct 11 01:23:04.641330 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 781/1581] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:23:03 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:04.647296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:04.648482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:04.663323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:04.666265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:04.666971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:04.670616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:04.671368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:04.672175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:04.701076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:04.727754 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90667077-a04a-414f-965e-ef5d6f45f815 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 0.342011 Oct 11 01:23:04.732363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 801/1582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:04 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:04.742020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8980f326-a0bb-454b-9ab6-abb25b6bf60e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112f81a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-501402499", "description": "tempest-description-339328192"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:05.195980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8980f326-a0bb-454b-9ab6-abb25b6bf60e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.461837 Oct 11 01:23:05.196913 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 802/1583] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:05.202762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96646e71-84fd-47c7-bad4-1f751668da4f", "name": "network-vif-plugged", "status": "completed", "tag": "9744eee6-d394-4ea2-86ce-d48e7d27c746"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:05.232459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:05.233538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:05.235459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:05.236673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:05.240192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:05.252110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:05.255775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:05.257327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a406734d-8952-44b6-834d-4d728d81764a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.614563 Oct 11 01:23:05.258677 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 782/1584] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:04 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:05.264509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbc4afe4-2937-4014-87e7-f63cf34524bb tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112fa459d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1491493646", "description": "tempest-description-1177037261"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:05.266756 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] Creating event network-vif-plugged:9744eee6-d394-4ea2-86ce-d48e7d27c746 for instance 96646e71-84fd-47c7-bad4-1f751668da4f on n-h2-772273-9 Oct 11 01:23:05.276768 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8dc54a4b-1236-4aab-a31f-2e6388740b27 req-523ddec8-e23a-4abe-a5d6-063010d21497 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078253 Oct 11 01:23:05.280100 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 803/1585] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:05.410318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:05.413803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:05.431209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:05.433167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:05.435560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:05.436660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:05.440016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:05.443974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:05.863054 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbc4afe4-2937-4014-87e7-f63cf34524bb tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.603068 Oct 11 01:23:05.863692 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 783/1586] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:05.883266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:05.883919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:05.894879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:05.900325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:05.907304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:05.915332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-459de0d2-356d-494b-a8c5-5080ea5f69b7 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.509608 Oct 11 01:23:05.916379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:05.916534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:05.917199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:05.917978 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 804/1587] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:05 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:05.919230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:06.182314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-250960910", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "920a046a-0b3e-45d8-976e-a5a69b80241e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:06.275794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:06.285893 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cfc4d08e-9eec-42c3-94fd-76703b0f182a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 0.420635 Oct 11 01:23:06.291841 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 784/1588] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:05 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:06.298660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] validate_networks() for [('920a046a-0b3e-45d8-976e-a5a69b80241e', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:23:06.304038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:06.319594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:06.351899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:06.352500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:06.352967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:06.354169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:06.354649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:06.355082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:07.063153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:07.081698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:07.083184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:07.086575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92d66641-7bd9-477a-b624-3d8c0c664393 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.793543 Oct 11 01:23:07.089870 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 785/1589] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:06 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:07.109058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:07.115467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:07.161999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:07.162506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:07.162948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:07.163711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:07.164168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:07.164602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:07.856863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:07.873074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92c90363-3e26-4e57-b131-3287bb375fc0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1332 microversion: 2.1 time: 0.780828 Oct 11 01:23:07.876742 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 786/1590] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:07 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1332 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:07.902347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:07.910828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:07.926360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:07.927152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:07.927680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:07.931479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:07.932212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:07.933102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.092102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:23:08.096416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:23:08.098541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:23:08.101585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:23:08.102377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:23:08.119383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:08.120974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:08.122922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.123964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:08.125354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:08.126015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.162721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Getting quotas for project 8e1e7c3ccbe1403fb5330faf6bb0d86a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:23:08.170547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Getting quotas for user f380eb4fd2b84ba9bfcb037a74dc2a9a and project 8e1e7c3ccbe1403fb5330faf6bb0d86a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:23:08.191805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:23:08.195027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:23:08.290984 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-248eeebc-eb6a-444a-96b9-05fd4549319a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112624 Oct 11 01:23:08.301413 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 805/1591] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:23:08.316724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "name": "network-vif-plugged", "status": "completed", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:08.334219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:08.334725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:08.335209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.376566 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] Creating event network-vif-plugged:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:23:08.382203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e7ea635b-f8cd-4294-8ab6-90a6cbbf99e4 req-255281be-fdbc-443a-bb25-af48d7a7d326 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078781 Oct 11 01:23:08.383044 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 806/1592] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:08.417048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:08.449722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9bbd67f3-89b2-4a16-874a-b89df614fa2b tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 0.559236 Oct 11 01:23:08.456427 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 787/1593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:07 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:08.471564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:08.471564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:08.486732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:08.487317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:08.487707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.488397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:08.488845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:08.489272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:08.620691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc441c1f-59b4-42d2-8449-a7563d82bf8f tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f799700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1452915655", "description": "tempest-description-488125670"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:08.880779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:08.906568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:08.908548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:08.910327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33756e14-0af4-4305-b257-aca7b7c09f8d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.452926 Oct 11 01:23:08.929497 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 788/1594] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:08 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:08.940366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f331357a-6e6f-4137-97e9-72872f2c1030 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:08.941480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f331357a-6e6f-4137-97e9-72872f2c1030 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:09.050623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f331357a-6e6f-4137-97e9-72872f2c1030 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:09.072446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc441c1f-59b4-42d2-8449-a7563d82bf8f tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.688296 Oct 11 01:23:09.073318 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 807/1595] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:09.079876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:09.080815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:09.084147 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f331357a-6e6f-4137-97e9-72872f2c1030 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1215 microversion: 2.1 time: 0.133378 Oct 11 01:23:09.089169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 789/1596] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:08 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:09.091308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:09.092413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:09.094095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:09.095005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:09.095681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:09.096277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:09.105272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09bcbe3a-498c-40f0-a238-a3786582ea23 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112fabedc0>, body: {"security_group_rule": {"parent_group_id": "dbf7aaeb-9370-4e2d-88e5-f0a0e32b3325", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:09.723049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:09.736729 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7f8d332-d67c-4706-9a86-01071459e985 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1536 microversion: 2.1 time: 0.662138 Oct 11 01:23:09.737366 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 808/1597] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:09 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1536 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:09.745800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:09.748046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:09.771108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:09.771946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:09.772623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:09.773526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:09.774154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:09.775163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:10.066301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:10.079884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c1aa9b1-92e3-4cef-8019-715bfdacba00 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1478 microversion: 2.1 time: 0.341184 Oct 11 01:23:10.084623 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 809/1598] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:09 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1478 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:10.097658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e401419-f68b-4a65-b544-4658c66111e0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'create', calling method: .version_select at 0x7f112f7789d0>, body: {"pool": "b8dd60d3-adec-4df7-ab56-a2028419c3bc"} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:10.430977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09bcbe3a-498c-40f0-a238-a3786582ea23 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.337317 Oct 11 01:23:10.431628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 790/1599] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:10.436642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:10.437258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:10.454651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:10.455145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:10.455612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:10.459445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:10.460240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:10.460887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:11.326746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:11.340969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:11.347214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:11.352851 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d63e64a6-ff25-4db8-a9cf-f6dd89956e9a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1813 microversion: 2.25 time: 0.919018 Oct 11 01:23:11.355392 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 791/1600] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:10 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1813 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:11.362928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:11.363615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:11.397599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:11.398560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:11.399099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:11.399983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:11.400529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:11.401157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:11.582704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:11.592762 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a09fd2c-92d0-4b37-b59b-459268048621 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1273 microversion: 2.1 time: 0.235375 Oct 11 01:23:11.593617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 792/1601] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:11 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:11.615874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b09b72ef-668d-4e75-9315-619335cd2513 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112fa3f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-473408213", "description": "tempest-description-62437314"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:12.345436 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b09b72ef-668d-4e75-9315-619335cd2513 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.749474 Oct 11 01:23:12.349447 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 793/1602] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:11 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:12.632807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cac25336-71e8-4dce-b480-2b764ecfa1a8"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:12.636460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:12.653118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:12.654095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:12.655039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:12.656042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:12.661024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:12.661816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:12.697929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:12.844839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] HTTP exception thrown: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Request method failure captured: Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments/a6987401-4240-45fc-a9be-28e5978a5f8e HTTP/1.1 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 74 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTwrBHVP3ZaKN3pWUkNmwgrNYX78fBUYUxi3AXgvfdE8hmm7hnyI_3rS1FeHfXFF4ECkMgyiA20W7RUiOkLmvpd2cuSGmTpt_Ds0eMOkhbodY-C5Ix-8_0HEypQB-1BDGRxFJpxmvw4NiselLv5OZeA49GblgwOyoHEe27iBRhTVcE Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1708f557a21a46dd9c5f91b98ed436f6 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:23:12.891825 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1708f557a21a46dd9c5f91b98ed436f6 Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesAdminNegativeTest-1214812222-project-admin Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 42bc72eef67f473087721a0cae4adb59 Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesAdminNegativeTest-1214812222-project-admin Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: {"volumeAttachment": {"volumeId": "cac25336-71e8-4dce-b480-2b764ecfa1a8"}} Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:23:12.893871 n-d-772273-9 devstack@n-api.service[120494]: exception: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '466b8790-0063-4112-b494-0f56de3aef94', 'id': 'a6987401-4240-45fc-a9be-28e5978a5f8e', 'body': {'volumeAttachment': {'volumeId': 'cac25336-71e8-4dce-b480-2b764ecfa1a8'}}} Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:23:12.895038 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. (HTTP 404) (Request-ID: req-76128491-a66e-445f-8057-3cf142280cdb) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:23:12.897150 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:12.899319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. Oct 11 01:23:12.901656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:12.904972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Returning 400 to user: Volume cac25336-71e8-4dce-b480-2b764ecfa1a8 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:12.904972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2306bbfa-3299-4636-92b9-d3673b09b57d tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] 10.222.0.66 "PUT /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments/a6987401-4240-45fc-a9be-28e5978a5f8e" status: 400 len: 107 microversion: 2.1 time: 0.547706 Oct 11 01:23:12.911525 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 794/1603] 10.222.0.66 () {60 vars in 1433 bytes} [Tue Oct 11 01:23:12 2022] PUT /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments/a6987401-4240-45fc-a9be-28e5978a5f8e => generated 107 bytes in 561 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:23:12.917172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:12.919320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:12.945185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:12.946071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:12.946793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:12.947829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:12.951746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:12.955842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:13.518036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:13.530204 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0ac6956-184b-4584-9011-5e6074ea280f tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1464 microversion: 2.1 time: 0.617003 Oct 11 01:23:13.537711 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 795/1604] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:12 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1464 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:13.542728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0238360b-6382-4f47-98c7-be42ebe6dc91 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112fa3f1f0>, body: {"security_group_rule": {"parent_group_id": "4b79c9e6-826b-4344-8bbc-37dd0b6b5d1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:14.381617 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0238360b-6382-4f47-98c7-be42ebe6dc91 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.842683 Oct 11 01:23:14.382233 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 796/1605] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:13 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:14.387028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:14.387812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:14.403598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:14.404341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:14.404789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:14.405499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:14.405952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:14.406378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:14.810943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:14.851902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:14.856261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:14.857537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c64c113-0b75-489a-ab29-293380c83c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1803 microversion: 2.25 time: 0.474171 Oct 11 01:23:14.865944 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 797/1606] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:14 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1803 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:14.879800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:14.880741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:14.890494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:14.891534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:14.892158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:14.893416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:14.894403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:14.895205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:15.613910 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e401419-f68b-4a65-b544-4658c66111e0 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.527853 Oct 11 01:23:15.628169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 810/1607] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:23:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:15.635507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:15.636830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:15.645142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:15.645900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:15.646988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:15.647937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:15.648197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:15.649861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:15.650580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:15.661063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-71018594-1b7a-4454-b635-ce80f67ce688 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.793702 Oct 11 01:23:15.662069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 798/1608] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:14 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:15.670903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:15.675433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:15.685512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:15.685662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:15.686072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:15.686791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:15.687248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:15.694406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:15.815871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lazy-loading 'services' on Instance uuid 466b8790-0063-4112-b494-0f56de3aef94 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:15.952529 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e167fb6c-0405-43bf-89e6-4ca9d2de5be5 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "DELETE /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments/a6987401-4240-45fc-a9be-28e5978a5f8e" status: 202 len: 0 microversion: 2.1 time: 0.321308 Oct 11 01:23:15.967910 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 811/1609] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:23:15 2022] DELETE /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments/a6987401-4240-45fc-a9be-28e5978a5f8e => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:15.981843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9448ee2c-a608-44d6-a367-59b7f0dfc783 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f6eb9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-620560123", "description": "tempest-description-1866592234"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:16.019398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:16.036572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b20babae-bb20-402c-b1ba-cbaa15de2abc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1464 microversion: 2.1 time: 0.373328 Oct 11 01:23:16.037759 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 799/1610] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:15 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:16.042494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb3ad30-e2c3-4fe4-a8ed-0a5c9976bbb8 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '.version_select at 0x7f112fa3f040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:16.047091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb3ad30-e2c3-4fe4-a8ed-0a5c9976bbb8 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.047957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb3ad30-e2c3-4fe4-a8ed-0a5c9976bbb8 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.048561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb3ad30-e2c3-4fe4-a8ed-0a5c9976bbb8 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.061312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5eb3ad30-e2c3-4fe4-a8ed-0a5c9976bbb8 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.021971 Oct 11 01:23:16.062861 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 800/1611] 10.222.0.66 () {60 vars in 1184 bytes} [Tue Oct 11 01:23:16 2022] GET /compute/v2.1/os-migrations => generated 2536 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:16.068161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.102"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:16.071728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:16.078261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.078955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.079805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.080708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.081325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.082535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.117892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:23:16.118305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquired lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:23:16.600748 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9448ee2c-a608-44d6-a367-59b7f0dfc783 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.630942 Oct 11 01:23:16.609084 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 812/1612] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:16.609084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:16.609084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:16.628935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.629586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.629692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.630332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.634164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.634714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.704955 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-adbce5b7-169d-4b55-b716-df737f3592cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102242 Oct 11 01:23:16.708268 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 813/1613] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:23:16 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:16.718459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:16.722226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:16.729758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.730572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.731219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.732587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.734481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.735406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.830725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:23:16.831895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:23:16.832548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:23:16.833157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:23:16.833758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:23:16.913503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:16.924202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.925273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.926179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.927717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.928485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.929131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.961195 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2ce0d15-e5fa-4f6a-a0ff-b97fb91a28f3 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 1068 microversion: 2.1 time: 0.251684 Oct 11 01:23:16.961880 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 814/1614] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:16 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 1068 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 01:23:16.969104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:16.969987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:16.982359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.983448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.984424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:16.985430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:16.986178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:16.987143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:17.314728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:17.351908 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0aae52f6-ddea-4e36-a1a9-03523a025b89 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 2421 microversion: 2.25 time: 0.385802 Oct 11 01:23:17.352953 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 815/1615] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:16 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 2421 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:17.369083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:17.394387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:17.395158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:17.398159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:17.436715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] Creating event network-changed:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:17.470103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2a8be33f-6b4e-4480-91b7-8bf1ba15452e req-54630c5e-6d93-4d7f-9140-00349b343d28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100476 Oct 11 01:23:17.473481 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 816/1616] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:17.483090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89816e9e-f845-4c9d-9e4b-f955738aa91d tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f7573a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-435723963", "description": "tempest-description-554908674"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:17.806442 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89816e9e-f845-4c9d-9e4b-f955738aa91d tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.330364 Oct 11 01:23:17.817066 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 817/1617] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:17.823464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:17.825333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:17.854766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:17.855881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:17.856328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:17.861378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:17.861378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:17.861753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:18.149060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:18.151702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:18.165227 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2be59261-6406-446c-a581-e14ee586c62e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.343987 Oct 11 01:23:18.182587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 818/1618] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:17 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:18.188853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:18.190015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:18.194387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:18.197874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:18.198372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:18.199327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:18.200496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:18.201124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:18.201718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:18.578106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:18.593280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8226b50e-afe7-46d7-b934-fdc0171687ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.409394 Oct 11 01:23:18.593887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 819/1619] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:18 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:18.612585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:18.613222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:18.622354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:18.624074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:18.624737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:18.625347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:18.626258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:18.626715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:18.627161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:18.925906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Building network info cache for instance {{(pid=120494) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:23:18.937622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:18.962014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c40e2fb7-f0a9-45bc-bd81-1cab857b4d6d tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 2421 microversion: 2.25 time: 0.361787 Oct 11 01:23:18.988407 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 820/1620] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:18 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 2421 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:19.006938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:19.026693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:19.055989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:19.056510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:19.058487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:19.060102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:19.066026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:19.066807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:19.067455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:19.159654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-318c283a-c1ed-4b0f-99ef-53abb565491c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169913 Oct 11 01:23:19.160805 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 821/1621] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:23:18 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:19.178406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8bfaa4a4-85aa-423b-98f6-3e76c12c77de tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f7aa1f0>, body: {"security_group_rule": {"parent_group_id": "21dfc965-a9a8-4ebf-8ac1-91d1c5224447", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1dfd32d2-c920-4f52-b140-d6e71bb5402a"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:20.372600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8bfaa4a4-85aa-423b-98f6-3e76c12c77de tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.201437 Oct 11 01:23:20.374507 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 822/1622] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:20.380807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:20.381599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:20.400319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.401056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.402464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.405589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.406314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.406979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.613345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lazy-loading 'services' on Instance uuid a13c1e5b-8018-4cf4-90fa-42732ab63ac1 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:20.617295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:20.788893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c6c798d-9c7d-420b-8d5e-a4f5331a3bec tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments/2c003e43-241a-460c-9966-ff9574d4a5e3" status: 202 len: 0 microversion: 2.25 time: 0.412240 Oct 11 01:23:20.789692 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 823/1623] 10.222.0.66 () {60 vars in 1457 bytes} [Tue Oct 11 01:23:20 2022] DELETE /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments/2c003e43-241a-460c-9966-ff9574d4a5e3 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:20.800732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:20.801302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:20.802179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Updating instance_info_cache with network_info: [{"id": "9744eee6-d394-4ea2-86ce-d48e7d27c746", "address": "fa:16:3e:cb:e0:17", "network": {"id": "ec2803f9-65d2-4e5c-bb77-a1a4d224527a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-954212087-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a562b4ae4c314fc68294c57951b16b80", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9744eee6-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:23:20.812104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.812649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.813907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.814927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.816506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.817013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.829138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Releasing lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:23:20.830033 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39ef1ef7-bf3a-4660-b6e3-e5d773bc283a tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 202 len: 0 microversion: 2.1 time: 4.765929 Oct 11 01:23:20.830827 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 801/1624] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:16 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 0 bytes in 4767 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:23:20.838210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96646e71-84fd-47c7-bad4-1f751668da4f", "tag": "9744eee6-d394-4ea2-86ce-d48e7d27c746"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:20.877348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.879111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.880138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.900679 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] Creating event network-changed:9744eee6-d394-4ea2-86ce-d48e7d27c746 for instance 96646e71-84fd-47c7-bad4-1f751668da4f on n-h2-772273-9 Oct 11 01:23:20.908628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-de8b28aa-0fef-49ce-8fd7-244504df7339 req-6a95e92d-d573-438d-94f4-acbf32e21d0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074741 Oct 11 01:23:20.909951 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 802/1625] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:20.915300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:20.916285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:20.925271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.926063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.926690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:20.927612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:20.928225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:20.928857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:21.649385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:21.658880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d64e5791-2dcb-48bd-9a2f-2ab464c0b24f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.866155 Oct 11 01:23:21.663394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 824/1626] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:20 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:21.675690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:21.683212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:21.697299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:21.698049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:21.698732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:21.699634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:21.701491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:21.703230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:21.768600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a1c73dbd-094b-4e38-989a-e760d7be8a69 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097312 Oct 11 01:23:21.769454 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 825/1627] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:23:21 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:21.783557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce4985b8-bbf9-4b4d-bf6e-6bbca8114f74 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f8f0940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-461703511", "description": "tempest-description-922350291"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:21.830600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:21.846518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4af7ebc8-53cd-4670-a48d-9a77255fbbfc tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.935106 Oct 11 01:23:21.854417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 803/1628] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:20 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:21.870039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:21.876130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:21.891008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:21.894912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:21.895399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:21.897932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:21.898429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:21.899531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:21.948423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff058f26-6be7-46fc-84ed-5c37554b240a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091841 Oct 11 01:23:21.949949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 804/1629] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:23:21 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:23:21.958141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fcbf9a7-2020-4c1d-8ce2-03b3ef225f2f tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'create', calling method: .version_select at 0x7f112fabe040>, body: {"pool": "b8dd60d3-adec-4df7-ab56-a2028419c3bc"} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:22.273069 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce4985b8-bbf9-4b4d-bf6e-6bbca8114f74 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.496706 Oct 11 01:23:22.273683 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 826/1630] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:22.287296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-627d829f-2cc2-4e3a-87d9-a9685b4ffbec tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f781dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1007145134", "description": "tempest-description-6825917"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:22.699876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-627d829f-2cc2-4e3a-87d9-a9685b4ffbec tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.416236 Oct 11 01:23:22.703819 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 827/1631] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:22 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:23:22.718154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:22.720390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:22.742894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:22.744199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:22.745743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:22.747038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:22.748199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:22.749399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:22.966872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:22.976717 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0bf6b6de-9ac4-4988-8c8a-7a87a8686392 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.270264 Oct 11 01:23:22.995183 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 828/1632] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:22 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:23.002012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba074820-a9bc-486e-aa5f-aaa535454b02 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f778af0>, body: {"security_group_rule": {"parent_group_id": "fa6a522e-a677-4a3c-9d85-07c1455ba57a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7049dfea-4680-4f0b-9410-0064f7fc5f1f"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:23.600312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba074820-a9bc-486e-aa5f-aaa535454b02 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.603036 Oct 11 01:23:23.601370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 829/1633] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:22 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:23.609965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:23.612351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:23.639774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:23.640285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:23.640921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:23.641646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:23.642101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:23.642527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:23.707957 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0371c78e-f2de-4348-854b-64df7ba806aa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105356 Oct 11 01:23:23.708679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 830/1634] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:23:23 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:23:23.724687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:23.725904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:23.741976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:23.749345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:23.750027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:23.750963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:23.756475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:23.757209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:24.082305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:24.091865 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6df0bbca-66ba-4e76-9c05-5a390b0031bd tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.370924 Oct 11 01:23:24.094846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 831/1635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:23 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:24.106305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:24.113445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:24.121560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:24.122207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:24.122960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:24.124572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:24.125046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:24.125496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:24.130607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fcbf9a7-2020-4c1d-8ce2-03b3ef225f2f tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.179054 Oct 11 01:23:24.131223 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 805/1636] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:23:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:24.136249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1302523934", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c"}], "block_device_mapping_v2": [{"uuid": "45c41320-0db6-425b-81b2-c7165158ac6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:24.165824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ca6129f-be4d-434c-8647-a0e013234397 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069547 Oct 11 01:23:24.167027 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 832/1637] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:23:24 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:23:24.172421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d4d22f3-ac99-40c4-a47b-e82531ab5a43 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f6eb160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:24.172584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=69 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:24.263251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] validate_networks() for [('9b1dbe5c-42ba-4838-a11f-e90ff74a2e4c', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:23:24.609871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d4d22f3-ac99-40c4-a47b-e82531ab5a43 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/7049dfea-4680-4f0b-9410-0064f7fc5f1f" status: 202 len: 0 microversion: 2.1 time: 0.439598 Oct 11 01:23:24.610868 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 833/1638] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:24 2022] DELETE /compute/v2.1/os-security-groups/7049dfea-4680-4f0b-9410-0064f7fc5f1f => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:24.617975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1702759653", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "676615c4-e99d-4e90-8f33-c020aacefe96"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:24.707656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] validate_networks() for [('676615c4-e99d-4e90-8f33-c020aacefe96', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:23:24.829642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:23:24.830270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:23:24.830943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:23:24.831370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:23:24.831792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:23:24.848565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:24.849312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:24.849945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:24.850852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:24.851712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:24.852322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:24.882460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:23:24.887826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Getting quotas for user ef7f0979c5764837ae474f3a09cedb7b and project 5bb1d74dbd0f44adbe54bc82f7291298. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:23:24.987643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:23:24.989894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45c41320-0db6-425b-81b2-c7165158ac6d',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:23:25.266828 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd79b856-54a2-4b64-98bf-7b8861e4fb9b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134186 Oct 11 01:23:25.267899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 806/1639] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:23:25.272629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:25.273323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:25.280474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.281087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.281591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.288135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.288772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.289302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.298608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:23:25.300102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:23:25.300807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:23:25.302432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:23:25.303170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:23:25.314895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.315592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.316146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.316997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.317563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.318110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.353663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for project 633278094b7b443cbe24a4be4e4501d8. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:23:25.364821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Getting quotas for user 925177e3f3a94d8b90fc6beb4114fd7a and project 633278094b7b443cbe24a4be4e4501d8. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:23:25.379967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:23:25.383243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:23:25.451751 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d62f6fd6-0f16-4fca-8886-f7cb8ecec83c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839398 Oct 11 01:23:25.461330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 834/1640] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:23:25.469128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "name": "network-vif-plugged", "status": "completed", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:25.484929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.485423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.486017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.504394 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] Creating event network-vif-plugged:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:25.512133 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bf1afe0b-d871-4061-a362-e702d2fd020d req-c8d3e9b5-e79a-46ad-89d9-3bb4e757c84e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049217 Oct 11 01:23:25.513192 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 835/1641] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:25.520780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.11"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:25.524271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:25.533065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.534400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.534858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.535911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.536384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.536822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.539196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:25.559067 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57486620-6e4d-4877-bbe9-2e0ce6c1b104 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.289965 Oct 11 01:23:25.562713 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 807/1642] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:25 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:25.569431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67e5c86e-8d89-4ade-944f-c423e39aeff9 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f9c8040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:25.617473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:23:25.639920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquired lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:23:25.719371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67e5c86e-8d89-4ade-944f-c423e39aeff9 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/fa6a522e-a677-4a3c-9d85-07c1455ba57a" status: 200 len: 246 microversion: 2.1 time: 0.154192 Oct 11 01:23:25.720301 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 808/1643] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:23:25 2022] GET /compute/v2.1/os-security-groups/fa6a522e-a677-4a3c-9d85-07c1455ba57a => generated 246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:25.725452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:25.728207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:25.736947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.737453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.737952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:25.739800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:25.740358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:25.741101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.159725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:26.177674 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73edf71b-5d79-4702-8413-54cfa85ee17a tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.454269 Oct 11 01:23:26.180659 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 809/1644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:25 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:26.202243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:26.204943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:26.213879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.214517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.215061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.215935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.216498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.217195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.264243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c3956ea-14ba-47d5-84c7-b1afd0c45c32 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079628 Oct 11 01:23:26.265350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 810/1645] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:23:26 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:23:26.270995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:26.272377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:26.279440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.280300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.280988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.281996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.282572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.283326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.397794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:26.411805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0421fc35-1a0e-410c-9cb9-dfd4979b528b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1103 microversion: 2.1 time: 0.144271 Oct 11 01:23:26.414985 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 811/1646] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:26 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1103 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:26.421161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:26.421948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:26.440370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.441277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.442505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.443556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.444381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.445062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.755166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:26.766670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc.", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:26.767421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Releasing lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:23:26.768499 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.768499 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Request method failure captured: Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action HTTP/1.1 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 45 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMViev5h_KZKXmrMV2Qi1peXeVDXN3Q_QtBTH_OO4wNEDc28-Uh4QW0VedLfHe-SLysTHKfv2EB1IUtQg34XCFeOttFlhqbgUsbuLcZMlH-q6QKjMuS8wc2xcU055IZ6WpxXVpOE815HlEFZjaFtjsubYb4Qae2WwpMHoaTzwL75LdM Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:26.771368 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: aa0e566965f34dfab25d749e46dfac1d Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: {"addFloatingIp": {"address": "172.25.3.11"}} Oct 11 01:23:26.773401 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '96646e71-84fd-47c7-bad4-1f751668da4f', 'body': {'addFloatingIp': {'address': '172.25.3.11'}}} Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.774612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:26.775995 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.777882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.779239 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] Oct 11 01:23:26.781740 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:26.783298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Returning 400 to user: Cannot associate floating IP 172.25.3.11 (141e26ac-e19c-401a-996e-5313f21bfa94) with port 9744eee6-d394-4ea2-86ce-d48e7d27c746 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b8dd60d3-adec-4df7-ab56-a2028419c3bc. Oct 11 01:23:26.783298 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-2ed5919d-2497-4cdb-a0b6-76bd0d09836c'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:26.784410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c2c821c-9fac-4929-b135-99718cca14bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 400 len: 381 microversion: 2.1 time: 1.268265 Oct 11 01:23:26.785196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 836/1647] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:25 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 381 bytes in 1271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:23:26.790708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9dd0890-55f4-4579-9f6e-c65d979e6b89 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1214 microversion: 2.1 time: 0.374168 Oct 11 01:23:26.791771 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 812/1648] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:26 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:26.796364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f387d504-1850-4b0c-87e7-92e0af066ce1 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f8f69d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1525070248", "description": "tempest-description-1470406264"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:26.804955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:26.805578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:26.813982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.828347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.829003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:26.829767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:26.830246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:26.830675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:27.046518 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f387d504-1850-4b0c-87e7-92e0af066ce1 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.260052 Oct 11 01:23:27.047429 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 837/1649] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:27.055777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aae52858-de8c-40c0-85cb-3df50d3e4d8e tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '.version_select at 0x7f112f7aa550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:27.134185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:27.145638 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-277428d5-87a5-41dc-8956-b22fc8afe346 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1315 microversion: 2.1 time: 0.349779 Oct 11 01:23:27.148326 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 813/1650] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:26 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:27.153825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80e3b86f-1440-4d50-ab45-c6f71e721ade tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112fa54700>, body: {"security_group_rule": {"parent_group_id": "2b04dcb3-1384-404b-ac18-3ecaadc5adb2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:27.613747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80e3b86f-1440-4d50-ab45-c6f71e721ade tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.464087 Oct 11 01:23:27.621769 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 814/1651] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:27.626611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:27.627225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:27.639584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:27.640082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:27.640521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:27.641260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:27.641741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:27.642192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:27.880619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:27.935549 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ef2fe42-45d8-4b9a-8c52-b881c6a683c2 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.309613 Oct 11 01:23:27.958740 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 815/1652] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:27 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:27.975613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:27.979831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:28.020992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.029604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.030201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:28.030994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.031520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.031960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:28.100781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:28.106809 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afa999eb-4823-4d46-9e66-9fca045196a7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145817 Oct 11 01:23:28.114871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 816/1653] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:23:27 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:23:28.123176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:28.124303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:28.133771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.134667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.135373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:28.136361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.137854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.138558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:28.531413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:28.541194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14742d98-c87d-4003-b354-e2996030e43b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1159 microversion: 2.1 time: 0.424770 Oct 11 01:23:28.546079 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 817/1654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:28 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1159 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:28.551672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e85b88dd-b246-426d-9dde-76865e480a7e tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Action: 'create', calling method: .version_select at 0x7f112f9c8940>, body: {"security_group_rule": {"parent_group_id": "2b04dcb3-1384-404b-ac18-3ecaadc5adb2", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:28.845818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aae52858-de8c-40c0-85cb-3df50d3e4d8e tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/141e26ac-e19c-401a-996e-5313f21bfa94" status: 202 len: 0 microversion: 2.1 time: 1.795950 Oct 11 01:23:28.847453 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 838/1655] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:23:27 2022] DELETE /compute/v2.1/os-floating-ips/141e26ac-e19c-401a-996e-5313f21bfa94 => generated 0 bytes in 1799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:28.864262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:28.870935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:28.883094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.884423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.885355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:28.887032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:28.887872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:28.888500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.047938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e85b88dd-b246-426d-9dde-76865e480a7e tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.500868 Oct 11 01:23:29.056558 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 818/1656] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:23:28 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:29.061820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:29.062640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:29.082926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.083891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.084515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.085514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.086152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.088076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.128755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:29.137555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7833013b-75e9-4200-82fc-6fad17cee980 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1278 microversion: 2.1 time: 0.288650 Oct 11 01:23:29.138522 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 839/1657] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:28 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1278 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:29.160464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.102"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:29.453552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:29.455324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:29.467865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35aa9eeb-5871-4b99-bb82-c43bd3accfe0 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1502 microversion: 2.1 time: 0.409670 Oct 11 01:23:29.468472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 819/1658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:29 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:29.481196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.481688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:29.482313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:29.483426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.484776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.485944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.488037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.488769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.492623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.493050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.493498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.494206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:29.495034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:29.495660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:29.879328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:29.894548 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8670be0-eecf-4180-83d1-66411dc90926 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.424949 Oct 11 01:23:29.907422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 820/1659] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:29 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:29.915633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a9bd3f8-25ef-4324-9764-97ae96c72c99 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112fa54d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:29.955762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:23:29.956907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquired lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:23:30.107441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a9bd3f8-25ef-4324-9764-97ae96c72c99 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/2b04dcb3-1384-404b-ac18-3ecaadc5adb2" status: 200 len: 665 microversion: 2.1 time: 0.198528 Oct 11 01:23:30.118555 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 821/1660] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:23:29 2022] GET /compute/v2.1/os-security-groups/2b04dcb3-1384-404b-ac18-3ecaadc5adb2 => generated 665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:30.124124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:30.126435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:30.150772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:30.152184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:30.153175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:30.155653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:30.156303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:30.157058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:30.205472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-268f99a8-5eff-4850-b409-01eed9410d6a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.085529 Oct 11 01:23:30.206348 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 822/1661] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:23:30 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:30.219469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-501402499"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:30.221228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:30.233414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:30.234240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:30.234887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:30.235796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:30.236404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:30.238088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:30.857015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Adding security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 to port 6682b532-825e-4eca-af34-bd26f7eb3a55 Oct 11 01:23:32.021342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7eb8dc57-39e3-458c-8aa7-ca30f30c2ff7 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action" status: 202 len: 0 microversion: 2.1 time: 1.813694 Oct 11 01:23:32.031114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 823/1662] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:30 2022] POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action => generated 0 bytes in 1824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:32.038628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:32.039624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:32.067293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:32.068022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:32.068486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:32.069239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:32.069695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:32.070129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:32.302119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Building network info cache for instance {{(pid=120493) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 01:23:32.330326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:32.339327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab13e7ef-1706-4e16-8e32-000c19df75dc tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1211 microversion: 2.1 time: 0.306797 Oct 11 01:23:32.359898 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 824/1663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:32 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1211 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:32.367427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d47f0a35-5288-44e4-beb1-a907e894515b tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112fa549d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:33.460167 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d47f0a35-5288-44e4-beb1-a907e894515b tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/be734b36-6d5d-4df8-9fe5-ce75f0550db7" status: 202 len: 0 microversion: 2.1 time: 1.098788 Oct 11 01:23:33.468481 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 825/1664] 10.222.0.66 () {58 vars in 1287 bytes} [Tue Oct 11 01:23:32 2022] DELETE /compute/v2.1/os-security-group-rules/be734b36-6d5d-4df8-9fe5-ce75f0550db7 => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:33.501484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:33.502388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:33.535570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:33.546136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:33.547388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:33.548589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:33.549489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:33.550353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:33.860297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Updating instance_info_cache with network_info: [{"id": "9744eee6-d394-4ea2-86ce-d48e7d27c746", "address": "fa:16:3e:cb:e0:17", "network": {"id": "ec2803f9-65d2-4e5c-bb77-a1a4d224527a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-954212087-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a562b4ae4c314fc68294c57951b16b80", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9744eee6-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120493) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:23:33.882599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Releasing lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:23:33.884028 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-633349a9-ded2-42b6-84a1-70332f6c7074 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 202 len: 0 microversion: 2.1 time: 4.730676 Oct 11 01:23:33.884190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:33.886186 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 840/1665] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:29 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 0 bytes in 4733 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 01:23:33.894606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:33.895596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:33.896957 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cc03b462-0711-4997-b4dc-f682592553f6 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.421839 Oct 11 01:23:33.904784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:33.905533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:33.906406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:33.907363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:33.908152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:33.908920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:33.912415 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 826/1666] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:33 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:33.927057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fa54940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:34.282404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use.", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:34.283309 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.283309 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67 HTTP/1.1 Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:23:34.285950 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: exception: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.287805 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2093b4b5-56cc-400a-80e6-bb1a8abafb67'} Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:34.288979 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.290406 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:34.292506 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] Oct 11 01:23:34.294136 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:34.298571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:34.301917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 400 to user: Security Group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 in use. Oct 11 01:23:34.301917 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5f766376-7980-4e29-bb5f-7ee0f5c9488e'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:34.305151 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d547f60b-0fbf-4a16-9459-7b6899aeb462 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67" status: 400 len: 185 microversion: 2.1 time: 0.390007 Oct 11 01:23:34.306465 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 827/1667] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:33 2022] DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67 => generated 185 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:23:34.314497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a1453a2-00fe-4bbf-a0ca-e3e36902092c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1473 microversion: 2.1 time: 0.426541 Oct 11 01:23:34.320010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:34.320930 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 841/1668] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:33 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:34.332242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1c14df-3f0c-41cd-834a-f429029422d7", "tag": "41e38c92-6899-4ed6-94ed-a200158f412f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:34.344492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.344972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.345401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.351794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.352279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.352707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.373429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] Creating event network-changed:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:34.384147 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c4b807ca-fc2d-4209-901e-f721493d6651 req-27fd861a-3dc1-479f-9975-a29efd7af6c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075385 Oct 11 01:23:34.396862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] Creating event network-changed:41e38c92-6899-4ed6-94ed-a200158f412f for instance 0e1c14df-3f0c-41cd-834a-f429029422d7 on n-h1-772273-9 Oct 11 01:23:34.401454 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 828/1669] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:34.410587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:34.411290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:34.415905 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1b049cd5-be67-4104-ac11-408bf0d72215 req-90741f77-61f8-4606-8b56-c2ce6d0e35b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092646 Oct 11 01:23:34.418009 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 842/1670] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:34.428229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e86caf-abc5-4c24-9969-0443dc178c22 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f8f6d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:34.434457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.435114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.435585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.436305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.436761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.437188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.745729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:34.758867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f7e738e-203b-4d61-9a33-28aa0c075082 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1211 microversion: 2.1 time: 0.354642 Oct 11 01:23:34.760538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 829/1671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:34 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1211 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:34.784727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a73049a-0a48-4f39-a409-0b3e6a8de814 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '.version_select at 0x7f11387b1550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:34.855173 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50e86caf-abc5-4c24-9969-0443dc178c22 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/2b04dcb3-1384-404b-ac18-3ecaadc5adb2" status: 202 len: 0 microversion: 2.1 time: 0.435909 Oct 11 01:23:34.860111 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 843/1672] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:34 2022] DELETE /compute/v2.1/os-security-groups/2b04dcb3-1384-404b-ac18-3ecaadc5adb2 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:34.866219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:34.870922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:34.873864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:34.883701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.888531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.889236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.890175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:34.891508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:34.892469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:34.894811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:35.046125 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e8f3270-e31d-48bf-bba9-173172b11c76 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action" status: 202 len: 0 microversion: 2.1 time: 0.184308 Oct 11 01:23:35.047034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 844/1673] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:34 2022] POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:35.061796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f6cf3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:35.188383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:35.189248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Neutron security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:23:35.190046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] HTTP exception thrown: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.190046 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Request method failure captured: Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-security-groups/7049dfea-4680-4f0b-9410-0064f7fc5f1f HTTP/1.1 Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMV7bORt1wCrzqBjmTsgi7l5V8K-_pva-DuP2s8qB34GTq4C2QgIJjsr0byOsL7sZf0nSLMdQzvy2JOApQo53JO0IibDu9CjOYX3gB8NT9krzduxe9WJ63KoptcrxaigchvN7qB3KZxby_Lala8IwsW6rO6DuLY9it59KojJp4FTlgY Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 65859c101ebd421a86e5d047a0a60f1b Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-436644766 Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:35.192467 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/65859c101ebd421a86e5d047a0a60f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_65859c101ebd421a86e5d047a0a60f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/65859c101ebd421a86e5d047a0a60f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/65859c101ebd421a86e5d047a0a60f1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesTestJSON-436644766 Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 65859c101ebd421a86e5d047a0a60f1b Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-436644766 Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesTestJSON-436644766-project Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f152e26e280f4232aae8fd2f6c62b4e7 Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesTestJSON-436644766-project Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.194063 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '7049dfea-4680-4f0b-9410-0064f7fc5f1f'} Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:35.195230 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:23:35.196611 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.198006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] Oct 11 01:23:35.202680 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:35.205944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Returning 404 to user: Security group 7049dfea-4680-4f0b-9410-0064f7fc5f1f does not exist Oct 11 01:23:35.205944 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-60000553-f5d3-437c-a2ab-b98931de7d9b'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:35.207217 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-875b445e-9bf2-402c-a1c5-55de9cd7d7a8 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/7049dfea-4680-4f0b-9410-0064f7fc5f1f" status: 404 len: 194 microversion: 2.1 time: 0.158886 Oct 11 01:23:35.208361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 845/1674] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:35 2022] DELETE /compute/v2.1/os-security-groups/7049dfea-4680-4f0b-9410-0064f7fc5f1f => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:35.217136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:35.218737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:35.231441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:35.232195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:35.232829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:35.234006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:35.235024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:35.235844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:35.329932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:35.373454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:35.630320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:35.642688 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc5a3411-543a-46e3-9d73-a1a5f5981afc tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.432335 Oct 11 01:23:35.643727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 846/1675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:35 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:35.649493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:35.650656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:35.658255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:35.659053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:35.659844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:35.660664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:35.661229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:35.661760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:35.925482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:35.936659 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8005401-ab82-425d-9fac-45bba70f4656 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1572 microversion: 2.1 time: 0.291096 Oct 11 01:23:35.938061 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 847/1676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:35 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1572 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:35.953779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73a386a1-289a-48b5-b9c9-caed239eded3 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f79f820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:36.222398 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a73049a-0a48-4f39-a409-0b3e6a8de814 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/365c37d8-8e55-4d01-a9b2-538e5beb0410" status: 202 len: 0 microversion: 2.1 time: 1.441667 Oct 11 01:23:36.225854 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 830/1677] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:23:34 2022] DELETE /compute/v2.1/os-floating-ips/365c37d8-8e55-4d01-a9b2-538e5beb0410 => generated 0 bytes in 1446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:36.238568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:36.240971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:36.251139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.253246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.253942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.262805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.264936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.266003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.298530 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73a386a1-289a-48b5-b9c9-caed239eded3 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/fa6a522e-a677-4a3c-9d85-07c1455ba57a" status: 202 len: 0 microversion: 2.1 time: 0.358970 Oct 11 01:23:36.302476 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 848/1678] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:35 2022] DELETE /compute/v2.1/os-security-groups/fa6a522e-a677-4a3c-9d85-07c1455ba57a => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:36.308136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:36.308967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:36.317567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.318344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.318842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.320050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.320697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.321132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.511038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:36.521401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c13f0be2-f51d-425d-b3d2-223756f2888e tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1479 microversion: 2.1 time: 0.293236 Oct 11 01:23:36.522895 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 831/1679] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:36 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1479 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:36.529843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-487e720b-cf6b-45df-a99e-590869cefc44 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:36.531870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-487e720b-cf6b-45df-a99e-590869cefc44 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Request method failure captured: Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action HTTP/1.1 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 34 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMViev5h_KZKXmrMV2Qi1peXeVDXN3Q_QtBTH_OO4wNEDc28-Uh4QW0VedLfHe-SLysTHKfv2EB1IUtQg34XCFeOttFlhqbgUsbuLcZMlH-q6QKjMuS8wc2xcU055IZ6WpxXVpOE815HlEFZjaFtjsubYb4Qae2WwpMHoaTzwL75LdM Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:23:36.534697 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: aa0e566965f34dfab25d749e46dfac1d Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: {"addFloatingIp": {"address": ""}} Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:23:36.536510 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '96646e71-84fd-47c7-bad4-1f751668da4f', 'body': {'addFloatingIp': {'address': ''}}} Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '' Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:36.537558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:23:36.539264 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:23:36.540930 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 01:23:36.540930 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:36.542931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-487e720b-cf6b-45df-a99e-590869cefc44 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:36.544414 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-487e720b-cf6b-45df-a99e-590869cefc44 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 400 len: 142 microversion: 2.1 time: 0.019197 Oct 11 01:23:36.545546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:36.547033 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 832/1680] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:36 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 142 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:23:36.548440 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-237211ba-d2f8-407d-bb82-bbe37256880a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1211 microversion: 2.1 time: 0.244681 Oct 11 01:23:36.564433 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 849/1681] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:36 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:36.564667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7db3edcd-7c4f-41bd-8ab4-9eac996c3396 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f9d5b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:36.564780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96646e71-84fd-47c7-bad4-1f751668da4f", "tag": "9744eee6-d394-4ea2-86ce-d48e7d27c746"}, {"name": "network-changed", "server_uuid": "1ca08714-5734-464f-b11c-874c5139c898", "tag": "79a24c93-41ef-4255-a271-b5579e23dcdd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:36.576228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.577277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.578034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.596197 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Creating event network-changed:9744eee6-d394-4ea2-86ce-d48e7d27c746 for instance 96646e71-84fd-47c7-bad4-1f751668da4f on n-h2-772273-9 Oct 11 01:23:36.596788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] Creating event network-changed:79a24c93-41ef-4255-a271-b5579e23dcdd for instance 1ca08714-5734-464f-b11c-874c5139c898 on n-h1-772273-9 Oct 11 01:23:36.608940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-254cd58e-e3b9-4d7c-88bc-040355ac49f5 req-d0c56c82-595e-4812-ac55-db538a781f47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056732 Oct 11 01:23:36.610021 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 850/1682] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:36.632192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:36.634887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:36.654419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.666800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.667932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.668814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:36.669300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:36.669739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:36.739100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 01:23:36.739886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquired lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 01:23:37.026228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Releasing lock "refresh_cache-96646e71-84fd-47c7-bad4-1f751668da4f" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 01:23:37.026830 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] HTTP exception thrown: floating IP not found Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Request method failure captured: Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action HTTP/1.1 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 41 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMViev5h_KZKXmrMV2Qi1peXeVDXN3Q_QtBTH_OO4wNEDc28-Uh4QW0VedLfHe-SLysTHKfv2EB1IUtQg34XCFeOttFlhqbgUsbuLcZMlH-q6QKjMuS8wc2xcU055IZ6WpxXVpOE815HlEFZjaFtjsubYb4Qae2WwpMHoaTzwL75LdM Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:37.028781 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: aa0e566965f34dfab25d749e46dfac1d Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:37.030483 n-d-772273-9 devstack@n-api.service[120493]: exception: floating IP not found Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '96646e71-84fd-47c7-bad4-1f751668da4f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:37.031405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 11 01:23:37.033045 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.034672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Returning 404 to user: floating IP not found {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:37.034672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da370bce-67ed-4a61-9816-fb50b6cd2169 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 404 len: 67 microversion: 2.1 time: 0.414387 Oct 11 01:23:37.037897 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 851/1683] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:36 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 67 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:23:37.044666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:37.045308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:37.055282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.056105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.056848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:37.058214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.058896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.059550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:37.144573 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7db3edcd-7c4f-41bd-8ab4-9eac996c3396 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/1dfd32d2-c920-4f52-b140-d6e71bb5402a" status: 202 len: 0 microversion: 2.1 time: 0.593359 Oct 11 01:23:37.145792 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 833/1684] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:36 2022] DELETE /compute/v2.1/os-security-groups/1dfd32d2-c920-4f52-b140-d6e71bb5402a => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:37.152668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:37.153750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:37.167604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.168629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.170870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:37.172147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.173133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.175066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:37.457179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:37.465376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5f133724-77d9-4acd-8f73-3b7d1974dafa tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.426782 Oct 11 01:23:37.466544 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 852/1685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:37 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:37.471820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-658acc87-5806-46f4-946f-4c3c1dfd8006 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:37.578616 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-658acc87-5806-46f4-946f-4c3c1dfd8006 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-658acc87-5806-46f4-946f-4c3c1dfd8006 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Request method failure captured: Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action HTTP/1.1 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 44 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMViev5h_KZKXmrMV2Qi1peXeVDXN3Q_QtBTH_OO4wNEDc28-Uh4QW0VedLfHe-SLysTHKfv2EB1IUtQg34XCFeOttFlhqbgUsbuLcZMlH-q6QKjMuS8wc2xcU055IZ6WpxXVpOE815HlEFZjaFtjsubYb4Qae2WwpMHoaTzwL75LdM Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:37.581391 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: aa0e566965f34dfab25d749e46dfac1d Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:37.582894 n-d-772273-9 devstack@n-api.service[120493]: exception: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '96646e71-84fd-47c7-bad4-1f751668da4f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:37.583847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 11 01:23:37.585131 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:37.587268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:37.590010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-658acc87-5806-46f4-946f-4c3c1dfd8006 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:37.591129 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-658acc87-5806-46f4-946f-4c3c1dfd8006 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action" status: 404 len: 88 microversion: 2.1 time: 0.123310 Oct 11 01:23:37.598482 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 853/1686] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:37 2022] POST /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f/action => generated 88 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:23:37.604123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3ce5fb6-2d7e-4fcc-8105-7de7339ba1b5 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f8e5790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:37.651007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bcbcbbb-a579-4fe9-9053-b9719df321c5 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1572 microversion: 2.1 time: 0.503576 Oct 11 01:23:37.654402 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 834/1687] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:37 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1572 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:37.660833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:37.665145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:37.678052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.678475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.678922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:37.679679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:37.680144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:37.680586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.271601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:38.293045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e58ead60-0f24-4910-89d6-4cf3be1c467d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1479 microversion: 2.1 time: 0.634146 Oct 11 01:23:38.294846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 835/1688] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:37 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1479 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:38.305295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:38.314272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:38.331681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.332477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.334237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.336039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.337732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.339869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.544027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3ce5fb6-2d7e-4fcc-8105-7de7339ba1b5 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/21dfc965-a9a8-4ebf-8ac1-91d1c5224447" status: 202 len: 0 microversion: 2.1 time: 0.943655 Oct 11 01:23:38.544661 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 854/1689] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:37 2022] DELETE /compute/v2.1/os-security-groups/21dfc965-a9a8-4ebf-8ac1-91d1c5224447 => generated 0 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:38.549786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:38.550415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:38.556667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.557583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.558697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.559097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.559587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.560017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.597045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:38.676141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:38.687548 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c8860b2-481c-4477-b3d4-f867db059c58 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.389392 Oct 11 01:23:38.688429 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 836/1690] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:38 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:38.696778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "name": "network-vif-unplugged", "status": "completed", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:38.709021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.709870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.710803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.726075 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] Creating event network-vif-unplugged:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:23:38.735567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0f9165a9-11f4-40d8-a0d8-be2ff887bb59 req-bcc62670-215b-4582-bc25-e69ba959564d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045149 Oct 11 01:23:38.736563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 837/1691] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:38.737757 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48705459-0dbe-4aee-934d-9726224627e1 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "DELETE /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 204 len: 0 microversion: 2.1 time: 0.191811 Oct 11 01:23:38.739220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 855/1692] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:38 2022] DELETE /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:38.744466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:38.745669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:38.748139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a9d2cde-fe3f-41ce-9c17-01833d6afca1 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f112f94dca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:38.752811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.753668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.754304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.755455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:38.756095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:38.756521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:38.973538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:38.983742 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2260983-6466-4897-855d-cf2f74cefff2 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.244941 Oct 11 01:23:38.985290 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 838/1693] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:38 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:38.992258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:38.993182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:39.002325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.002818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.003469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.004563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.005365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.005949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.209313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a9d2cde-fe3f-41ce-9c17-01833d6afca1 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/4b79c9e6-826b-4344-8bbc-37dd0b6b5d1a" status: 202 len: 0 microversion: 2.1 time: 0.466672 Oct 11 01:23:39.211891 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 856/1694] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:38 2022] DELETE /compute/v2.1/os-security-groups/4b79c9e6-826b-4344-8bbc-37dd0b6b5d1a => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:39.220138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:39.221100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:39.227244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.227993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.229529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.230524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.231138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.231595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.317840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:39.326709 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ed29b4d-dc7f-45c4-9f5f-e7c16183b6a8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1572 microversion: 2.1 time: 0.340230 Oct 11 01:23:39.327965 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 839/1695] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:38 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1572 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:39.332775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3177a760-eb0a-468d-9bce-69f4d7bb8437 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] Calling method '.version_select at 0x7f11387b15e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:39.508815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:39.522706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55705ab9-9245-4e4f-9838-28d4dc1b793b tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1542 microversion: 2.1 time: 0.309439 Oct 11 01:23:39.524147 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 857/1696] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:39 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:39.530250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:39.531072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:39.539293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.540027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.541257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.542409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.543045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.544504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.752846 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3177a760-eb0a-468d-9bce-69f4d7bb8437 tempest-SecurityGroupRulesTestJSON-436644766 tempest-SecurityGroupRulesTestJSON-436644766-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/dbf7aaeb-9370-4e2d-88e5-f0a0e32b3325" status: 202 len: 0 microversion: 2.1 time: 0.423605 Oct 11 01:23:39.754878 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 840/1697] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:39 2022] DELETE /compute/v2.1/os-security-groups/dbf7aaeb-9370-4e2d-88e5-f0a0e32b3325 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:39.761305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:39.762248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:39.770124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.771049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.772396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:39.773850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:39.774880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:39.776349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.029681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:40.046027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7aed2201-7f9e-46a3-acd2-9344b1b94fa5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1479 microversion: 2.1 time: 0.513995 Oct 11 01:23:40.047587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 858/1698] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:39 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1479 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:40.062488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:40.063566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:40.081810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.082664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.083115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.083875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.084488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.085103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.125845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:40.137367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ed72d52-a2d6-408b-8946-bb8b0ba6055f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.381092 Oct 11 01:23:40.138546 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 841/1699] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:39 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:40.350737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:40.351751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:40.366026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.366922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.368250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.369232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.371156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.372118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.520291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:40.533958 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49df616c-029a-4548-a869-016894a6c200 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.484750 Oct 11 01:23:40.535587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 859/1700] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:40 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:40.557143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:40.558607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:40.567467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.568471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.569089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:40.570288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:40.570941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:40.571394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.153917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:41.167804 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf94cf30-6809-4850-bae7-3f392161eea8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1570 microversion: 2.1 time: 0.821129 Oct 11 01:23:41.171825 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 842/1701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:40 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1570 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:41.186038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "name": "network-vif-plugged", "status": "completed", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:41.210015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.213469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.214162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.220007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:41.230020 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e68c3645-262d-444c-bfef-0f2a6a420413 tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1542 microversion: 2.1 time: 0.677219 Oct 11 01:23:41.255467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 860/1702] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:40 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1542 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:41.264335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:41.270374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:41.271827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:41.274510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] Creating event network-vif-plugged:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:23:41.283126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.283957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.284640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.286475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.287112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.288548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.293821 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b169bc5f-aa7e-4207-a33a-3ae6521a7fb6 req-6e107872-f8e3-446f-b56d-daf24d9cf849 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118335 Oct 11 01:23:41.294819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 843/1703] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:41.303095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:41.303837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:41.324143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.324645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.325082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.325790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.326243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.326669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.751679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:41.768098 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63bdbf5a-8818-4a74-ba12-86f018e49d9f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.463506 Oct 11 01:23:41.768790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 844/1704] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:41 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:41.774041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1491493646"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:41.774852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:41.782246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:41.797893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.798660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.799099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.799840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.800293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.800711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.802271 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c3d4608-f478-4a70-be43-b7e77925f673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1479 microversion: 2.1 time: 0.545277 Oct 11 01:23:41.803770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 861/1705] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:41 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1479 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:41.825138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:41.825842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:41.835471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.836263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.843512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:41.844701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:41.847912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:41.848821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:42.167106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Adding security group 517bdfc3-53cc-4019-a726-33d75fa50f05 to port 6682b532-825e-4eca-af34-bd26f7eb3a55 Oct 11 01:23:42.316967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:42.333451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-814302fc-de37-4015-93d4-6f225fe0cf2f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.522413 Oct 11 01:23:42.334699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 862/1706] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:41 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:42.341428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:42.342361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:42.349809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:42.350862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:42.353035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:42.354117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:42.354824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:42.355561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:42.561777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e566965f34dfab25d749e46dfac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a562b4ae4c314fc68294c57951b16b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:42.569738 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f2fd438-4e9f-4e98-b052-af73c3adc23c tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 200 len: 1500 microversion: 2.1 time: 0.233672 Oct 11 01:23:42.584359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 863/1707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:42 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 1500 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:42.584359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96646e71-84fd-47c7-bad4-1f751668da4f", "name": "network-vif-deleted", "tag": "9744eee6-d394-4ea2-86ce-d48e7d27c746"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:42.593964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:42.594664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:42.595255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:42.607546 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] Creating event network-vif-deleted:9744eee6-d394-4ea2-86ce-d48e7d27c746 for instance 96646e71-84fd-47c7-bad4-1f751668da4f on n-h2-772273-9 Oct 11 01:23:42.614666 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2531fab8-94b8-4e4e-9aab-a7746e1d59b6 req-177d6ee5-0ef6-4a54-8612-71328e7d8f57 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Oct 11 01:23:42.616036 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 864/1708] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:42.792595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:42.793651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:42.803157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:42.811556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:42.812461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:42.813223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:42.816083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:42.816537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:43.256667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:43.303001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4dc75668-ddc3-4c3a-b6fa-6d03e69972c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action" status: 202 len: 0 microversion: 2.1 time: 1.532738 Oct 11 01:23:43.304865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 845/1709] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:41 2022] POST /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4/action => generated 0 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:43.310660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:43.318592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:43.350231 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce850585-8ae7-4d4c-99e0-8c948268d810 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.561651 Oct 11 01:23:43.358791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:43.359298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:43.359946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 865/1710] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:42 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:43.364884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f8f0dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:43.374124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:43.374930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:43.376384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:43.385156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.150202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use.", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:23:44.152247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.152247 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.152972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05 HTTP/1.1 Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:44.157581 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: exception: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.159258 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '517bdfc3-53cc-4019-a726-33d75fa50f05'} Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:44.161133 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.162474 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.163882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] Oct 11 01:23:44.168801 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.169627 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7da102d-59d9-4a67-aba1-ef42bd314d0d tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1464 microversion: 2.1 time: 0.860825 Oct 11 01:23:44.169627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 846/1711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:43 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1464 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:44.172068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 400 to user: Security Group 517bdfc3-53cc-4019-a726-33d75fa50f05 in use. Oct 11 01:23:44.172068 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-25c5b9ef-33af-4908-a71b-612ab34ebce1'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:44.173838 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ff23bd54-b36b-4065-b52e-7895a6a78584 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05" status: 400 len: 185 microversion: 2.1 time: 0.812572 Oct 11 01:23:44.174916 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 866/1712] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:43 2022] DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05 => generated 185 bytes in 814 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:23:44.177684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.179827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.180337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1c14df-3f0c-41cd-834a-f429029422d7", "name": "network-vif-plugged", "status": "completed", "tag": "41e38c92-6899-4ed6-94ed-a200158f412f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:44.194799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.195631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.196298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.206708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.207222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.209862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.211468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.213451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.214502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.216187 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] Creating event network-vif-plugged:41e38c92-6899-4ed6-94ed-a200158f412f for instance 0e1c14df-3f0c-41cd-834a-f429029422d7 on n-h1-772273-9 Oct 11 01:23:44.223788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d6090484-882a-44ce-93b3-34dbf60d6ba2 req-ce4c6f5d-8da1-4000-949c-332097178897 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047217 Oct 11 01:23:44.225970 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 867/1713] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:44.233432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.234466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] [instance: 96646e71-84fd-47c7-bad4-1f751668da4f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.242801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.244638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.245393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.248455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.248455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.249584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.288506 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] HTTP exception thrown: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Request method failure captured: Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f HTTP/1.1 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMViev5h_KZKXmrMV2Qi1peXeVDXN3Q_QtBTH_OO4wNEDc28-Uh4QW0VedLfHe-SLysTHKfv2EB1IUtQg34XCFeOttFlhqbgUsbuLcZMlH-q6QKjMuS8wc2xcU055IZ6WpxXVpOE815HlEFZjaFtjsubYb4Qae2WwpMHoaTzwL75LdM Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:44.296343 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a562b4ae4c314fc68294c57951b16b80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: a562b4ae4c314fc68294c57951b16b80 Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491 Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: aa0e566965f34dfab25d749e46dfac1d Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:23:44.297951 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '96646e71-84fd-47c7-bad4-1f751668da4f'} Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:44.299012 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. Oct 11 01:23:44.300423 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:44.301754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] Returning 404 to user: Instance 96646e71-84fd-47c7-bad4-1f751668da4f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:44.301754 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ff3d6d23-e034-4937-924c-c449010706bb tempest-FloatingIPsAssociationNegativeTestJSON-807324491 tempest-FloatingIPsAssociationNegativeTestJSON-807324491-project] 10.222.0.66 "GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f" status: 404 len: 111 microversion: 2.1 time: 0.069984 Oct 11 01:23:44.301754 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 868/1714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:44 2022] GET /compute/v2.1/servers/96646e71-84fd-47c7-bad4-1f751668da4f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:44.308225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.308735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.333178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.343778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.344352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.345185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.345854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.346451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.392062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:44.554153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:44.567979 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bcc8b557-5267-40ee-a500-4e0b30f5ded4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.398245 Oct 11 01:23:44.569152 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 847/1715] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:44 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:44.570008 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41d957ab-30bf-4346-809b-dc93b3e3b586 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 204 len: 0 microversion: 2.1 time: 0.269137 Oct 11 01:23:44.570589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 869/1716] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:44 2022] DELETE /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:44.579558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:44.582419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.585104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.588228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.600215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.601037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.601682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.602581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.603323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.604179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.606013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.606569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.607013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.607789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.608429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.609155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.621408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:44.719789 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7dcce02a-53fb-4258-a00b-f01ea772525c tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 0 microversion: 2.1 time: 0.149235 Oct 11 01:23:44.725342 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 848/1717] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:44 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:44.735415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.737770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.750644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.752287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.753931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.756745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.758091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.759298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.824199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:44.833102 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4feb7f2f-77b2-4a6a-b442-a47548aefd02 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.259465 Oct 11 01:23:44.833911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 870/1718] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:44 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:44.839545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:44.849565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:44.851994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.852672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.853614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.871806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] Creating event network-changed:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:44.878327 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6de71357-0d93-4774-94e5-dfed70460203 req-7f9abe0b-ee49-4d20-9085-370f39eea46c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042988 Oct 11 01:23:44.879671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 871/1719] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:44.886983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:44.887937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:44.895267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.896102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.896768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.898259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.898940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.899669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.963957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:44.964748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:44.965343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:44.965951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lazy-loading 'fault' on Instance uuid 4d60df1f-1573-4625-a01a-f528e9418492 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:45.166820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:45.176100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cceced6-e3c8-4a21-b417-deefe5b3f6af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1645 microversion: 2.1 time: 0.451635 Oct 11 01:23:45.182275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 849/1720] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:44 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1645 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:45.204698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8cd5f4a-31bb-4a1b-ba52-60090bff9506 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1598 microversion: 2.1 time: 0.323603 Oct 11 01:23:45.220532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 872/1721] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:44 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1598 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:45.229376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:45.231895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.243481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.244754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.245263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.246218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.247001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.247566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.351166 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-736e2b33-ad82-4191-b58f-e08dd0328cf4 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action" status: 202 len: 0 microversion: 2.1 time: 0.127343 Oct 11 01:23:45.352430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 850/1722] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:45 2022] POST /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:45.363287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:45.364608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.378109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.379484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.380619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.381591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.382148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.382743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.567578 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59c3bab4-7405-4e69-91c5-e54d1f990838 tempest-ServersAdminTestJSON-1947061224 tempest-ServersAdminTestJSON-1947061224-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1615 microversion: 2.1 time: 0.209116 Oct 11 01:23:45.568853 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 873/1723] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:45 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1615 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:45.593034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:45.593615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.600338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:45.600601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.605798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.606613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.607324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.608189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.608484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.608936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.609687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.610203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.610328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.610754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.610873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.611190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.659231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:45.812617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:45.818978 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5613a5d2-4dcc-4e65-b375-bd4d56692615 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 204 len: 0 microversion: 2.1 time: 0.231728 Oct 11 01:23:45.819971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 851/1724] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:45 2022] DELETE /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:45.832214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-caeaa19b-23f6-4aea-8df9-9b019d7659ad tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.237343 Oct 11 01:23:45.836124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:45.838215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.848255 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 874/1725] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:45 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:45.852472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.855103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.856638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.858168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:45.859005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:45.860162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.861540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.862803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.866145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.867077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.867794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:45.868742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:45.869374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:45.869991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:46.181310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:46.192290 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-805d74f8-bc5a-440a-9a6b-66216bb9a88c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1469 microversion: 2.1 time: 0.367154 Oct 11 01:23:46.217250 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 852/1726] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:45 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1469 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:46.230050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:46.230050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:46.238870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:46.245725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:46.245725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:46.245725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:46.250968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac4e16b7-8ea9-49ab-8334-0d5addaa174c tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.397954 Oct 11 01:23:46.252644 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 875/1727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:45 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:46.253005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:46.253563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:46.254006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:46.482174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:46.490510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-415f87a7-4633-4855-ad6a-e6c1590a50d3 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1645 microversion: 2.1 time: 0.272044 Oct 11 01:23:46.502464 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 853/1728] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:46 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1645 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:46.858946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:46.859799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:46.874292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:46.875874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:46.876603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:46.881019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:46.882740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:46.884244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.041511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:47.052161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-772b0e8e-39d1-4810-8422-7669ba8b6a78 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.198549 Oct 11 01:23:47.052782 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 876/1729] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:46 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:47.220922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:47.221545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:47.229119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.229608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.230042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.230738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.231193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.231643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.279751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:47.280371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:47.296123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.297834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.299169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.300254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.301057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.301914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.390296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:47.403518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f98e02f-1af7-43c2-9a21-09b1890dd673 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1469 microversion: 2.1 time: 0.185295 Oct 11 01:23:47.404055 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 854/1730] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:47 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1469 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:47.514614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:47.515599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:47.528189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.528930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.529614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.530524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:47.531385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:47.532005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:47.675826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:47.693879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39a75b8f-c050-4527-9131-6a4a93a50f55 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.414343 Oct 11 01:23:47.694765 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 877/1731] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:47 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:47.817742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:47.860656 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52fabce4-5350-4527-98d8-89cc4b38bd7f tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1645 microversion: 2.1 time: 0.334387 Oct 11 01:23:47.861446 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 855/1732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:47 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1645 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:48.015027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca08714-5734-464f-b11c-874c5139c898", "name": "network-vif-plugged", "status": "completed", "tag": "79a24c93-41ef-4255-a271-b5579e23dcdd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:48.052370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.053559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.054183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.072405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] Creating event network-vif-plugged:79a24c93-41ef-4255-a271-b5579e23dcdd for instance 1ca08714-5734-464f-b11c-874c5139c898 on n-h1-772273-9 Oct 11 01:23:48.079829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:48.080525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:48.099078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:48.100600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.101110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.102956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.102956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.102956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.103504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.115017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2def127e-1f17-40f3-aca9-9d8b6a3242ed req-dce8a80d-0a46-4b51-a51c-3d56f79e9b96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111022 Oct 11 01:23:48.116321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 878/1733] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:48.172811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:48.431039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:48.432918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:48.450506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.451842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.452503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.453961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.456436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.457077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.469373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:48.477863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-897fcb6b-9423-40b7-9103-109e0166002f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1318 microversion: 2.1 time: 0.407183 Oct 11 01:23:48.483121 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 856/1734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:48 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:48.690026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:48.699142 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b4484356-73a6-41d1-858c-422fc14d5848 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1469 microversion: 2.1 time: 0.272331 Oct 11 01:23:48.700509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 879/1735] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:48 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:48.721410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:48.722365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:48.729131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.729888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.730330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.731106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.731597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.732219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.885793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:48.886929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:48.898562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.905420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.906410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.907537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:48.908224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:48.908898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:48.984233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:49.001053 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75477cd2-6d56-4412-bab8-d960534c2472 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1199 microversion: 2.1 time: 0.281923 Oct 11 01:23:49.004972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 857/1736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:48 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1199 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:49.037158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69a6004-0cce-4e57-97e1-838d447161d7", "name": "network-vif-deleted", "tag": "5b2da5b2-404f-4e29-be04-f5d5f63904bc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:49.065687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.067078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.069956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.105927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] Creating event network-vif-deleted:5b2da5b2-404f-4e29-be04-f5d5f63904bc for instance e69a6004-0cce-4e57-97e1-838d447161d7 on n-h1-772273-9 Oct 11 01:23:49.122208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3fe26868-f278-41fa-b13f-9ae347d50d86 req-b29420f9-7f9b-4fb6-a14c-b150850bffdf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112605 Oct 11 01:23:49.122843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 858/1737] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:49.177863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:49.193321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b904b98-a3d0-4a38-a662-fa6b31d80f3e tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1645 microversion: 2.1 time: 0.310750 Oct 11 01:23:49.203891 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 880/1738] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:48 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1645 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:49.511025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:49.511829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:49.525135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.531027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.532285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.533221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.535413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.536682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.724644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:49.725894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:49.735881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.736587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.737211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.741632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.753499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.756231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.848072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:49.848579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:49.849028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:49.861444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lazy-loading 'fault' on Instance uuid e69a6004-0cce-4e57-97e1-838d447161d7 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:49.977400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:49.989580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a27d1a15-bae1-47da-b7b8-4078a566cc9c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 200 len: 1303 microversion: 2.1 time: 0.268747 Oct 11 01:23:49.990464 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 881/1739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:49 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 1303 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:50.023658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:50.041151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:50.042061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:50.044087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f93ccbf-be94-422b-8a94-032b130c1d03 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1509 microversion: 2.1 time: 0.533855 Oct 11 01:23:50.045204 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 859/1740] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:49 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:50.056419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.056953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.057870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.058890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.059582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.062130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.194916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "name": "network-vif-unplugged", "status": "completed", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:50.219661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.226039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.226484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.253694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] Creating event network-vif-unplugged:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:50.261387 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b843d010-fcd3-4376-92f9-ebc234b6ae79 req-3a68e7d9-8d15-49f9-aad6-6b2d916cbf8d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074444 Oct 11 01:23:50.268046 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 860/1741] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:23:50.278062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:50.278794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:50.294302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.294804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.298238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.300209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.302872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.303625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.588979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:50.601859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ea02523-7467-4cea-bc0c-f486c518e064 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1466 microversion: 2.1 time: 0.332003 Oct 11 01:23:50.604605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 861/1742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:50 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:50.715755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:50.723834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36c7835a-421c-482e-9231-e1167c2d9079 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1383 microversion: 2.1 time: 0.688033 Oct 11 01:23:50.735361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 882/1743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:50 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1383 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:50.901514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4ea2c8-381c-44a2-846c-ad349f12dab4", "name": "network-vif-deleted", "tag": "6682b532-825e-4eca-af34-bd26f7eb3a55"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:50.947246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:50.948305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:50.951674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:50.997489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] Creating event network-vif-deleted:6682b532-825e-4eca-af34-bd26f7eb3a55 for instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 on n-h1-772273-9 Oct 11 01:23:51.004221 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-efd4cfc2-f3f8-4643-ac4c-2701ceb02b57 req-1b95f211-1db6-4992-8769-f02a9e5a0105 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114471 Oct 11 01:23:51.005114 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 883/1744] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:51.019968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.021086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: e69a6004-0cce-4e57-97e1-838d447161d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.028490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.029378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.030063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.031027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.032433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.033103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.061651 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] HTTP exception thrown: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Request method failure captured: Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 HTTP/1.1 Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMUoSzP8fso5zebhhLOrLW5Eddywf0J55Kq4xafdFtz5Os8NrqEqHC3sq-ixb1ucFYZ8TQ5dWRqLZc4oZglBBKge_x8uEFQYyJ2NzVRlyZpmfeI_jF2d6Dwoy3bVPQD6nPBZg7HTtyjv8hb5b59FbadDV9ZANpMC5-lBWZpMJltJJMA Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:51.066591 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 825933c38eef4b7792bfe66e5a07ae88 Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. Oct 11 01:23:51.068882 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e69a6004-0cce-4e57-97e1-838d447161d7'} Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:51.070096 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. Oct 11 01:23:51.072726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:51.075416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Returning 404 to user: Instance e69a6004-0cce-4e57-97e1-838d447161d7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:51.076216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-faf4acc7-82fe-4105-8590-d25a087b00d1 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7" status: 404 len: 111 microversion: 2.1 time: 0.065263 Oct 11 01:23:51.088122 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 884/1745] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:51 2022] GET /compute/v2.1/servers/e69a6004-0cce-4e57-97e1-838d447161d7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:51.094016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.094938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.116369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.119568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.121467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.124588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.126936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.129251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.210651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.211289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.236306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.239786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.240257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.242903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.254404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.254756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.261190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:51.465118 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab1908a9-1cdd-45cf-bf9b-1d08fde6ffbb tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "DELETE /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 204 len: 0 microversion: 2.1 time: 0.375178 Oct 11 01:23:51.465723 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 885/1746] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:51 2022] DELETE /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:51.474862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.475597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.497317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.497807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.498237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.498935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.499602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.507015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.659745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b16a59e-13fc-4bda-9495-25ed147b87c5 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1534 microversion: 2.1 time: 0.914991 Oct 11 01:23:51.664093 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 862/1747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:50 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1534 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:51.680338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.681851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.693111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.700019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.700702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.701649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.702268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.702871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.792467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.792963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.800083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.800821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lazy-loading 'fault' on Instance uuid 9f4ea2c8-381c-44a2-846c-ad349f12dab4 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:51.860097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:51.872412 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a020062-6254-4856-acc5-91f0e9b2b5d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1305 microversion: 2.1 time: 0.206961 Oct 11 01:23:51.883154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 863/1748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:51 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1305 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:51.888418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:51.889256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:51.900520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.901238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.912108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:51.913143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:51.913779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:51.914372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.000787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:52.018814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c3caf0b-5a6f-40be-9b53-3b98d72363c5 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1470 microversion: 2.1 time: 0.548363 Oct 11 01:23:52.019808 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 886/1749] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:51 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:23:52.189848 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b24c851-2cca-4038-a4ef-4c91b1a51f6b tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1534 microversion: 2.1 time: 0.305091 Oct 11 01:23:52.191711 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 864/1750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:51 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1534 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:52.214054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:52.218747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.219711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.220353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.221398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.222085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.222704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.240466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:23:52.259742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11b9dbf3-4e06-483f-a6f5-24c00bdd2d99 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050150 Oct 11 01:23:52.271797 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 887/1751] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:23:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:52.273902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": false, "disk_over_commit": false}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:52.277601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:52.284902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.285687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.287054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.288200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.288980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.290832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.355443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lazy-loading 'flavor' on Instance uuid 1ca08714-5734-464f-b11c-874c5139c898 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:52.393195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:23:52.892080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "37a52397-3953-49d0-8746-4d0812b958c2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:52.895169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:52.919977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.920486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.925376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:52.926363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:52.927222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:52.928325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.128336 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] HTTP exception thrown: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Request method failure captured: Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7/os-volume_attachments/41b44745-cfb8-40b1-889e-e5a43a455af6 HTTP/1.1 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 74 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMTwrBHVP3ZaKN3pWUkNmwgrNYX78fBUYUxi3AXgvfdE8hmm7hnyI_3rS1FeHfXFF4ECkMgyiA20W7RUiOkLmvpd2cuSGmTpt_Ds0eMOkhbodY-C5Ix-8_0HEypQB-1BDGRxFJpxmvw4NiselLv5OZeA49GblgwOyoHEe27iBRhTVcE Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 1708f557a21a46dd9c5f91b98ed436f6 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:23:53.132825 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1708f557a21a46dd9c5f91b98ed436f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 1708f557a21a46dd9c5f91b98ed436f6 Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1214812222 Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesAdminNegativeTest-1214812222-project-admin Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 42bc72eef67f473087721a0cae4adb59 Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesAdminNegativeTest-1214812222-project-admin Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: {"volumeAttachment": {"volumeId": "37a52397-3953-49d0-8746-4d0812b958c2"}} Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:23:53.134999 n-d-772273-9 devstack@n-api.service[120493]: exception: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '0e1c14df-3f0c-41cd-834a-f429029422d7', 'id': '41b44745-cfb8-40b1-889e-e5a43a455af6', 'body': {'volumeAttachment': {'volumeId': '37a52397-3953-49d0-8746-4d0812b958c2'}}} Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:23:53.141621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. (HTTP 404) (Request-ID: req-8e8779dc-73e7-4c02-90cd-511a534c750f) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:23:53.143679 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:53.145058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. Oct 11 01:23:53.146323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:53.147981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] Returning 404 to user: Volume 41b44745-cfb8-40b1-889e-e5a43a455af6 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:53.147981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5f7032e8-c14d-4f94-beea-369b90399618 tempest-VolumesAdminNegativeTest-1214812222 tempest-VolumesAdminNegativeTest-1214812222-project-admin] 10.222.0.66 "PUT /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7/os-volume_attachments/41b44745-cfb8-40b1-889e-e5a43a455af6" status: 404 len: 109 microversion: 2.1 time: 0.250073 Oct 11 01:23:53.147981 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 888/1752] 10.222.0.66 () {60 vars in 1433 bytes} [Tue Oct 11 01:23:52 2022] PUT /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7/os-volume_attachments/41b44745-cfb8-40b1-889e-e5a43a455af6 => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:53.147981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:53.147981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:53.162624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:53.163131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:53.163605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.168231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:53.168416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:53.168810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.265620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:53.267430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:53.269472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.270576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lazy-loading 'fault' on Instance uuid 9f4ea2c8-381c-44a2-846c-ad349f12dab4 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:53.393618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:53.423224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dfc7a982-0734-4c17-869a-4c705556f484 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 200 len: 1305 microversion: 2.1 time: 0.263739 Oct 11 01:23:53.447927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 889/1753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:53 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 1305 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:53.468931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:53.469698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:53.495073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:53.499813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:53.500658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.501453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:53.501936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:53.502380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:53.830710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:53.890062 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1bcf16b-67bd-45ae-b4e7-0489edda839c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1470 microversion: 2.1 time: 0.436800 Oct 11 01:23:53.899060 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 890/1754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:53 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:54.496187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:54.499433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:54.526499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:54.529454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:54.532654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:54.538916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:54.539863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:54.556115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:54.585014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 HTTP/1.1 Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:23:54.586764 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:23:54.588637 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9f4ea2c8-381c-44a2-846c-ad349f12dab4'} Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:54.591279 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:23:54.595845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:23:54.599007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:54.599007 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b02f63c-a703-4b44-a2ca-815d6f129852 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 404 len: 111 microversion: 2.1 time: 0.126458 Oct 11 01:23:54.599680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 891/1755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:54 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:23:54.604837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d91f1af-0c7d-4eb4-9388-79cf984bee61 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f9c7790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:56.038140 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d91f1af-0c7d-4eb4-9388-79cf984bee61 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67" status: 202 len: 0 microversion: 2.1 time: 1.437298 Oct 11 01:23:56.039950 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 892/1756] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:54 2022] DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67 => generated 0 bytes in 1440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:56.046367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:56.047747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:56.063261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.063981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.064437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:56.065165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.069614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.070102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:56.154434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.155144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.156052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:56.156856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lazy-loading 'fault' on Instance uuid 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:23:56.282841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:56.296971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3bacc6db-9691-44e1-a6b7-550f6d75ca8c tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 200 len: 1304 microversion: 2.1 time: 0.255603 Oct 11 01:23:56.299308 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 893/1757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:56 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:56.311168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fb84e7-8a64-4b1c-90d5-c1b8738600a7", "name": "network-vif-deleted", "tag": "0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:56.337114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.340076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.340578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:56.385696 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] Creating event network-vif-deleted:0c6cb7a4-69b1-4374-9c5c-6bca0ac8f09c for instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 on n-h1-772273-9 Oct 11 01:23:56.408214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-98d442ed-9a56-4f0e-9e97-5294060d7c81 req-d49ffd7d-61b0-4f80-9b62-7acc88ea76c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106746 Oct 11 01:23:56.413980 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 894/1758] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:56.428704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96a59990-6e84-41b3-ba47-2386cd24d8c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f6cf8b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:56.810969 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73fcd2c6-6817-49ad-a252-a55f2abeaa2d tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898/action" status: 202 len: 0 microversion: 2.1 time: 4.541406 Oct 11 01:23:56.814984 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 865/1759] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:23:52 2022] POST /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898/action => generated 0 bytes in 4546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:56.819965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:56.822166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:56.842733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.843229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.843692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:56.844401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:56.854330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:56.856853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:57.150288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96a59990-6e84-41b3-ba47-2386cd24d8c8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05" status: 202 len: 0 microversion: 2.1 time: 0.732580 Oct 11 01:23:57.151577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 895/1760] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:56 2022] DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:23:57.156754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1578416679", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "20dc106a-253b-405c-ac01-f4b2f29545d4"}], "block_device_mapping_v2": [{"uuid": "4c50d13c-9133-49c8-83d8-76ae1c5ffea5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:57.271628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] validate_networks() for [('20dc106a-253b-405c-ac01-f4b2f29545d4', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:23:57.338468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:57.348798 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-628e0c34-e34d-4a56-b300-5186ad1b8149 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.532170 Oct 11 01:23:57.350120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 866/1761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:56 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:57.359398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52eac214-57c1-4a0c-8872-467e5f93b033 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'create', calling method: .version_select at 0x7f112f9c8160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1608002243", "description": "tempest-description-11124847"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:58.158357 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52eac214-57c1-4a0c-8872-467e5f93b033 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.806376 Oct 11 01:23:58.167527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 867/1762] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:23:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:58.167527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:58.167527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 53fb84e7-8a64-4b1c-90d5-c1b8738600a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:58.187679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.191938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.192460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.193682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.194277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.196200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.283684 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] HTTP exception thrown: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Request method failure captured: Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 HTTP/1.1 Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMUoSzP8fso5zebhhLOrLW5Eddywf0J55Kq4xafdFtz5Os8NrqEqHC3sq-ixb1ucFYZ8TQ5dWRqLZc4oZglBBKge_x8uEFQYyJ2NzVRlyZpmfeI_jF2d6Dwoy3bVPQD6nPBZg7HTtyjv8hb5b59FbadDV9ZANpMC5-lBWZpMJltJJMA Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:23:58.298058 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 825933c38eef4b7792bfe66e5a07ae88 Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. Oct 11 01:23:58.299585 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '53fb84e7-8a64-4b1c-90d5-c1b8738600a7'} Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:23:58.300442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. Oct 11 01:23:58.301828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:23:58.303059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Returning 404 to user: Instance 53fb84e7-8a64-4b1c-90d5-c1b8738600a7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:23:58.303059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c9e641f-4a00-4ae3-90a5-f9a73d22cd08 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7" status: 404 len: 111 microversion: 2.1 time: 0.140235 Oct 11 01:23:58.303580 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 868/1763] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:58 2022] GET /compute/v2.1/servers/53fb84e7-8a64-4b1c-90d5-c1b8738600a7 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:23:58.319082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:58.320351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:58.339976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.341308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.342027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.343771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.344591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.345237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.410818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:23:58.411921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:23:58.412657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:23:58.413271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:23:58.413883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:23:58.423163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:58.432822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.433667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.434322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.435294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:58.442814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:58.443623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:58.474496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:23:58.496868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Getting quotas for user 81493fadd3b044479ce4722ce58f3235 and project 6af68227080040c7845ed9f9ebb758af. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:23:58.621641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb85c26b-b49c-4e54-bab8-46c30b290fb4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 204 len: 0 microversion: 2.1 time: 0.313959 Oct 11 01:23:58.622473 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 869/1764] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:58 2022] DELETE /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:58.639882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1756441-1014-4aa7-996e-99e51fbfbafa tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Action: 'update', calling method: .version_select at 0x7f112fa29dc0>, body: {"security_group": {"name": "tempest-sg-hth-489793017", "description": "tempest-description-hth-7668038"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:23:58.677778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:23:58.682850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c50d13c-9133-49c8-83d8-76ae1c5ffea5',volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:23:58.953616 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ace16b1-772a-497c-8c2d-4edcc70f3a66 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.797301 Oct 11 01:23:58.955863 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 896/1765] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:23:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:23:58.977303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:58.983121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:58.998367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.001493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.003728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.004854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.006287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.006910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.070071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:23:59.103030 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1756441-1014-4aa7-996e-99e51fbfbafa tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "PUT /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6" status: 200 len: 214 microversion: 2.1 time: 0.479229 Oct 11 01:23:59.103921 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 870/1766] 10.222.0.66 () {60 vars in 1290 bytes} [Tue Oct 11 01:23:58 2022] PUT /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6 => generated 214 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:59.117962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:59.123631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:59.146572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.148477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.150420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.151840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.153153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.153601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.277236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f6768e1-1f0b-433f-9b31-0a3622b92004 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 204 len: 0 microversion: 2.1 time: 0.319747 Oct 11 01:23:59.278532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 897/1767] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:23:58 2022] DELETE /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:23:59.287391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:59.288903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:59.307445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.307799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.308516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.310312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.317064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.317709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.623471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:59.642739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdcde98d-247a-4821-99b4-931c08ccead4 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1515 microversion: 2.1 time: 0.360687 Oct 11 01:23:59.647948 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 898/1768] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:59 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:59.652659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:59.669340 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b9193db-212b-457c-9eb7-7191a05d03b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.555850 Oct 11 01:23:59.669958 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 871/1769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:59 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:23:59.674938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:59.677149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:59.692371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9d3e839-18cb-425c-b63d-2a3b812db709 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fa29c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:59.788101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9d3e839-18cb-425c-b63d-2a3b812db709 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6" status: 200 len: 214 microversion: 2.1 time: 0.111385 Oct 11 01:23:59.790220 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 872/1770] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:23:59 2022] GET /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6 => generated 214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:23:59.795242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:23:59.796143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:23:59.808085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.808941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.809564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.810475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:23:59.811122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:23:59.811796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:23:59.881754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:59.894694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:59.901364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:23:59.904120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f665da7b-15c3-47b1-a120-19410166e41d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1104 microversion: 2.25 time: 0.255023 Oct 11 01:23:59.919947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 899/1771] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:23:59 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1104 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:23:59.930897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b6f3bf6-c504-422c-b5cc-5cf2658e1e62 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fb599d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.159629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:00.163084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:00.174887 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8330ac7-86f5-4a6d-97ad-d064e5b58082 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1470 microversion: 2.1 time: 0.383294 Oct 11 01:24:00.176355 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 873/1772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:23:59 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:00.268463 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b6f3bf6-c504-422c-b5cc-5cf2658e1e62 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6" status: 202 len: 0 microversion: 2.1 time: 0.347275 Oct 11 01:24:00.270249 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 900/1773] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:23:59 2022] DELETE /compute/v2.1/os-security-groups/6214b87a-ecd1-4b69-9d45-0b8021dc3ff6 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:24:00.278419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.279324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:00.298503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.301855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.304337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.307100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.307858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.309927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.331712 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 HTTP/1.1 Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:00.333404 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.335239 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '9f4ea2c8-381c-44a2-846c-ad349f12dab4'} Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.336369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.338214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.343108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.344268 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6908c1bc-969a-4529-8528-29c06f2783a2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 404 len: 111 microversion: 2.1 time: 0.070276 Oct 11 01:24:00.348543 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 874/1774] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.357155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.358350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: 9f4ea2c8-381c-44a2-846c-ad349f12dab4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:00.367465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.368753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.369421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.370621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.371302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.371991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.388907 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 HTTP/1.1 Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:00.390637 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.392201 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9f4ea2c8-381c-44a2-846c-ad349f12dab4'} Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.393060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. Oct 11 01:24:00.394458 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.397161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Instance 9f4ea2c8-381c-44a2-846c-ad349f12dab4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.397161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6eec4161-3029-4576-83a5-fff8ac2c36e9 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4" status: 404 len: 111 microversion: 2.1 time: 0.040014 Oct 11 01:24:00.397161 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 901/1775] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:00 2022] GET /compute/v2.1/servers/9f4ea2c8-381c-44a2-846c-ad349f12dab4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:24:00.400948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fa5e4c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.431946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:00.433101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 517bdfc3-53cc-4019-a726-33d75fa50f05 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:00.433830 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.433830 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05 HTTP/1.1 Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:00.436013 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.437800 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '517bdfc3-53cc-4019-a726-33d75fa50f05'} Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.438897 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:00.440469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.443757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] Oct 11 01:24:00.446989 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.450252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 517bdfc3-53cc-4019-a726-33d75fa50f05 does not exist Oct 11 01:24:00.450252 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-5ff13712-9e04-4b6b-b1a9-1983bc088857'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.451632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cf2b86f-eba6-4b2b-9744-3a06eb326b77 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05" status: 404 len: 194 microversion: 2.1 time: 0.054373 Oct 11 01:24:00.453628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 875/1776] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/os-security-groups/517bdfc3-53cc-4019-a726-33d75fa50f05 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.464082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fb599d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.530547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:00.531534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:00.532598 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.532598 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67 HTTP/1.1 Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:00.536300 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.537805 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2093b4b5-56cc-400a-80e6-bb1a8abafb67'} Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.538727 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:00.541195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.542816 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 2093b4b5-56cc-400a-80e6-bb1a8abafb67 does not exist Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-f18e32e3-dd35-4fc0-95b1-04de3c8fae08'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54756a94-b912-41f4-b1a1-f8a1c0f46599 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67" status: 404 len: 194 microversion: 2.1 time: 0.079731 Oct 11 01:24:00.544718 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 902/1777] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/os-security-groups/2093b4b5-56cc-400a-80e6-bb1a8abafb67 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.550391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f9aa0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.592617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:00.593311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:00.594331 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.594331 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 HTTP/1.1 Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:00.597129 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.598645 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '7f1b644c-d04d-4e70-b5b8-ed6f6ce38212'} Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.599622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:00.601426 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.603399 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 does not exist Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-dceefad5-7ba9-46e4-92a3-4e6beeef4833'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2d98d1b-2a78-42cd-8f05-e978443472d4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212" status: 404 len: 194 microversion: 2.1 time: 0.053328 Oct 11 01:24:00.605415 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 876/1778] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/os-security-groups/7f1b644c-d04d-4e70-b5b8-ed6f6ce38212 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.610193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f8e1b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.644246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:00.644950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 946dd6d6-27e6-410d-9bde-a1deee1e69da not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:00.645500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.645500 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da HTTP/1.1 Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:00.647703 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.649998 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '946dd6d6-27e6-410d-9bde-a1deee1e69da'} Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.651165 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:00.652745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.654952 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 946dd6d6-27e6-410d-9bde-a1deee1e69da does not exist Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-3b2432dc-dd7b-4253-86c0-1ef15932faaf'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.657621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5996588a-2659-4815-afa4-d543907aee56 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da" status: 404 len: 194 microversion: 2.1 time: 0.044170 Oct 11 01:24:00.661963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112fabeb80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.663111 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 903/1779] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/os-security-groups/946dd6d6-27e6-410d-9bde-a1deee1e69da => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.671735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.672726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:00.683571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.690773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.691493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.692509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.693181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.693821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.699971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:00.700620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group 4b446ae7-40bd-4335-9261-b90a19f66962 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:00.701136 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.701136 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962 HTTP/1.1 Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:00.705116 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.707253 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4b446ae7-40bd-4335-9261-b90a19f66962'} Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.708754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:00.711857 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.714470 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] Oct 11 01:24:00.718485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:00.720134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group 4b446ae7-40bd-4335-9261-b90a19f66962 does not exist Oct 11 01:24:00.720134 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-ec48f79e-de00-41b9-8b1b-546ccb789b67'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:00.721557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a9441e9-2964-43b7-ad81-7a02e79473b4 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962" status: 404 len: 194 microversion: 2.1 time: 0.066926 Oct 11 01:24:00.722593 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 877/1780] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:00 2022] DELETE /compute/v2.1/os-security-groups/4b446ae7-40bd-4335-9261-b90a19f66962 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:00.735404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:00.736333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:00.746788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.747778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.748972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.750370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:00.751069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:00.751841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:00.995550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:01.006169 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1646b525-c20a-43e2-a6da-55db02db104b tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1515 microversion: 2.1 time: 0.341841 Oct 11 01:24:01.011239 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 904/1781] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:00 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1515 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:01.022124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f6cfee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:01.075742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:01.084379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:24:01.085206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Neutron security group bdb07b95-0036-4f8e-a252-5a52ebda41ed not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:24:01.085897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.085897 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.087782 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78cd86a1-cf34-4db8-97b6-f5b75ddffcf1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.355108 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed HTTP/1.1 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:01.088814 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.103635 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'bdb07b95-0036-4f8e-a252-5a52ebda41ed'} Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:01.105388 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:24:01.107218 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.111437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] Oct 11 01:24:01.117194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:01.118144 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 878/1782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:00 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:01.118144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:01.118144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:01.118574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Security group bdb07b95-0036-4f8e-a252-5a52ebda41ed does not exist Oct 11 01:24:01.118574 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-a60476ab-cafa-4ef4-a882-91c14434dd3e'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:01.119573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdc0f67d-ddff-482e-8f01-6a8bd93c9476 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed" status: 404 len: 194 microversion: 2.1 time: 0.106303 Oct 11 01:24:01.120669 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 905/1783] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:01 2022] DELETE /compute/v2.1/os-security-groups/bdb07b95-0036-4f8e-a252-5a52ebda41ed => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:01.120937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.121769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.123362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.125873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.126428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.127586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.131847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:01.132568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:01.144600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.145438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.146100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.147017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.147697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.148325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.227402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:24:01.426444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:01.452734 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac37f783-cb4b-40fc-ab78-adb1e20a422d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 204 len: 0 microversion: 2.1 time: 0.325991 Oct 11 01:24:01.458032 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 906/1784] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:24:01 2022] DELETE /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:01.473127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:01.475588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:01.498056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.499882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.502598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.503628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.507800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.510317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.795632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:01.814208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:01.816431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:01.817595 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-922c6244-fa66-475b-9a81-37e81c51b9ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1185 microversion: 2.25 time: 0.725040 Oct 11 01:24:01.818536 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 879/1785] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:01 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1185 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:01.827588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:01.831415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:01.845606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.855153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.868476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:01.869252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:01.869730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:01.870168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.072188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:02.085760 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2168c9b-e24b-4768-bb06-89363971a0ac tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1470 microversion: 2.1 time: 0.621361 Oct 11 01:24:02.108887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 907/1786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:01 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:02.115507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:02.120061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:02.135827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.136341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.136795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.137521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.137985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.138417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.507138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:02.515963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07d735e1-8c21-437f-8ff8-c9528e756829 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1645 microversion: 2.1 time: 0.695972 Oct 11 01:24:02.516525 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 880/1787] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:01 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1645 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:02.532272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:02.533136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:02.552291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.553093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.553719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.554631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.556095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.565896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:02.566524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.574624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9cee265b-e005-4c8e-b819-5660868ace99 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1515 microversion: 2.1 time: 0.464192 Oct 11 01:24:02.575592 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 908/1788] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:02 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:02.847443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:02.848419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:02.863712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.864772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.868751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:02.871051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:02.872628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:02.873484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.038691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:03.056877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:03.058604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:03.060183 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-245d6356-5ef5-475d-8df8-63d991ef9689 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1251 microversion: 2.25 time: 0.217673 Oct 11 01:24:03.061214 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 909/1789] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:02 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1251 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:03.117274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:03.119783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:03.127027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.132113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.132684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.135844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.136435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.144036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.185323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:03.446218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:03.468307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825933c38eef4b7792bfe66e5a07ae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f2320ac975413cb4401b9c082c6a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:03.470166 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fae4752c-84d2-467c-955c-c74163afb121 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.943781 Oct 11 01:24:03.472306 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 881/1790] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:02 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:03.483585 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eb1d6deb-3358-4ba1-a5d7-911f5477d2af tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 200 len: 1428 microversion: 2.1 time: 0.369203 Oct 11 01:24:03.490588 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 910/1791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:03 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 1428 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:03.504327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dbdaaa1-d82f-47c6-8dcb-c001bcd69685 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112f9af5e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:03.544111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:03.551086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:03.565506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.576169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.577168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.588724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.591817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.592470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.602347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dbdaaa1-d82f-47c6-8dcb-c001bcd69685 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599" status: 200 len: 637 microversion: 2.1 time: 0.109369 Oct 11 01:24:03.614150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 882/1792] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:24:03 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599 => generated 637 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:03.620681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d60df1f-1573-4625-a01a-f528e9418492", "name": "network-vif-deleted", "tag": "617bd076-7e44-4329-89e2-fdfc4a2d016f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:03.632466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.633916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.634527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.647423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] Creating event network-vif-deleted:617bd076-7e44-4329-89e2-fdfc4a2d016f for instance 4d60df1f-1573-4625-a01a-f528e9418492 on n-h1-772273-9 Oct 11 01:24:03.654045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c57f112e-6c08-4354-8316-feeeee75b01b req-eff48f66-8291-46ce-a2e4-9f2f65ed1cc3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038197 Oct 11 01:24:03.654945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 883/1793] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:03.660568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:03.661518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:03.669316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.670023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.670660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:03.671572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:03.672670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:03.673271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:04.280536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:04.307419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-623dcd7e-608b-4d9a-b6ae-991b986e0729 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 200 len: 1473 microversion: 2.1 time: 0.650980 Oct 11 01:24:04.312110 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 884/1794] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:03 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 1473 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:04.334320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a611e780-2a33-419a-a3a2-b40d878abf4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112f9b1820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:04.466421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a611e780-2a33-419a-a3a2-b40d878abf4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:04.480638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a611e780-2a33-419a-a3a2-b40d878abf4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:04.622257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:04.633264 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f50b644b-889f-458c-a677-9f669f6e163a tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1645 microversion: 2.1 time: 1.092274 Oct 11 01:24:04.637689 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 911/1795] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:03 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1645 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:04.642652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:04.647012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:04.660845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:04.661388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:04.661839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:04.662601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:04.663047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:04.666560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.055129 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a611e780-2a33-419a-a3a2-b40d878abf4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.724096 Oct 11 01:24:05.055770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 885/1796] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:04 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:05.061015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:05.063955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:05.079549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.080095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.080760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.081508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.081977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.082412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.237345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:05.255448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:05.262577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:05.267472 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04b7d149-ed28-4383-8547-0ef7c8e30902 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1251 microversion: 2.25 time: 0.625595 Oct 11 01:24:05.268098 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 912/1797] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:04 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1251 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:05.279656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:05.283408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] [instance: 4d60df1f-1573-4625-a01a-f528e9418492] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:05.294353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.299466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.300898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.301858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.305582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.306260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.348034 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] HTTP exception thrown: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Request method failure captured: Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 HTTP/1.1 Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMUoSzP8fso5zebhhLOrLW5Eddywf0J55Kq4xafdFtz5Os8NrqEqHC3sq-ixb1ucFYZ8TQ5dWRqLZc4oZglBBKge_x8uEFQYyJ2NzVRlyZpmfeI_jF2d6Dwoy3bVPQD6nPBZg7HTtyjv8hb5b59FbadDV9ZANpMC5-lBWZpMJltJJMA Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:05.353412 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3f2320ac975413cb4401b9c082c6a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminTestJSON-150684494 Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c3f2320ac975413cb4401b9c082c6a1a Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminTestJSON-150684494 Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 825933c38eef4b7792bfe66e5a07ae88 Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminTestJSON-150684494-project Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. Oct 11 01:24:05.355243 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4d60df1f-1573-4625-a01a-f528e9418492'} Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:05.356291 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. Oct 11 01:24:05.357906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.360777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] Returning 404 to user: Instance 4d60df1f-1573-4625-a01a-f528e9418492 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:05.363124 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05516426-cfe7-4f2f-87c8-59cabde66692 tempest-ServersAdminTestJSON-150684494 tempest-ServersAdminTestJSON-150684494-project] 10.222.0.66 "GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492" status: 404 len: 111 microversion: 2.1 time: 0.092110 Oct 11 01:24:05.368146 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 913/1798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:05 2022] GET /compute/v2.1/servers/4d60df1f-1573-4625-a01a-f528e9418492 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:05.377990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c5d16795-f343-4ca3-b8a1-0ef3ceffc690 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112fa5fca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:05.787103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:05.801842 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afa019f1-31d1-4ad6-b3f4-bf52ed0784b2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.744378 Oct 11 01:24:05.813047 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 886/1799] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:05 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:05.828584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:05.836831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 0e1c14df-3f0c-41cd-834a-f429029422d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:05.846730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.849906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.850755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.856194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.856919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.857533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.889904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] HTTP exception thrown: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Request method failure captured: Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 HTTP/1.1 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTo0av3Sol5FuEJikZsHtjKrwykiy86FyqDXAS8jWig05uWq4ERUnP0hMbsLXStFcX5WOU_P9oHYRt25cB3adG_Myh97JhvTntuIKrpEAwcPFb5m4slyVFghHmLrNkRg1HzFDpOI1nVMBPUtNVxOB_CJt6C5Vvohq_p8C62XStBDdY Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 633278094b7b443cbe24a4be4e4501d8 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:05.895081 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 633278094b7b443cbe24a4be4e4501d8 Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesAdminNegativeTest-408777827-project Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 925177e3f3a94d8b90fc6beb4114fd7a Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesAdminNegativeTest-408777827-project Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. Oct 11 01:24:05.896913 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0e1c14df-3f0c-41cd-834a-f429029422d7'} Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:05.897965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. Oct 11 01:24:05.900214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:05.905503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Returning 404 to user: Instance 0e1c14df-3f0c-41cd-834a-f429029422d7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:05.906756 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e20c7ca-2d18-41c5-abb3-dc584d015895 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7" status: 404 len: 111 microversion: 2.1 time: 0.092394 Oct 11 01:24:05.909518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 887/1800] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:05 2022] GET /compute/v2.1/servers/0e1c14df-3f0c-41cd-834a-f429029422d7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:05.921662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:05.922745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:05.944106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.952172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.956826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.957776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:05.958445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:05.959476 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c5d16795-f343-4ca3-b8a1-0ef3ceffc690 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "DELETE /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.589554 Oct 11 01:24:05.960431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:05.963968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 914/1801] 10.222.0.66 () {58 vars in 1296 bytes} [Tue Oct 11 01:24:05 2022] DELETE /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_version => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:05.972474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1c14df-3f0c-41cd-834a-f429029422d7", "name": "network-vif-deleted", "tag": "41e38c92-6899-4ed6-94ed-a200158f412f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:06.001680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:06.002160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:06.002588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:06.032714 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] Creating event network-vif-deleted:41e38c92-6899-4ed6-94ed-a200158f412f for instance 0e1c14df-3f0c-41cd-834a-f429029422d7 on n-h1-772273-9 Oct 11 01:24:06.052037 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eb0301cc-e47c-43b1-8321-0124974f7b5d req-99cd6359-9cd3-4533-a3cf-be85f540fe46 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085780 Oct 11 01:24:06.055259 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 915/1802] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:06.065719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f0a364e-bf87-4a8e-8387-8dea170e2636 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112f8f0280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:06.139815 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f0a364e-bf87-4a8e-8387-8dea170e2636 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 37 microversion: 2.1 time: 0.083048 Oct 11 01:24:06.145415 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 916/1803] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:24:06 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:06.151872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b708bd04-a6b5-4aeb-8b23-abbeac143fcb tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112f9dd550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:06.237083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b708bd04-a6b5-4aeb-8b23-abbeac143fcb tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:06.251082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b708bd04-a6b5-4aeb-8b23-abbeac143fcb tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:06.282106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:06.297617 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85bf9b6e-5849-4977-83bc-05824d08cca8 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1645 microversion: 2.1 time: 0.380854 Oct 11 01:24:06.299424 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 888/1804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:05 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1645 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:06.319322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:06.322102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:06.367433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:06.367952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:06.368400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:06.369132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:06.369592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:06.370021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:06.766116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:06.782998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:06.787177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:06.788346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-153a7153-66d5-41c9-a6ee-dd7a3a766abd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1251 microversion: 2.25 time: 0.485677 Oct 11 01:24:06.813062 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 889/1805] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:06 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1251 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:06.828947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:06.829574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:06.831697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b708bd04-a6b5-4aeb-8b23-abbeac143fcb tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.683972 Oct 11 01:24:06.832949 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 917/1806] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:06 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:06.843247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f1b67f5-b63d-4216-9912-8385907ee7b8 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112f81af70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:06.860990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:06.861408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:06.861855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:06.862581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:06.879705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:06.880433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:06.907674 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f1b67f5-b63d-4216-9912-8385907ee7b8 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.068648 Oct 11 01:24:06.915310 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 918/1807] 10.222.0.66 () {58 vars in 1290 bytes} [Tue Oct 11 01:24:06 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_distro => generated 33 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:06.948695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91be3f7b-0264-4855-8257-23ecfbe0a6b5 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112f8e1b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:07.106137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-91be3f7b-0264-4855-8257-23ecfbe0a6b5 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:07.118993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-91be3f7b-0264-4855-8257-23ecfbe0a6b5 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:07.472177 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91be3f7b-0264-4855-8257-23ecfbe0a6b5 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.555664 Oct 11 01:24:07.473920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 919/1808] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:06 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:07.481359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d782405a-8208-412d-af5b-0393f8078bdb", "name": "network-vif-deleted", "tag": "de506e57-456e-439f-b896-b3ca9f95fbec"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:07.503666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.504543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.505394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.527672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] Creating event network-vif-deleted:de506e57-456e-439f-b896-b3ca9f95fbec for instance d782405a-8208-412d-af5b-0393f8078bdb on n-h2-772273-9 Oct 11 01:24:07.540225 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5f9dc925-e254-43c4-895a-115ba4c2a13b req-562d4de1-4b1c-4d33-b66e-81e75f6c346d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061752 Oct 11 01:24:07.547633 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 920/1809] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:07.563254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:07.568396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:07.583464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.585865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.586574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.590938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.591819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.592619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.692837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.693705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.694531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.695439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lazy-loading 'fault' on Instance uuid d782405a-8208-412d-af5b-0393f8078bdb {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:07.842351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:07.855410 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e913f928-f118-40c9-97bd-e4170ed72ae1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 1.030706 Oct 11 01:24:07.871756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 890/1810] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:06 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:07.878985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27d9f3f9-8e77-4c03-81df-162d498f7667 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112f9ba820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:07.941442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f380eb4fd2b84ba9bfcb037a74dc2a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1e7c3ccbe1403fb5330faf6bb0d86a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:07.942515 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27d9f3f9-8e77-4c03-81df-162d498f7667 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069291 Oct 11 01:24:07.943421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 891/1811] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:24:07 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:07.952692 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e967511d-cb3f-4aec-8721-87c5891545af tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 200 len: 1305 microversion: 2.1 time: 0.398937 Oct 11 01:24:07.954452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:07.954452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:07.958038 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 921/1812] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:07 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 1305 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:07.965876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.968931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.970936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.971931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:07.974465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:07.975125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:07.979549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fb8430f-4fdc-4a67-8b74-d3e74412d660 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112fb8ddc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:08.097211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4fb8430f-4fdc-4a67-8b74-d3e74412d660 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:08.116931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4fb8430f-4fdc-4a67-8b74-d3e74412d660 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:08.389255 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fb8430f-4fdc-4a67-8b74-d3e74412d660 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.429724 Oct 11 01:24:08.390621 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 922/1813] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:07 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:08.400972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2e76891-735a-4ebc-8567-bc6941079c6d tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112fb8d160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:08.460210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:08.471079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b2e76891-735a-4ebc-8567-bc6941079c6d tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:08.477324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b2e76891-735a-4ebc-8567-bc6941079c6d tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:08.801238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:08.813727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:08.817071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:08.819037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b6b1bf5-0a55-4789-b968-e710e441a19a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1293 microversion: 2.25 time: 0.873903 Oct 11 01:24:08.829365 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 892/1814] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:07 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1293 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:08.883683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:08.884410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:08.892839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:08.893338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:08.893786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:08.894881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:08.895006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:08.895427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:08.902014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2e76891-735a-4ebc-8567-bc6941079c6d tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 64 microversion: 2.1 time: 0.506066 Oct 11 01:24:08.907228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 923/1815] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:08 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 64 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:24:08.912018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3adbf94-31a2-4134-ba23-3e3fd8ec4425 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112faa0dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:08.977725 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3adbf94-31a2-4134-ba23-3e3fd8ec4425 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 64 microversion: 2.1 time: 0.069715 Oct 11 01:24:08.981985 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 924/1816] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:24:08 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 64 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:24:08.993279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:08.993594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] [instance: d782405a-8208-412d-af5b-0393f8078bdb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:09.005863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:09.006521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:09.007103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:09.009256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:09.009846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:09.011444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:09.030595 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] HTTP exception thrown: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Request method failure captured: Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb HTTP/1.1 Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMVQE0KE7VpBDWNJl-LrWcFHWN4mkLUvjffe6HK7toeq54Y30S_VahnlmvpZMFJSnShPmhke4Qxnm7KDyLRh9toh6lXMUAtrV2bt5n6_neH8soX0Uw6Xi4s_6wRmgvcwYXCpfYXt0VMNvNCpF27X2YjhDbNOu_wvLBGwSi3GpHyP0PQ Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:09.035023 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e1e7c3ccbe1403fb5330faf6bb0d86a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 8e1e7c3ccbe1403fb5330faf6bb0d86a Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1398737584 Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f380eb4fd2b84ba9bfcb037a74dc2a9a Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsTestJSON-1398737584-project Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. Oct 11 01:24:09.039268 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd782405a-8208-412d-af5b-0393f8078bdb'} Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:09.040261 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. Oct 11 01:24:09.041860 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:09.043378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Returning 404 to user: Instance d782405a-8208-412d-af5b-0393f8078bdb could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:09.043378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef9eb2b7-b609-4cfb-8d9a-e092e960be3d tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb" status: 404 len: 111 microversion: 2.1 time: 0.053797 Oct 11 01:24:09.047366 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 925/1817] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:08 2022] GET /compute/v2.1/servers/d782405a-8208-412d-af5b-0393f8078bdb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:09.054963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6d2e20f-d8fb-46ac-a5c6-b56b89feed4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112fb59dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:09.130158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c6d2e20f-d8fb-46ac-a5c6-b56b89feed4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:09.137454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c6d2e20f-d8fb-46ac-a5c6-b56b89feed4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:09.259644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:09.274328 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39cf5cc7-dbf7-4fc3-9e46-d4b5e9769aa1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.393272 Oct 11 01:24:09.276463 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 893/1818] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:08 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:09.294428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf91020b-eec2-4d7c-9cd5-785d2af84307 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f9a0430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:09.761716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6d2e20f-d8fb-46ac-a5c6-b56b89feed4c tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712861 Oct 11 01:24:09.766728 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 926/1819] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:09 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:09.774105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b080b644-d01c-438e-b0c4-804ef84e6eb8", "tag": "85f801b6-9678-4675-bf11-12dd14196dc3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:09.792472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:09.793181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:09.794325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:09.821687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] Creating event network-changed:85f801b6-9678-4675-bf11-12dd14196dc3 for instance b080b644-d01c-438e-b0c4-804ef84e6eb8 on n-h1-772273-9 Oct 11 01:24:09.829121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a35fda85-a93f-4f60-99b9-a77f44eb9eca req-8ca22dc0-753f-45eb-a454-2968e19fe758 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064096 Oct 11 01:24:09.830196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 927/1820] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:09.842064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-216eee91-1271-438f-b995-130c23918800 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update', calling method: .version_select at 0x7f112fa5fb80>, body: {"meta": {"os_version": "alt"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:09.939228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-216eee91-1271-438f-b995-130c23918800 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:09.949142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-216eee91-1271-438f-b995-130c23918800 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:10.377766 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-216eee91-1271-438f-b995-130c23918800 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.543546 Oct 11 01:24:10.379172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 928/1821] 10.222.0.66 () {60 vars in 1313 bytes} [Tue Oct 11 01:24:09 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata/os_version => generated 31 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:10.390421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:10.391556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:10.410207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:10.412943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:10.414275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:10.417411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:10.418112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:10.418755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:10.651039 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf91020b-eec2-4d7c-9cd5-785d2af84307 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/cc08d4cd-55a6-4143-8721-5ca49f31cafa" status: 202 len: 0 microversion: 2.1 time: 1.372103 Oct 11 01:24:10.651688 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 894/1822] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:09 2022] DELETE /compute/v2.1/os-security-groups/cc08d4cd-55a6-4143-8721-5ca49f31cafa => generated 0 bytes in 1374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:24:10.657341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:10.657883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:10.669363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:10.673293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:10.673964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:10.674900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:10.688177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:10.688914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:10.975958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:10.996776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:10.999244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:11.000636 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99adb2f5-a6a5-48f7-b22b-ee5853acc4ee tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1293 microversion: 2.25 time: 0.615107 Oct 11 01:24:11.001369 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 929/1823] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:10 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1293 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:11.023930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4c22217-7fb8-4984-bfc0-10823ef889c8 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112fbf5c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:11.091154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a4c22217-7fb8-4984-bfc0-10823ef889c8 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 58 microversion: 2.1 time: 0.071262 Oct 11 01:24:11.092109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 930/1824] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:24:11 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:11.146015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:11.161965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6c7900a-4b7c-4608-90a3-c33bdee3ab3f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.509050 Oct 11 01:24:11.162950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 895/1825] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:10 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:11.168436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e0bb577-d4ca-4185-b404-3c9d316659d2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] Calling method '.version_select at 0x7f112f9a0670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:11.361675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1658688790", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "183567f0-82e5-49b1-b067-c7e3326ca6e5"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:11.461066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] validate_networks() for [('183567f0-82e5-49b1-b067-c7e3326ca6e5', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:24:11.840154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e0bb577-d4ca-4185-b404-3c9d316659d2 tempest-SecurityGroupsTestJSON-1398737584 tempest-SecurityGroupsTestJSON-1398737584-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/41e69103-7169-4411-8cdb-a6c3619db3a0" status: 202 len: 0 microversion: 2.1 time: 0.675611 Oct 11 01:24:11.841810 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 896/1826] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:24:11 2022] DELETE /compute/v2.1/os-security-groups/41e69103-7169-4411-8cdb-a6c3619db3a0 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:24:11.848131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27c8f1e9-d728-4f81-99af-bfeba4603ae1 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'update_all', calling method: .version_select at 0x7f112f9aaca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:11.958854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-27c8f1e9-d728-4f81-99af-bfeba4603ae1 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:11.966463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-27c8f1e9-d728-4f81-99af-bfeba4603ae1 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:12.499551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27c8f1e9-d728-4f81-99af-bfeba4603ae1 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 61 microversion: 2.1 time: 0.656471 Oct 11 01:24:12.500266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 897/1827] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:11 2022] PUT /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 61 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:12.513387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:12.515471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:12.532214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:12.532711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:12.533152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:12.542250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:12.542790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:12.543238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:12.944377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:24:12.944993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:24:12.945297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:24:12.945899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:24:12.946481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:24:12.966999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:12.967798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:12.968407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:12.969651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:12.970376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:12.971096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:13.016194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Getting quotas for project f3be63655de345b8bce584b9126c6fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:13.021595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:13.036475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:13.037932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:13.044708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Getting quotas for user 512b862ac1f64cb7a316bf15382d145a and project f3be63655de345b8bce584b9126c6fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:13.049287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f0693a7-2a42-48c7-8032-381649bee947 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1293 microversion: 2.25 time: 0.545186 Oct 11 01:24:13.051546 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 898/1828] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:12 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1293 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:13.068263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:13.068900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:13.090334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:24:13.098331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:13.099127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:13.099602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:13.102742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:24:13.107171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:13.107786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:13.113366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:13.187423 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87e264d8-d39b-4601-8d3b-6754b82f327b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.093853 Oct 11 01:24:13.192578 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 931/1829] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:24:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:24:13.215028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-64a23f21-42f8-498c-90f6-9cf86a0d2f88 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Action: 'create', calling method: .version_select at 0x7f112f821a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:13.326196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-64a23f21-42f8-498c-90f6-9cf86a0d2f88 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:13.341078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-64a23f21-42f8-498c-90f6-9cf86a0d2f88 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Getting quotas for user a3e1e965a9024fe8be9c1a8a55cd91d9 and project e0f5204a9f4848689ae21a3438724211. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:13.353717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:14.059934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:14.064395 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-64a23f21-42f8-498c-90f6-9cf86a0d2f88 tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "POST /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 85 microversion: 2.1 time: 0.870273 Oct 11 01:24:14.065126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 932/1830] 10.222.0.66 () {60 vars in 1281 bytes} [Tue Oct 11 01:24:13 2022] POST /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 85 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:14.087718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:14.090573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:14.093507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ba32a8f-003f-475c-bb8d-fdabba26c136 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 1.037389 Oct 11 01:24:14.106177 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 899/1831] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:13 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:14.145771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6dffa1b-00ba-4fc8-914d-03a1b2dceaec tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] Calling method '.version_select at 0x7f112fa64b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:14.243853 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6dffa1b-00ba-4fc8-914d-03a1b2dceaec tempest-ImagesMetadataTestJSON-7639564 tempest-ImagesMetadataTestJSON-7639564-project] 10.222.0.66 "GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata" status: 200 len: 85 microversion: 2.1 time: 0.116587 Oct 11 01:24:14.245692 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 900/1832] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:24:14 2022] GET /compute/v2.1/images/aa5df3ea-8682-4cf8-9aa1-366aad567599/metadata => generated 85 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:14.273731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:14.278679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:14.307242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:14.313683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:14.316561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:14.317349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:14.328492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:14.329638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:14.441906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:14.457633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:14.471625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:14.476398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3bb70020-de71-4455-921a-1cc163cf7768 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1259 microversion: 2.21 time: 0.408191 Oct 11 01:24:14.477648 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 933/1833] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:14 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1259 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:14.707087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-135322394", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:14.852187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:24:14.852822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:24:14.853501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:24:14.854771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:24:14.855381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:24:14.934541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:14.935050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:14.935531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:14.936282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:14.936744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:14.937175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:14.998916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Getting quotas for project 76caac25b4dc4ea8a9f89ddd4fc540da. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:15.022401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Getting quotas for user ae8400bca6484a35a5adbdb7413a6891 and project 76caac25b4dc4ea8a9f89ddd4fc540da. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:15.056354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:24:15.072142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:24:15.080953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:15.090501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:15.098092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:15.116222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1be823e9-73f1-446a-94ed-4cfeb4010214 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1293 microversion: 2.25 time: 0.849367 Oct 11 01:24:15.117107 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 901/1834] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:14 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1293 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:15.148805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:15.149380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:15.168065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:15.181974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:15.182843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:15.183892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:15.186098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:15.193162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:15.249069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:15.253457 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3333e564-1620-4c3a-b257-64671391281a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.744664 Oct 11 01:24:15.270141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 934/1835] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:24:15.283094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:15.283957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:16.140781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.157812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.164130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.191033 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2bc06cd-9044-4656-b6f3-0a5fe90c70a4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1452 microversion: 2.91 time: 0.917959 Oct 11 01:24:16.191576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 935/1836] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:15 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1452 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:16.205927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:16.206556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:16.221901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:16.224025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:16.225523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:16.227784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:16.234822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:16.235481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:16.524106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.542620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.545427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.547241 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9aa3ae65-f476-4ffa-a513-495ce650ac97 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1317 microversion: 2.21 time: 0.353195 Oct 11 01:24:16.548594 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 936/1837] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:16 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:16.556333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:16.557541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:16.567873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:16.568807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:16.571884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:16.574352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:16.574855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:16.578389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:16.650571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:16.667219 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b008599-7342-433c-b9c3-37af47a5d4f9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 1.528779 Oct 11 01:24:16.670917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 902/1838] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:15 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:16.993384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.057820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.068866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.075793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a900f16a-1282-4dc5-a902-e80b2519b719 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.525800 Oct 11 01:24:17.085981 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 937/1839] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:16 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:17.227942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:17.228585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:17.238131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.238908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.242075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.244214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.245322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.247553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.417174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.426409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.432431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.444160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5b50d9a-52ed-4ea9-8324-a28c108baebd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1504 microversion: 2.91 time: 0.223994 Oct 11 01:24:17.446668 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 903/1840] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:17 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:17.576120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:17.577381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:17.595478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.596217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.596829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.601860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.602646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.604032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.695199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:17.695889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:17.708503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.710727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.711941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.713223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:17.715395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:17.719048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:17.766389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.776498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.781062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:17.784939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6246a299-b979-494d-830c-c36a21c178e5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1317 microversion: 2.21 time: 0.214222 Oct 11 01:24:17.788646 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 938/1841] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:17 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:18.114357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:18.115016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:18.122879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.124485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.124968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:18.125774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.126256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.126690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:18.234393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.243885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c9a16a0-7651-483c-86dd-d89191b025d7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.553304 Oct 11 01:24:18.250992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 904/1842] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:17 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:18.481001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:18.481786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:18.489920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:18.493519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.494421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.497511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:18.498360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.499146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.499677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:18.604287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.622259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.625743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.627544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81f43bc1-71c6-413a-9ca7-c1e1a525bb4b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.517222 Oct 11 01:24:18.628275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.631437 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 939/1843] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:18 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:18.644357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.647261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:18.657481 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c181d95-af09-415e-8f4b-fdae2c90ae0c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1510 microversion: 2.91 time: 0.180404 Oct 11 01:24:18.658807 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 905/1844] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:18 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:18.816159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:18.817406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:18.832370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.835568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.837254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:18.840403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:18.842912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:18.843974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:19.271561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:19.274183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:19.300415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:19.300940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:19.301393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:19.302139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:19.304989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:19.305522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:19.724136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:19.733806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:19.735252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:19.745515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-399133df-8ef6-4ae3-8962-a184957aa427 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.935519 Oct 11 01:24:19.746162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 940/1845] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:18 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:19.764312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:19.767013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:19.776004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:19.778149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:19.778714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:19.780576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:19.782120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:19.782728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.418256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.445480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35d58a97-26bc-4574-a8b9-bb386eb4fc0a tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 1.177418 Oct 11 01:24:20.468460 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 906/1846] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:19 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:20.477648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:20.478865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:20.488958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.489830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.490675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.492992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.494232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.495216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.654273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.672470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.674069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.685295 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7eead39b-32bc-41f8-bf13-993e832ce45e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.937984 Oct 11 01:24:20.689182 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 941/1847] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:19 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:20.704362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:20.706087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:20.724833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.725985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.726355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.727067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.727588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.728085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.769852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:24:20.797459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.822246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.826574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:20.844061 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf59f652-49c8-4404-aa17-c0ad9a51a3ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1531 microversion: 2.91 time: 0.372832 Oct 11 01:24:20.846609 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 907/1848] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:20 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1531 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:20.860154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:20.863322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:20.886066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.888626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.889666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:20.891649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:20.894069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:20.896181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.028442 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1721b3c5-d614-48d9-842f-f066255649cf tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "DELETE /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 204 len: 0 microversion: 2.1 time: 0.336877 Oct 11 01:24:21.029007 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 942/1849] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:24:20 2022] DELETE /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:21.354649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:21.355433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:21.371054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.371594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.372039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.372758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.373218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.373999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.570979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:21.580399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lazy-loading 'services' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:21.582914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:21.598715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:21.605122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:21.612824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61a87753-d897-404c-a932-4c3320abe8a5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.763663 Oct 11 01:24:21.613445 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 908/1850] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:20 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:21.627633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:21.630353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:21.646073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.649265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c9822ff7-c9c6-433c-981a-5cab8e207bd1 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1936 microversion: 2.91 time: 0.613683 Oct 11 01:24:21.650058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.650711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.651674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.652307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.653667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.654225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 943/1851] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:21 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1936 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:21.664668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:21.665607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:21.678261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.683888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.684462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.685301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:21.686938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:21.686938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:21.976755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:22.268852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:22.278039 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28cbc4b9-fac8-44df-9b0e-896f0812a39e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.622448 Oct 11 01:24:22.279253 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 944/1852] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:21 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:22.284876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca08714-5734-464f-b11c-874c5139c898", "name": "network-vif-unplugged", "status": "completed", "tag": "79a24c93-41ef-4255-a271-b5579e23dcdd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:22.297511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.298309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.298935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.309311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:22.313979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] Creating event network-vif-unplugged:79a24c93-41ef-4255-a271-b5579e23dcdd for instance 1ca08714-5734-464f-b11c-874c5139c898 on n-h1-772273-9 Oct 11 01:24:22.321635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5df9e6bb-70af-4f4d-ab0d-83ae1a222466 req-27c43279-23c1-47ad-92c6-294110ff92fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040546 Oct 11 01:24:22.322528 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 945/1853] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:22.329573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:22.330764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:22.346661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.348608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.349321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.351016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.351920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.355320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.366629 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5643195d-405f-4b48-9a59-1cc737a6c8a0 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1682 microversion: 2.1 time: 0.747347 Oct 11 01:24:22.368287 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 909/1854] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:21 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1682 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:22.374325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:22.375115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:22.383800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.384577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.385344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.386250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.387024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.387661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.629198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lazy-loading 'services' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:22.685239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b72a8f3-992f-40a7-b986-a1085e8b3a19 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1936 microversion: 2.91 time: 0.361267 Oct 11 01:24:22.688030 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 946/1855] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:22 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1936 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:22.692993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:22.693605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:22.711572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.712191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.712705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:22.713375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:22.713842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:22.714281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.456442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.500728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.504128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.508253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f0b1e32-b797-45e7-aa8b-b4344171ce47 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 1.138425 Oct 11 01:24:23.512846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 910/1856] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:22 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:23.522589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:23.535480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.538973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.539754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.542342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.543053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.543881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.578622 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8ea0a83-0430-4812-a6be-7343e80423f6 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.064447 Oct 11 01:24:23.579581 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 911/1857] 10.222.0.66 () {60 vars in 1217 bytes} [Tue Oct 11 01:24:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:24:23.585982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:23.587088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:23.598836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.599492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.600013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.600770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.601294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.601644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.673509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.687875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.689420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:23.696307 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f7b6ae3-1c46-4b53-9d24-c6d48fc23b6f tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 1.006466 Oct 11 01:24:23.701384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 947/1858] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:22 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:23.715881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:23.716588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:23.742503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.743029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.743516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:23.744338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:23.744700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:23.745136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.516769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:24.534028 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0cb82df5-fcdb-4f8a-ae71-38f8f8429eba tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.952584 Oct 11 01:24:24.535317 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 912/1859] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:23 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:24.543006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:24.544684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:24.555416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:24.556228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:24.570867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.572405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:24.573562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:24.575771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.628452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:24.665429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lazy-loading 'flavor' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:24.666765 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40f716ff-f943-4124-9289-d3508ab9f34e tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1682 microversion: 2.1 time: 0.963969 Oct 11 01:24:24.669126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 948/1860] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:23 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1682 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:24.694428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7783a5f7-35ba-46bc-a22f-b5c63ba972a2", "tag": "231ddbf9-0488-4ff3-8694-e72adc11bc59"}, {"name": "network-changed", "server_uuid": "1ca08714-5734-464f-b11c-874c5139c898", "tag": "79a24c93-41ef-4255-a271-b5579e23dcdd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:24.748272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:24.749258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:24.751968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.796730 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Creating event network-changed:231ddbf9-0488-4ff3-8694-e72adc11bc59 for instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 on n-h2-772273-9 Oct 11 01:24:24.798889 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] Creating event network-changed:79a24c93-41ef-4255-a271-b5579e23dcdd for instance 1ca08714-5734-464f-b11c-874c5139c898 on n-h1-772273-9 Oct 11 01:24:24.825820 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0e10979e-a7e4-403c-ad43-ee93d5a3c72d req-fde2ac7e-cda8-43a4-831e-6f2477d9df44 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.152919 Oct 11 01:24:24.827118 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 949/1861] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:24.844262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:24.845015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:24.867994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:24.868500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:24.868961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.869687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:24.870140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:24.870793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:24.968044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:25.158323 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2213917-2f87-4b80-8072-1e10234b5658 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action" status: 202 len: 0 microversion: 2.91 time: 0.620389 Oct 11 01:24:25.158954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 913/1862] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:24:24 2022] POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:25.169816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:25.170538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:25.188240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:25.188805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:25.189257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:25.189983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:25.190445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:25.190876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:25.888624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:25.904575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:25.906650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:25.911930 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e886f26-0580-4373-900d-16525a530c40 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 1.083058 Oct 11 01:24:25.913392 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 950/1863] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:24 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:25.920124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:25.921181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:25.930015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:25.931700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:25.932524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:25.933644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:25.934366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:25.935014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.106556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.114120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.120287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.121803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.130189 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da3bca3d-8480-4e04-8c53-d9a802227f9f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.215488 Oct 11 01:24:26.130801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.132823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 951/1864] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:25 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:26.132989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.134014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-388d8c55-5835-4d59-bab7-f2e9c6635c00 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.973673 Oct 11 01:24:26.144218 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 914/1865] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:25 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:26.148728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:26.149641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:26.159602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:26.160236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:26.161756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.162589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.163222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.163991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.164279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=52 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:26.169932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.170138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.170429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.171074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.171216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.171864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.172503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.173106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.368600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.381948 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0fec9fa-f652-4ced-bca6-9ab85b30725a tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1615 microversion: 2.1 time: 0.236968 Oct 11 01:24:26.382547 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 915/1866] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:26 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1615 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:26.564114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:26.579532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2b67a41-a43d-44b7-9a8f-27dfe7f3b8fa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.444096 Oct 11 01:24:26.581947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 952/1867] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:26 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:26.824036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466b8790-0063-4112-b494-0f56de3aef94", "name": "network-vif-deleted", "tag": "4574072d-6b59-4849-9ec5-351524511edc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:26.841456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.844175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.847178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.877494 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] Creating event network-vif-deleted:4574072d-6b59-4849-9ec5-351524511edc for instance 466b8790-0063-4112-b494-0f56de3aef94 on n-h2-772273-9 Oct 11 01:24:26.892422 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9bcd65d6-6b21-4dbb-8b7b-8f0ba7b60b6e req-eb85c919-2cfc-47c1-b210-e75b37484dec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073459 Oct 11 01:24:26.895923 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 916/1868] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:26.941419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:26.942205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:26.952403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.955815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.956404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:26.957303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:26.957873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:26.958967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.167027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:27.168482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:27.184011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.184569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.188729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.190047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.190580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.191146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.453549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.463780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.471540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.479507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.480832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3208e3b8-8960-4a65-8444-ceb808a252c2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.537235 Oct 11 01:24:27.481837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 953/1869] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:26 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:27.499583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:27.501263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.503004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.504385 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dfc08f5-d5a1-416f-b075-af01912e5c0b tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.344295 Oct 11 01:24:27.505147 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 917/1870] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:27 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:27.515714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:27.521350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:27.522093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:27.529636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.532201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.534756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.535764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.539509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.540193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.545054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.546426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.546882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.547631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.548405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.548544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.584975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:27.709788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.722148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.726817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.735877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:27.739014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9ee332c-e019-4610-9eb4-b05237cee379 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.253074 Oct 11 01:24:27.740018 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 954/1871] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:27 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:27.752309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:27.752899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:27.767315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.767992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.768440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.769160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:27.769624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:27.770052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:27.770987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdcc7aef-5c97-4571-b859-84ebc991416c tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1615 microversion: 2.1 time: 0.263096 Oct 11 01:24:27.772054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 918/1872] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:27 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1615 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:28.105113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:28.131367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ae1f9c6-4a52-422b-a85a-b018b4d59ebb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.389064 Oct 11 01:24:28.135844 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 955/1873] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:27 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:28.509492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:28.510166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:28.534436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.539285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.540590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:28.541603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.543783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:28.545059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:28.545312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.548165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:28.560559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.561831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.562566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:28.565581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.572486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.573183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:28.914222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:28.926875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:28.930120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:28.936271 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82b0ef74-bb9f-4b4a-a3f0-5268d0d8e1f8 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.399690 Oct 11 01:24:28.952592 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 956/1874] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:28 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:28.965284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:28.966370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:28.974098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.975216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.975909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:28.976850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:28.978045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:28.978697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.121162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.121767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.132926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.134781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.136423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a0c6188-3f0e-431d-9e5c-b70b75449f93 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.631625 Oct 11 01:24:29.137561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 919/1875] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:28 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:29.139478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.140996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.143163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:29.144054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:29.147541 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6443c5e6-5e8c-4966-a8ee-5e599a52f09a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.193491 Oct 11 01:24:29.163367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 957/1876] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:28 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:29.167825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.168651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.169338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.176166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.176366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:29.177378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.178582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.183718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:29.205909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.207394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.208195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.209465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.210144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.211026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.238239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.239000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.241231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.241865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lazy-loading 'fault' on Instance uuid 466b8790-0063-4112-b494-0f56de3aef94 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:29.300348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925177e3f3a94d8b90fc6beb4114fd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633278094b7b443cbe24a4be4e4501d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.310805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf3c98a5-9386-4a1c-bcc2-d8c98b7b9da3 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 200 len: 1331 microversion: 2.1 time: 0.171854 Oct 11 01:24:29.312555 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 920/1877] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:29 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:29.461677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:29.474267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8503972a-d747-4b1c-9bda-e7778ca2af8e tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.313737 Oct 11 01:24:29.475443 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 958/1878] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:29 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:29.835523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:29.841473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.841473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.847263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.848387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.852174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.853581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.926439 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9c308d7-963e-430b-92dd-8564ba9800ef tempest-AZV2TestJSON-1006159125 tempest-AZV2TestJSON-1006159125-project] 10.222.0.66 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.344011 Oct 11 01:24:29.934691 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 921/1879] 10.222.0.66 () {58 vars in 1164 bytes} [Tue Oct 11 01:24:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:24:29.968241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:29.968860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:29.979438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.979935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.982524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:29.983944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:29.986037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:29.986702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:30.167604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:30.168223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:30.181902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:30.182402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:30.182844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:30.183589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:30.184063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:30.184492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.225205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.239897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.242053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.242343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.246263 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c395098-0d54-430e-b23d-acd84a8dfcfb tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 1.280876 Oct 11 01:24:31.250828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 959/1880] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:29 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:31.260870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:31.261730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.262126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:31.268066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.272580 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d79b083b-6d80-4182-b4d4-336b83dd2c5f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 1.109478 Oct 11 01:24:31.274692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.287660 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 922/1881] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:30 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:31.287989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.287989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.287989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.287989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.288340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.297323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:31.297323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] [instance: 466b8790-0063-4112-b494-0f56de3aef94] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:31.311000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.311535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.314889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.316745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.317295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.318182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.347227 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] HTTP exception thrown: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Request method failure captured: Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 HTTP/1.1 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMTo0av3Sol5FuEJikZsHtjKrwykiy86FyqDXAS8jWig05uWq4ERUnP0hMbsLXStFcX5WOU_P9oHYRt25cB3adG_Myh97JhvTntuIKrpEAwcPFb5m4slyVFghHmLrNkRg1HzFDpOI1nVMBPUtNVxOB_CJt6C5Vvohq_p8C62XStBDdY Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 633278094b7b443cbe24a4be4e4501d8 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:31.349165 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/633278094b7b443cbe24a4be4e4501d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 633278094b7b443cbe24a4be4e4501d8 Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-408777827 Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesAdminNegativeTest-408777827-project Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 925177e3f3a94d8b90fc6beb4114fd7a Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesAdminNegativeTest-408777827-project Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. Oct 11 01:24:31.351610 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '466b8790-0063-4112-b494-0f56de3aef94'} Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:31.352499 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. Oct 11 01:24:31.355729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:31.358603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Returning 404 to user: Instance 466b8790-0063-4112-b494-0f56de3aef94 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:31.358603 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a90108f5-c92e-4bdc-9205-259c5041afc7 tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94" status: 404 len: 111 microversion: 2.1 time: 0.073261 Oct 11 01:24:31.358603 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 923/1882] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:31 2022] GET /compute/v2.1/servers/466b8790-0063-4112-b494-0f56de3aef94 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:31.361938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:31.362619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:31.371290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.372044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.372304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.373792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.374239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.374679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.464073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.474197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.476798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.483149 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37f16462-e104-4c8f-a2fd-833ac35c53aa tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.230658 Oct 11 01:24:31.484761 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 960/1883] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:31 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:31.490017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b080b644-d01c-438e-b0c4-804ef84e6eb8", "name": "network-vif-plugged", "status": "completed", "tag": "85f801b6-9678-4675-bf11-12dd14196dc3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:31.499884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:31.500652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:31.501320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:31.505232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:31.513914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] Creating event network-vif-plugged:85f801b6-9678-4675-bf11-12dd14196dc3 for instance b080b644-d01c-438e-b0c4-804ef84e6eb8 on n-h1-772273-9 Oct 11 01:24:31.519239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b3469233-5653-4444-a038-224bd811fd16 req-e839839f-7123-4130-9d15-0c0a0567aeb9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Oct 11 01:24:31.520131 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 961/1884] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:31.525779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1acd1981-801d-4701-83c0-bc7c25654c4f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] Calling method '.version_select at 0x7f112fc9c8b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:31.535312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:31.548095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1acd1981-801d-4701-83c0-bc7c25654c4f tempest-VolumesAdminNegativeTest-408777827 tempest-VolumesAdminNegativeTest-408777827-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-765369175" status: 202 len: 0 microversion: 2.1 time: 0.026716 Oct 11 01:24:31.549234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 962/1885] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-765369175 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:24:31.718524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b8fd606-dc64-4de8-a5ea-5c745d5433b3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Action: 'create', calling method: .version_select at 0x7f112fc2cd30>, body: {"keypair": {"name": "tempest-keypair-2112235809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Bi7RMmKQsJhfLpCSjEeXE8w5sX5zGnHOdcLn9Ejp4r2K4Ti/HttgBOaJXSYAJmv4QdTJRx1TBBw7H8SWEPhodK+FApqJG8zYVDFRAOrhUUBt7XogvaV/AuEf3wJjv+w=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:31.749838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8b8fd606-dc64-4de8-a5ea-5c745d5433b3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for project fb9662f7f6e343c29219bcb20e76075a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:31.758873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8b8fd606-dc64-4de8-a5ea-5c745d5433b3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for user e7613cc8ae6642e4933bbb832a2c8da6 and project fb9662f7f6e343c29219bcb20e76075a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:31.839679 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b8fd606-dc64-4de8-a5ea-5c745d5433b3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.288983 Oct 11 01:24:31.840822 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 963/1886] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:24:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:31.867288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:31.879783 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5ec9149-ddca-4d35-ac64-fe7be73797f2 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.522209 Oct 11 01:24:31.881838 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 924/1887] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:31 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:32.278241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:32.278986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:32.295720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:32.296632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:32.298245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:32.299621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:32.301968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:32.303995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:32.305696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:32.306920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:32.319764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:32.321754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:32.322317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:32.324155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:32.326200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:32.326886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:32.968917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:32.978312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:32.979774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:32.986857 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bc8b671-4d3d-49fb-b8be-8b599032ea2c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1281 microversion: 2.25 time: 0.685565 Oct 11 01:24:32.990989 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 925/1888] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:32 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1281 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:32.999557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:32.999732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.002043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:33.013668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:33.017262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.022103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:33.022776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:33.023953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.031939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67745dbb-ea0c-41ff-9892-0ba9b8293fc3 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.752504 Oct 11 01:24:33.031939 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 964/1889] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:32 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:33.034304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:33.039476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:33.040130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:33.041220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:33.047853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:33.062450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:33.063074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:33.064024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:33.065152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:33.065889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:33.066385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:33.334842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.346509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.352416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.365861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-58ee733a-2e85-46d5-a41f-9c7008aaf8f6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.371268 Oct 11 01:24:33.367112 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 926/1890] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:32 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:33.492857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:33.503323 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1af0c2b5-cea4-4612-b474-32ae9e5eba97 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.474860 Oct 11 01:24:33.505602 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 965/1891] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:33 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:33.584583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7783a5f7-35ba-46bc-a22f-b5c63ba972a2", "name": "network-vif-plugged", "status": "completed", "tag": "231ddbf9-0488-4ff3-8694-e72adc11bc59"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:33.604019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:33.604979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:33.605731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:33.635199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] Creating event network-vif-plugged:231ddbf9-0488-4ff3-8694-e72adc11bc59 for instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 on n-h2-772273-9 Oct 11 01:24:33.673023 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-603d7949-c597-4b2f-9c27-9b188f9fc649 req-0118e51a-d981-443e-846a-ccb6e2f32855 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093231 Oct 11 01:24:33.678060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 927/1892] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:24:34.023411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:34.024643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:34.031388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.032257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.033579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.034714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.035238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.035768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.053811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:34.054812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:34.066981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.067714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.069570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.073939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.075103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.075829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.725821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.736381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.738143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.739628 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d4c882b-186a-4565-b51a-84fc060d2b50 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1476 microversion: 2.25 time: 0.720743 Oct 11 01:24:34.740445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 966/1893] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:34 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1476 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:34.757708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:34.758593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:34.773677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.774769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.775356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.776393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.777847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.778841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.814687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.832597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.840071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.843747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66978420-f910-4d1f-b06d-453c5bec9f54 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.792859 Oct 11 01:24:34.845054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 928/1894] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:34 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:34.854128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:34.855056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:34.875171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.877194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.879058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.882006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:34.882485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:34.882930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:34.950192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.962088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.963886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:34.969846 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ae320c2-6e39-4d81-8c34-335fab6862fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.227467 Oct 11 01:24:34.971325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 967/1895] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:34 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:35.254352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:35.255300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:35.262588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.263588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.264265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:35.265240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.266205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.266861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:35.394549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:35.403527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc7befb5-7f55-48ea-bcf9-61e85f4072e9 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.556362 Oct 11 01:24:35.410361 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 929/1896] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:34 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:35.633212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid b080b644-d01c-438e-b0c4-804ef84e6eb8 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:35.658148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2b51bb2-35fb-43bc-ba97-d2288d223fc7 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1969 microversion: 2.25 time: 0.685143 Oct 11 01:24:35.659694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 968/1897] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:34 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1969 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:35.685786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:35.686405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:35.693897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.694855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.695567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:35.696491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.697148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.697778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:35.877939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:35.878550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:35.886909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.891550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.892258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:35.894923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:35.897163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:35.905448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.122860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid b080b644-d01c-438e-b0c4-804ef84e6eb8 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:36.150715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6dae89f4-08a5-4bc1-8581-ada2a87a43df tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1969 microversion: 2.25 time: 0.468847 Oct 11 01:24:36.167279 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 930/1898] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:35 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1969 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:36.176211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:36.177122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:36.187495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.190023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.190681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.191642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.192275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.193449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.345971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.367228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.391308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.392348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.393559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-18e01b15-d13d-4f65-a26d-7e296e37a924 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1359 microversion: 2.21 time: 0.519675 Oct 11 01:24:36.396721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 969/1899] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:35 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1359 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:36.403286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:36.408263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.409190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.412801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.414497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.415553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.416043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.421108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.422548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.437146 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10344da5-6cb8-437b-a9e7-5e6c5339bf56 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.268541 Oct 11 01:24:36.439910 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 931/1900] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:36 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:36.451378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f38ab910-78b5-41cf-bab4-7dd20346420c tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052086 Oct 11 01:24:36.451378 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 970/1901] 10.222.0.66 () {60 vars in 1217 bytes} [Tue Oct 11 01:24:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:24:36.457461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1752853823", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a5fe132e-f745-4c43-aeb5-a80393b9dc9c"}], "security_groups": [{"name": "tempest-securitygroup--163222241"}], "key_name": "tempest-keypair-2112235809", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:36.480755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:36.481391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:36.494318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.494904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.495382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.496110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.496574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.497006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.713868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] validate_networks() for [('a5fe132e-f745-4c43-aeb5-a80393b9dc9c', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:24:36.872007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:36.881614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ddcffe0-23c8-4ab9-a39e-da601265b206 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1393 microversion: 2.1 time: 0.412880 Oct 11 01:24:36.883024 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 932/1902] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:36 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1393 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:36.905859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-772273-9", "block_migration": "auto"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:36.911157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:36.920708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.921525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.922501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.923736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:36.924370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:36.924968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:36.965470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'flavor' on Instance uuid b080b644-d01c-438e-b0c4-804ef84e6eb8 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:24:36.986875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Going to try to live migrate instance to n-h2-772273-9 {{(pid=120494) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:24:37.657891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for project fb9662f7f6e343c29219bcb20e76075a. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:37.672774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for user e7613cc8ae6642e4933bbb832a2c8da6 and project fb9662f7f6e343c29219bcb20e76075a. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:37.714830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:24:37.715484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:24:37.716133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:24:37.716796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:24:37.721305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:24:37.741589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:37.742095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:37.742659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:37.747732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:37.748285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:37.748660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:37.791185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for project fb9662f7f6e343c29219bcb20e76075a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:37.805375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Getting quotas for user e7613cc8ae6642e4933bbb832a2c8da6 and project fb9662f7f6e343c29219bcb20e76075a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:37.830881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:24:37.833614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:24:37.942319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-713609f3-8ed0-4ce4-adb7-28b215119a2b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.487959 Oct 11 01:24:37.944130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 971/1903] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:24:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:24:37.955537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:37.959894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:37.971911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:37.972604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:37.973349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:37.974876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:37.975535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:37.976300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:38.563071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.580719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.582591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.587007 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0421aedc-c90f-4d37-9743-b6ebe52c6d8c tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1553 microversion: 2.21 time: 0.640886 Oct 11 01:24:38.590456 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 972/1904] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:37 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1553 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:38.600674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:38.602764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:38.617560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:38.625365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:38.625956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:38.627031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:38.627283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:38.627770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:38.782996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.796918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.801108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:38.811518 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5daca5b2-c9fe-4119-8940-7d954d30c629 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.218937 Oct 11 01:24:38.843358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 973/1905] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:38 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:38.849419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:38.850788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:38.857800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:38.860429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:38.861282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:38.862756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:38.863695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:38.864934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.521770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:39.539029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdbacea6-7927-484a-997a-f5a3856f788b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1383 microversion: 2.1 time: 0.694396 Oct 11 01:24:39.561515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 974/1906] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:38 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1383 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:39.567112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:39.568031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:39.594168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.594873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.595647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.596546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.597294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.598136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.713758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:39.724559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce987842-28b9-4c40-bbe8-f4f911c028dd tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1322 microversion: 2.1 time: 0.160980 Oct 11 01:24:39.732534 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 975/1907] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:39 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:39.742437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:39.743126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:39.750218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.751171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.752018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.752935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.753612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.754210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.772303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2e2a026-8ddb-4f01-be06-8a4466563ae1 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8/action" status: 202 len: 0 microversion: 2.25 time: 2.871739 Oct 11 01:24:39.773274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 933/1908] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:24:36 2022] POST /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8/action => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:39.778139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b80f118d-5fac-403b-93e5-72b6d3d11c63 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '.version_select at 0x7f112fa54430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:39.781847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80f118d-5fac-403b-93e5-72b6d3d11c63 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.788468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80f118d-5fac-403b-93e5-72b6d3d11c63 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.789173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80f118d-5fac-403b-93e5-72b6d3d11c63 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.806139 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b80f118d-5fac-403b-93e5-72b6d3d11c63 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 3087 microversion: 2.1 time: 0.031042 Oct 11 01:24:39.807252 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 934/1909] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:24:39 2022] GET /compute/v2.1/os-migrations => generated 3087 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:39.840271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:39.847798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:39.858317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:24:39.862827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.863833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.865617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.866721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.867672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.868598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.869427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:39.881564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:39.969709 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c04c0814-8765-4b5b-ad2a-57d67ba9dba6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 204 len: 0 microversion: 2.21 time: 0.235523 Oct 11 01:24:39.970307 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 976/1910] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:39 2022] DELETE /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:24:39.977415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:39.979819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:39.987636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.988128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.989401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:39.990383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:39.991848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:39.992637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.073369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.083819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.085977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.087963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b879825d-705f-4a96-93a7-2354ecf9db02 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.276532 Oct 11 01:24:40.088784 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 935/1911] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:39 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:40.097894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:40.099517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:40.113926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.114539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.115134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.116863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.118327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.118891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.164917 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac74a2da-799d-43bc-aaeb-46a096bfe9a1 tempest-LiveMigrationTest-441753747 tempest-LiveMigrationTest-441753747-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1534 microversion: 2.1 time: 0.192914 Oct 11 01:24:40.165781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 977/1912] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:39 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1534 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:40.171084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:40.172001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:40.180629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.181456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.182539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.195553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.196382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.197044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.210574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.221318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.224358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.231649 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-deb70c2a-1256-487e-aaaf-c9e20cf5ada4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.140837 Oct 11 01:24:40.232316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 936/1913] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:40 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:40.242147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:40.242679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:40.264271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.265011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.265648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.266750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.268192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.268806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.331875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:24:40.413853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.435812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.438368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.443624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71aa880c-a1c2-4e15-8713-613deccb5dc6 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1559 microversion: 2.21 time: 0.275698 Oct 11 01:24:40.444710 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 978/1914] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:40 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1559 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:40.483777 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e7002a6-aa8f-4f04-835d-24b7c37ac177 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 204 len: 0 microversion: 2.1 time: 0.250097 Oct 11 01:24:40.485310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 937/1915] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:24:40 2022] DELETE /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:24:40.493995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:40.495017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:40.502751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.503734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.504570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.506101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.506788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.507522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.712627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.719099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:40.722049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d778f21-28c1-4567-b099-279ce42f2eb3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1389 microversion: 2.1 time: 0.232788 Oct 11 01:24:40.722832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 979/1916] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:40 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:40.753593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:40.755318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:40.761748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.762518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.762947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.763674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:40.764124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:40.764543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:40.841106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:40.849739 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7fcb1eb6-9e26-4eb7-9046-a05042d48c0c tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1330 microversion: 2.1 time: 0.100399 Oct 11 01:24:40.850697 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 938/1917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:40 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:41.119747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:41.121289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:41.130467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.131115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.131692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.132836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.133477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.133908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.272630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:41.273643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:41.281606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.282506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.283127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.284134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.284597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.285230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.315436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.336828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.339761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.341329 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-085d34df-bea6-4922-b7ba-7f27babec5ac tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.226274 Oct 11 01:24:41.344034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 980/1918] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:41 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:41.448527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.458030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.460185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.465447 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cf644d3-84ba-462d-9b3d-d114cbb0c83c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.200573 Oct 11 01:24:41.467419 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 939/1919] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:41 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:41.472693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:41.473041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:41.480089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.480917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.481532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.482573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.483200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.483870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.752558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:41.753304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:41.763652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.765470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.767747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.769751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.770986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.771712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.788260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.809253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.821551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:41.822800 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-afffe11b-e6a2-4089-af34-db001ba931ee tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1559 microversion: 2.21 time: 0.354342 Oct 11 01:24:41.848296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 981/1920] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:41 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:41.873412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:41.874033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:41.882143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.882634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.883074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:41.898498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:41.899116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:41.899603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.078760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.097350 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b50548b5-5708-4200-81bf-98e958847d90 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1328 microversion: 2.1 time: 0.227702 Oct 11 01:24:42.098034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 982/1921] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:41 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1328 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:42.277463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.291938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d10d20f-b62c-4de1-a76b-30651b81d4c3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1389 microversion: 2.1 time: 0.548242 Oct 11 01:24:42.292899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 940/1922] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:41 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1389 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:42.375370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:42.376800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:42.388441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.389218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.389824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.390703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.391447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.392122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.497306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:42.498365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:42.505046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.505761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.506377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.507282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.507929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.508526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.615331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.627908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.629499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.637076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05de169d-ebc4-4d87-bca0-1d6ebb01cb08 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.143516 Oct 11 01:24:42.653997 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 941/1923] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:42 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:42.753443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.763882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.765934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:42.767964 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6af3c2a2-32af-468a-8811-4a678185ad53 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.399636 Oct 11 01:24:42.769372 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 983/1924] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:42 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:42.819180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7783a5f7-35ba-46bc-a22f-b5c63ba972a2", "name": "network-vif-deleted", "tag": "231ddbf9-0488-4ff3-8694-e72adc11bc59"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:42.833736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:42.836604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.837814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.838385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.862411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:42.863179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:42.870166 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] Creating event network-vif-deleted:231ddbf9-0488-4ff3-8694-e72adc11bc59 for instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 on n-h2-772273-9 Oct 11 01:24:42.878896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.883885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-21712ebe-eda1-47c7-b9f4-a2e5b34c26b4 req-428317aa-7797-4130-962c-a5abc667d0a6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069743 Oct 11 01:24:42.885650 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 942/1925] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:42.886522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.889502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:42.893525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:42.894262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:42.895007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.113832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.122337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:43.123291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:43.127511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.132588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '512b862ac1f64cb7a316bf15382d145a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3be63655de345b8bce584b9126c6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.134100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2998139d-d8ff-4397-80c7-0d8c4f475d39 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 200 len: 1344 microversion: 2.21 time: 0.276620 Oct 11 01:24:43.138388 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 984/1926] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:42 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 1344 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:43.141969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.142652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.143393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.144324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.144970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.145790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.318109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:43.318743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:43.341235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.342719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.344534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.346167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.348115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.352077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.373770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.389880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6f6ea87-5e50-403b-8f90-1241146b81e3 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1328 microversion: 2.1 time: 0.267154 Oct 11 01:24:43.390747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 943/1927] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:43 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:43.670632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.671151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:43.671477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:43.683415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1bf391ad-6ff1-44a5-a44a-3c07fc85df56 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1389 microversion: 2.1 time: 0.370400 Oct 11 01:24:43.685066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.685771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.687788 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 985/1928] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:43 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1389 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:43.688433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.689360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.689983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.692853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.798572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:43.799856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:43.813745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.817050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.818184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.819402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:43.821490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:43.831189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:43.894090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.906496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.908169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:43.921208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9150d8d3-d74e-4f1a-a9b0-a88f59338d54 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.253338 Oct 11 01:24:43.922429 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 944/1929] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:43 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:44.161538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.162543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.169451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.177668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.178414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.180026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.180498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.181634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.214487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] HTTP exception thrown: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Request method failure captured: Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 HTTP/1.1 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMW6rcm6wP2E48HA5b8skhZINGlGRMXWLs7NDcYKPz-JsNAw8Ws1fNESG77UEu8QTLUoaHqd4SVGZzCUAdxWn2e_Zx1DyIx2u1imItisTTaXbDjTbHvaxy8FTNtvIakVXRYEeDFEUmRA1BhMnqtPRDaqcxAgsk4UbvfWi-D2O9U26LM Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:24:44.220429 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 512b862ac1f64cb7a316bf15382d145a Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.222714 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '7783a5f7-35ba-46bc-a22f-b5c63ba972a2'} Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:44.224146 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.228618 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.230404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Returning 404 to user: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:44.230404 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-807acf47-6da4-4860-b7a8-ab94560eb735 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 404 len: 111 microversion: 2.21 time: 0.064479 Oct 11 01:24:44.230404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 945/1930] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:44 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:24:44.236131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '.version_select at 0x7f112f8d10d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.236744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.253953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.254369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.257386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.258444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.262761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.263490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.431396 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b5ab830-7c25-4fa6-bafb-4a0c42fc21c5 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.201504 Oct 11 01:24:44.435888 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 946/1931] 10.222.0.66 () {60 vars in 1337 bytes} [Tue Oct 11 01:24:44 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2/os-instance-actions => generated 611 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:24:44.445638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca08714-5734-464f-b11c-874c5139c898", "name": "network-vif-deleted", "tag": "79a24c93-41ef-4255-a271-b5579e23dcdd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:44.463988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.464478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.468950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.493569 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] Creating event network-vif-deleted:79a24c93-41ef-4255-a271-b5579e23dcdd for instance 1ca08714-5734-464f-b11c-874c5139c898 on n-h2-772273-9 Oct 11 01:24:44.503220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6f96b6b9-6152-477d-9d1d-db5eaef04d0a req-24bcd16e-42ff-43c1-b726-9437ea6433c5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065736 Oct 11 01:24:44.503884 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 947/1932] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:44.514879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.519634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.533426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.533926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.534369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.538357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.538969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.539459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.541096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:44.554251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:44.556012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:44.563815 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96f579a3-d089-4a95-bd05-7aac19540614 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.763917 Oct 11 01:24:44.575699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 986/1933] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:43 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:44.594159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.594677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.612329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.612856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.613297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.614723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.618421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.623722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.657313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] HTTP exception thrown: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Request method failure captured: Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 HTTP/1.1 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMW6rcm6wP2E48HA5b8skhZINGlGRMXWLs7NDcYKPz-JsNAw8Ws1fNESG77UEu8QTLUoaHqd4SVGZzCUAdxWn2e_Zx1DyIx2u1imItisTTaXbDjTbHvaxy8FTNtvIakVXRYEeDFEUmRA1BhMnqtPRDaqcxAgsk4UbvfWi-D2O9U26LM Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:44.659763 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 512b862ac1f64cb7a316bf15382d145a Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.662486 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '7783a5f7-35ba-46bc-a22f-b5c63ba972a2'} Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:44.663700 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.665701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.668822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Returning 404 to user: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:44.673509 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6bf0c2f0-fb68-4b1e-a64a-bae9c2f326ba tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 404 len: 111 microversion: 2.21 time: 0.096330 Oct 11 01:24:44.674748 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 987/1934] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:24:44 2022] DELETE /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:24:44.693430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.694281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] [instance: 7783a5f7-35ba-46bc-a22f-b5c63ba972a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.698543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:44.715446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.717640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.718337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.720096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.721876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.725112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.762619 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] HTTP exception thrown: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Request method failure captured: Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 HTTP/1.1 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMW6rcm6wP2E48HA5b8skhZINGlGRMXWLs7NDcYKPz-JsNAw8Ws1fNESG77UEu8QTLUoaHqd4SVGZzCUAdxWn2e_Zx1DyIx2u1imItisTTaXbDjTbHvaxy8FTNtvIakVXRYEeDFEUmRA1BhMnqtPRDaqcxAgsk4UbvfWi-D2O9U26LM Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:44.766518 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3be63655de345b8bce584b9126c6fe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f3be63655de345b8bce584b9126c6fe1 Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-662487771 Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 512b862ac1f64cb7a316bf15382d145a Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-InstanceActionsV221TestJSON-662487771-project Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.768624 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '7783a5f7-35ba-46bc-a22f-b5c63ba972a2'} Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:44.769774 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. Oct 11 01:24:44.772168 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:44.778612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] Returning 404 to user: Instance 7783a5f7-35ba-46bc-a22f-b5c63ba972a2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:44.778612 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e093cfa3-0c23-48ad-a010-93b6c6921234 tempest-InstanceActionsV221TestJSON-662487771 tempest-InstanceActionsV221TestJSON-662487771-project] 10.222.0.66 "GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2" status: 404 len: 111 microversion: 2.21 time: 0.093517 Oct 11 01:24:44.778911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 988/1935] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:44 2022] GET /compute/v2.1/servers/7783a5f7-35ba-46bc-a22f-b5c63ba972a2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:24:44.790459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:44.791393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:44.803964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.807912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.808513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:44.809378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:44.810007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:44.810534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:45.010017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.020786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5fe5163-c3ed-4752-a5ea-16294c387774 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.240610 Oct 11 01:24:45.021384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 989/1936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:44 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:45.030097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:45.034989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:45.046308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:45.051265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:45.052506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:45.053446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:45.054112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:45.058345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:45.122239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.130888 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36dcbe2e-0bd1-4e87-8854-e1fc4427126f tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.625739 Oct 11 01:24:45.134203 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 948/1937] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:44 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:45.599674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:45.601772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:45.616442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.620789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:45.626189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:45.627908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:45.630941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:45.631107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.633245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:45.634311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:45.635509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.648931 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47796f4d-7c6a-4c1e-ae24-2f3fdacf233d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.625438 Oct 11 01:24:45.649542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 990/1938] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:45 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:45.892774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.905076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.908597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:45.909811 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e79eae31-2cd0-458f-a91c-d815666e63b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.318443 Oct 11 01:24:45.910385 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 949/1939] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:45 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:46.048959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:46.051451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:46.064303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.065226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.065911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.068487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.069261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.070971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.157606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:46.158711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:46.170955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.171778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.172448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.173807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.174871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.175980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.369057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:46.380668 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b2148ac-a468-443e-bf76-e8f1e3c727b3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.335132 Oct 11 01:24:46.381282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 991/1940] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:46 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:46.603581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:46.615189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6fe96ca-3723-453c-99fc-6c75fd7b3c08 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.460320 Oct 11 01:24:46.631544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 950/1941] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:46 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:46.677368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:46.677995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:46.696100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.696100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.696100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.696790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.697254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.697686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.839055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:46.856953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:46.872126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:46.903948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-efc3ef03-0c43-4936-9a0f-755d10cf3165 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.230967 Oct 11 01:24:46.905036 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 992/1942] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:46 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:46.953860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:46.959970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:46.971635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.972394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.974015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:46.975035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:46.975796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:46.976690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.406187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:47.406949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:47.419871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:47.420746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:47.421424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.422408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:47.423113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:47.423904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.433005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:47.447297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:47.448929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:47.451528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbbe41da-47d4-4f66-94f6-3714b743cf51 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.512548 Oct 11 01:24:47.465191 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 951/1943] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:46 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:47.467675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf56385-b27a-4d14-9f63-468910324e4b", "tag": "74e0f6a3-7ce2-499a-b43a-4155786e5636"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:47.482269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:47.487948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:47.488717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.499421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:47.508803 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] Creating event network-changed:74e0f6a3-7ce2-499a-b43a-4155786e5636 for instance ddf56385-b27a-4d14-9f63-468910324e4b on n-h2-772273-9 Oct 11 01:24:47.531259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2e418231-4a03-45e2-9b8c-060b31dbc399 req-d9004316-1170-43db-a58a-6e90953a91fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064071 Oct 11 01:24:47.546071 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 952/1944] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:47.617973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:47.634691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24c4e963-6556-4d81-9a44-43c40eccc018 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.231891 Oct 11 01:24:47.638798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:47.639543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:47.648782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:47.649201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:47.649606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.650366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:47.650813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:47.651739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 993/1945] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:47 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:47.658915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:47.944814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:47.945586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:47.999002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:48.006533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:48.053702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.059967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.060486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.063572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.064431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.066034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.230538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.243799 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-042d85ca-fe70-4944-aae4-202ebd53fec0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.609152 Oct 11 01:24:48.249096 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 953/1946] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:47 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:48.341192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.353808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.355916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.378706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-342310f7-c798-494f-9948-cd96c974ee43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.446277 Oct 11 01:24:48.380127 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 994/1947] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:47 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:48.480716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:48.481697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:48.491449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.493042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.495485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.496372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.496959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.498636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.663881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:48.664623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:48.675279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.675894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.676487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.677329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:48.677908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:48.678455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:48.812642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.830251 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b56ef076-33a9-4ed0-9ecd-f2969ba8a507 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.171302 Oct 11 01:24:48.831504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 995/1948] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:48 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:48.947813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.956232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.958627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:48.960252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84031fae-3008-4aa7-80a3-81168b82e04f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.483850 Oct 11 01:24:48.961082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 954/1949] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:48 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:49.311443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:49.312330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:49.319757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.320730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.321339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.322260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.322899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.323534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.411424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:49.412357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:49.419520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.420276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.420921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.421840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.422473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.423721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.583209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:49.592392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:49.597974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:49.617333 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b278a41e-45e0-4d7c-83a9-4dd0853f340a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.210285 Oct 11 01:24:49.623190 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 955/1950] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:49 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:24:49.742990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:49.756016 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca14fe59-e15a-488c-b5bb-4deefc7f0d74 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.448363 Oct 11 01:24:49.760269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 996/1951] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:49 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:49.856992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:49.864616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:49.883671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.884393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.885021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.886587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:49.889193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:49.892034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:49.938978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-603e5eb6-6989-4a4f-8a54-8c33bd25b75f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Action: 'create', calling method: .version_select at 0x7f112fa294c0>, body: {"keypair": {"name": "tempest-keypair-306555011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCj32RJSzNYRuJzMwhB9mxU4T6CFc+vJ5DeWsY6skX24g1tPZUT4hAdU9fSMBRay/V9hpMpsck3h5VM2fLAg8XUUrBCHT0vMIcC++ZtcLIptsPncJccvUwNNy+P79MlR3A=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:49.973945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-603e5eb6-6989-4a4f-8a54-8c33bd25b75f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for project 27aefacad2da4218ace0f2330ac931ca. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:24:49.990458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-603e5eb6-6989-4a4f-8a54-8c33bd25b75f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for user 4a46950996b44164995eaf4238df6839 and project 27aefacad2da4218ace0f2330ac931ca. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:24:50.009820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:50.013960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:24:50.023624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f3a5b70-43d1-48da-ae4e-6f3deed8be0d tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.169284 Oct 11 01:24:50.026086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 997/1952] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:49 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:50.038499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:50.039405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:50.050402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.050547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.050932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:50.051540 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-603e5eb6-6989-4a4f-8a54-8c33bd25b75f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325109 Oct 11 01:24:50.051713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.052213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.052716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:50.053426 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 956/1953] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:24:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:24:50.304768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:50.314687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:50.321705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:50.323314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef17d865-7af0-437d-93b2-a088b6399612 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.296084 Oct 11 01:24:50.324525 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 998/1954] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:50 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:50.667226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:50.670509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:50.686254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.687142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.691167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:50.692745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.693597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.695972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:50.784866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:50.785741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:50.805854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.806565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.807188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:50.808154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:50.808780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:50.809365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:51.465101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:51.477320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:51.480183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:51.496687 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb206022-0b48-4636-9c8c-fad2118c5e81 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.840396 Oct 11 01:24:51.500055 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 957/1955] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:50 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:51.511565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:51.515821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:51.531761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:51.533273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:51.536560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:51.538566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:51.538989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:51.539602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:51.828186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:51.837655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac2f8588-fb38-415d-9c8d-4b9a568ce731 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.336350 Oct 11 01:24:51.876977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:51.879785 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 958/1956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:51 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:51.889434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:51.889647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-165c012a-c234-4595-b5a6-d8fff9300890 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 1.108552 Oct 11 01:24:51.890089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:51.906439 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 999/1957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:50 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:51.917745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:51.918266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:51.918710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:51.919749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:51.920476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:51.920726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:52.528836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:52.529735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:52.545027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:52.551551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:52.552258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:52.553192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:52.553838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:52.554509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:52.723181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:52.735510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:52.739729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:52.756804 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d4f6001-b767-4e38-b4c1-5bed6bff7f48 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1558 microversion: 2.91 time: 0.230080 Oct 11 01:24:52.760412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1000/1958] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:52 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:52.871838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:52.872965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:52.892219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:52.894463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:52.897075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:52.898297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:52.904617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:52.905355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:53.016148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:53.035978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9b983c38-11aa-41ca-8273-825af0ef7132 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.171769 Oct 11 01:24:53.038892 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1001/1959] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:52 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:53.062430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:53.064311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:53.091259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:53.092702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:53.099474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:53.100473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:53.100966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:53.101474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:53.147532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:53.162174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:53.163967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:53.171396 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b572e40-2bf0-42af-9604-06b44ee299fd tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.290184 Oct 11 01:24:53.187770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 959/1960] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:51 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:53.796778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:53.796778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:53.807137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:53.820190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:53.820684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:53.821700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:53.822182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:53.822622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:54.087668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:54.106380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:54.120060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:54.141631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-def6c4a5-b5e2-4d0f-b747-56e18af15632 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.351106 Oct 11 01:24:54.142929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 960/1961] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:53 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:54.152220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:54.153854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:54.170008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:54.176165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:54.176974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:54.177999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:54.178712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:54.179481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:54.345159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:54.354536 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf8d637e-fccd-451c-adec-25b0abb03e8b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 1.313037 Oct 11 01:24:54.361197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:54.370977 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1002/1962] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:53 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:54.379419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cf2ca04-b7a0-41ee-8d90-46ccb03c9aeb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 200 len: 1184 microversion: 2.1 time: 0.234278 Oct 11 01:24:54.382946 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 961/1963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:54 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 1184 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:54.385278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:54.388594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:54.409631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:54.410580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:54.411910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:54.413014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:54.413659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:54.415009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.180254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:55.181589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:55.207309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.209035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.209691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.210821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.211676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.212335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.365504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.391505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.394976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.408967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5cf5849e-7cb0-4eb0-88af-e88b090bd01f tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.029151 Oct 11 01:24:55.411141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1003/1964] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:54 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:55.436593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:55.440238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:55.464191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.466975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.468028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.469675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.470885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.471539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.806190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.846034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.847720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.849882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:55.868027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5590647-cc33-48ba-90aa-233386de9068 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.450846 Oct 11 01:24:55.870061 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1004/1965] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:55 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:55.896427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd756b24-17e4-4f4d-87e9-5ad62f786be2 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.728429 Oct 11 01:24:55.911366 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 962/1966] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:55 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:55.914902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:55.917484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 1ca08714-5734-464f-b11c-874c5139c898] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:55.966644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.967138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.967609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:55.976205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:55.976750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:55.977197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:56.034203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] HTTP exception thrown: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Request method failure captured: Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 HTTP/1.1 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMQwyl1gkQdPyfFnknDfMHOkxzyQr4vpFbVh6mgroIzP-1IsPf4DpD1WEzLXo01ZOMYCn6Rl81sMK_1_EeDvpC1ugBslcrccVDSPO3sSkEOZk2KbyKX5LKbDO8PBHN7zm_igInqjyU6sotkAH8Ud0PfkTH9WNti1ZyzHzifzfqjU4xo Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:24:56.074454 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-LiveMigrationTest-1103055366 Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-LiveMigrationTest-1103055366-project Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ef7f0979c5764837ae474f3a09cedb7b Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-LiveMigrationTest-1103055366-project Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. Oct 11 01:24:56.076610 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1ca08714-5734-464f-b11c-874c5139c898'} Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:24:56.077705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. Oct 11 01:24:56.080292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:24:56.084551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Returning 404 to user: Instance 1ca08714-5734-464f-b11c-874c5139c898 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:24:56.090722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b244fbf9-80fa-4790-acf9-0b6170193af4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898" status: 404 len: 111 microversion: 2.1 time: 0.218652 Oct 11 01:24:56.094389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1005/1967] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:55 2022] GET /compute/v2.1/servers/1ca08714-5734-464f-b11c-874c5139c898 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:24:56.440369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:56.446149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:56.473463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:56.475535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:56.476953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:56.478145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:56.481245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:56.482330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:56.896380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:56.897005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:56.915885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:56.920962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:56.922862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:56.926724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:56.932944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:56.934992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:57.167625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.179839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.183477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.188646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7154930-81da-468b-84a2-c9c628dc1dc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.755646 Oct 11 01:24:57.189774 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 963/1968] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:56 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:57.203592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:57.204505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:57.237466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:57.238876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:57.239540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:57.240440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:57.243713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:57.246773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:57.478996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.490607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.496293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.511942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f3950c0-f179-4486-b904-c08ae08816ea tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.319244 Oct 11 01:24:57.513879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 964/1969] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:57 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:57.532696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf56385-b27a-4d14-9f63-468910324e4b", "name": "network-vif-plugged", "status": "completed", "tag": "74e0f6a3-7ce2-499a-b43a-4155786e5636"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:24:57.560606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:57.562488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:57.564233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:57.592930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] Creating event network-vif-plugged:74e0f6a3-7ce2-499a-b43a-4155786e5636 for instance ddf56385-b27a-4d14-9f63-468910324e4b on n-h2-772273-9 Oct 11 01:24:57.605543 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-dd0fde9d-594a-439d-a4a6-09f9587349b5 req-e15a4df0-5c1e-4185-9091-708168e2cc8c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086776 Oct 11 01:24:57.606876 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 965/1970] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:24:57.672637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:57.687519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af760d03-a11e-423b-a653-04c975879fa0 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.795305 Oct 11 01:24:57.689926 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1006/1971] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:56 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:24:58.218387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:58.219089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:58.234945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.235471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.240050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.241862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.246285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.247320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.554391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:58.555139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:58.584578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.587515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.589572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.596494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.602445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.603214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.855656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:58.871644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:58.873341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:58.886248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35113140-7004-4b94-9d5d-ad7214dfb0f7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.342231 Oct 11 01:24:58.889998 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1007/1972] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:58 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:58.899710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:58.902638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:58.939217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.943582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.944096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.944915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:58.945566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:58.946181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:58.996687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:59.006364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:59.015137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:59.027445 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-019e4bc3-60cf-4298-9d19-c3d0a9c3cfe2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.811232 Oct 11 01:24:59.031380 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 966/1973] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:58 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:24:59.351021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:24:59.361764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b47f13c-896e-447d-82c4-411ca6e4d1af tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1395 microversion: 2.1 time: 0.470211 Oct 11 01:24:59.395795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1008/1974] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:24:58 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1395 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:24:59.916894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:24:59.926681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:24:59.959945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:59.962570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:59.967428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:24:59.969187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:24:59.972825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:24:59.976938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:00.002198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:00.067324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:00.068940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:00.115724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:00.117527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:00.121643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:00.127477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:00.128075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:00.131642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:00.735057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:00.749807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:00.752718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:00.761855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77586785-b304-4085-8520-ce312d1eade2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.700368 Oct 11 01:25:00.764121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1009/1975] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:00 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:00.780575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:00.781716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:00.793878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:00.796226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:00.798917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:00.800665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:00.802732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:00.803915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:01.157521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:01.204884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:01.209312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:01.237827 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e4373e3-1b33-48dc-baf3-64d651ac5c70 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 1.325466 Oct 11 01:25:01.282680 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 967/1976] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:24:59 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:01.788078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:01.794222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:01.794925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:01.812135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:01.814967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:01.815679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:01.816774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b270e23-af00-431c-bb56-c6782ce8ae60 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1575 microversion: 2.1 time: 1.044528 Oct 11 01:25:01.818502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:01.819467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1010/1977] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:00 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1575 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:01.820156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:01.820786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:01.845457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:01.846103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:01.867675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:01.875403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:01.876245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:01.877391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:01.878094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:01.879022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:02.299074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-684e369a-f5c6-4ab8-8e50-55bb8fab0042 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.457556 Oct 11 01:25:02.299827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1011/1978] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:25:01 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b/os-interface => generated 284 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:25:02.306008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:02.307057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:02.318797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:02.321849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:02.323332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:02.329166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:02.333615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:02.334388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:03.525042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.536154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.555071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.557567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-571daaa0-2d6f-4278-9d77-5ad4ca1199e7 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.771272 Oct 11 01:25:03.565415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.566026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 968/1979] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:01 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:03.575968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.585919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:03.610818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aea604a9-852c-48d4-b518-7a24a20a56a1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 1.309609 Oct 11 01:25:03.612002 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1012/1980] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:02 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:04.524060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9e5b7a6-9e09-4418-8c76-abb16b1b84b3 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949578213", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:04.529507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e9e5b7a6-9e09-4418-8c76-abb16b1b84b3 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] HTTP exception thrown: min_count must be <= max_count Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9e5b7a6-9e09-4418-8c76-abb16b1b84b3 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Request method failure captured: Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 184 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMXvnX9wRsiy8tgSfomS80I-_cx1S7eJ5_8w06FZIg1XRFRZIpaDmiRtXFzrmAclvK603nKmYb-erkFhBCDVxSHg0Agx_JRXkKMtbFf_aah4tVai8uAiVbnGARGuskWjci36cV1XVA6GWcwrCF_J_Q5W0k94HqnTQp5F003n0RTaoWI Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:04.533351 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 42444b1ef09247e589de521d0af67678 Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:25:04.535037 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949578213", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: exception: min_count must be <= max_count Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1949578213', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:25:04.536934 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 11 01:25:04.538417 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:04.542074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9e5b7a6-9e09-4418-8c76-abb16b1b84b3 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Returning 400 to user: min_count must be <= max_count {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:04.543214 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9e5b7a6-9e09-4418-8c76-abb16b1b84b3 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.759293 Oct 11 01:25:04.563065 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 969/1981] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:03 2022] POST /compute/v2.1/servers => generated 74 bytes in 775 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:25:04.594264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:04.595732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:04.618163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:04.622130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:04.622929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:04.625947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:04.631307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:04.635514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:04.640980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:04.641734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:04.667500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:04.669101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:04.669591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:04.671541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:04.672004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:04.672439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:04.909917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:04.932051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:04.936619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:04.994574 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14ff2f30-0b46-4224-a207-0be279678315 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.355490 Oct 11 01:25:05.001177 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 970/1982] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:04 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:05.035786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6bb31a3-06d8-4edb-a59d-6f884c9fce93 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1726632898", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "max_count": 0}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6bb31a3-06d8-4edb-a59d-6f884c9fce93 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Request method failure captured: Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 168 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMXvnX9wRsiy8tgSfomS80I-_cx1S7eJ5_8w06FZIg1XRFRZIpaDmiRtXFzrmAclvK603nKmYb-erkFhBCDVxSHg0Agx_JRXkKMtbFf_aah4tVai8uAiVbnGARGuskWjci36cV1XVA6GWcwrCF_J_Q5W0k94HqnTQp5F003n0RTaoWI Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:05.056156 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 42444b1ef09247e589de521d0af67678 Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:25:05.058186 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1726632898", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "max_count": 0}} Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1726632898', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'max_count': 0}}} Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 0 Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.059308 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.061522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.063241 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.073645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6bb31a3-06d8-4edb-a59d-6f884c9fce93 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:05.075209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6bb31a3-06d8-4edb-a59d-6f884c9fce93 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.072493 Oct 11 01:25:05.077067 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 971/1983] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:05.180951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:05.192492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:05.198088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:05.201979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0245965a-1e1e-498f-a620-8fbeb40e8e15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.611684 Oct 11 01:25:05.209364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1013/1984] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:04 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:05.342027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-358bb945-9505-48d9-9e5a-0c483a62aff8 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-830462196", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "max_count": 2.5}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-358bb945-9505-48d9-9e5a-0c483a62aff8 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Request method failure captured: Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 169 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMXvnX9wRsiy8tgSfomS80I-_cx1S7eJ5_8w06FZIg1XRFRZIpaDmiRtXFzrmAclvK603nKmYb-erkFhBCDVxSHg0Agx_JRXkKMtbFf_aah4tVai8uAiVbnGARGuskWjci36cV1XVA6GWcwrCF_J_Q5W0k94HqnTQp5F003n0RTaoWI Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:05.353546 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 42444b1ef09247e589de521d0af67678 Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:25:05.355523 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-830462196", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "max_count": 2.5}} Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-830462196', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'max_count': 2.5}}} Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.356596 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.358486 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.360137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-358bb945-9505-48d9-9e5a-0c483a62aff8 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:05.364445 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-358bb945-9505-48d9-9e5a-0c483a62aff8 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024350 Oct 11 01:25:05.366961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 972/1985] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:05.462585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4fd1111-1bce-4410-a4d3-a6e3a727c27c tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2008653708", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 0}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4fd1111-1bce-4410-a4d3-a6e3a727c27c tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Request method failure captured: Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 168 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMXvnX9wRsiy8tgSfomS80I-_cx1S7eJ5_8w06FZIg1XRFRZIpaDmiRtXFzrmAclvK603nKmYb-erkFhBCDVxSHg0Agx_JRXkKMtbFf_aah4tVai8uAiVbnGARGuskWjci36cV1XVA6GWcwrCF_J_Q5W0k94HqnTQp5F003n0RTaoWI Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:25:05.467842 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 42444b1ef09247e589de521d0af67678 Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:25:05.469516 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2008653708", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 0}} Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2008653708', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'min_count': 0}}} Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 0 Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.470292 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.473300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.475778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4fd1111-1bce-4410-a4d3-a6e3a727c27c tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:05.478613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4fd1111-1bce-4410-a4d3-a6e3a727c27c tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011064 Oct 11 01:25:05.479282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1014/1986] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:05.579904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e10f6f4-06d2-43a6-a381-4094f696a1e1 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785447831", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 2.5}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e10f6f4-06d2-43a6-a381-4094f696a1e1 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Request method failure captured: Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 170 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMXvnX9wRsiy8tgSfomS80I-_cx1S7eJ5_8w06FZIg1XRFRZIpaDmiRtXFzrmAclvK603nKmYb-erkFhBCDVxSHg0Agx_JRXkKMtbFf_aah4tVai8uAiVbnGARGuskWjci36cV1XVA6GWcwrCF_J_Q5W0k94HqnTQp5F003n0RTaoWI Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:05.586008 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1a0d0b6a664427a9f941f81d76d41d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c1a0d0b6a664427a9f941f81d76d41d7 Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1579979672 Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 42444b1ef09247e589de521d0af67678 Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1579979672-project Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:25:05.587766 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785447831", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 2.5}} Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1785447831', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'min_count': 2.5}}} Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.588562 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.590330 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:05.593242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e10f6f4-06d2-43a6-a381-4094f696a1e1 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:05.594088 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e10f6f4-06d2-43a6-a381-4094f696a1e1 tempest-MultipleCreateNegativeTestJSON-1579979672 tempest-MultipleCreateNegativeTestJSON-1579979672-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020835 Oct 11 01:25:05.598961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 973/1987] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:06.039576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:06.040186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:06.064923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:06.067969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:06.084031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:06.085250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:06.088087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:06.092473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:06.242124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:06.243287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:06.272751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:06.279741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:06.281827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:06.282804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:06.285235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:06.285874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:06.712105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:06.730779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:06.732434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:06.753746 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-681aa804-eaee-4e34-b371-857819116417 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.721576 Oct 11 01:25:06.766849 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1015/1988] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:06 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:07.196051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:07.208195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:07.210826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:07.212939 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3a0cf2d-7261-48f6-aea7-37e23ae8593a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.977401 Oct 11 01:25:07.232257 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 974/1989] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:06 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:07.283031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:07.285270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:07.305927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:07.312272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:07.313566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:07.315931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:07.321622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:07.323746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:07.343649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf56385-b27a-4d14-9f63-468910324e4b", "tag": "74e0f6a3-7ce2-499a-b43a-4155786e5636"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:07.382481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:07.385637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:07.387102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:07.435833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:07.485239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:07.489087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] Creating event network-changed:74e0f6a3-7ce2-499a-b43a-4155786e5636 for instance ddf56385-b27a-4d14-9f63-468910324e4b on n-h2-772273-9 Oct 11 01:25:07.521351 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d182d083-f0a6-4889-b800-6bb13dd87517 req-2b4d60bc-cebb-4f4e-93d4-f0a66ad65bea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181299 Oct 11 01:25:07.522266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 975/1990] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:25:07.800674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:07.801370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:07.824613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:07.825116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:07.825556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:07.826286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:07.826746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:07.827180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.118453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.124983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.146371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.148227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.149081 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-68f1df09-db72-4af2-9db4-478e41db60f2 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1575 microversion: 2.1 time: 0.866493 Oct 11 01:25:08.150874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1016/1991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:07 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1575 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:08.170642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6195ef18-ab41-4d5e-97ab-bd6f727719fd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.374587 Oct 11 01:25:08.171086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:08.173722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:08.179418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 976/1992] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:07 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:08.190194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.195459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.196202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.197379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.198080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.198791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.245052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:08.248881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:08.266212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.273198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.274062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.275086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.282126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.288597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.298735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:25:08.550524 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-021339c5-1209-45ff-862b-48adf495dafa tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 204 len: 0 microversion: 2.1 time: 0.393611 Oct 11 01:25:08.554537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1017/1993] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:25:08 2022] DELETE /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:25:08.588422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:08.590683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:08.625289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.628993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.629719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.630500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:08.633425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:08.635414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:08.899528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.908385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.925860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:08.936428 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-903b7aec-d9ec-4844-92dd-c5339116912e tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.695168 Oct 11 01:25:08.952288 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 977/1994] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:08 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:09.209890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:09.211684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:09.221887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:09.228204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:09.229768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:09.230844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:09.231607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:09.232306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:09.628857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:09.645248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-637986e3-0cac-42fa-bc8b-3b32476b8097 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1667 microversion: 2.1 time: 1.083742 Oct 11 01:25:09.651086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1018/1995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:08 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1667 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:09.821615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:09.830505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:09.832570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:09.888927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99be311f-20b0-4f30-befc-e75dc7e78aa3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.671099 Oct 11 01:25:09.889552 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 978/1996] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:09 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:09.968455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:09.969598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:09.982457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:09.984272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:09.985004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:09.986395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:09.989514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:09.991080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:10.389702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b080b644-d01c-438e-b0c4-804ef84e6eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "85f801b6-9678-4675-bf11-12dd14196dc3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:10.426070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:10.427140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:10.431514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:10.480429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] Creating event network-vif-unplugged:85f801b6-9678-4675-bf11-12dd14196dc3 for instance b080b644-d01c-438e-b0c4-804ef84e6eb8 on n-h1-772273-9 Oct 11 01:25:10.497501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c5be681d-7e4a-4221-aec9-66303ba36873 req-b91f3ceb-7687-402d-9cae-8c03653ebc34 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112057 Oct 11 01:25:10.513647 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 979/1997] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:10.690918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:10.694007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:10.734161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:10.738377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:10.738883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:10.741884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:10.743900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:10.744382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:11.861206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:11.872804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:11.892636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:11.905123 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65b69ecc-0b7d-41e5-a481-95abed75c319 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.940789 Oct 11 01:25:11.909409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1019/1998] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:09 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:11.920456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:11.921083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:11.959594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:11.960099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:11.960549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:11.961276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:11.961737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:11.962170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:12.160388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:12.175318 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-da8c1e3f-6a9c-4fe3-b516-f5a52fc324df tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1667 microversion: 2.1 time: 1.499059 Oct 11 01:25:12.189732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 980/1999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:10 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1667 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:12.517096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:12.531617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:12.535279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:12.552031 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3504e66-c026-4467-99a5-854b08878cdc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.641500 Oct 11 01:25:12.554879 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1020/2000] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:11 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:12.677304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b080b644-d01c-438e-b0c4-804ef84e6eb8", "tag": "85f801b6-9678-4675-bf11-12dd14196dc3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:12.711632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:12.715736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:12.716221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:12.724779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:12.776506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] Creating event network-changed:85f801b6-9678-4675-bf11-12dd14196dc3 for instance b080b644-d01c-438e-b0c4-804ef84e6eb8 on n-h1-772273-9 Oct 11 01:25:12.824693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-50d77f01-d151-4ee2-a67d-c61be3128e7a req-30d110fb-c129-47bc-90e9-25ae015fa2a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151916 Oct 11 01:25:12.825319 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 981/2001] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:12.940649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:12.940649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:12.949797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:12.950297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:12.950751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:12.961157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:12.961783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:12.962241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:13.217632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:13.219165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:13.238059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:13.245206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:13.249152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:13.263861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:13.270774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:13.271842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:14.741534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:14.760082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d4950e5-e724-44d8-bcab-0b1e14d7c143 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1600 microversion: 2.1 time: 1.547353 Oct 11 01:25:14.761045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 982/2002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:13 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1600 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:14.765818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:14.766427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:14.799955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:14.804060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:14.804773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:14.805704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:14.806348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:14.806790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:15.051350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.064576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.073077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.074319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8faa07e9-8dd8-402f-9ce1-3dc155b22f7b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 2.140029 Oct 11 01:25:15.091805 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1021/2003] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:12 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:15.117094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.128535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.129848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:15.145338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03d61c3e-b86e-4fc0-9a16-7670c86fe554 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.383145 Oct 11 01:25:15.149073 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 983/2004] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:14 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:15.792543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:15.793607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:15.808249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:15.847056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:15.847922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:15.849367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:15.856409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:15.857240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:15.858418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.105708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:16.107558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:16.148464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:16.179554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:16.181998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:16.185591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.186403 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49772fc1-10e6-41b7-9a52-f52b3ac19ca7 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1600 microversion: 2.1 time: 0.403488 Oct 11 01:25:16.188716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1022/2005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:15 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1600 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:16.189366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:16.190199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:16.190879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.208824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e51375-b088-4724-ba57-79280f142f80", "name": "network-vif-deleted", "tag": "dc0187aa-306a-4e37-bbfa-adfad047bab4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:16.257627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:16.260236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:16.261901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.302327 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] Creating event network-vif-deleted:dc0187aa-306a-4e37-bbfa-adfad047bab4 for instance 72e51375-b088-4724-ba57-79280f142f80 on n-h1-772273-9 Oct 11 01:25:16.317983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-24ab7343-070d-43c1-a85a-a21d620d671d req-65675b37-2421-45f7-810a-2bd22101d6c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123697 Oct 11 01:25:16.319838 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1023/2006] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:16.354927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:16.358743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:16.385287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:16.410558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:16.412085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.424124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:16.425125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:16.428085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:16.742857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:16.791284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:16.802083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:16.832906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d6505954-e3f8-4782-920e-e2e82a6e1859 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.503983 Oct 11 01:25:16.851362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1024/2007] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:16 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:17.005063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:17.025505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:17.029772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:17.034581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e49a336-a834-41f7-85e6-ef4443242f58 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.934714 Oct 11 01:25:17.041503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 984/2008] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:16 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:17.221007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:17.222515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:17.235789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:17.238993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:17.239712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:17.240808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:17.247099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:17.247845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:17.374994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:17.380614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:17.381306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:17.383079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lazy-loading 'fault' on Instance uuid 72e51375-b088-4724-ba57-79280f142f80 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:17.459261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:17.473997 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d28d286f-f298-44fd-a811-8de6f4e07f00 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 200 len: 1324 microversion: 2.1 time: 0.257139 Oct 11 01:25:17.488638 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1025/2009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:17 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:17.872029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:17.873397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:17.899040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:17.900897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:17.903157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:17.909650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:17.910763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:17.913286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:18.071570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:18.072558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:18.094414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:18.096622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:18.101051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:18.107286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:18.108731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:18.114293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:18.209982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:18.237976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:18.241836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:18.257187 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f070bf4-33ba-426e-86ac-f8e8c672f64e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.394311 Oct 11 01:25:18.260774 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 985/2010] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:17 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:18.513993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:18.515108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 72e51375-b088-4724-ba57-79280f142f80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:18.525829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:18.526335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:18.529407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:18.533114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:18.534015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:18.534471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:18.573518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] HTTP exception thrown: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Request method failure captured: Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 HTTP/1.1 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQwyl1gkQdPyfFnknDfMHOkxzyQr4vpFbVh6mgroIzP-1IsPf4DpD1WEzLXo01ZOMYCn6Rl81sMK_1_EeDvpC1ugBslcrccVDSPO3sSkEOZk2KbyKX5LKbDO8PBHN7zm_igInqjyU6sotkAH8Ud0PfkTH9WNti1ZyzHzifzfqjU4xo Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:18.578251 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ef7f0979c5764837ae474f3a09cedb7b Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. Oct 11 01:25:18.580134 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '72e51375-b088-4724-ba57-79280f142f80'} Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:18.581065 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. Oct 11 01:25:18.582603 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:18.584095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Returning 404 to user: Instance 72e51375-b088-4724-ba57-79280f142f80 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:18.584095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dfa1ba73-09e8-4eb6-ab9b-3e1c7d3d8d2f tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80" status: 404 len: 111 microversion: 2.1 time: 0.085452 Oct 11 01:25:18.587550 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 986/2011] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:18 2022] GET /compute/v2.1/servers/72e51375-b088-4724-ba57-79280f142f80 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:25:18.598702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c7533a8-4b2a-4eda-9726-ffa11cd21508 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '.version_select at 0x7f112f9c1f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:18.632402 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c7533a8-4b2a-4eda-9726-ffa11cd21508 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705535004" status: 202 len: 0 microversion: 2.1 time: 0.041248 Oct 11 01:25:18.634297 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 987/2012] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:25:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705535004 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:25:19.301930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:19.311884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:19.340478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:19.341386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:19.341542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:19.342133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:19.342594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:19.343018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:19.607686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.622516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.628341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.640075 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62ef32d9-2d83-4adc-b370-c9094b994809 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.352039 Oct 11 01:25:19.654618 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 988/2013] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:19 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:19.749525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.761047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.762847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:19.767268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19744b0e-ebc7-4038-9585-3bf42fbb70f9 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.700207 Oct 11 01:25:19.789882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1026/2014] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:18 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:20.682336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:20.682907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:20.699350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:20.708045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:20.708529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:20.709309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:20.718024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:20.718554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:20.798315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:20.800465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:20.825973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:20.831016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:20.834609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:20.839530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:20.842936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:20.847181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:21.292857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:21.309734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:21.319650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:21.339291 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4982b59-4484-420a-8e52-de96e3d5adce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.661207 Oct 11 01:25:21.340619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 989/2015] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:20 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:22.252967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.266638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.268170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.269486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8125e81-0f60-4b4a-befa-7c212104758a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 1.475938 Oct 11 01:25:22.270069 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1027/2016] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:20 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:22.284352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:22.284880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:22.296736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.297176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.297597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.298324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.299373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.299793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.381394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:22.382027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:22.394234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:25:22.402122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.402619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.403053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.403801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.404255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.404799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.612280 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-853336a0-1d86-46c8-bfdd-de87f2e49fdb tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 204 len: 0 microversion: 2.1 time: 0.330920 Oct 11 01:25:22.613722 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 990/2017] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:25:22 2022] DELETE /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:25:22.625986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:22.629294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:22.644292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.648918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.649762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.651580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:22.654136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:22.654846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:22.783552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.804938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.809293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:22.839818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61372238-7b5a-49a3-b722-27c68df9c6ab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.467194 Oct 11 01:25:22.841331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1028/2018] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:22 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:23.205684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:23.222846 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0844de30-afe1-4772-883b-01ee62c42ecf tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1483 microversion: 2.1 time: 0.601538 Oct 11 01:25:23.228933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 991/2019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:22 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1483 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:23.296839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:23.297438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:23.309897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:23.310394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:23.310822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:23.320400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:23.321308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:23.321916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:23.675721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:23.684768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:23.692369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:23.694649 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-982342c3-2bb5-4388-ae7f-85c37e76de10 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.401689 Oct 11 01:25:23.695708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1029/2020] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:23 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:23.877773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:23.878980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:23.906958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:23.908271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:23.909671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:23.910647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:23.912961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:23.915123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:24.254880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:24.255833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:24.267486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:24.268197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:24.268785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:24.269612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:24.270967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:24.271539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:24.429050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:24.443686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:24.444922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:24.468181 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c726ee1d-cf9a-42d5-9b74-17cde10544ce tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.593413 Oct 11 01:25:24.472194 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 992/2021] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:23 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:24.717515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:24.725126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:24.725759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:24.734002 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9c5971b-61fe-456b-ab03-c0174ce649ce tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1483 microversion: 2.1 time: 0.477650 Oct 11 01:25:24.734736 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1030/2022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:24 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1483 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:24.742732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:24.743238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:24.743722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:24.744454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:24.744916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:24.751050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:25.052352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.055653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:25.076715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.111526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.120152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0bcbb882-af3d-4ac7-8326-8ccdb30bc15d tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.394042 Oct 11 01:25:25.120862 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 993/2023] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:24 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:25.502139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:25.503046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:25.514122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:25.543635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:25.544278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:25.548824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:25.549803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:25.550504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:25.691694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.703309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:25.711819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.714160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:25.734111 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1b6276f-d121-424d-9a19-9bec7366dea9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.231540 Oct 11 01:25:25.736733 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1031/2024] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:25 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:25.764708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:25.765329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:25.775154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:25.775702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:25.776132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:25.776857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:25.777315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:25.777984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.083271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:26.101556 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07cf217d-e873-40a9-8f6e-6a5ad44762c4 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1483 microversion: 2.1 time: 0.340633 Oct 11 01:25:26.109071 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 994/2025] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:25 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1483 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:26.149824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:26.150445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:26.165428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:26.166788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:26.166788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.167302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:26.167777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:26.168206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.509253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:26.535096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:26.543739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:26.545208 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec1ce6ed-5a06-4538-8d95-b8534e9826ad tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.399125 Oct 11 01:25:26.548470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1032/2026] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:26 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:26.770467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:26.771297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:26.774911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df22e7c-51bd-4947-890e-e8ce59e9eb91", "name": "network-vif-deleted", "tag": "cdbd7279-5c55-4416-b67e-b854f06e96e7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:26.789398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:26.795669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:26.799712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:26.800432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.801484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:26.803048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:26.807203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.812752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:26.813371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:26.853186 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] Creating event network-vif-deleted:cdbd7279-5c55-4416-b67e-b854f06e96e7 for instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 on n-h2-772273-9 Oct 11 01:25:26.867253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6341bff1-7341-487c-975b-d0c0564b8f3a req-4289a962-5f49-4377-9757-f9821ef9bc52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104721 Oct 11 01:25:26.873310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 995/2027] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:26.993933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:27.007876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:27.015789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:27.026860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7213348f-6746-4ed2-89a5-cbd86c8160c3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1535 microversion: 2.91 time: 0.261440 Oct 11 01:25:27.030846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1033/2028] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:26 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1535 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:27.131046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:27.131800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:27.139171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:27.139888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:27.140345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:27.143634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:27.144235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:27.144607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:27.233352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:27.234149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:27.234809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:27.236244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lazy-loading 'fault' on Instance uuid 2df22e7c-51bd-4947-890e-e8ce59e9eb91 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:27.319753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:27.327917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26ed46cf-fda5-41ee-8958-f67301d606dd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 200 len: 1299 microversion: 2.1 time: 0.201249 Oct 11 01:25:27.328514 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 996/2029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:27 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:27.575205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:27.576719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:27.588767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:27.598537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:27.599400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:27.602413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:27.606643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:27.607306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.066363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:28.067592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:28.093819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.094164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.094635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.100532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.100832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.101194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.242190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.256243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.258976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.261634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.266158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b12dbb6d-6f32-4f7c-8214-05dfab91aa65 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1535 microversion: 2.91 time: 0.206561 Oct 11 01:25:28.275154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 997/2030] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:28 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:28.276688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.279774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.286112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91c97278-54e2-4e85-ae90-a92f68d2d072 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1486 microversion: 2.25 time: 0.714733 Oct 11 01:25:28.287074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1034/2031] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:27 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1486 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:28.351481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:28.352134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 2df22e7c-51bd-4947-890e-e8ce59e9eb91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:28.358680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.359084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.359572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.360267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.361218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.361637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.377606 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] HTTP exception thrown: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Request method failure captured: Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 HTTP/1.1 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQwyl1gkQdPyfFnknDfMHOkxzyQr4vpFbVh6mgroIzP-1IsPf4DpD1WEzLXo01ZOMYCn6Rl81sMK_1_EeDvpC1ugBslcrccVDSPO3sSkEOZk2KbyKX5LKbDO8PBHN7zm_igInqjyU6sotkAH8Ud0PfkTH9WNti1ZyzHzifzfqjU4xo Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:28.381309 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ef7f0979c5764837ae474f3a09cedb7b Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. Oct 11 01:25:28.382618 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2df22e7c-51bd-4947-890e-e8ce59e9eb91'} Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:28.383253 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. Oct 11 01:25:28.384204 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:28.385002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Returning 404 to user: Instance 2df22e7c-51bd-4947-890e-e8ce59e9eb91 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:28.385002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2add6b8b-a723-45c4-a93f-19ef900b445b tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91" status: 404 len: 111 microversion: 2.1 time: 0.035729 Oct 11 01:25:28.385002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 998/2032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:28 2022] GET /compute/v2.1/servers/2df22e7c-51bd-4947-890e-e8ce59e9eb91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:25:28.393093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:28.393843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:28.401281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.401774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.402206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.402911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.403373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.403795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.438220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:25:28.539126 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0403f316-1416-48cc-af75-c42844de40b6 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 204 len: 0 microversion: 2.1 time: 0.145411 Oct 11 01:25:28.539766 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1035/2033] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:25:28 2022] DELETE /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:25:28.549974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:28.551134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:28.558777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.559707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.560550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.561789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:28.562585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:28.563227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:28.732077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:28.743596 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccd89d50-10f0-4dd5-9f3d-93067aec71fd tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1501 microversion: 2.1 time: 0.198904 Oct 11 01:25:28.744506 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 999/2034] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:28 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:29.297746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:29.299519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:29.306996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.307741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.308335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.320011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:29.321207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:29.325245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.325949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.328563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.332990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.335992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.337268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.342244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.343956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.345354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.493185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.508654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.510304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.525550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-26e43ac9-8364-4ead-b0ad-351ebe1a3c85 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1478 microversion: 2.91 time: 0.232119 Oct 11 01:25:29.526764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1036/2035] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:29 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1478 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:29.558668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:29.561316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:29.579484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.580202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.580801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.581677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.582283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.582862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.616177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.629954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.632325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:29.636296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c24a9d1d-708e-43ae-8df0-1aebec332a15 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1476 microversion: 2.25 time: 0.326211 Oct 11 01:25:29.643804 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1000/2036] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:29 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:29.668144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-772273-9". {{(pid=120493) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 01:25:29.670163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35b796ca-25ca-4a35-8f10-c2a505c561fb tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '.version_select at 0x7f112f8faf70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:29.675014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35b796ca-25ca-4a35-8f10-c2a505c561fb tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.675696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35b796ca-25ca-4a35-8f10-c2a505c561fb tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.677085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35b796ca-25ca-4a35-8f10-c2a505c561fb tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.692397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35b796ca-25ca-4a35-8f10-c2a505c561fb tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.028660 Oct 11 01:25:29.693972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1001/2037] 10.222.0.66 () {60 vars in 1184 bytes} [Tue Oct 11 01:25:29 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:29.710118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:29.710877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:29.722135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.722626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.725247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.725982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.728756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.731408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.783038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12b32e50-d881-47f4-be6f-29fc30b03039 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action" status: 202 len: 0 microversion: 2.91 time: 0.227439 Oct 11 01:25:29.785008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1037/2038] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:25:29 2022] POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:25:29.790881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:29.791993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:29.799693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.801127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.801720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:29.802865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:29.803493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:29.804382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.131057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] Lazy-loading 'services' on Instance uuid b080b644-d01c-438e-b0c4-804ef84e6eb8 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:30.161282 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1fca8a56-1c7c-448c-aa4c-6ac154ca5e73 tempest-LiveAutoBlockMigrationV225Test-941261294 tempest-LiveAutoBlockMigrationV225Test-941261294-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1969 microversion: 2.25 time: 0.455480 Oct 11 01:25:30.162589 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1002/2039] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:29 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1969 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:30.180278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:30.180908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:30.187742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.190719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.191366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.192403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.192871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.196389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.213338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:30.225362 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58921cc1-9398-49a5-abaa-91745e374bd3 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1501 microversion: 2.1 time: 0.439108 Oct 11 01:25:30.239376 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1038/2040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:29 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1501 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:30.239550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:30.240029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:30.271311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.272834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.274133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.275715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.276979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.278379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.342341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:25:30.362327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:30.377740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:30.383429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:30.402153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d9f8d93-6285-4610-89ab-48209d2df5a6 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1486 microversion: 2.91 time: 0.237919 Oct 11 01:25:30.402613 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1003/2041] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:30 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:30.569424 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-575d6df2-5af6-4015-bbd4-4bb2ee558d0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 204 len: 0 microversion: 2.25 time: 0.340801 Oct 11 01:25:30.570323 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1039/2042] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:25:30 2022] DELETE /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:25:30.581172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:30.582127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:30.625741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.630449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.632663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:30.636024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:30.637677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:30.638748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:31.093891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] Calling method '.version_select at 0x7f1134981b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:31.164082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 45a21bcc-68fa-409e-8018-374e9fa98bf6 could not be found", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:25:31.165620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] HTTP exception thrown: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] Request method failure captured: Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-floating-ips/45a21bcc-68fa-409e-8018-374e9fa98bf6 HTTP/1.1 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYKWX4f93FtKu2jelRWytMxBznLIhPfvjBD_qXzf7VNu6YXftZpRZq3xohS4PmX7mDspVCLDc25Xv6Po2-Iai78TfjsIUIMQ0gRXNB4rI742kZouLbOtlWO1tXmZTNeD725HkXC7esD7gEj2bb1sfBi7PSSga8EO7CGyYUJwNZ6q9Q Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 5f8d46e95e7d4dc4bfd264d931b23d92 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1395020442 Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:25:31.167856 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5f8d46e95e7d4dc4bfd264d931b23d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5f8d46e95e7d4dc4bfd264d931b23d92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f8d46e95e7d4dc4bfd264d931b23d92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f8d46e95e7d4dc4bfd264d931b23d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1395020442 Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 5f8d46e95e7d4dc4bfd264d931b23d92 Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1395020442 Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a770cad3083a4be0b21823421ab1b56b Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: exception: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6 Oct 11 01:25:31.168961 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '45a21bcc-68fa-409e-8018-374e9fa98bf6'} Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:25:31.169591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 45a21bcc-68fa-409e-8018-374e9fa98bf6 could not be found Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56e6bd6b-bc79-42e6-bafa-1b4dc3f39c66'] Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6. Oct 11 01:25:31.175745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6 Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:31.176619 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6 Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] Returning 404 to user: Floating IP not found for ID 45a21bcc-68fa-409e-8018-374e9fa98bf6 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f71f507-77bd-4c79-8b9b-53d49a0050bc tempest-FloatingIPDetailsNegativeTestJSON-1395020442 tempest-FloatingIPDetailsNegativeTestJSON-1395020442-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/45a21bcc-68fa-409e-8018-374e9fa98bf6" status: 404 len: 111 microversion: 2.1 time: 0.490909 Oct 11 01:25:31.177586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1040/2043] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:25:30 2022] GET /compute/v2.1/os-floating-ips/45a21bcc-68fa-409e-8018-374e9fa98bf6 => generated 111 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:25:31.257194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:31.257918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:31.268417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:31.268927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:31.269362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:31.270074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:31.270527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:31.270950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:31.449898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.459181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.464204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.471110 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db8860c5-4f0c-4cb7-a583-087f4a941d8a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1482 microversion: 2.25 time: 0.892213 Oct 11 01:25:31.474086 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1004/2044] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:30 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1482 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:31.483214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:31.496688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:31.511226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:31.518349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:31.520221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:31.523633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:31.524344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:31.524944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:31.625335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.644462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62bb40c3-3adc-480d-93a2-5ef0951b60d1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1459 microversion: 2.1 time: 0.389639 Oct 11 01:25:31.650519 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1041/2045] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:31 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1459 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:31.770796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.782586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.786254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:31.800677 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-068bfd26-9541-4db5-883d-1a6e0ae1e7ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1488 microversion: 2.91 time: 0.325323 Oct 11 01:25:31.809092 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1005/2046] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:31 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1488 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:31.979547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Action: 'create', calling method: .version_select at 0x7f112fe5d0d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:32.009416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Getting quotas for project e9c396c55c0143aebe750950f42b9ea3. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:25:32.016031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Getting quotas for user 780e2a1391fa40e9a752344f278b523f and project e9c396c55c0143aebe750950f42b9ea3. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:25:32.063365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fb6b75-af88-4705-a346-11b2319f09f5", "name": "network-vif-deleted", "tag": "bdc0a7c5-e120-4cc9-bd46-ea705d703f0a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:32.085493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.089704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.090427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.132202 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] Creating event network-vif-deleted:bdc0a7c5-e120-4cc9-bd46-ea705d703f0a for instance 14fb6b75-af88-4705-a346-11b2319f09f5 on n-h2-772273-9 Oct 11 01:25:32.144609 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-02e4ffa6-1087-40c7-aa53-1b06538b75ef req-dcffd3ec-ec3e-41c4-ac81-370beceb813d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085241 Oct 11 01:25:32.147360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Getting quotas for project e9c396c55c0143aebe750950f42b9ea3. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:25:32.148444 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1006/2047] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:25:32.169328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Getting quotas for user 780e2a1391fa40e9a752344f278b523f and project e9c396c55c0143aebe750950f42b9ea3. Resources: {'server_groups'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:25:32.208154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2957ea82-7a4a-4380-9680-ed8047abbde5 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.555737 Oct 11 01:25:32.208779 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1042/2048] 10.222.0.66 () {62 vars in 1214 bytes} [Tue Oct 11 01:25:31 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:25:32.221439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e148221b-465f-4c44-8827-6388c0cf4e30 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.250111 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e148221b-465f-4c44-8827-6388c0cf4e30 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.033425 Oct 11 01:25:32.263242 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1007/2049] 10.222.0.66 () {60 vars in 1193 bytes} [Tue Oct 11 01:25:32 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:25:32.270366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25c9fcc7-7e6f-415a-b19c-606b3b6557dc tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.295733 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25c9fcc7-7e6f-415a-b19c-606b3b6557dc tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116" status: 200 len: 235 microversion: 2.64 time: 0.031923 Oct 11 01:25:32.296671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1043/2050] 10.222.0.66 () {60 vars in 1304 bytes} [Tue Oct 11 01:25:32 2022] GET /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116 => generated 235 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:25:32.309296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f36b35e-8195-46ac-a890-66f90d0193ba tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.369730 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f36b35e-8195-46ac-a890-66f90d0193ba tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116" status: 204 len: 0 microversion: 2.64 time: 0.065265 Oct 11 01:25:32.370619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1008/2051] 10.222.0.66 () {60 vars in 1307 bytes} [Tue Oct 11 01:25:32 2022] DELETE /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:25:32.381290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc6ed285-cc7a-4828-935d-100842212b32 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.398722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-dc6ed285-cc7a-4828-935d-100842212b32 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] HTTP exception thrown: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc6ed285-cc7a-4828-935d-100842212b32 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Request method failure captured: Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116 HTTP/1.1 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYLnncZkH-AoATN5rC3s7gSoLInbTsDqJdyAq_CEy7lC83lHazF_OUF-ln9WqoCY6R_llD7ZtX-fIZcwQ40U9vwYa_dsLmo_YWY0k5TuiNZQU2eAiT-dQ3182d4MLy7dFu06HNeUZjfXE8Km-eBMykADkWTUiF6AKyOdlILCxoQzNE Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.64 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e9c396c55c0143aebe750950f42b9ea3 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerGroup264TestJSON-330003263 Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:25:32.400916 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e9c396c55c0143aebe750950f42b9ea3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e9c396c55c0143aebe750950f42b9ea3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e9c396c55c0143aebe750950f42b9ea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e9c396c55c0143aebe750950f42b9ea3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerGroup264TestJSON-330003263 Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e9c396c55c0143aebe750950f42b9ea3 Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerGroup264TestJSON-330003263 Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerGroup264TestJSON-330003263-project Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 780e2a1391fa40e9a752344f278b523f Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerGroup264TestJSON-330003263-project Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. Oct 11 01:25:32.402218 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '07bb29de-8fcf-4b9d-b857-2da32043c116'} Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:32.403179 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. Oct 11 01:25:32.404339 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:32.405352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc6ed285-cc7a-4828-935d-100842212b32 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] Returning 404 to user: Instance group 07bb29de-8fcf-4b9d-b857-2da32043c116 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:32.411895 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc6ed285-cc7a-4828-935d-100842212b32 tempest-ServerGroup264TestJSON-330003263 tempest-ServerGroup264TestJSON-330003263-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116" status: 404 len: 117 microversion: 2.64 time: 0.030607 Oct 11 01:25:32.412806 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1044/2052] 10.222.0.66 () {60 vars in 1307 bytes} [Tue Oct 11 01:25:32 2022] DELETE /compute/v2.1/os-server-groups/07bb29de-8fcf-4b9d-b857-2da32043c116 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:32.498856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.499677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:32.523544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.525905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.526959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.528205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.528891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.529686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.671858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:32.673411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:32.686626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.689912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.690531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.694198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.694967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.695663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.765441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:32.789075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:32.793374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:32.794088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:32.798428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lazy-loading 'fault' on Instance uuid 14fb6b75-af88-4705-a346-11b2319f09f5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:33.335826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f0979c5764837ae474f3a09cedb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb1d74dbd0f44adbe54bc82f7291298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:33.357192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef77f995-af77-4e8b-809b-6e4f2818ce41 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 200 len: 1301 microversion: 2.1 time: 0.689440 Oct 11 01:25:33.362850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1045/2053] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:32 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 1301 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:33.375660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:33.376880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:33.392623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:33.393673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:33.394499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:33.395692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:33.397101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:33.397754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:33.716756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:33.753949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:33.759319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:33.773466 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36202a78-1033-4b1c-9ce2-fe3539c2661f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.409036 Oct 11 01:25:33.774303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1046/2054] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:33 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:34.040528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:34.061914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:34.071409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:34.079059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b171e856-13d5-425b-bd17-3496a8055efe tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1482 microversion: 2.25 time: 1.580516 Oct 11 01:25:34.080929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1009/2055] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:32 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1482 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:34.183197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b080b644-d01c-438e-b0c4-804ef84e6eb8", "name": "network-vif-deleted", "tag": "85f801b6-9678-4675-bf11-12dd14196dc3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:34.206536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:34.207260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:34.211048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:34.247373 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] Creating event network-vif-deleted:85f801b6-9678-4675-bf11-12dd14196dc3 for instance b080b644-d01c-438e-b0c4-804ef84e6eb8 on n-h2-772273-9 Oct 11 01:25:34.269491 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b86b905d-9332-43d1-bf8c-6491797b1f12 req-0bab344a-5f2b-43e4-b567-87248fe34968 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090001 Oct 11 01:25:34.273329 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1047/2056] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:34.384665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:34.385683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] [instance: 14fb6b75-af88-4705-a346-11b2319f09f5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:34.399947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:34.401213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:34.405527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:34.406446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:34.413675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:34.416762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] HTTP exception thrown: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Request method failure captured: Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 HTTP/1.1 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMQwyl1gkQdPyfFnknDfMHOkxzyQr4vpFbVh6mgroIzP-1IsPf4DpD1WEzLXo01ZOMYCn6Rl81sMK_1_EeDvpC1ugBslcrccVDSPO3sSkEOZk2KbyKX5LKbDO8PBHN7zm_igInqjyU6sotkAH8Ud0PfkTH9WNti1ZyzHzifzfqjU4xo Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:25:34.463648 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5bb1d74dbd0f44adbe54bc82f7291298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5bb1d74dbd0f44adbe54bc82f7291298 Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveMigrationTest-1103055366 Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ef7f0979c5764837ae474f3a09cedb7b Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveMigrationTest-1103055366-project Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. Oct 11 01:25:34.465109 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '14fb6b75-af88-4705-a346-11b2319f09f5'} Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:34.465686 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. Oct 11 01:25:34.466671 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:25:34.469623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] Returning 404 to user: Instance 14fb6b75-af88-4705-a346-11b2319f09f5 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:34.469623 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39739e96-9833-4be3-883e-11cfe42a19c1 tempest-LiveMigrationTest-1103055366 tempest-LiveMigrationTest-1103055366-project] 10.222.0.66 "GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5" status: 404 len: 111 microversion: 2.1 time: 0.081768 Oct 11 01:25:34.469623 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1010/2057] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:34 2022] GET /compute/v2.1/servers/14fb6b75-af88-4705-a346-11b2319f09f5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:25:34.809882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:34.811245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:34.833605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:34.834538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:34.836880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:34.841575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:34.843093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:34.846173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:34.861182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:35.113443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:35.115073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:35.141749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:35.144887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:35.146157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:35.149498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:35.150636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:35.153252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:35.262197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.276929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.282845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.305139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4be8054f-96fd-4636-bfb4-816b1c4db38f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.497543 Oct 11 01:25:35.307054 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1048/2058] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:34 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:35.433382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.456628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.461362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:35.464934 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-adbfd914-79cb-47d0-9b1d-a03e732a4763 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1266 microversion: 2.25 time: 0.356169 Oct 11 01:25:35.485688 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1011/2059] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:35 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:36.338716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:36.340328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:36.353296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:36.357225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:36.358859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:36.359804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:36.361903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:36.364747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:36.512957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:36.514568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:36.523755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:36.530186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:36.530817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:36.532784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:36.534845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:36.535469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:36.865584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.878809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.888647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.913548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05e8acef-2b34-4ff4-bbb0-7f8aa24d05d7 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.579131 Oct 11 01:25:36.920469 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1049/2060] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:36 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:36.940468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-62559318", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8e142901-8c62-4694-9190-cdfc6cc1ba31"}], "security_groups": [{"name": "tempest-securitygroup--890363467"}], "key_name": "tempest-keypair-306555011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "50969d51-db38-416d-9eb8-a05ab5e77158", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:36.954160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.988970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.991667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:36.996917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cdb2178-15fb-4d0d-9b66-799d3946b1f5 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1266 microversion: 2.25 time: 0.486943 Oct 11 01:25:36.999725 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1012/2061] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:36 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:37.730599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] validate_networks() for [('8e142901-8c62-4694-9190-cdfc6cc1ba31', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:25:37.955367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:37.956728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:37.971076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:37.972056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:37.972792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:37.974497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:37.975875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:37.977455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:38.859524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for project 27aefacad2da4218ace0f2330ac931ca. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:25:38.879128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for user 4a46950996b44164995eaf4238df6839 and project 27aefacad2da4218ace0f2330ac931ca. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:25:38.936996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:25:38.937440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:25:38.938009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:25:38.938421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:25:38.938856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:25:38.988130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:38.988625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:38.989079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:38.989837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:38.996880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:38.997399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:39.070567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for project 27aefacad2da4218ace0f2330ac931ca. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:25:39.083109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Getting quotas for user 4a46950996b44164995eaf4238df6839 and project 27aefacad2da4218ace0f2330ac931ca. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:25:39.222384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.230897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.232329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.232778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:25:39.235825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50969d51-db38-416d-9eb8-a05ab5e77158',volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:25:39.258419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1df4c6c-53eb-444e-b0a4-0af7d4ef6b43 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 1.308059 Oct 11 01:25:39.261183 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1013/2062] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:37 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:39.271742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:39.272362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:39.300937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:39.301434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:39.304839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:39.312362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:39.313585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:39.314163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:39.483142 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ca07126-93c9-4143-8b94-82a755b6c4ef tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.561130 Oct 11 01:25:39.484107 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1050/2063] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:25:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:25:39.496215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e0b7024-2c3a-47b2-bedd-3cf9febf2223 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:39.497100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e0b7024-2c3a-47b2-bedd-3cf9febf2223 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:39.690340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5e0b7024-2c3a-47b2-bedd-3cf9febf2223 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.698896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.708263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.709707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:39.710869 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4654653e-7a30-4ba1-8af6-168f91b4e8dc tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1266 microversion: 2.25 time: 0.448720 Oct 11 01:25:39.711443 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1014/2064] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:39 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1266 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:39.711992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e0b7024-2c3a-47b2-bedd-3cf9febf2223 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1119 microversion: 2.1 time: 0.219059 Oct 11 01:25:39.732772 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1051/2065] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:39 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1119 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:40.290697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:40.291617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:40.319678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:40.322038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.322540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.322982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:40.324093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.324762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.325346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:40.390042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:40.741047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:40.746352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:40.758820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:40.773129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:40.778213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.798907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:40.801443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.804335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:40.805338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.813982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.814436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:40.832680 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2456b641-7f1f-4cbf-a0d4-f79a85214516 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.546260 Oct 11 01:25:40.843380 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1015/2066] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:40 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:40.851292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:40.867200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:40.878765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.879523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.885148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:40.886155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:40.888967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:40.889641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:41.129298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:41.139014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:41.149823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:41.151836 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbfbe376-44ca-4558-af21-9a4b9291332d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1161 microversion: 2.1 time: 0.309414 Oct 11 01:25:41.153537 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1016/2067] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:40 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1161 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:41.164392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:41.165743 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77d18028-a698-498c-86ed-527bf12140b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1266 microversion: 2.25 time: 0.428898 Oct 11 01:25:41.172380 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1052/2068] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:40 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1266 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:41.865735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:41.867431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:41.879179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:41.884021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:41.884785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:41.888483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:41.895788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:41.900824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:42.180455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:42.181172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:42.201302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:42.232548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:42.233237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:42.235821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:42.236411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:42.238848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:43.748863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:43.789904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:43.806653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:43.839775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61da13fe-7b21-4e20-a556-36d067f6276a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 1.974967 Oct 11 01:25:43.854500 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1017/2069] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:41 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:43.854500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:43.854500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:43.879855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:43.883774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:43.884730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:43.885762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:43.886553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:43.889497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:44.141169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:44.157814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73243ee7-ce83-4236-8ddb-85bab3fca438 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1225 microversion: 2.1 time: 1.980256 Oct 11 01:25:44.160739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1053/2070] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:42 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1225 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:44.373507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:44.394734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:44.400778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:44.405775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-162fe6c6-7fdf-4614-85a4-5f8c1ad53265 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 200 len: 1266 microversion: 2.25 time: 0.563156 Oct 11 01:25:44.429140 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1018/2071] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:43 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:44.869856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:44.870863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:44.895171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:44.895851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:44.896297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:44.897072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:44.899893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:44.900319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:45.182695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:45.184423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:45.203671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:45.213277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:45.215635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:45.217308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:45.222052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:45.224960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:45.229051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:45.242962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:45.248785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:45.265458 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d59bee47-685f-48eb-bd77-58e43a59b6c9 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.400109 Oct 11 01:25:45.268734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1054/2072] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:44 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:45.436809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:45.438312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: b080b644-d01c-438e-b0c4-804ef84e6eb8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:45.456585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:45.457388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:45.463482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:45.465531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:45.467769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:45.468299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:45.526255 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] HTTP exception thrown: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Request method failure captured: Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 HTTP/1.1 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRz56Qj3xGlTIDj9g7S-SkM0x0p76oi6ORoNfTWOjUNqfMmOY0-L45FJPXWDB25YFnSFV31RDxFeOKr4zWT4Dj4bfleNkXdKAi61kAbDsB5_Ar2mq2TEtWTtxiGT6dZrdzZP0zZDAY1ah41u1wmOcnmoFwsEaYWurLSplnrVnG5GGU Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:25:45.531327 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6af68227080040c7845ed9f9ebb758af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 81493fadd3b044479ce4722ce58f3235 Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. Oct 11 01:25:45.532976 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b080b644-d01c-438e-b0c4-804ef84e6eb8'} Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:25:45.533912 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. Oct 11 01:25:45.535258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:25:45.538267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Returning 404 to user: Instance b080b644-d01c-438e-b0c4-804ef84e6eb8 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:25:45.544493 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50e8ef97-07d0-4f67-9c9b-8a04d0b1bae4 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8" status: 404 len: 111 microversion: 2.25 time: 0.115386 Oct 11 01:25:45.551474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1055/2073] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:45 2022] GET /compute/v2.1/servers/b080b644-d01c-438e-b0c4-804ef84e6eb8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:25:45.619114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:45.632651 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcf7e8aa-90e5-48ee-8024-2792250ed0d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1235 microversion: 2.1 time: 0.454488 Oct 11 01:25:45.635643 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1019/2074] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:45 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1235 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:46.300697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:46.302554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:46.315093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:46.315985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:46.317675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:46.320094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:46.321672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:46.323676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:46.513301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:46.528806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:46.530315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:46.552065 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-305e5e6a-85ca-4e25-a6ae-ea04b95b73e0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.255210 Oct 11 01:25:46.553978 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1056/2075] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:46 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:46.657270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:46.657954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:46.690003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:46.690731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:46.691180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:46.692004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:46.692634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:46.694056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:46.956646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:46.968040 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5bec6a38-c417-4d7e-af15-3b9412e2e179 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1235 microversion: 2.1 time: 0.314842 Oct 11 01:25:46.971492 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1020/2076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:46 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1235 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:47.584347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:47.585621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:47.600677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:47.601506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:47.602827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:47.604546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:47.607765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:47.610013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:47.765955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:47.778074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:47.779844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:47.788250 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8982ba7-04d4-4522-b56f-06eda124fc57 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.207333 Oct 11 01:25:47.789458 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1057/2077] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:47 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:47.997759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:47.998373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:48.011167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:48.017289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:48.018154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:48.019243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:48.020807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:48.021454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:48.173224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:48.184667 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c32365b-b6af-4971-9a49-ca7007ae0455 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1235 microversion: 2.1 time: 0.189961 Oct 11 01:25:48.187840 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1021/2078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:47 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1235 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:48.823369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:48.824164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:48.840630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:48.841822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:48.843774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:48.844805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:48.846957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:48.847800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:49.034489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:49.152348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:49.167835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:49.177500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:49.199228 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05421a23-f140-4e21-ae79-2cf0b1df7469 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.380481 Oct 11 01:25:49.205014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1058/2079] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:48 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:49.230957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:49.231670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:49.246319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:49.246812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:49.247251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:49.270752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:49.276673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:49.280445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:50.198291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:50.209720 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c4a8103-06df-4b9a-b40d-402cc4db62a9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1302 microversion: 2.1 time: 0.988945 Oct 11 01:25:50.215507 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1022/2080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:49 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1302 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:50.239006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:50.239739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:50.257085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=20 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:50.274011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:50.276509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:50.278552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:50.282904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:50.286078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:50.287199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:50.541321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:50.558006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:50.567940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:50.579444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a8c2261-5373-4348-8b9f-f6c4ff700eab tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.345585 Oct 11 01:25:50.581585 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1059/2081] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:50 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:51.241505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:51.242129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:51.257474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:51.257973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:51.258420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:51.259145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:51.259625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:51.260251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:51.612682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:51.613865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:51.626970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:51.627781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:51.633369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:51.634397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:51.635023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:51.635787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:51.847227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:51.870991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:51.880538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:51.910558 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5cae8d70-2d85-40bb-8c00-559f6e2475b4 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.302205 Oct 11 01:25:51.911553 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1060/2082] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:51 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:52.092325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:52.106263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c947f7c5-b38d-4203-bbe0-3c361800fc37 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1302 microversion: 2.1 time: 0.863289 Oct 11 01:25:52.106909 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1023/2083] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:51 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1302 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:52.599809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d158c4-f3de-4660-b630-d93f890d7122", "tag": "c75b0ebc-0e01-49f8-b9cd-562f5f63efdc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:52.682649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:52.684461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:52.685455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:52.702173 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] Creating event network-changed:c75b0ebc-0e01-49f8-b9cd-562f5f63efdc for instance 14d158c4-f3de-4660-b630-d93f890d7122 on n-h1-772273-9 Oct 11 01:25:52.709623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ececd358-0d76-4d21-a5b6-23090845cab2 req-50484d94-758a-46cc-8703-37045555a78a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118670 Oct 11 01:25:52.710899 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1061/2084] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:25:52.941585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:52.942199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:52.963382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:52.965901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:52.966598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:52.968147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:52.970230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:52.970922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.132587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:53.133341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:53.176879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.177497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.177939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.178863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.179589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.181063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.310084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:53.328587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:53.336876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:53.363713 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3ee2e60-f9eb-4071-9594-65071157d888 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1531 microversion: 2.91 time: 0.426351 Oct 11 01:25:53.369196 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1024/2085] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:52 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1531 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:53.401793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:53.402892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:53.418498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.422322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.423805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.427230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.429989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.432572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.823792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lazy-loading 'services' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:53.867784 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fb4f8e5-8bc2-4abe-8287-b9426d5b8769 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1936 microversion: 2.91 time: 0.470190 Oct 11 01:25:53.869214 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1025/2086] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:53 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1936 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:53.903119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:53.912218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:25:53.912836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:53.926741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.927249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f206e29-4661-4f0a-8a98-2a4867d1b113 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1302 microversion: 2.1 time: 0.797675 Oct 11 01:25:53.929958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.930751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.933287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:53.936682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:53.937490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:53.946708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1062/2087] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:53 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1302 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:54.009095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lazy-loading 'flavor' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:25:54.522168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcdce8e2-974e-42d7-9960-c8519ba80d58 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action" status: 202 len: 0 microversion: 2.91 time: 0.623940 Oct 11 01:25:54.526334 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1026/2088] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:25:53 2022] POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:25:54.534080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:54.534919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:54.551847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:54.554175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:54.556671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:54.559714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:54.561186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:54.564563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:54.957019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:54.958080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:54.978196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:54.978842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:54.979907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:54.982252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:54.984363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:54.984980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:55.026367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:55.040976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:55.044261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:55.057367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d41aaad1-4807-4923-a9c8-72dd33a6fc6c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.529200 Oct 11 01:25:55.062245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1063/2089] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:54 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:55.444198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:55.459794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-699d3fcb-541f-4772-a072-ec8d67a79d4e tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1302 microversion: 2.1 time: 0.508255 Oct 11 01:25:55.462338 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1027/2090] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:54 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1302 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:25:56.096805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:56.097426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:56.109473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.117629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.120598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.123299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.125262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.126942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.367781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:56.382939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:56.386444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:56.396527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d0e7ed4-21d2-454f-a8bb-3ad6f2b49edf tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.306984 Oct 11 01:25:56.397928 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1064/2091] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:56 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:56.494068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:56.495539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:56.506166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.506668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.507302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.508321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.508683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.509115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.691908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:56.708339 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-000764be-adf5-4b41-b7cb-0ffde014a50f tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.223752 Oct 11 01:25:56.709275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1028/2092] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:56 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:56.906856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:56.907632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:56.914504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.915551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.916275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.917207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:56.918061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:56.918691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:56.947053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:25:57.093675 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-560dd24c-7093-4642-bb9b-5c0a4290f20b tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 204 len: 0 microversion: 2.25 time: 0.190227 Oct 11 01:25:57.094562 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1065/2093] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:25:56 2022] DELETE /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:25:57.103311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:57.106293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:57.116442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.117350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.118275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:57.119269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.120676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.122135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:57.153059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:57.428830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:57.430206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:57.449259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.452757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.460222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:57.461292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.461967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.462597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:57.466082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:57.591228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.608793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.610652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.629630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90b79695-b87c-423a-b88f-429f715d6fc0 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.205129 Oct 11 01:25:57.630906 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1066/2094] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:57 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:57.654105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.667490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.668958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:57.677764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-947bd678-bcaf-4398-8ed3-d6f607882be0 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1731 microversion: 2.25 time: 0.578886 Oct 11 01:25:57.678374 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1029/2095] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:57 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1731 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:57.734603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:57.735549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:57.743394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:25:57.747288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.748144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.751280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:57.752221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:57.752873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:57.753475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:58.659973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:58.666828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:58.667469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:58.671387 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b11b8d5d-da41-47d8-a88f-91ee0bbb513d tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.940984 Oct 11 01:25:58.680715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1067/2096] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:57 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:25:58.685898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:58.686949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:58.687411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:58.688132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:58.688588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:58.689012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:58.712982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:58.715461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:58.728968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:58.729845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:58.730696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:58.736544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:58.737308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:58.737962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:58.917744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:58.939524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:58.943279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:58.956480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21e1dc70-1868-4df3-a81f-298385a29a34 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.293271 Oct 11 01:25:58.958243 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1030/2097] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:58 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:25:59.319941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:59.331868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:59.335094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:25:59.337564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8ec4bbb-2ee9-40b8-90f5-fe14ed33526c tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1731 microversion: 2.25 time: 0.637960 Oct 11 01:25:59.350131 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1068/2098] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:58 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1731 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:25:59.712000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:59.714828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:25:59.729803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:59.730918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:59.733549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:59.734666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:25:59.735641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:25:59.738441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:25:59.989400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:25:59.990777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:00.007817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:00.008493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:00.009308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:00.011467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:00.012116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:00.012718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:00.065228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.125974 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c52baec0-0313-457b-bc94-cf0539759ca3 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.419921 Oct 11 01:26:00.128719 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1031/2099] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:25:59 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:00.159467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.175274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.179994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.194704 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19ae106c-6196-48c0-9e09-83ab9dd74425 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.209229 Oct 11 01:26:00.195311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1069/2100] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:25:59 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:00.365744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:00.366576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:00.377608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:00.379020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:00.381738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:00.382838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:00.383942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:00.386272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:00.405500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13c1e5b-8018-4cf4-90fa-42732ab63ac1", "name": "network-vif-deleted", "tag": "a07fa4f3-38b1-48c5-9232-8adc2d9694c6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:00.437812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:00.448445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:00.449191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:00.478857 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] Creating event network-vif-deleted:a07fa4f3-38b1-48c5-9232-8adc2d9694c6 for instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 on n-h2-772273-9 Oct 11 01:26:00.484291 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-76f272eb-d36c-4d50-bba8-0b3fcf260a15 req-461d9e09-6fab-42b4-bc37-38649a003ef5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082682 Oct 11 01:26:00.484901 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1070/2101] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:26:00.586420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.598125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.599709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:00.604963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd334571-ec0c-4184-8c39-c80bb3b69fc2 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 200 len: 1663 microversion: 2.25 time: 0.243186 Oct 11 01:26:00.629973 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1032/2102] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:00 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 1663 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:01.155587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:01.156297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:01.177416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.177913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.178353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.179067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.182390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.183178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.224635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:01.225259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:01.236817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.239171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.239669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.241698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.244590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.245208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.587403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:01.617286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:01.624102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:01.632600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b66fbf60-ec12-4c65-be8b-a0f608cefbc5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.410007 Oct 11 01:26:01.633542 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1033/2103] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:01 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:26:01.639667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:01.640614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: a13c1e5b-8018-4cf4-90fa-42732ab63ac1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:01.658944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.659835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.663899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.666251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:01.675521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:01.676222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:01.706293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] HTTP exception thrown: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Request method failure captured: Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 HTTP/1.1 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRz56Qj3xGlTIDj9g7S-SkM0x0p76oi6ORoNfTWOjUNqfMmOY0-L45FJPXWDB25YFnSFV31RDxFeOKr4zWT4Dj4bfleNkXdKAi61kAbDsB5_Ar2mq2TEtWTtxiGT6dZrdzZP0zZDAY1ah41u1wmOcnmoFwsEaYWurLSplnrVnG5GGU Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:26:01.708729 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6af68227080040c7845ed9f9ebb758af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 81493fadd3b044479ce4722ce58f3235 Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. Oct 11 01:26:01.710179 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a13c1e5b-8018-4cf4-90fa-42732ab63ac1'} Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:26:01.710988 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. Oct 11 01:26:01.712354 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:01.714372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:01.725659 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d94a11f3-7419-4c02-92b0-4447a56e4758 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.575069 Oct 11 01:26:01.728296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1071/2104] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:01 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:01.754216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Returning 404 to user: Instance a13c1e5b-8018-4cf4-90fa-42732ab63ac1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:26:01.755483 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfec4cdd-e119-4378-a436-6626a17c6041 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1" status: 404 len: 111 microversion: 2.25 time: 0.120671 Oct 11 01:26:01.759462 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1034/2105] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:01 2022] GET /compute/v2.1/servers/a13c1e5b-8018-4cf4-90fa-42732ab63ac1 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:26:01.771463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c6e93e6-8939-4b54-9daf-f71ddb55ea0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '.version_select at 0x7f112fd56940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:01.820664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c6e93e6-8939-4b54-9daf-f71ddb55ea0a tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111960981" status: 204 len: 0 microversion: 2.25 time: 0.057129 Oct 11 01:26:01.823220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1072/2106] 10.222.0.66 () {60 vars in 1262 bytes} [Tue Oct 11 01:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111960981 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:26:02.665021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:02.665641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:02.675367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:02.675959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:02.676403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:02.677121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:02.677582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:02.678016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:02.762311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:02.768067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:02.804553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:02.812894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:02.817216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:02.818870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:02.819275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:02.821199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:03.352642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:03.374473 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8fe881e0-873d-46cb-9f44-f8898c751aff tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.620153 Oct 11 01:26:03.376389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:03.381888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1073/2107] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:02 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:03.402942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:03.404890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:03.449312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-638f7e63-7bef-49d9-8823-ca93660a4d5f tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.783970 Oct 11 01:26:03.482438 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1035/2108] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:02 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:04.410472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:04.411832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:04.422836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:04.427018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:04.427638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:04.431820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:04.432647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:04.433274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:04.485105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:04.485718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:04.502101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:04.508455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:04.509317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:04.513516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:04.517017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:04.519175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:04.980061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:04.995244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:04.997785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:05.032769 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68bfdd7d-4d20-452a-816a-e4568f3e38cd tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.551762 Oct 11 01:26:05.034738 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1036/2109] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:04 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:05.198944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:05.212592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b26eb76a-4029-4223-9f1f-771fc7f6bb15 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.806330 Oct 11 01:26:05.225354 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1074/2110] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:04 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:05.326728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1794664325", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:05.424390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:26:05.942537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:26:05.943088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:26:05.943479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:26:05.943901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:26:05.944318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:26:05.957073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:05.958041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:05.958702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:05.959679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:05.960503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:05.961358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.003747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:26:06.044301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:26:06.048382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:06.049912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:06.079386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.080163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.082291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.083120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:26:06.083641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.085662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.086962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.093638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:26:06.140328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:26:06.243139 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf12b794-0230-426a-83a6-e25ec518ea8b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173030 Oct 11 01:26:06.249192 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1037/2111] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:26:06.286599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:06.287244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:06.310442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.311844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.312823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.315644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.316705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.319246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.408179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-477bd22b-173f-4018-b8c1-5da18e567630 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 204 len: 0 microversion: 2.25 time: 0.370913 Oct 11 01:26:06.410704 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1075/2112] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:26:06 2022] DELETE /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:26:06.427671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:06.428510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:06.452088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.454273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.455533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.457231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:06.458464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:06.461236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:06.801363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:06.826044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:06.829112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:06.836638 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07d3b619-7e1b-4d75-95c5-e61d403fa965 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.586282 Oct 11 01:26:06.838373 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1038/2113] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:06 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:06.845164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23b0bb9e-5399-4ca0-b0c6-8f2740e72a0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:06.845996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23b0bb9e-5399-4ca0-b0c6-8f2740e72a0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:06.991796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23b0bb9e-5399-4ca0-b0c6-8f2740e72a0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:07.006192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23b0bb9e-5399-4ca0-b0c6-8f2740e72a0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1213 microversion: 2.1 time: 0.165868 Oct 11 01:26:07.007332 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1039/2114] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:06 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:07.015407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:07.016286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:07.028208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:07.031313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:07.034839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:07.035723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:07.036276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:07.036778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:07.302288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:07.313955 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57538046-2a37-4601-ae0a-853bc750be01 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.900372 Oct 11 01:26:07.315506 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1076/2115] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:06 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:07.477805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:07.490075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-781931870", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:07.507464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:07.508927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:07.510132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-038e8a3b-e920-463e-af52-381464a25c30 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 200 len: 1549 microversion: 2.25 time: 0.501698 Oct 11 01:26:07.519448 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1040/2116] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:07 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 1549 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:07.636410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] validate_networks() for [('bb9ccd50-81be-4dc9-b2d7-be4d2807b2b1', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:26:07.857328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83c7632-d984-4249-aab7-f3f7a602872b", "name": "network-vif-deleted", "tag": "3149c506-f06f-473d-9f4d-265670905ee1"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:07.915533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:07.916953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:07.919965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:07.969052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] Creating event network-vif-deleted:3149c506-f06f-473d-9f4d-265670905ee1 for instance f83c7632-d984-4249-aab7-f3f7a602872b on n-h2-772273-9 Oct 11 01:26:07.978207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f3ee2914-8f8d-4256-ba89-9c9848920bf5 req-27fa0448-81b9-4c4b-b924-0208144b7455 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124625 Oct 11 01:26:07.988601 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1041/2117] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:26:08.007461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:08.009208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:08.028504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.029869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.031095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:08.032084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.032781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.033407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:08.294964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:08.309148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:08.317439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:08.342619 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43f50139-1708-4d10-800c-23474ef9b32e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.350339 Oct 11 01:26:08.345546 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1042/2118] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:07 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:08.386518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:08.389395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:08.414006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.416389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.418228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:08.419552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.421882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.425312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:08.773481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:08.793127 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3e94534-8165-4186-937a-666b076eefa0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1265 microversion: 2.1 time: 0.421863 Oct 11 01:26:08.795893 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1043/2119] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:08 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1265 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:08.812826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:08.813455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:08.829025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.829675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.830832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:08.832193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:08.832782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:08.833687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.114888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:09.125938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-357954db-b1f7-42c7-a40b-e2065db1abdf tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.328144 Oct 11 01:26:09.137907 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1044/2120] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:08 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:09.156320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.156940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: f83c7632-d984-4249-aab7-f3f7a602872b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.176300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.176882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.177328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.178045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.178497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.178916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.199389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] HTTP exception thrown: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Request method failure captured: Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b HTTP/1.1 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMRz56Qj3xGlTIDj9g7S-SkM0x0p76oi6ORoNfTWOjUNqfMmOY0-L45FJPXWDB25YFnSFV31RDxFeOKr4zWT4Dj4bfleNkXdKAi61kAbDsB5_Ar2mq2TEtWTtxiGT6dZrdzZP0zZDAY1ah41u1wmOcnmoFwsEaYWurLSplnrVnG5GGU Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:26:09.202056 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6af68227080040c7845ed9f9ebb758af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 81493fadd3b044479ce4722ce58f3235 Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. Oct 11 01:26:09.203417 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'f83c7632-d984-4249-aab7-f3f7a602872b'} Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:26:09.204200 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. Oct 11 01:26:09.205403 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:09.207716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Returning 404 to user: Instance f83c7632-d984-4249-aab7-f3f7a602872b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:26:09.208858 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2dc3041b-56c2-4f41-a1b8-88b5ba122c87 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b" status: 404 len: 111 microversion: 2.25 time: 0.056372 Oct 11 01:26:09.209965 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1045/2121] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:09 2022] GET /compute/v2.1/servers/f83c7632-d984-4249-aab7-f3f7a602872b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:26:09.221347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.222079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.230430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.231429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.232197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.233399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.234012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.234707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.278715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:26:09.359703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:09.380577 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1414b731-6cd5-4953-8368-5dae26f09e62 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 204 len: 0 microversion: 2.25 time: 0.163205 Oct 11 01:26:09.385653 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1046/2122] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:26:09 2022] DELETE /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:26:09.394160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.395112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.405850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.406846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.407634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.408617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.409313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.409959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.444488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:26:09.445308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:26:09.445798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:26:09.447283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:26:09.447743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:26:09.466016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.466509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.466984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.467745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.468370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.468981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.502405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:26:09.509017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for user 5f9b009187ab4ad78d7fe88a44863179 and project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:26:09.525009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:26:09.527855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:26:09.535874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:09.545595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:09.552884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:09.559850 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48c1bc58-53a9-40fd-859b-dbd22e3b0ca1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.172156 Oct 11 01:26:09.562586 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1047/2123] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:09 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:09.580166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.581013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.595228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.595914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.600768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.601532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.602060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.602482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.624904 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ce8f029-eae6-4bc6-9c94-a117e1f744df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.304540 Oct 11 01:26:09.625825 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1077/2124] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:26:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:26:09.631492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:09.643600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c80bef6-2de4-4a58-9b12-30060ca42346 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.646901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c80bef6-2de4-4a58-9b12-30060ca42346 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.800488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c80bef6-2de4-4a58-9b12-30060ca42346 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:09.809095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c80bef6-2de4-4a58-9b12-30060ca42346 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1221 microversion: 2.1 time: 0.175909 Oct 11 01:26:09.814898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1078/2125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:09 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:09.857043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:09.858407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:09.866645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.872681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.873383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:09.874300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:09.876688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:09.877294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:10.156169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:10.171449 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2885723e-7b90-48d0-a639-5cfd6608a164 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1271 microversion: 2.1 time: 0.338617 Oct 11 01:26:10.174735 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1079/2126] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:09 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1271 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:10.188707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1158596312", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:10.334277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] validate_networks() for [('bb9ccd50-81be-4dc9-b2d7-be4d2807b2b1', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:26:10.369339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:10.412462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:10.414085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81493fadd3b044479ce4722ce58f3235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af68227080040c7845ed9f9ebb758af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:10.436977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34a31661-a8cc-4eb7-a43f-c426077f75b3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 200 len: 1563 microversion: 2.25 time: 0.851782 Oct 11 01:26:10.437418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1048/2127] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:09 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 1563 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:10.451539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:10.452175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:10.486301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:10.486925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:10.488723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:10.490878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:10.492809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:10.494519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:11.058070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:11.070387 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b19ce99c-c28b-44ca-9920-6c0cfd87f391 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 0.630091 Oct 11 01:26:11.070387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1049/2128] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:10 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:11.084358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:11.087029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:11.102722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:11.103231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:11.103810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:11.104625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:11.105107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:11.105532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:11.349891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:11.361026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:11.367060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:11.379832 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c946d10-74c0-42b3-b3fd-15b95841beee tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.307343 Oct 11 01:26:11.382179 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1050/2129] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:11 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:11.811842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1226985790", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "11db0ee6-bf74-4f94-a889-16aabb18b472"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:11.945203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] validate_networks() for [('11db0ee6-bf74-4f94-a889-16aabb18b472', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:26:12.582429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:26:12.583682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:26:12.584307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:26:12.584888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:26:12.585478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:26:12.647133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:12.655979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:12.660576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:12.662186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:12.663211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:12.664039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:12.705484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:26:12.722063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for user 5f9b009187ab4ad78d7fe88a44863179 and project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:26:12.753429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:26:12.766177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:26:12.875699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-94b7adac-aa9d-4f0e-ac1d-67fe83376ecd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.698518 Oct 11 01:26:12.878791 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1080/2130] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:26:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:26:12.892462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:12.893232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:12.908740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:12.909230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:12.909679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:12.914354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:12.914884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:12.916720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.462627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:13.472602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0b03aba-701c-49c2-abad-03cfba0a971d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 0.592380 Oct 11 01:26:13.479188 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1081/2131] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:12 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:13.488568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d158c4-f3de-4660-b630-d93f890d7122", "name": "network-vif-plugged", "status": "completed", "tag": "c75b0ebc-0e01-49f8-b9cd-562f5f63efdc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:13.501773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.502342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.504063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.530978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] Creating event network-vif-plugged:c75b0ebc-0e01-49f8-b9cd-562f5f63efdc for instance 14d158c4-f3de-4660-b630-d93f890d7122 on n-h1-772273-9 Oct 11 01:26:13.539682 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9e7f8ef2-5244-42a8-9fde-f9c19c87761f req-7a46cb12-0ddf-4c3e-b4ba-9a5f899bfbb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054745 Oct 11 01:26:13.540994 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1082/2132] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:13.546632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:13.547742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] [instance: ad991591-cd0a-4007-a8a7-a3ddea88189e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:13.569228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.569832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.570415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.571683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.572352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.573421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.606701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] HTTP exception thrown: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Request method failure captured: Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e HTTP/1.1 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMRz56Qj3xGlTIDj9g7S-SkM0x0p76oi6ORoNfTWOjUNqfMmOY0-L45FJPXWDB25YFnSFV31RDxFeOKr4zWT4Dj4bfleNkXdKAi61kAbDsB5_Ar2mq2TEtWTtxiGT6dZrdzZP0zZDAY1ah41u1wmOcnmoFwsEaYWurLSplnrVnG5GGU Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:26:13.609174 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6af68227080040c7845ed9f9ebb758af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6af68227080040c7845ed9f9ebb758af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6af68227080040c7845ed9f9ebb758af Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584 Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 81493fadd3b044479ce4722ce58f3235 Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1600967584-project Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. Oct 11 01:26:13.610565 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ad991591-cd0a-4007-a8a7-a3ddea88189e'} Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:26:13.611275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. Oct 11 01:26:13.612481 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:26:13.615064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] Returning 404 to user: Instance ad991591-cd0a-4007-a8a7-a3ddea88189e could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:26:13.616167 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-572b90a6-ab1a-40ff-8075-9cb2e5b6efc3 tempest-LiveAutoBlockMigrationV225Test-1600967584 tempest-LiveAutoBlockMigrationV225Test-1600967584-project] 10.222.0.66 "GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e" status: 404 len: 111 microversion: 2.25 time: 0.074007 Oct 11 01:26:13.617277 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1083/2133] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:13 2022] GET /compute/v2.1/servers/ad991591-cd0a-4007-a8a7-a3ddea88189e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:26:13.625796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad991591-cd0a-4007-a8a7-a3ddea88189e", "name": "network-vif-deleted", "tag": "d60c6926-f8d4-47cb-9efd-43daaf733530"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:13.646648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.647405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.648070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.668402 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] Creating event network-vif-deleted:d60c6926-f8d4-47cb-9efd-43daaf733530 for instance ad991591-cd0a-4007-a8a7-a3ddea88189e on n-h2-772273-9 Oct 11 01:26:13.681681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c844fc64-dd8a-4148-9517-3cbd5b25c1f9 req-00b3eb21-9324-44e7-b606-a581f3dc1191 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062358 Oct 11 01:26:13.682838 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1084/2134] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:13.695263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:13.696810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:13.716324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:26:13.716951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:26:13.717371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:26:13.718434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:26:13.718698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:26:13.720297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.727162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.728388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.730263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.732157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.733959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.756025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.761097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.761568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.762397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.768116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.768589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:13.835777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:26:13.843409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for user a0510e6acedd400f86f1c8f9e8a1c75d and project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:26:13.866522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:26:13.871057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:26:13.963366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1023088-bf39-494f-8e7f-0bac1860d818 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.576065 Oct 11 01:26:13.964276 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1051/2135] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:26:13.977511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:13.981589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:13.998561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:13.999141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:13.999622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:14.000422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:14.000881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:14.001421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:14.744414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:14.765074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:14.768797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:14.789830 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3bc53b4a-791d-4251-91df-cbe6a7cf5393 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.822378 Oct 11 01:26:14.796450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1052/2136] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:13 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:14.822495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:14.824414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:14.840092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:14.846477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:14.849990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:14.858122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:14.860218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:14.861105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:14.938935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:14.952429 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-26a54eb7-1cc3-473b-9189-f6147e104cde tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1290 microversion: 2.1 time: 1.268043 Oct 11 01:26:14.953040 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1085/2137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:13 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1290 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:14.964342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:14.985756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:14.998141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Searching by: {'deleted': False, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:26:15.016920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.017774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.018358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.019279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.030977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.031702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.093563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:26:15.146110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:15.151998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:15.159713 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43770b86-7339-449d-b838-050f12759494 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1274 microversion: 2.1 time: 0.361419 Oct 11 01:26:15.167082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1053/2138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:14 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:15.179504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d14085a-26d1-4fa4-b22e-6c64c396b133 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.220959 Oct 11 01:26:15.180361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1086/2139] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:26:14 2022] GET /compute/v2.1/servers => generated 334 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:15.189673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:15.190321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:15.193744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:15.194762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:15.200269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.201342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.216526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.217333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.217459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.219481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.219948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.221859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.222538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.223458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.224047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.226923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.551403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:15.559855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e06d5363-320f-407c-bf09-c3ab56253e85 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1212 microversion: 2.1 time: 0.391232 Oct 11 01:26:15.572178 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1054/2140] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:15 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1212 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:15.584055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:15.591615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:15.592569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Searching by: {'deleted': False, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:26:15.608803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.610006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.611493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.612594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.613799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.614789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.674607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:26:15.754032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:15.766149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.767003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.767626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.876798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:15.885557 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75ac0205-ea44-493a-84f7-6442cb225e27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 0.703800 Oct 11 01:26:15.886152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1087/2141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:15 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:15.890804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:15.900639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.901316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.902008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.916715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] Creating event network-changed:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h2-772273-9 Oct 11 01:26:15.922468 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-77ccf597-fb2a-4f56-b7ca-60f068273589 req-00ba1295-9107-4160-9707-de989493af30 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034970 Oct 11 01:26:15.923072 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1088/2142] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:15.928307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:15.928998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:15.936752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.937562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.938095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:15.940169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:15.941232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:15.941817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.053538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.067308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.074390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.088902 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-372ab889-e6fd-4513-922c-23a9f6a049fc tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.159286 Oct 11 01:26:16.089802 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1089/2143] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:15 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:16.101446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.103490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:16.116253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.117046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.117861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.119218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.119880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.120517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.195912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00d210ad-9787-4701-82f1-f9498dd2f06b tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.622312 Oct 11 01:26:16.196508 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1055/2144] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:26:15 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:16.202531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.204122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:16.221574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.225660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.226363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.228546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.231246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.233753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.501700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.526205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a43d4d05-3ba7-4353-8069-840bff169daa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1282 microversion: 2.1 time: 0.328281 Oct 11 01:26:16.527594 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1056/2145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:16.539780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22268200-b713-4e3d-8c4e-fb55ab51b6c8 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.555172 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22268200-b713-4e3d-8c4e-fb55ab51b6c8 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024599 Oct 11 01:26:16.557029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1057/2146] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:16.600070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.601004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:16.612220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.613084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.613768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.616608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.617449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.628540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.679792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.690178 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1864b3c4-b91a-4ffe-bacb-037e2af18a72 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1481 microversion: 2.1 time: 0.599050 Oct 11 01:26:16.690775 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1090/2147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1481 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:16.716467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.717310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:16.726541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.727408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.728051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.731615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.732422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.733067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.808876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:16.827406 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8360f97-7a15-43ce-b859-355fde33d1d1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1212 microversion: 2.1 time: 0.230739 Oct 11 01:26:16.830605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1058/2148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1212 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:16.912737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.913594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:16.927870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.930546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.933440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.934361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:16.935887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:16.938848 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab0b0d36-6827-4ae7-89c2-4e9370781606 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226554 Oct 11 01:26:16.940034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1091/2149] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:26:16.940946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:16.988939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:16.989586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:17.005595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.007031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.007746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.015997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.019255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.020850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.116315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:26:17.414157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a346d98c-c88b-476a-82cb-0c4a1189f67e tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 204 len: 0 microversion: 2.1 time: 0.424050 Oct 11 01:26:17.420739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1092/2150] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:26:16 2022] DELETE /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:26:17.432017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:17.433615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:17.443383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:17.458640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.459172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.459661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.460571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.461211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.462827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.620226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:17.629101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-248bb29a-e621-4505-acff-69ce234ef152 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 0.722140 Oct 11 01:26:17.629707 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1059/2151] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:16 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:17.636940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:17.648307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:17.648745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:17.664764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:17.665383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:17.671503 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67a42405-0f96-4e37-be68-78df370dfdca tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.251920 Oct 11 01:26:17.672108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1093/2152] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:17 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:17.677669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.683764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.684397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.685815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.686417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.686988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.688737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:17.700292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:17.707121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.709956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.710337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:17.711069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:17.711567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:17.711985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:18.320806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:18.333593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ceb01e29-b71a-4659-85af-5c94149fecd4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1280 microversion: 2.1 time: 0.655837 Oct 11 01:26:18.337624 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1094/2153] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:17 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1280 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:18.349702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:18.350598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:18.364943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:18.365713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:18.366307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:18.368763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:18.369379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:18.370177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:18.629186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:18.638776 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-547d8148-4acc-4fa6-a8f6-ea663a310a71 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1260 microversion: 2.1 time: 0.299332 Oct 11 01:26:18.643553 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1095/2154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:18 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:18.656618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:18.657718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:18.673749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:18.674524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:18.675128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:18.676042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:18.676718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:18.677372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.036661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.048257 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8348bcb-4bfe-40ba-90a6-ba94bd5b0fb5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1699 microversion: 2.1 time: 1.417444 Oct 11 01:26:19.049501 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1060/2155] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:17 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1699 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:19.056687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:19.058100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:19.083887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.085671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.086787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.087765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.088754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.090427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.509302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.542102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.545118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.552066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e61cc61-f535-47ec-a5ee-11834637fc7c tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.500328 Oct 11 01:26:19.553785 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1061/2156] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:19 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:19.558832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:19.560661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:19.567562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.568267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.569043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.571283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.572186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.572844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.686219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.699657 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-016a87b3-2e51-470e-adac-96e491d4ea0e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 1.046578 Oct 11 01:26:19.701536 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1096/2157] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:18 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:19.710055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:19.710872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:19.724846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.725595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.727651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.729035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:19.730429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:19.733576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:19.793919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.811704 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ced62b9b-9e54-4169-b64c-aa62f49e580b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1280 microversion: 2.1 time: 0.252162 Oct 11 01:26:19.813749 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1062/2158] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:19 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:19.964138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:19.979605 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1aece301-071d-4faf-a466-4bb3aa08e228 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1266 microversion: 2.1 time: 0.274841 Oct 11 01:26:19.987882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1097/2159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:19 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:20.074065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:20.074698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:20.095874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.096384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.096830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.097558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.098019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.098452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.566431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e8ad0e-ca96-49f3-8dd6-7c3754139535", "tag": "c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:20.588127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.588618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.589056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.618903 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] Creating event network-changed:c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc for instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 on n-h1-772273-9 Oct 11 01:26:20.626637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d0464e30-0f0f-410f-9ee1-b3e9b4b1e926 req-e62135f1-0e81-4f5e-a3d5-73ebe276300a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065298 Oct 11 01:26:20.630923 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1098/2160] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:26:20.638656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:20.639945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:20.646839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.647583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.648183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.649101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.649728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.650308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.672355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:20.689074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6f1ddc7-0ad6-438a-8341-7b6e324d1320 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1699 microversion: 2.1 time: 0.618820 Oct 11 01:26:20.690043 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1063/2161] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:20 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1699 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:20.727606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:20.728564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:20.736825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.737758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.739066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.740440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:20.741207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:20.741863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:20.961196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:21.003533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:21.006986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:21.025700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07d11e08-7a1d-4cd9-9a89-2ae1ef194359 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1558 microversion: 2.91 time: 0.392161 Oct 11 01:26:21.026339 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1099/2162] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:20 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1558 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:21.054539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:21.055042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:21.063087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:21.063874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:21.064491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:21.065384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:21.066141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:21.066745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:21.891842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:21.917259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5361762a-171c-4526-8666-27770b0c40f4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 1.192338 Oct 11 01:26:21.922240 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1064/2163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:20 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:21.932656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:21.934918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:21.949016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:21.950385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:21.951586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:21.952737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:21.953769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:21.955169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.080213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.102009 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a86a325c-8c65-4cef-b835-91f4b3b4a179 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 1.051237 Oct 11 01:26:22.105577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1100/2164] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:21 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:22.114873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:22.116718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:22.131690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.132255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.133831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.134579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.135042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.135538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.142117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.149257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:22.160486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3aec4e46-b8f1-4c65-9564-b3b15d0e9dae tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1266 microversion: 2.1 time: 0.232672 Oct 11 01:26:22.169573 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1065/2165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:21 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:22.183556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:22.192256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:22.212021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.212557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.212971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.213704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.217388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.218022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.397828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.422565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1963142-b52b-4e75-9d8e-d8fbc27d8a36 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1632 microversion: 2.1 time: 0.315059 Oct 11 01:26:22.432227 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1101/2166] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:22 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1632 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:22.499665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.519440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.526122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:22.548371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a144292b-fc55-41ee-800d-efbc90f4caeb tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.374065 Oct 11 01:26:22.560958 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1066/2167] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:22 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:22.788211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:22.805389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:22.816734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.817277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.817717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.834900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] Creating event network-vif-plugged:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h2-772273-9 Oct 11 01:26:22.843512 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-403af818-b4d1-455d-992b-64d18148e304 req-710f697a-df51-4605-a3d8-1a70f7cfc0f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060159 Oct 11 01:26:22.844876 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1102/2168] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:22.946374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:22.948017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:22.967938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.968554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.969015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:22.969765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:22.970232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:22.970682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.128893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:23.129902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:23.149756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.152409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.156216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.157645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.161569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.168885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.489556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:23.511862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1b2735f-dede-4850-aa24-814e787a40c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 0.388414 Oct 11 01:26:23.532327 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1103/2169] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:23 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:23.537715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:23.538651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:23.548148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.549671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.550375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.551388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.553047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.553968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.602761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:23.615243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:23.631970 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccc10f30-a623-4cc1-b81a-294e48b534a2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1313 microversion: 2.1 time: 0.686983 Oct 11 01:26:23.633273 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1067/2170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:22 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:23.647703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:23.655132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:23.676034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.676702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.677284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:23.679124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:23.680466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:23.685277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:24.600730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:24.627544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e495c47-4348-42a1-9980-0f9c28f61ab9 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1481 microversion: 2.1 time: 0.974988 Oct 11 01:26:24.628855 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1068/2171] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:23 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1481 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:24.633741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d158c4-f3de-4660-b630-d93f890d7122", "tag": "c75b0ebc-0e01-49f8-b9cd-562f5f63efdc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:24.661719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:24.662215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:24.662657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:24.693644 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] Creating event network-changed:c75b0ebc-0e01-49f8-b9cd-562f5f63efdc for instance 14d158c4-f3de-4660-b630-d93f890d7122 on n-h1-772273-9 Oct 11 01:26:24.724568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3f02b4a5-79d1-43d7-9b4c-c9a60feb5a3e req-c6cdde4f-283f-45bd-a14b-f7721c3a35fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094255 Oct 11 01:26:24.728167 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1069/2172] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:24.735907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:24.756400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:24.769762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:24.770276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:24.770728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:24.771511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:24.771965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:24.772399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:24.797605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:24.809667 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de6be30f-b279-4fd0-b9ef-94d9d9d369cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 1.275836 Oct 11 01:26:24.834769 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1104/2173] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:23 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:24.850656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:24.859815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:24.875224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:24.887141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:24.892144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:24.896329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:24.897133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:24.897818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:25.066525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:25.153414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:25.172171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:25.173637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:25.198289 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a026e96-4f63-450d-85ba-b0ec6f20b2b1 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.361943 Oct 11 01:26:25.208449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1105/2174] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:24 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:25.213542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:25.214165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:25.238101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:25.238583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:25.243989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:25.244951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:25.245613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:25.246205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:25.269469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7613cc8ae6642e4933bbb832a2c8da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9662f7f6e343c29219bcb20e76075a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:25.283256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-981d1ca5-863a-4af2-9a78-f486cc4ee8f5 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 200 len: 1632 microversion: 2.1 time: 0.553615 Oct 11 01:26:25.283894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1070/2175] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:24 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 1632 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:25.344913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:25.345564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:25.384910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:25.385421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:25.385877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:25.386608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:25.387079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:25.387543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:25.636253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:25.750210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:26.268649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:26.280828 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2f73bfa-d401-41af-bd47-dd0a32e21b2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1463 microversion: 2.1 time: 0.959644 Oct 11 01:26:26.301497 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1071/2176] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:25 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1463 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:26.313259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:26.313889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:26.332009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:26.332518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:26.332970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:26.333696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:26.334158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:26.334596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:26.395640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:26.410967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-849e55b7-534c-4933-b09d-b0f694a7c59f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 1.196860 Oct 11 01:26:26.413303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1106/2177] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:25 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:26.429658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:26.452644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:26.474161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:26.487773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:26.497174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:26.498189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:26.498851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:26.499495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:26.671712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:26.688967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:26.690486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:26.720475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ba7dceb-9d9f-4f80-8377-fdd16206aa68 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.303325 Oct 11 01:26:26.725710 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1107/2178] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:26 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:26.739182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebf141b-9da6-4eab-8764-a77f0349d669", "tag": "1d0a3e03-caac-4b71-b727-baa4cffde4b5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:26.783024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:26.783792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:26.785482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:26.830908 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] Creating event network-changed:1d0a3e03-caac-4b71-b727-baa4cffde4b5 for instance aebf141b-9da6-4eab-8764-a77f0349d669 on n-h2-772273-9 Oct 11 01:26:26.857594 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-dee09306-c15e-4e00-a950-0c2dfb5c65d1 req-d56f090b-2a54-45ee-940a-8aa6a3dadcb5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127858 Oct 11 01:26:26.867000 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1108/2179] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:27.180131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:27.190048 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d477b1f-79b2-42a0-919f-74d9f40d6c2b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.887386 Oct 11 01:26:27.190658 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1072/2180] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:26 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:27.215409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:27.216042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] [instance: ddf56385-b27a-4d14-9f63-468910324e4b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:27.233813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.234460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.234920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.235683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.236149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.243655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.273818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:27.275072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:27.275650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] HTTP exception thrown: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Request method failure captured: Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b HTTP/1.1 Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMXP5JJ_EfpdRaouh03_YHTa3Hi7M0DLMrSiXo6i2BmG7uMllJ1ksmI97thXsktivGlzDo3xM5GRLfxFKKqyIDnD3HuYdC1Osr-xAhwKM8RLs5gR1SWb_DUKm4EfbNn0gePPiKkYOTUuEiLceqKXoF2NKYgukLxyJfk1yedd_kH5Z6A Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: fb9662f7f6e343c29219bcb20e76075a Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-1080939581 Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:26:27.288236 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fb9662f7f6e343c29219bcb20e76075a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fb9662f7f6e343c29219bcb20e76075a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fb9662f7f6e343c29219bcb20e76075a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fb9662f7f6e343c29219bcb20e76075a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-1080939581 Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: fb9662f7f6e343c29219bcb20e76075a Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-1080939581 Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-1080939581-project Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e7613cc8ae6642e4933bbb832a2c8da6 Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-1080939581-project Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. Oct 11 01:26:27.289543 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ddf56385-b27a-4d14-9f63-468910324e4b'} Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:26:27.290577 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. Oct 11 01:26:27.292592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:26:27.293909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Returning 404 to user: Instance ddf56385-b27a-4d14-9f63-468910324e4b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:26:27.293909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1214f40f-3a6d-4e68-9932-a0df94b825dc tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b" status: 404 len: 111 microversion: 2.1 time: 0.078176 Oct 11 01:26:27.293909 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1073/2181] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:27 2022] GET /compute/v2.1/servers/ddf56385-b27a-4d14-9f63-468910324e4b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:26:27.300276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.301704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.302332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.303225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.304623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.305695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.312603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf56385-b27a-4d14-9f63-468910324e4b", "name": "network-vif-deleted", "tag": "74e0f6a3-7ce2-499a-b43a-4155786e5636"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:27.333565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.337554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.338228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.368958 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] Creating event network-vif-deleted:74e0f6a3-7ce2-499a-b43a-4155786e5636 for instance ddf56385-b27a-4d14-9f63-468910324e4b on n-h2-772273-9 Oct 11 01:26:27.381945 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ce04472f-0cb5-4cb0-a1fe-793ea574d42c req-1a688137-5868-4ffc-a6db-2b8acf79bf9a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075889 Oct 11 01:26:27.385332 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1074/2182] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:27.397568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a3e134c-f0ea-4ac7-9d89-b2f8cb7cd882 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] Calling method '.version_select at 0x7f113876f940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:27.455281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a3e134c-f0ea-4ac7-9d89-b2f8cb7cd882 tempest-ServersTestJSON-1080939581 tempest-ServersTestJSON-1080939581-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112235809" status: 202 len: 0 microversion: 2.1 time: 0.067111 Oct 11 01:26:27.456437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1075/2183] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112235809 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:26:27.461775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:27.462706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:27.472137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.477088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.477712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:27.478588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:27.479169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:27.482644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:28.506926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:28.523412 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52c38b46-aa57-4cb6-9a6a-e42eddd4e81c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 1.063158 Oct 11 01:26:28.527307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1076/2184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:27 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:28.542464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:28.543141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:28.565751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:28.567919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:28.569057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:28.574879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:28.576517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:28.578459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:28.948138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf108940-35c9-497c-a189-253607e646f9 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1614 microversion: 2.1 time: 2.077431 Oct 11 01:26:28.951783 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1109/2185] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:26 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1614 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:28.955554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:28.963735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:28.964526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:28.966862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:28.974799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:28.976172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:28.978722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:28.979296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:28.980188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:28.982496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:28.983234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:28.991462 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2e3e44b-9ce1-46e4-b5bb-4de534f6d3ba tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.461438 Oct 11 01:26:28.994676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1077/2186] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:28 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:29.004361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e8ad0e-ca96-49f3-8dd6-7c3754139535", "name": "network-vif-plugged", "status": "completed", "tag": "c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:29.050595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.052019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.053246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.084233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] Creating event network-vif-plugged:c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc for instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 on n-h1-772273-9 Oct 11 01:26:29.091138 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a0a63eb7-c94d-48b8-bc04-964c5b01bc51 req-fb396ee2-7b80-4393-ab5f-4658d943d81c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093654 Oct 11 01:26:29.092569 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1078/2187] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:29.099987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:29.114243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:29.121467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:29.125939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.126675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.127324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.128485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.129098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.129694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.200369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b57f10f33354f6ebb2ab44528b0c480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675a10ce51b4e2c96130047f59b3ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:29.201324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] flavor_id is None. Assuming migration. {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 01:26:29.202099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:26:29.254446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:29.272109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60f8de18-3cb7-4f14-b4aa-fe346e8c3c16 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.318321 Oct 11 01:26:29.273671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1110/2188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:28 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:29.547873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0efad7b2-813c-47f4-9b4b-efc6020658ca", "tag": "97784ded-d158-48c1-b094-d768089d35a8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:29.588480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.595811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.596661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.628421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] Creating event network-changed:97784ded-d158-48c1-b094-d768089d35a8 for instance 0efad7b2-813c-47f4-9b4b-efc6020658ca on n-h2-772273-9 Oct 11 01:26:29.645001 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e009fa1b-2b38-419f-ae06-a2b4522d84f3 req-06becbe2-dcdb-4844-a41a-899e49ebe791 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104370 Oct 11 01:26:29.651665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1111/2189] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:26:29.661411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:29.671476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:29.691739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.692517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.693135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.694036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.694654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.695249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.811503 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e727a87d-9039-419c-b37f-dee1b86fff20 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7/action" status: 202 len: 0 microversion: 2.1 time: 0.715046 Oct 11 01:26:29.812796 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1079/2190] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:26:29 2022] POST /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:26:29.827507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:29.828180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:29.846206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.846737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.847188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:29.848630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:29.849099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:29.849548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:30.271719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.280167 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-277eae24-ce58-46aa-9d75-0e215ec821a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1472 microversion: 2.1 time: 0.462882 Oct 11 01:26:30.288855 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1080/2191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:29 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1472 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:30.317175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:30.319199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:30.343960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:30.345257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:30.346142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:30.348407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:30.350269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:30.351387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:30.423105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.432192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91a84720-2b9c-4bb7-9383-0cc225034e11 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 0.778760 Oct 11 01:26:30.437459 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1112/2192] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:29 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:30.445325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:30.446234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:30.454461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:30.454966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:30.455614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:30.456553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:30.457025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:30.457491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:30.603285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.612547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.616695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.623031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61a80133-3bdd-4d91-9bef-79b2eadc28ec tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.323759 Oct 11 01:26:30.641513 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1081/2193] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:30 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:30.881354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:30.898551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bfdac520-d5f8-4a92-a77e-9b379e761f8b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.457357 Oct 11 01:26:30.919941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1113/2194] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:30 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:31.308512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:31.309210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:31.322722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.323642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.324283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.326707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.327359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.327994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.459438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:31.460038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:31.470976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.472609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.474183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.474946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.477633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.479637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.819143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:31.834863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d01b91ca-259e-41d6-9b4a-8fadd7cd57e7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1472 microversion: 2.1 time: 0.529217 Oct 11 01:26:31.836596 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1082/2195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:31 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:31.847204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:31.850864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:31.869290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:31.881380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.882866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.883755 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1bb6227d-fcf2-4a23-a296-4f34b80a8fab tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 0.428449 Oct 11 01:26:31.888035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.911080 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1114/2196] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:31 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:31.913116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.915883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.916527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.929633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:31.932041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:31.953863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.959192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.960159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:31.966281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:31.966963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:31.967719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:32.219870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:32.228671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:32.237063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:32.247854 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08421f79-cf22-46b1-94a7-e537381fbff3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.408391 Oct 11 01:26:32.249496 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1083/2197] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:31 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:32.383479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:32.401759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a98d77d-fbb2-49f7-ab1d-2e02be8e2317 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.476010 Oct 11 01:26:32.411370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1115/2198] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:31 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:32.863115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:32.864406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:32.880098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:32.881952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:32.884428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:32.885418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:32.887064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:32.888229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:32.918347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:32.918969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:32.931558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:32.932067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:32.932510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:32.933237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:32.933699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:32.934125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:32.949993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:33.272749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:33.290103 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f346f35-e05a-4e21-a406-6b6b2fe846b7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1472 microversion: 2.1 time: 0.423954 Oct 11 01:26:33.294123 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1084/2199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:32 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:33.307700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:33.308738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:33.329953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:33.331368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:33.334571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:33.335601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:33.336547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:33.340066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:33.637366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:33.648812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:33.656042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:33.668990 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0c244e0-03b7-4526-a8f5-b7d5122b2a1d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.371781 Oct 11 01:26:33.669589 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1085/2200] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:33 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:33.695072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:33.697103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:33.719061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:33.720333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:33.720775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:33.724385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:33.724955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:33.725296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:33.917173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:33.962753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9b023665-4d26-4f3c-9eba-b065ce59f4b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 1.046626 Oct 11 01:26:34.001258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1116/2201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:32 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:34.261447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:34.283570 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f80417cd-6ca2-4f81-904f-83a760e34cdb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.603509 Oct 11 01:26:34.303175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1086/2202] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:33 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:34.320624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:34.321348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:34.329379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:34.330258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:34.330915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:34.332104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:34.332769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:34.333419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:34.703767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:34.704708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:34.720540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:34.721162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:34.721754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:34.722552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:34.723091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:34.723616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:34.989082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.004063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.020967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.046903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4259a27-51d2-4f23-a06b-3a737e6fb360 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.347105 Oct 11 01:26:35.049201 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1087/2203] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:34 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:35.070710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:35.072498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:35.090189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:35.091834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:35.092296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:35.095598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:35.096223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:35.096670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:35.248897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.260043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50e29f9a-750f-4331-8a03-0c05b49899fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1472 microversion: 2.1 time: 0.946428 Oct 11 01:26:35.260634 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1117/2204] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:34 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1472 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:35.286936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebf141b-9da6-4eab-8764-a77f0349d669", "name": "network-vif-plugged", "status": "completed", "tag": "1d0a3e03-caac-4b71-b727-baa4cffde4b5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:35.327956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:35.328874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:35.332057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:35.375487 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] Creating event network-vif-plugged:1d0a3e03-caac-4b71-b727-baa4cffde4b5 for instance aebf141b-9da6-4eab-8764-a77f0349d669 on n-h2-772273-9 Oct 11 01:26:35.395377 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9c3f0392-712c-42d1-81c6-217c0f0ba0d7 req-a2fb3d8f-f311-4938-a8d8-2461ad527781 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132510 Oct 11 01:26:35.399554 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1118/2205] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:35.418181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:35.422587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:35.440969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:35.445825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:35.451059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:35.453523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:35.454126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:35.456357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:35.820474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.837404 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-691cc155-64c1-41c2-9582-aa654c14fad8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 0.776734 Oct 11 01:26:35.857326 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1088/2206] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:35 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:35.892917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:35.906150 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-081426dc-23ea-4232-b7b8-0f19fa4fb854 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.499948 Oct 11 01:26:35.914330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1119/2207] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:35 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:36.086318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:36.087550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:36.105253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.108304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.110279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.117182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.118142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.118753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.294809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:36.296829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:36.303502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:36.330442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:36.331043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.333227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.334549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:36.334828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.335921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.336389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.336820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.355561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f0cc632-eec1-48f2-bbfd-f858ea3d5270 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.272901 Oct 11 01:26:36.378911 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1089/2208] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:36 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:36.654337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:36.662977 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82f902ae-b2d1-47c8-8296-267b79010363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.373262 Oct 11 01:26:36.671504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1120/2209] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:36 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:36.867207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:36.869151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:36.882101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.883276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.883989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.885737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.886455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.887668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.943741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:36.944693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:36.956736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.957226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.957830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:36.958538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:36.958988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:36.965812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:37.457316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:37.472053 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3259616c-fab4-4447-9a71-cdbde6ece796 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1322 microversion: 2.1 time: 0.613474 Oct 11 01:26:37.476174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:37.492009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1090/2210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:36 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:37.494008 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-43315c35-704c-4f9d-83fa-d1b0150819c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.555419 Oct 11 01:26:37.497748 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1121/2211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:36 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:37.501099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:37.508714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:37.518750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:37.520689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:37.521239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:37.526377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:37.526963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:37.527646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:37.665274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:37.681031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:37.684911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:37.696775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c658a43b-5a53-42db-b933-04513bfd513e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.201304 Oct 11 01:26:37.700471 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1091/2212] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:37 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:37.703080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:37.703967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:37.717254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:37.721994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:37.728122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:37.728910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:37.729395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:37.731307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:38.003114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:38.013669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:38.020797 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-44dffcdd-cb20-4e99-ba88-3c525d8b93a4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.328914 Oct 11 01:26:38.023496 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1122/2213] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:37 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:38.515813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:38.522899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:38.524334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:38.525146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:38.541497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:38.541999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:38.542768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:38.544180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:38.544368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:38.545371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:38.545990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:38.546648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:38.547598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:38.548207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:38.548863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:38.551936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.323967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:39.354450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1841c9d8-7407-4ec6-a9c8-baeacfb12329 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1515 microversion: 2.1 time: 0.842540 Oct 11 01:26:39.357610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1092/2214] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:38 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1515 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:39.381226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:39.383646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:39.414340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.418971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.420026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.423936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.431651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.432488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.456926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:39.469079 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9be26f82-ebcf-4f08-8d33-c0b18fa3cc4a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.951420 Oct 11 01:26:39.469676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1123/2215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:38 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:39.494196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:39.494817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:39.532328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.536829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.538722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.539890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.541131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.544975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.674850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:39.684738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:39.706164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:39.726002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c40fad97-4662-46d5-affb-ec0c8ce52575 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.365776 Oct 11 01:26:39.726902 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1093/2216] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:39 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:39.737833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efad7b2-813c-47f4-9b4b-efc6020658ca", "name": "network-vif-plugged", "status": "completed", "tag": "97784ded-d158-48c1-b094-d768089d35a8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:39.775387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.776215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.776807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.813249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] Creating event network-vif-plugged:97784ded-d158-48c1-b094-d768089d35a8 for instance 0efad7b2-813c-47f4-9b4b-efc6020658ca on n-h2-772273-9 Oct 11 01:26:39.832224 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-33181b3a-f90d-4fcc-b182-378c44428481 req-39c0511a-66e9-4c18-8e8c-6354202d417b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094295 Oct 11 01:26:39.833156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1094/2217] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:39.845291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:39.853455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:39.869592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.874813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.879310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.880391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:39.881049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:39.881753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:39.933220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'flavor' on Instance uuid aebf141b-9da6-4eab-8764-a77f0349d669 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:26:40.106927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f366d0c-7374-498a-a173-85a035f7e9fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action" status: 200 len: 32 microversion: 2.1 time: 0.271201 Oct 11 01:26:40.108315 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1095/2218] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:26:39 2022] POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action => generated 32 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:26:40.121858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:40.123273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:40.137577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.139424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.140978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:40.145386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.146202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.146875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:40.182593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:40.200282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-361f4eaf-b0bc-4533-a33d-8b19860e9652 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.729540 Oct 11 01:26:40.209462 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1124/2219] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:39 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:40.495657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:40.496459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:40.509789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.510632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.511180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:40.512194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.516522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.517416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:40.867622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:40.880478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29a0af99-fdac-47d6-99f0-b14ffe59fec4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.765522 Oct 11 01:26:40.891305 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1096/2220] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:40 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:40.895385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:40.896225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:40.908905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.909684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.912850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:40.913854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:40.914514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:40.915111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:41.160538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:41.162164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:41.178230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb0a91e0-0aee-4ad2-a254-9182a0e159e3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1308 microversion: 2.1 time: 0.680468 Oct 11 01:26:41.178859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:41.183261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:41.195726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1125/2221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:40 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:41.203099 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9adff06f-e6db-4e2a-9e92-2716e94e5691 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.320519 Oct 11 01:26:41.205784 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1097/2222] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:40 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:41.242532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:41.243548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:41.251326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:41.257564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:41.259051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:41.260065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:41.260747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:41.261405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:41.659635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:41.673817 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48fdd694-b507-488a-9f03-63e4ae8cab33 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.435030 Oct 11 01:26:41.678603 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1126/2223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:41 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:41.906484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:41.909323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:41.933641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:41.938142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:41.939056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:41.948453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:41.949371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:41.952561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.208569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:42.210589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:42.229017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.229526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.229977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.235185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.235814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.236272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.343994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:42.358082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07858458-f6df-459d-9889-b790484f0218 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.450693 Oct 11 01:26:42.358730 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1098/2224] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:41 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:42.381508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:42.381508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:42.401329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.402078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.402722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.404839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.405745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.407790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.589118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:42.601498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a02f42c5-02d7-4d62-be08-868225d9c1e1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1487 microversion: 2.1 time: 0.397687 Oct 11 01:26:42.606185 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1127/2225] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:42 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1487 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:42.623684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:42.635606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:42.637230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:42.638391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:42.648807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.649872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.650651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.651769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.652437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.653317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.656688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:42.660727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:42.677706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23f588e0-2afe-4ac0-afb9-89adf7beff74 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.317768 Oct 11 01:26:42.679122 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1099/2226] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:42 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:42.710406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:42.712274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:42.742555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.743317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.744097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.745447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.749985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.750458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.895040 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a90cf98-06b3-4903-895e-99cb6c6b328b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca/action" status: 202 len: 0 microversion: 2.1 time: 0.265125 Oct 11 01:26:42.902261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1128/2227] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:26:42 2022] POST /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:26:42.921499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:42.923742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:42.946527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.946527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.952041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:42.955818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:42.961487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:42.961949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:43.070310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.081337 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e1559ea-d7a0-4552-a43a-cc52cfc9f062 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.379688 Oct 11 01:26:43.084894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1100/2228] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:42 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:43.386732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:43.387830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:43.400807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:43.401513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:43.402182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:43.403003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:43.403911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.405001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:43.408588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:43.416072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7c85686-a7b3-4acd-9437-fa5ccd169cdc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1492 microversion: 2.1 time: 0.512389 Oct 11 01:26:43.416973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1129/2229] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:42 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:43.723221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:43.723721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.724885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:43.731953 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5635164-5019-45b7-ae72-2be2e7633910 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.349669 Oct 11 01:26:43.736837 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1101/2230] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:43 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:43.748011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:43.748900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:43.749573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:43.750614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:43.751541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:43.752286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:43.892812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.909263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.917722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:43.930364 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e99b3edc-e1ab-4dba-9ea9-24fc4ecf4db3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.213045 Oct 11 01:26:43.935672 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1130/2231] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:43 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:44.122684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:44.123197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:44.145014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.145976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.146675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.147971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.152329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.153160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.444092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:44.444868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:44.466943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.467489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.468144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.469032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.469648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.470234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.618844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:44.630865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c513570-f413-4dd1-9c94-e1e95d089a11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.516129 Oct 11 01:26:44.631747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1102/2232] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:44 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:44.768467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:44.785573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e061ab3-8e08-4019-9aaf-ab424cc7c36d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 200 len: 1472 microversion: 2.1 time: 0.344851 Oct 11 01:26:44.788417 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1131/2233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:44 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:44.793428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:44.797210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:44.805273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.805800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.806237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.806948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.807629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.808280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.885145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78f663f5-c665-4fca-9c8d-6b8d8e6cd9ec tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] Calling method '.version_select at 0x7f112f9a9280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:44.911712 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78f663f5-c665-4fca-9c8d-6b8d8e6cd9ec tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.278650 Oct 11 01:26:44.918622 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1103/2234] 10.222.0.66 () {60 vars in 1226 bytes} [Tue Oct 11 01:26:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:44.930016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2090133528"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:44.935520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:44.944788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.945672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.946486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:44.947646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:44.948314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:44.949117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:45.076400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:45.085553 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2250c27-7bd2-4b75-a704-4f2fd3854d90 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.295819 Oct 11 01:26:45.086126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1132/2235] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:44 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:45.092283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78c76a18-66ca-4e4e-9902-35ee5fab2359 tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] Action: 'update', calling method: .version_select at 0x7f1138911ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:45.168768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:45.240210 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a45bf10-00a3-4c09-8295-ba5eeb98464a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca/action" status: 202 len: 0 microversion: 2.1 time: 0.318438 Oct 11 01:26:45.241920 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1104/2236] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:26:44 2022] POST /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:26:45.258628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:45.259686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:45.267297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:45.269839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:45.271105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:45.272103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:45.272884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:45.274042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:45.282043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78c76a18-66ca-4e4e-9902-35ee5fab2359 tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.193606 Oct 11 01:26:45.289209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1133/2237] 10.222.0.66 () {62 vars in 1247 bytes} [Tue Oct 11 01:26:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:45.293988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93b5b61b-ee90-470e-af7c-24c5553623d7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112ff12af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:45.372342 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93b5b61b-ee90-470e-af7c-24c5553623d7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.084382 Oct 11 01:26:45.373156 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1134/2238] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:45 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:45.385329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d661f368-f7e9-4ae8-a320-dd0044f43742 tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] Calling method '.version_select at 0x7f1138932f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:45.392223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:45.405824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:45.406698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:45.422789 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6fdb806-5d09-40e6-9584-53e70cc5f990 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1553 microversion: 2.91 time: 0.170997 Oct 11 01:26:45.424173 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1105/2239] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:45 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:45.444693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d661f368-f7e9-4ae8-a320-dd0044f43742 tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.070181 Oct 11 01:26:45.451721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1135/2240] 10.222.0.66 () {60 vars in 1226 bytes} [Tue Oct 11 01:26:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:45.457661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e631c5f-d3bb-4db1-9311-4f2842b9019f tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] Action: 'update', calling method: .version_select at 0x7f1134d97e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:45.575733 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e631c5f-d3bb-4db1-9311-4f2842b9019f tempest-QuotaClassesAdmin257Test-1048318156 tempest-QuotaClassesAdmin257Test-1048318156-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.122530 Oct 11 01:26:45.576645 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1106/2241] 10.222.0.66 () {62 vars in 1247 bytes} [Tue Oct 11 01:26:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:45.659786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:45.664027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:45.675007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:45.675963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:45.676604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:45.682114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:45.683752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:45.684363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:45.985545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:45.997231 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6041bafe-2696-4b66-9860-80b9e2c32d89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.345158 Oct 11 01:26:45.998025 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1136/2242] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:45 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:46.113008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:46.114424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:46.135455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:46.136200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:46.137201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:46.138707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:46.142675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:46.143601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:46.389066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47132ee0-6037-4c9b-9a95-cbb4c519c64e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112ff120d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:46.440939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47132ee0-6037-4c9b-9a95-cbb4c519c64e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.055636 Oct 11 01:26:46.441523 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1137/2243] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:46 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:46.466593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:46.467222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:46.473487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:46.474044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:46.474890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:46.475720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:46.476347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:46.476927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:46.494607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:46.506199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ea6843f3-a1ac-4516-87bf-894db6366681 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.397245 Oct 11 01:26:46.525627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1107/2244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:46 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:46.612837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:46.633756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:46.638071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:46.644693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f419863-6f19-4566-a990-96541dfc9fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1535 microversion: 2.91 time: 0.181934 Oct 11 01:26:46.645946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1138/2245] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:46 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1535 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:26:47.024891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:47.026261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:47.076082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.085673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.086248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.088870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.089366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.091714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.379700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:47.394837 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0100e4f9-307d-4572-a5df-d0fbce070cff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.376779 Oct 11 01:26:47.395775 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1108/2246] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:47 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:47.459085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd880a40-402f-4437-ba2f-b8e2bb141dd4 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388eb3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:47.533904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:47.535506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:47.548235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.549012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.549960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.551140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.552420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.553016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.558968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd880a40-402f-4437-ba2f-b8e2bb141dd4 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.105356 Oct 11 01:26:47.560743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1139/2247] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:47 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:47.675613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:47.676255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:47.690601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.691047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.691527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.692286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:47.692909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:47.693243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:47.842957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:47.858487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:47.862810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:47.868329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:47.885504 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5891ba9-a4ee-4713-b74b-3bdab24417d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.356401 Oct 11 01:26:47.887642 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1109/2248] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:47 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:47.900600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f8f940f6-8e36-4017-b21e-e5beaf34c9f8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1535 microversion: 2.91 time: 0.229028 Oct 11 01:26:47.901515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1140/2249] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:47 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:48.427473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:48.429900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:48.455074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:48.456992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:48.457640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:48.459150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:48.459858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:48.464009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:48.578884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5bba7cf8-5dae-494a-ba01-c0b68bf2f390 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138932f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:48.656005 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5bba7cf8-5dae-494a-ba01-c0b68bf2f390 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.083135 Oct 11 01:26:48.658148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1141/2250] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:48 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:48.863971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:48.877043 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bfeee45-30f2-4652-b8fc-ba952f0d4b69 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.459796 Oct 11 01:26:48.881108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1110/2251] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:48 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:48.915419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:48.916090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:48.937451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:48.938077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:48.938543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:48.939310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:48.939806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:48.940246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:48.944072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:48.944793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:48.963928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:48.980651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:48.981452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:48.993994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:48.995997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.001921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.002553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.300591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:49.314560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:49.317338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:49.328038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb769d68-e138-4716-b810-c752762ee3d8 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1538 microversion: 2.91 time: 0.395844 Oct 11 01:26:49.332049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1111/2252] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:48 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1538 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:49.363732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:49.367169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:49.390626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.391137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.392096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.394902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.395739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.396364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.579628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-772273-9". {{(pid=120494) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 01:26:49.701648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:49.720834 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f749b915-6b1a-4ace-9f02-c52a6a85d100 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action" status: 202 len: 0 microversion: 2.91 time: 0.360936 Oct 11 01:26:49.722175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1112/2253] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:26:49 2022] POST /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:26:49.728222 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-becad5b4-2b63-4d55-83fa-51a9bc2ae29b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.813440 Oct 11 01:26:49.731637 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1142/2254] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:48 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:49.733613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44bd458a-1b68-44ce-a29c-50cfc6a63b7c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1134f7b1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:49.742693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:49.746425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:49.764282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.766921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.768507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.769299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.772375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.774915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.834307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44bd458a-1b68-44ce-a29c-50cfc6a63b7c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.110141 Oct 11 01:26:49.836820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1113/2255] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:49 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:49.907033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:49.907705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:49.925074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.926049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.926522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:49.927879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:49.931064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:49.932513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:50.290208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:50.322771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:50.332120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:50.343436 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a02bdb4-e232-47cc-b357-facef9529f69 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1486 microversion: 2.91 time: 0.609509 Oct 11 01:26:50.369308 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1143/2256] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:49 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1486 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:50.566397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:50.579898 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05c43918-84aa-4972-9465-7aa906a84afc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.680887 Oct 11 01:26:50.582406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1114/2257] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:49 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:50.758725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:50.759630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:50.777216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:50.779979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:50.780457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:50.782079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:50.782689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:50.783130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:50.828343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:50.856685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-460e91cd-c816-4770-bac7-3dd7b5c3aecd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11346a9f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:50.941695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-460e91cd-c816-4770-bac7-3dd7b5c3aecd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.093576 Oct 11 01:26:50.952800 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1115/2258] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:50 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:51.382653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:51.383493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:51.397316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:51.398173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:51.398793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:51.414220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:51.414729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:51.418936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:51.441774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:51.450391 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4be74b2-4597-4d1a-95cb-505f4e23728f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.696573 Oct 11 01:26:51.474805 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1144/2259] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:50 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:51.609723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:51.610603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:51.620665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:51.629155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:51.629628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:51.630404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:51.630913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:51.631532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:51.715845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:51.735658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:51.737547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:51.761619 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-975fb0ca-bc01-4a2d-be36-0e06390aafb3 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1486 microversion: 2.91 time: 0.384059 Oct 11 01:26:51.762740 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1116/2260] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:51 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1486 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:51.960461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cfd0363-64dd-46f3-b87d-772210cead1c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1134cdbee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:52.039005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:52.041668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cfd0363-64dd-46f3-b87d-772210cead1c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.085803 Oct 11 01:26:52.042422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1117/2261] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:51 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:52.047230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6fc8fa5-d8e4-4b6f-a920-a2eaf0ce5fb2 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.442890 Oct 11 01:26:52.083665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1145/2262] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:51 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:26:52.308736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Action: 'update', calling method: .version_select at 0x7f11341b2f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:52.470062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.472059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.473616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.476069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.476777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.478876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.491834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:52.503671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:52.534659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.536038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.538350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.542068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.542878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.543662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.660071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d36289a4-ce01-42fa-b6f9-386637876b85 tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618" status: 200 len: 240 microversion: 2.36 time: 0.614742 Oct 11 01:26:52.668860 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1118/2263] 10.222.0.66 () {62 vars in 1303 bytes} [Tue Oct 11 01:26:52 2022] PUT /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618 => generated 240 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:52.682797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Calling method '.version_select at 0x7f113416f700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:52.839062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.839579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.840011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.840771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.841225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.855679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.922642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5779d4c-4af8-4432-9437-41200e79343f tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618/detail" status: 200 len: 672 microversion: 2.36 time: 0.246503 Oct 11 01:26:52.926066 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1119/2264] 10.222.0.66 () {60 vars in 1304 bytes} [Tue Oct 11 01:26:52 2022] GET /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618/detail => generated 672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:52.942037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:52.942670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:52.954437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.954927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.967270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.969305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:52.969945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:52.970543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:52.974610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:26:53.150055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:53.201963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:53.208280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:53.238301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aae80f19-92c1-4542-bc51-05a590beab1e tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.307940 Oct 11 01:26:53.240816 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1120/2265] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:52 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:53.248445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35fd0555-a5c5-432f-95ff-f0b7f104657e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11349c4280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:53.343590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35fd0555-a5c5-432f-95ff-f0b7f104657e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1414 microversion: 2.1 time: 0.100480 Oct 11 01:26:53.344682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1121/2266] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:53 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:53.351702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:53.358782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:53.372763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.373296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.375749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.376930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.377242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.377681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.422321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:53.430983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e938f1c-6263-40c5-9933-9a6c84defd0f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.956533 Oct 11 01:26:53.457140 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1146/2267] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:52 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:53.468772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Action: 'update', calling method: .version_select at 0x7f112f7b6940>, body: {"quota_set": {"ram": "2048"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:53.668359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.669126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.669711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.670640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.671711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.672470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.746943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.747627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.749186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:53.749824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.750740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.752556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.753154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.758168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24463391-84a7-499a-a1bf-c8657ea23e5e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1477 microversion: 2.1 time: 0.411279 Oct 11 01:26:53.758788 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1122/2268] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:26:53 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:26:53.891405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e0b8c850-0e5e-4bac-a171-e1c31d2225bb tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618?user_id=b1d02728336a4feca733a4e7ff502ccb" status: 200 len: 240 microversion: 2.36 time: 0.431645 Oct 11 01:26:53.892082 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1147/2269] 10.222.0.66 () {62 vars in 1384 bytes} [Tue Oct 11 01:26:53 2022] PUT /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618?user_id=b1d02728336a4feca733a4e7ff502ccb => generated 240 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:53.896765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1495273725", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "44f990d1-d41e-447f-8b45-5c7d6acbd9b8"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:53.906321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efad7b2-813c-47f4-9b4b-efc6020658ca", "name": "network-vif-plugged", "status": "completed", "tag": "97784ded-d158-48c1-b094-d768089d35a8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:26:53.932096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:53.932579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:53.933007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:53.963158 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] Creating event network-vif-plugged:97784ded-d158-48c1-b094-d768089d35a8 for instance 0efad7b2-813c-47f4-9b4b-efc6020658ca on n-h2-772273-9 Oct 11 01:26:53.971322 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-91534501-21a6-4e7e-945c-a6a88375b08f req-e85d57f0-a173-4be4-b6d0-5f163b3adc7d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075614 Oct 11 01:26:53.973141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1148/2270] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:26:53.986849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9b64c27e-d76a-4da8-9f8d-d76b4703538c tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] Calling method '.version_select at 0x7f112fd284c0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:54.101979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9b64c27e-d76a-4da8-9f8d-d76b4703538c tempest-QuotasAdminTestV236-1413605216 tempest-QuotasAdminTestV236-1413605216-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618?user_id=b1d02728336a4feca733a4e7ff502ccb" status: 200 len: 282 microversion: 2.36 time: 0.126463 Oct 11 01:26:54.109053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1149/2271] 10.222.0.66 () {60 vars in 1364 bytes} [Tue Oct 11 01:26:53 2022] GET /compute/v2.1/os-quota-sets/3739dc959a694ddf88c57c98d7602618?user_id=b1d02728336a4feca733a4e7ff502ccb => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:26:54.269858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:26:54.270753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:26:54.293741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:54.295017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:54.295732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:54.296623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:26:54.297508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:26:54.299663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:26:54.533784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:54.554073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:54.557677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:26:54.568794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3a00e65-5c42-4bfa-b445-54358259792d tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.303166 Oct 11 01:26:54.569424 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1150/2272] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:26:54 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:26:54.580798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab052dcc-3cb6-4daa-a1d7-c4b1261ff390 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138872c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:02.841102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:02.884335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:03.753393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=11 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:03.778141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:03.919630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:04.097110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:04.541709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=28 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:04.566236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:11.538607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] validate_networks() for [('44f990d1-d41e-447f-8b45-5c7d6acbd9b8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:27:11.559112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab052dcc-3cb6-4daa-a1d7-c4b1261ff390 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1423 microversion: 2.1 time: 16.985239 Oct 11 01:27:11.560545 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1151/2273] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:26:54 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1423 bytes in 16988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:11.566928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:11.567563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:11.597394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:11.597864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:11.598304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:11.599627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:11.599627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:11.600335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:12.428298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:12.437099 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de6a648a-f2b4-4104-ab36-f27bec1e513a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.875709 Oct 11 01:27:12.442726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1152/2274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:11 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:12.457077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:12.457708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:12.476995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:12.481576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:12.482291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:12.485904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:12.487311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:12.488585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.047026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.057788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c82bd97-eee9-4b17-945d-cad42a4275cd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 0.613406 Oct 11 01:27:13.062806 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1153/2275] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:12 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:13.076529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:13.077374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:13.099012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.100331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.101178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.102236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.108416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:27:13.109852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:27:13.111608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:27:13.112507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:27:13.113265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:27:13.116696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.119467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.154951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.160143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.162410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.165631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.167048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.169315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.235869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Getting quotas for project 4edd07cb225141e2913b7fcb0c884425. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:27:13.284887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Getting quotas for user cd3d667c276d4a2cbdcd375f2f11ba8f and project 4edd07cb225141e2913b7fcb0c884425. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:27:13.311718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Going to run 3 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:27:13.321558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:13.350955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.371232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.373314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.380389 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fd02277-ce31-40c3-8c81-07de3214c249 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.314848 Oct 11 01:27:13.382298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1154/2276] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:13 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:13.406695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "name": "network-vif-unplugged", "status": "completed", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:13.426433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.426997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.427609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.428150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 67b771e4-1918-4555-9f39-9129f8c34e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=d3b18b72-7398-451b-828d-c8e45afda1e0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:13.454492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Creating event network-vif-unplugged:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h1-772273-9 Oct 11 01:27:13.468342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:27:13.489317 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eda2df4c-f2b8-462b-96e3-6459d9ea3a97 req-13ede466-a3bd-4e69-a92b-50a592870105 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093767 Oct 11 01:27:13.489658 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1155/2277] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:13.492192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=67b771e4-1918-4555-9f39-9129f8c34e8d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:13.496300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:13.503039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.503978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Searching by: {'deleted': False, 'project_id': '27aefacad2da4218ace0f2330ac931ca'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:13.510828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.511350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.511905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.512678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.513143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.513574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.552558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:27:13.621502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4c9180d-8f25-45d7-b805-d8fc8bd50993 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.127716 Oct 11 01:27:13.623426 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1156/2278] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:27:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:13.636307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13dc65cc-5d02-49fc-97e0-a393fabda889 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f113439e670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:13.641931 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de826b6c-b50e-4378-a315-2bbc66937776 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.860779 Oct 11 01:27:13.644819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1123/2279] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 19885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:27:13.659437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:13.687382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.688118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.688733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.730666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Creating event network-vif-plugged:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h1-772273-9 Oct 11 01:27:13.732316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13dc65cc-5d02-49fc-97e0-a393fabda889 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 200 len: 1423 microversion: 2.1 time: 0.107008 Oct 11 01:27:13.733389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1157/2280] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:27:13 2022] GET /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:13.750575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:27:13.752751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:13.753575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:13.762871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.763486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.763997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.765703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.766494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.766736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.768037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ad20158b-e2ce-4cec-880e-c269918635b7 req-3115bb4b-6f67-4612-b46b-4bcfc89cdb1f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121593 Oct 11 01:27:13.769451 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1124/2281] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:13.778736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:13.780758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:13.788321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.789150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.794166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.796141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.796900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.797545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.909235 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-012a199e-8bbc-4219-9692-009bfdf2e1f8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7/action" status: 204 len: 0 microversion: 2.1 time: 0.163264 Oct 11 01:27:13.915810 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1158/2282] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:13 2022] POST /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7/action => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:27:13.922316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:13.933070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:13.933948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Searching by: {'deleted': False, 'project_id': '27aefacad2da4218ace0f2330ac931ca'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:13.948081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.955054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.955479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:13.956758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:13.956758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:13.957432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.032691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:27:14.108347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:14.116474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:14.117024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:14.118029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.119511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:14.132714 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcc753fb-bbfe-496a-b9de-e0bd1c15810b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.357976 Oct 11 01:27:14.135960 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1125/2283] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:13 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:14.149768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:14.156203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:14.156990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:14.240123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:14.240681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:14.241138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.243716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:14.244247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:14.244695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.282095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88d3b324-4826-4ead-bbce-06fdd704552a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.144946 Oct 11 01:27:14.282956 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1126/2284] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:27:14 2022] GET /compute/v2.1/servers => generated 1018 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:14.297576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-822c6d6a-cd41-4b31-9a8f-dcc98297d1dc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1134456f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:14.331239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75970ba5-ce70-48fa-b795-becdb3aa4eca tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.414029 Oct 11 01:27:14.333242 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1159/2285] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:27:13 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:14.350686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:14.351582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:14.372412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:14.373716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:14.374227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.377269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:14.377754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:14.378260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:14.821320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:14.832068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9096f3cd-6604-4516-8b2c-5a95ddfb3367 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 0.487107 Oct 11 01:27:14.833196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1160/2286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:14 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:14.838374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-adcadfde-2978-4660-bd34-9c4ab4057d83 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:14.840593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adcadfde-2978-4660-bd34-9c4ab4057d83 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:14.986907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-adcadfde-2978-4660-bd34-9c4ab4057d83 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:15.019914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-adcadfde-2978-4660-bd34-9c4ab4057d83 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1223 microversion: 2.1 time: 0.185193 Oct 11 01:27:15.050803 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1161/2287] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:14 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:15.072137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1e20129-7450-4a45-9653-8565f5b787b8 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:15.100147 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1e20129-7450-4a45-9653-8565f5b787b8 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048068 Oct 11 01:27:15.104266 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1162/2288] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:27:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:15.135100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:15.138307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:15.154263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.155000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.156528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.157404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.158200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.159119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.351237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:15.370923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:15.378575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:15.412584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a80fbf1d-e281-4d24-bc63-15d97839859a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.304420 Oct 11 01:27:15.414486 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1163/2289] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:15 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:15.419874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:15.420731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:15.430746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.430746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.431894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.432884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.433642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.434326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.647959 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-822c6d6a-cd41-4b31-9a8f-dcc98297d1dc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 204 len: 0 microversion: 2.1 time: 1.362763 Oct 11 01:27:15.648978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1127/2290] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:14 2022] DELETE /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 0 bytes in 1364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:27:15.656047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:15.657005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:15.673400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.673889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.677312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.680219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.681662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.682059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.739267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:27:15.867594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:15.877507 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-633c30ba-b2a2-46b2-ac00-c7ed6900f825 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.461860 Oct 11 01:27:15.887757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1164/2291] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:15 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:15.904032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:15.930870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.932044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.935114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.957264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-931cc770-2d07-45de-abb5-91ecba1b5bdd tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 204 len: 0 microversion: 2.1 time: 0.306904 Oct 11 01:27:15.966078 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1128/2292] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:27:15 2022] DELETE /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:27:15.974772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Creating event network-changed:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h1-772273-9 Oct 11 01:27:15.976799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:15.978997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:15.990124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:27:15.992679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.993415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:15.996497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:15.997570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:15.999327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.000082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.021187 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4fe6735f-b074-45cc-95e1-b37bf2a9c0b9 req-ae1f622a-54f7-46b3-b8e1-47d915cb7c4a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136131 Oct 11 01:27:16.038130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1165/2293] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:16.045959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:16.046683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:16.054969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:27:16.074044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.074555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.075569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.076299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.078069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.078551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.164515 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c30c19c0-b792-41c2-9f3b-6ad8b7685f5c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 204 len: 0 microversion: 2.1 time: 0.196374 Oct 11 01:27:16.180100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1129/2294] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:27:15 2022] DELETE /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:27:16.187763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:16.188132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:16.200469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.201383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.202045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.202992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.203730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.204376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.507756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.520489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-530f56df-9836-4a23-b07d-1c0903781805 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 0.480702 Oct 11 01:27:16.521139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1166/2295] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:16 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:16.529940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:16.530557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:16.544151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.544648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.545361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.546346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.547422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.548149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.647033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.655093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f692ed48-9ea0-41a9-9a8c-d27c29bb1867 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1606 microversion: 2.1 time: 0.483474 Oct 11 01:27:16.667635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1130/2296] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:16 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1606 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:16.668347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.673546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1917081615", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "11db0ee6-bf74-4f94-a889-16aabb18b472"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:16.680723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4db7d204-924d-4084-b211-2f86946e8423 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1227 microversion: 2.1 time: 0.158414 Oct 11 01:27:16.684198 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1167/2297] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:16 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1227 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:16.694449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:16.695061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:16.706836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.707620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.709309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.710754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:16.711224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:16.712288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:16.764742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] validate_networks() for [('11db0ee6-bf74-4f94-a889-16aabb18b472', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:27:16.846881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.855538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.857754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:16.862859 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08b9dcb6-e309-451c-b8e0-7d1b04c2a0d5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.177208 Oct 11 01:27:16.863917 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1168/2298] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:16 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:16.948406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9aa48028-420e-4126-b35d-c68e11317c73 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Action: 'create', calling method: .version_select at 0x7f1138916f70>, body: {"pool": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:18.525861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:27:18.526883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:27:18.527548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:27:18.528126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:27:18.529222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:27:18.551195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:18.551886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:18.552471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:18.553384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:18.554008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:18.554581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:18.622102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:27:18.639870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for user a0510e6acedd400f86f1c8f9e8a1c75d and project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:27:18.667472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:27:18.675356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:18.765179 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6c795eb-f65b-4f2d-b337-9d3b11281aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.108053 Oct 11 01:27:18.768509 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1131/2299] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:27:18.782529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:18.783171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:18.834874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:18.835778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:18.837608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:18.842125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:18.842837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:18.844529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:19.338238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:19.354029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd15f6fc-68bb-44b8-8acc-b670c3e3e197 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1521 microversion: 2.1 time: 0.584327 Oct 11 01:27:19.354918 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1132/2300] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:18 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:19.359765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efad7b2-813c-47f4-9b4b-efc6020658ca", "name": "network-vif-unplugged", "status": "completed", "tag": "97784ded-d158-48c1-b094-d768089d35a8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:19.381640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:19.382222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:19.382757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:19.407921 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] Creating event network-vif-unplugged:97784ded-d158-48c1-b094-d768089d35a8 for instance 0efad7b2-813c-47f4-9b4b-efc6020658ca on n-h2-772273-9 Oct 11 01:27:19.421241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fcbb8492-e23a-48d5-8d44-f89bff317b65 req-3ba8ba21-67b6-4f49-8378-39c829ddd92b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064446 Oct 11 01:27:19.422156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1133/2301] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:19.439123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:19.439934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:19.447139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:19.447682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:19.448266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:19.448989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:19.449448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:19.449876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.077225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.087318 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7dec03b-7431-40a8-9831-ac83383bdc53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 1.663653 Oct 11 01:27:21.089895 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1134/2302] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:19 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:21.096521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:21.101979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:21.124513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.125014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.125622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.126510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.126966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.127798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.469352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.479235 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6811da80-d3d7-43be-92cd-fd61cea5a787 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1539 microversion: 2.1 time: 0.388011 Oct 11 01:27:21.491939 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1135/2303] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:21 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1539 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:21.505838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:21.506473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:21.518005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.518512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.519012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.519690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.521142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.521732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.659538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.670960 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-601342b7-c6d7-4020-9ff9-22676b5894fb tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1281 microversion: 2.1 time: 0.177133 Oct 11 01:27:21.675910 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1136/2304] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:21 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:21.692085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:21.693120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:21.700664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.701458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.702576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.703653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.704271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.704858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.868349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.877697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.879179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:21.918059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed5ab0c1-27cd-443a-b6d6-79bf605d7fa5 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1544 microversion: 2.91 time: 0.240542 Oct 11 01:27:21.949813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1137/2305] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:21 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:21.962449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:21.966025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:21.978893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.984402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.987867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:21.989106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:21.989686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:21.990445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:22.090932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:22.102783 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0705e88-9f36-4c14-a0be-7bf1d434e42d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1260 microversion: 2.1 time: 0.151357 Oct 11 01:27:22.117372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1138/2306] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:21 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:22.129097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:22.130051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:22.139625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:22.140428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:22.141104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:22.142022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:22.142662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:22.143294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:22.886016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:22.902075 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12459560-e3f6-4071-b53b-7f83c169d8a8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1501 microversion: 2.1 time: 0.783185 Oct 11 01:27:22.903434 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1139/2307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:22 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1501 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:23.029199 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9aa48028-420e-4126-b35d-c68e11317c73 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.163918 Oct 11 01:27:23.038394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1169/2308] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:27:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:23.040789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d158c4-f3de-4660-b630-d93f890d7122", "name": "network-vif-deleted", "tag": "c75b0ebc-0e01-49f8-b9cd-562f5f63efdc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:23.055043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0efad7b2-813c-47f4-9b4b-efc6020658ca", "name": "network-vif-deleted", "tag": "97784ded-d158-48c1-b094-d768089d35a8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:23.069465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.071236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.073430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.076065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.077111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.083626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.088089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:23.112736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] Creating event network-vif-deleted:97784ded-d158-48c1-b094-d768089d35a8 for instance 0efad7b2-813c-47f4-9b4b-efc6020658ca on n-h2-772273-9 Oct 11 01:27:23.113897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] Creating event network-vif-deleted:c75b0ebc-0e01-49f8-b9cd-562f5f63efdc for instance 14d158c4-f3de-4660-b630-d93f890d7122 on n-h1-772273-9 Oct 11 01:27:23.127735 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c5b46089-6065-4f99-8947-2bd142dcf41d req-63013176-be57-4bef-9f52-0bb1994b0254 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222816 Oct 11 01:27:23.131421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1140/2309] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:23.149084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.150104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:23.167120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-42be7731-c845-463f-89bd-d6a0c692e503 req-6a0fd859-be15-4191-9de8-16ac76161722 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125516 Oct 11 01:27:23.175991 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1170/2310] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:23.189847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.190249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.190932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.191642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.192598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.193272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.193846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.206514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:23.229055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.231022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.231945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.239045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.243726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.244511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.433366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.442435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:23.453058 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28cc75f4-873e-4583-8a90-d1e2c4f851d2 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1250 microversion: 2.1 time: 0.273341 Oct 11 01:27:23.455580 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1171/2311] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1250 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:23.470059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.470617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:23.492428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.493388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.494782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.497345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.500093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.501912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.675545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.687316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed922bc7-2877-4097-b108-bd0a7c83d7e6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1281 microversion: 2.1 time: 0.230616 Oct 11 01:27:23.690137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1172/2312] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:23.718410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.725399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:23.733296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.734064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.735877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.736889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.737607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.738182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.784465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.795719 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6cc46de8-5f81-46b7-a571-48087a3aaa62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 0.662728 Oct 11 01:27:23.796801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1141/2313] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:23.805936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.807300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:23.815816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.816242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.817492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.818441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:23.819430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:23.819833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:23.946714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.971760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.974134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:23.981162 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff6373a2-0afa-4b08-95ba-462ecb7bc628 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1531 microversion: 2.91 time: 0.182631 Oct 11 01:27:23.982625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1142/2314] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1531 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:23.988245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6aae7d9-23b0-453e-a800-003ecc10a9cc tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f11343df790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:23.991823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:24.163021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:24.178195 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec12b426-c69d-462a-8c33-18618faa3c13 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1515 microversion: 2.1 time: 0.470397 Oct 11 01:27:24.179132 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1173/2315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:24.202150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:24.202861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.209335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.209904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.210495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.211275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.211968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.212331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.334962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:24.356643 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c487511d-2650-489a-8dce-957d27085d1e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1266 microversion: 2.1 time: 0.160572 Oct 11 01:27:24.360942 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1174/2316] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:24 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:24.371942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:24.372822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.384542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.385574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.386215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.387979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.388712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.389385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.461839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6aae7d9-23b0-453e-a800-003ecc10a9cc tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/980b4c20-d239-40b1-8c79-0971a3078e5e" status: 200 len: 142 microversion: 2.1 time: 0.477544 Oct 11 01:27:24.463404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1143/2317] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:27:23 2022] GET /compute/v2.1/os-floating-ips/980b4c20-d239-40b1-8c79-0971a3078e5e => generated 142 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:24.469410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:24.473098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: e49f153d-0f25-40fd-85d5-2a0317dc3a9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.480080 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/e49f153d-0f25-40fd-85d5-2a0317dc3a9d/action HTTP/1.1 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 14 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:27:24.488034 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: {"rescue": {}} Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:27:24.489380 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e49f153d-0f25-40fd-85d5-2a0317dc3a9d', 'body': {'rescue': {}}} Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:24.490293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. Oct 11 01:27:24.491485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:24.494618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 404 to user: Instance e49f153d-0f25-40fd-85d5-2a0317dc3a9d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:24.495908 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7110e91f-6a19-404f-b85e-dc1bbd4f2b72 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/e49f153d-0f25-40fd-85d5-2a0317dc3a9d/action" status: 404 len: 111 microversion: 2.1 time: 0.031294 Oct 11 01:27:24.496905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1144/2318] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:24 2022] POST /compute/v2.1/servers/e49f153d-0f25-40fd-85d5-2a0317dc3a9d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:27:24.513198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fefa02e5-1929-4157-810e-bb1683258a1d tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f11354c2af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:24.534303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] Lazy-loading 'services' on Instance uuid 884e53d0-a2f4-4d16-b145-568fa0f7acc5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:27:24.581849 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bae2df99-2849-4ed2-8388-438d433624c2 tempest-UnshelveToHostMultiNodesTest-1460340115 tempest-UnshelveToHostMultiNodesTest-1460340115-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1936 microversion: 2.91 time: 0.218325 Oct 11 01:27:24.605871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1175/2319] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:24 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1936 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:24.625269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:24.629773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.637147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.637899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.638491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.643532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.644872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.645736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.787969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:24.824466 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db03be38-36e1-4657-b3fb-025fec1c6843 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1250 microversion: 2.1 time: 0.216328 Oct 11 01:27:24.826305 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1176/2320] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:24 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1250 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:24.836281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:24.840258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.849933 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fefa02e5-1929-4157-810e-bb1683258a1d tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.346169 Oct 11 01:27:24.851261 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1145/2321] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:27:24 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:24.854320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.856501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.856958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.857109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:24.857682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.857799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:24.858421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.863101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.867977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.868727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.869378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.870296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:24.870746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:24.871609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:24.913533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:27:25.008709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:25.035835 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19ae6c13-9977-431e-8de6-438a98767ffd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action" status: 202 len: 0 microversion: 2.1 time: 0.204170 Oct 11 01:27:25.040821 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1177/2322] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:24 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:25.047732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:25.048769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:25.064572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:25.065479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:25.066479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:25.067496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:25.068181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:25.068945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:25.179918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96de1461-9d3e-48e5-a13a-c4b58f097c36 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "DELETE /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 204 len: 0 microversion: 2.91 time: 0.324205 Oct 11 01:27:25.185869 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1146/2323] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:27:24 2022] DELETE /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:27:25.203137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:25.203936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:25.211101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12,nova_api:UPDATE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:25.213621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:25.214212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:25.214669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:25.215949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:25.216419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:25.216949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:25.393100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:25.410843 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-149aef22-177a-4227-b8a8-91186582d418 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.363800 Oct 11 01:27:25.411831 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1178/2324] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:25 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:25.428597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-908efbdd-f07d-42d1-9088-6d76fa040999 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f1138845670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:26.162845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:26.177433 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-283bbb20-97d1-4129-b893-c8e76d30e628 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1471 microversion: 2.1 time: 0.990056 Oct 11 01:27:26.178450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1147/2325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:25 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1471 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:26.208436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:26.209061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:26.230034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.234262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.234751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:26.235601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.236069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.236492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:26.615986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:26.629806 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c56bd37-5066-4a3f-8723-74cd2875cb67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1500 microversion: 2.1 time: 0.435061 Oct 11 01:27:26.630661 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1148/2326] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:26 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1500 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:26.636641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:26.637696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:26.660962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.662404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.662864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:26.663736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.665037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.665497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:26.836088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:26.862543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:26.864372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae8400bca6484a35a5adbdb7413a6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76caac25b4dc4ea8a9f89ddd4fc540da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:26.874554 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d546e502-56e8-467a-8dbf-1e13f903978a tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 200 len: 1537 microversion: 2.91 time: 0.242586 Oct 11 01:27:26.881069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1149/2327] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:26 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:27:26.887241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:26.888161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:26.907738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.908568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.909284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:26.911064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:26.912009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:26.912645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.460374 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-908efbdd-f07d-42d1-9088-6d76fa040999 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/980b4c20-d239-40b1-8c79-0971a3078e5e" status: 202 len: 0 microversion: 2.1 time: 2.038925 Oct 11 01:27:27.465588 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1179/2328] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:27:25 2022] DELETE /compute/v2.1/os-floating-ips/980b4c20-d239-40b1-8c79-0971a3078e5e => generated 0 bytes in 2053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:27.491818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b18b72-7398-451b-828d-c8e45afda1e0", "tag": "a4385f15-1a56-4153-90e1-d4ac7468a21b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:27.513059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.513939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.514843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.529156 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] Creating event network-changed:a4385f15-1a56-4153-90e1-d4ac7468a21b for instance d3b18b72-7398-451b-828d-c8e45afda1e0 on n-h1-772273-9 Oct 11 01:27:27.535564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-706462de-e879-43f1-aaa7-b7920a70355e req-1ea7cf16-80ba-4d2f-8e8a-87ce8bae6582 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062730 Oct 11 01:27:27.536626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1180/2329] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:27.541974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:27.542875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:27.550835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.551582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.552176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.553054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.553651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.554403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.565213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:27.574894 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-142b7d98-4dab-4d38-b531-94082b8bd5ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.692502 Oct 11 01:27:27.577123 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1150/2330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:26 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:27.586580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:27.587558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:27.596549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.597286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.597893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.598810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.599455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.600043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.681688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a46950996b44164995eaf4238df6839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aefacad2da4218ace0f2330ac931ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:27.700416 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97904e01-4850-4a80-8f15-9f934be18ef6 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 200 len: 1250 microversion: 2.1 time: 0.160132 Oct 11 01:27:27.716221 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1181/2331] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:27 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 1250 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:27.733516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:27.743494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:27.757350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.759254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.759849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.761005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.762842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.773274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.818864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'flavor' on Instance uuid c9e8ad0e-ca96-49f3-8dd6-7c3754139535 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:27:27.879057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Cannot 'rescue' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state paused Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action HTTP/1.1 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 14 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:27:27.881310 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: {"rescue": {}} Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:27:27.882815 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'rescue' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state paused Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c9e8ad0e-ca96-49f3-8dd6-7c3754139535', 'body': {'rescue': {}}} Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 in vm_state paused. Cannot rescue while the instance is in this state. Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:27.883739 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state paused Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state paused Oct 11 01:27:27.885087 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:27.886464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 409 to user: Cannot 'rescue' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state paused {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:27.887633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92d16937-578c-4ff8-bdf5-924af00da843 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action" status: 409 len: 144 microversion: 2.1 time: 0.168212 Oct 11 01:27:27.888765 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1182/2332] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:27 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action => generated 144 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:27:27.894368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:27.895308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:27.897008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:27.902751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.903611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.904284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.905593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:27.907465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:27.908328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:27.915736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-650bdaa3-3003-4384-abe0-a8f37a1ad1b3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.333966 Oct 11 01:27:27.920893 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1151/2333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:27 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:27.933168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8792a536-1568-493f-aa41-3b9f572764a0 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Action: 'create', calling method: .version_select at 0x7f11349f98b0>, body: {"pool": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:28.314216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:28.322109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f138a25f-30ee-455e-aa59-8e743d23440c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1463 microversion: 2.1 time: 0.432101 Oct 11 01:27:28.336137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1183/2334] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:27 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1463 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:28.346500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:28.347228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:28.353565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.354242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.354910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.355801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.356404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.356979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.443855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c8aaae41-a554-4052-ad84-99db6432478c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action" status: 202 len: 0 microversion: 2.1 time: 0.106159 Oct 11 01:27:28.444497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1184/2335] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:28 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:28.459176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:28.460779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] [instance: 884e53d0-a2f4-4d16-b145-568fa0f7acc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:28.473008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.473868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.474556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.475492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.476265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.476896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.495652 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] HTTP exception thrown: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Request method failure captured: Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 HTTP/1.1 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMW8jvzi5IqdEE6JryCBAbmptWr1WL375fe6cZTLdULE5w43FFB4OhbGbBNtEejcFmtQB0t6vhuFRp9jpkpUFiLsG6xLKnKi3FxA4T8WsEDs_mTFXHC6L4KSxGfaIxmuBJy2RISKRLgZjGqcps-yMxU2hijN2LolHQEzJL1_7pL2Bnw Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.91 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 76caac25b4dc4ea8a9f89ddd4fc540da Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1444971970 Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:27:28.497615 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76caac25b4dc4ea8a9f89ddd4fc540da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76caac25b4dc4ea8a9f89ddd4fc540da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76caac25b4dc4ea8a9f89ddd4fc540da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76caac25b4dc4ea8a9f89ddd4fc540da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1444971970 Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 76caac25b4dc4ea8a9f89ddd4fc540da Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1444971970 Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-UnshelveToHostMultiNodesTest-1444971970-project Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ae8400bca6484a35a5adbdb7413a6891 Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1444971970-project Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. Oct 11 01:27:28.499161 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '884e53d0-a2f4-4d16-b145-568fa0f7acc5'} Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:28.500080 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. Oct 11 01:27:28.501405 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:28.503273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] Returning 404 to user: Instance 884e53d0-a2f4-4d16-b145-568fa0f7acc5 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:28.504321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d0a76a4-543d-46ad-b20f-e96a2fed7066 tempest-UnshelveToHostMultiNodesTest-1444971970 tempest-UnshelveToHostMultiNodesTest-1444971970-project] 10.222.0.66 "GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5" status: 404 len: 111 microversion: 2.91 time: 0.058502 Oct 11 01:27:28.505331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1185/2336] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:27:28 2022] GET /compute/v2.1/servers/884e53d0-a2f4-4d16-b145-568fa0f7acc5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:27:28.514745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:28.517314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:28.529745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.530267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.530698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.540492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:28.541020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:28.541422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:28.562142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:28.657680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:29.051258 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5acd94b-5f18-4d8a-8b8e-0419106403eb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1614 microversion: 2.1 time: 0.544596 Oct 11 01:27:29.060696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1186/2337] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:28 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1614 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:29.066148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:29.066767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:29.083807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:29.084568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:29.085204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:29.086926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:29.091063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:29.092015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:29.506650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:29.515313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2ba69fb-4dd8-4005-8b54-79546a160969 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1515 microversion: 2.1 time: 0.453520 Oct 11 01:27:29.529194 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1187/2338] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:29 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1515 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:29.529194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:29.529194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:29.543270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:29.544001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:29.544220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:29.544928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:29.545465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:29.545803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:29.580927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:30.374392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:30.389153 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b68d2fbf-aad9-494e-a155-9cfc06fd7914 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.868857 Oct 11 01:27:30.389751 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1188/2339] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:29 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:30.403178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:30.403985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] [instance: 14d158c4-f3de-4660-b630-d93f890d7122] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:30.417461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:30.418155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:30.419502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:30.420386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:30.421001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:30.421579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:30.453390 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] HTTP exception thrown: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Request method failure captured: Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 HTTP/1.1 Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMXhqSfZKRRupuFX4qyYP0uG39Ia6g7maPPpl_7B1LuJ0DDAQ_0RF0Xt4t53kC5skSJ0iFHBYC-vYCm6FyTnDI2xXR3GgGg6L7Vhfgc2ObpVXubaRoFLDSPLxOGidLafeNBwnb-gOYTMyJJasnZCCaoTZ7Cp0OOimahvvWzWrLgz-Dg Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 27aefacad2da4218ace0f2330ac931ca Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestBootFromVolume-1260592771 Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:27:30.456108 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/27aefacad2da4218ace0f2330ac931ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_27aefacad2da4218ace0f2330ac931ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/27aefacad2da4218ace0f2330ac931ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/27aefacad2da4218ace0f2330ac931ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestBootFromVolume-1260592771 Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 27aefacad2da4218ace0f2330ac931ca Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1260592771 Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestBootFromVolume-1260592771-project Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4a46950996b44164995eaf4238df6839 Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestBootFromVolume-1260592771-project Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. Oct 11 01:27:30.457538 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '14d158c4-f3de-4660-b630-d93f890d7122'} Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:30.458384 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. Oct 11 01:27:30.460433 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:30.465708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Returning 404 to user: Instance 14d158c4-f3de-4660-b630-d93f890d7122 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:30.471306 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d0e131ff-4d48-48b0-9ffc-4cc009f78a90 tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122" status: 404 len: 111 microversion: 2.1 time: 0.077387 Oct 11 01:27:30.473583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1189/2340] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:30 2022] GET /compute/v2.1/servers/14d158c4-f3de-4660-b630-d93f890d7122 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:27:30.486485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:30.488482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:30.501789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:30.504545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:30.505592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:30.509855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:30.511603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:30.513621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:30.921278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:30.929564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e68778f2-570e-4686-8c35-9e1748459a1a tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.454605 Oct 11 01:27:30.930358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1190/2341] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:30 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:30.943136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-196483ee-9d17-4cf8-ad2b-acea9f7cb5ec tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '.version_select at 0x7f11388a4dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:30.957682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-196483ee-9d17-4cf8-ad2b-acea9f7cb5ec tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:30.958177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-196483ee-9d17-4cf8-ad2b-acea9f7cb5ec tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:30.958616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-196483ee-9d17-4cf8-ad2b-acea9f7cb5ec tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:30.972989 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-196483ee-9d17-4cf8-ad2b-acea9f7cb5ec tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.035099 Oct 11 01:27:30.987892 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1191/2342] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:27:30 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:31.002749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b771e4-1918-4555-9f39-9129f8c34e8d", "tag": "2be78599-8905-41c2-9d67-10ec272bd21f"}, {"name": "network-changed", "server_uuid": "4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f", "tag": "67aecee7-6830-4299-89b8-239f4f966c4c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:31.046381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:31.046876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:31.047377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:31.088315 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Creating event network-changed:2be78599-8905-41c2-9d67-10ec272bd21f for instance 67b771e4-1918-4555-9f39-9129f8c34e8d on n-h1-772273-9 Oct 11 01:27:31.089083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] Creating event network-changed:67aecee7-6830-4299-89b8-239f4f966c4c for instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f on n-h2-772273-9 Oct 11 01:27:31.113484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-15059626-9435-4556-b2e6-75536a947411 req-eb5d86ef-afac-490e-88d7-ae08b3f4b09a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123757 Oct 11 01:27:31.115746 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1192/2343] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:31.133314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5662c1b7-f42c-421c-bc09-e98e5392f98a tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] Calling method '.version_select at 0x7f1138845310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:31.182692 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5662c1b7-f42c-421c-bc09-e98e5392f98a tempest-ServersTestBootFromVolume-1260592771 tempest-ServersTestBootFromVolume-1260592771-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306555011" status: 202 len: 0 microversion: 2.1 time: 0.062038 Oct 11 01:27:31.184596 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1193/2344] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:27:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306555011 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:31.300857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1059968803", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:31.380737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:27:32.231075 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8792a536-1568-493f-aa41-3b9f572764a0 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.308030 Oct 11 01:27:32.232580 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1152/2345] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:27:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:32.243784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:32.244710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:32.255442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.256251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.257579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.258901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.260225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.260658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.428400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:27:32.428400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:27:32.428400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:27:32.428400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:27:32.428400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:27:32.437181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.437760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.438972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.439865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.440421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.440948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.462653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:27:32.469714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:27:32.475035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:32.487786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:27:32.491302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:32.547090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-64525e4c-f50d-4101-9781-974d4df12a0d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251575 Oct 11 01:27:32.548799 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1194/2346] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:27:32.553895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:32.555055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:32.562026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.562799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.564082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.565203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.565870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.566510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.873442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:32.881641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23e77cd4-2c3a-4c74-b7f7-4307191c7584 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.647791 Oct 11 01:27:32.882238 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1153/2347] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:32 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:32.899399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:32.901693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:32.924107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.927650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.928683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.929590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:32.931975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:32.932617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:32.992609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'flavor' on Instance uuid c9e8ad0e-ca96-49f3-8dd6-7c3754139535 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:27:33.103807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:33.119691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea721f4d-0849-4bee-88a5-2a1156590ac7 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.567296 Oct 11 01:27:33.136937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1195/2348] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:32 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:33.168619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55ad4c20-d637-4d76-8c8f-ed15c03bd996 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f1138809430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:33.190941 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0c2051e-c336-45d6-a69a-c5902ecf0af6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action" status: 200 len: 32 microversion: 2.1 time: 0.307175 Oct 11 01:27:33.195475 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1154/2349] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:32 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:27:33.207535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1588263d-4330-4818-a872-5c61134d7904 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:33.213135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1588263d-4330-4818-a872-5c61134d7904 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:33.783221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1588263d-4330-4818-a872-5c61134d7904 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:33.795566 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1588263d-4330-4818-a872-5c61134d7904 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1213 microversion: 2.1 time: 0.597060 Oct 11 01:27:33.808970 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1155/2350] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:33 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1213 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:33.822071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc4abbc3-9988-426d-bfc8-c41a5fef9e28", "tag": "ba51674b-0705-44d3-830e-8f5303de41c9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:33.870674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:33.876945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:33.877795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:33.911666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] Creating event network-changed:ba51674b-0705-44d3-830e-8f5303de41c9 for instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 on n-h2-772273-9 Oct 11 01:27:33.932396 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8a21fe61-dbcf-4453-8e42-a11cf34719a8 req-f2d0373b-b9ba-46cc-a109-6b9a30f76b6b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116633 Oct 11 01:27:33.933363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1156/2351] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:33.938757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:33.939486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:33.946555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:33.947264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:33.947879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:33.948734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:33.949327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:33.949906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:34.500964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:34.511232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-678a8ed0-7579-4b6d-8b9e-2bf7c6dad587 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.576674 Oct 11 01:27:34.518026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1157/2352] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:33 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:34.533217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:34.537237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:34.554696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:34.556740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:34.557487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:34.558472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:34.560551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:34.561206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:35.085852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:35.096608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d098c35e-07eb-4bfa-9a07-8d2f4499b4e8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.576915 Oct 11 01:27:35.111375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1158/2353] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:34 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:35.119244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:35.119876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:35.126811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:35.127304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:35.128009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:35.128742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:35.129385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:35.129820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:35.170091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:35.633445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:35.651296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42a8d433-adb6-4236-80ad-fd289c5a44d9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.541838 Oct 11 01:27:35.652502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1159/2354] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:35 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:35.921784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b18b72-7398-451b-828d-c8e45afda1e0", "name": "network-vif-plugged", "status": "completed", "tag": "a4385f15-1a56-4153-90e1-d4ac7468a21b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:35.938420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:35.939451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:35.940112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:35.971708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] Creating event network-vif-plugged:a4385f15-1a56-4153-90e1-d4ac7468a21b for instance d3b18b72-7398-451b-828d-c8e45afda1e0 on n-h1-772273-9 Oct 11 01:27:35.978498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-872b993f-53d1-4337-9ddc-5b144fe6b2fd req-bc7ce354-4371-4045-9628-0f3a9619100b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323368 Oct 11 01:27:35.979395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1160/2355] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:35.988475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:35.990355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:36.009875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.010666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.011401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:36.012556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.013253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.013904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:36.833024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:36.862121 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21aade92-fd1c-4734-b4b3-6ce934893e7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.879942 Oct 11 01:27:36.865367 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1161/2356] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:35 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:36.879796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:36.882811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:36.893890 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55ad4c20-d637-4d76-8c8f-ed15c03bd996 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f" status: 202 len: 0 microversion: 2.1 time: 3.742680 Oct 11 01:27:36.894982 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1196/2357] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:27:33 2022] DELETE /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f => generated 0 bytes in 3757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:36.905418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:36.906283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:36.916318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.917717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.918565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:36.919612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.920285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.920951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:36.924450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.924961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.925585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:36.926467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:36.927267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:36.927905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:37.398845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:37.413836 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-882d3766-3b9a-402c-9247-e5df02c1039f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.517446 Oct 11 01:27:37.414682 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1197/2358] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:36 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:37.419499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:37.426489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:37.433111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:37.438672 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73f7eada-4295-4174-8c00-62e76a184d06 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.571346 Oct 11 01:27:37.440130 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1162/2359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:36 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:37.446733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f1134241820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:37.453077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:37.453570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:37.454010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:37.454714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:37.455769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:37.456189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:37.664499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a1a1faf5-169d-4632-8b81-9590a4c5c64f could not be found", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:27:37.665527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] HTTP exception thrown: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Request method failure captured: Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f HTTP/1.1 Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMZ0Rrm9VYrRuotipdV0UxUeEsSnTX1kZOqZXvEWKUDBNnXMDW3f9WoLnVqRe1rBewe0qGNI1XyztrpHYSLh0WpzpYkSQlNp-gBMKCTdUWJk34BRPs_kCzjHr8_G-m4VE-EgY7Tc2kQZWixmPu4U3f2gAAKex2A_y9gvGt60gkGqeNk Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5a8a8e45af9e47dbb736a99220c3135e Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:27:37.668216 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5a8a8e45af9e47dbb736a99220c3135e Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsTestJSON-1931258962-project Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: fb1f69ee35f44aaeae1529190566ea72 Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsTestJSON-1931258962-project Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: exception: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a1a1faf5-169d-4632-8b81-9590a4c5c64f'} Oct 11 01:27:37.669798 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:27:37.671187 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a1a1faf5-169d-4632-8b81-9590a4c5c64f could not be found Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0907832-c2f0-4f53-90e1-038dfb79e189'] Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f. Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.672512 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:37.674447 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:37.676079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.676079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.677294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Returning 404 to user: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:37.678343 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f0df8b3-7d01-42ea-9469-27d0fc43ae7c tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f" status: 404 len: 111 microversion: 2.1 time: 0.237277 Oct 11 01:27:37.679111 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1163/2360] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:27:37 2022] GET /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:27:37.693243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Calling method '.version_select at 0x7f11341e1a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:37.823135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a1a1faf5-169d-4632-8b81-9590a4c5c64f could not be found", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:27:37.823914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] HTTP exception thrown: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Request method failure captured: Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f HTTP/1.1 Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMZ0Rrm9VYrRuotipdV0UxUeEsSnTX1kZOqZXvEWKUDBNnXMDW3f9WoLnVqRe1rBewe0qGNI1XyztrpHYSLh0WpzpYkSQlNp-gBMKCTdUWJk34BRPs_kCzjHr8_G-m4VE-EgY7Tc2kQZWixmPu4U3f2gAAKex2A_y9gvGt60gkGqeNk Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5a8a8e45af9e47dbb736a99220c3135e Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:27:37.827854 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a8a8e45af9e47dbb736a99220c3135e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5a8a8e45af9e47dbb736a99220c3135e Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1931258962 Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-FloatingIPsTestJSON-1931258962-project Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: fb1f69ee35f44aaeae1529190566ea72 Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-FloatingIPsTestJSON-1931258962-project Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: exception: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a1a1faf5-169d-4632-8b81-9590a4c5c64f'} Oct 11 01:27:37.829211 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:27:37.829940 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a1a1faf5-169d-4632-8b81-9590a4c5c64f could not be found Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81ea3562-99a7-43cd-9317-1c0fc9fedfc9'] Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f. Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.831908 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:37.834162 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:37.836118 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f Oct 11 01:27:37.836118 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:37.836118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] Returning 404 to user: Floating IP not found for ID a1a1faf5-169d-4632-8b81-9590a4c5c64f {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:37.836118 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f78c1445-546c-41c1-b1e5-204967536e61 tempest-FloatingIPsTestJSON-1931258962 tempest-FloatingIPsTestJSON-1931258962-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f" status: 404 len: 111 microversion: 2.1 time: 0.145548 Oct 11 01:27:37.836118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1164/2361] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:27:37 2022] DELETE /compute/v2.1/os-floating-ips/a1a1faf5-169d-4632-8b81-9590a4c5c64f => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:27:37.899623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:37.900020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:37.921024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:37.921884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:37.926114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:37.928054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:37.928748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:37.930626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.158303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:38.173143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad8d0c37-df24-4bbc-91b8-bb5577b0b1a6 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.751049 Oct 11 01:27:38.174358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1198/2362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:37 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:38.179257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b771e4-1918-4555-9f39-9129f8c34e8d", "name": "network-vif-plugged", "status": "completed", "tag": "2be78599-8905-41c2-9d67-10ec272bd21f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:38.203607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:38.204355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:38.206804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.237825 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] Creating event network-vif-plugged:2be78599-8905-41c2-9d67-10ec272bd21f for instance 67b771e4-1918-4555-9f39-9129f8c34e8d on n-h1-772273-9 Oct 11 01:27:38.246342 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-10e728a6-94f5-4fa1-98bc-e9c2cb50a197 req-7feef2eb-c5e2-41f8-914c-5acc6bed428a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070437 Oct 11 01:27:38.247895 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1199/2363] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:38.335873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:38.352603 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c85598cd-9282-4dc7-8d72-614f6054efab tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.464779 Oct 11 01:27:38.355741 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1165/2364] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:37 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:38.440351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:38.440697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:38.447619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:38.448314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:38.449403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.450130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:38.450873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:38.451400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.462344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:38.463072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:38.477869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:38.484416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:38.485142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.486068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:38.487090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:38.487612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:38.964962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:38.974448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5898701-d38e-4812-a5a2-a9247349a9ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.540911 Oct 11 01:27:38.975155 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1200/2365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:38 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:39.053889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:39.067141 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-86d5c18a-8161-4227-a1ed-06bdd017860f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.608921 Oct 11 01:27:39.068397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1166/2366] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:38 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:39.196683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:39.197310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:39.210849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:39.211614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:39.212219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:39.213102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:39.213696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:39.214276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:39.378188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:39.378812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:39.386606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:39.387105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:39.387568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:39.388297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:39.388742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:39.389174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.176112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:40.191250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:40.192624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b0db441-775f-4a1b-916d-26bab22b8336 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.818333 Oct 11 01:27:40.193601 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1167/2367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:39 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:27:40.211459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:40.212288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:40.218509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:40.220846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:40.225200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.226134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6dad870-718d-4a50-99fc-e9418446db95 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 1.033125 Oct 11 01:27:40.226898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:40.227579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:40.228182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.243127 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1201/2368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:39 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:40.268251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:40.270615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:40.290317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:40.291263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:40.294404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.295752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:40.297296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:40.298585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.613876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:40.629949 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3995cb59-8fd9-442b-b0c9-5c12f9486095 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.431745 Oct 11 01:27:40.655435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1168/2369] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:40 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:40.661480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f", "name": "network-vif-plugged", "status": "completed", "tag": "67aecee7-6830-4299-89b8-239f4f966c4c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:40.683380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:40.683862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:40.684298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:40.700115 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] Creating event network-vif-plugged:67aecee7-6830-4299-89b8-239f4f966c4c for instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f on n-h2-772273-9 Oct 11 01:27:40.719758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f40e2afd-69eb-40f4-9c27-909fd77dab2c req-aa1dc70d-5797-4153-afd2-fd24131915a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062689 Oct 11 01:27:40.720502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1169/2370] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:40.773869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:40.785089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e371391-ba7b-4f1c-9821-e6adac53b8cc tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.528934 Oct 11 01:27:40.785694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1202/2371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:40 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:41.022216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c51d4a-6553-4530-885e-5eca6bba61f9", "tag": "9e1f45cd-3a59-40ab-b205-b4de386555f8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:41.058331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.058826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.059267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.083984 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] Creating event network-changed:9e1f45cd-3a59-40ab-b205-b4de386555f8 for instance c6c51d4a-6553-4530-885e-5eca6bba61f9 on n-h1-772273-9 Oct 11 01:27:41.094536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9bb010b4-6e47-48c9-9cce-c374f186641e req-9c1ceb18-7d00-40c0-9596-e7e7993f6983 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084482 Oct 11 01:27:41.096008 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1170/2372] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:41.219059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:41.219713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:41.233092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.234705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.235174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.237406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.240662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.241161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.262529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:41.263259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:41.275883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.281452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.281990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.286749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.287257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.287734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.645866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:41.668078 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d0edacac-1d27-40a8-917e-6651018d531d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.453644 Oct 11 01:27:41.668850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1203/2373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:41 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:41.683732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:41.684601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:41.685287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:41.695423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.696244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.697028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.698023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.698853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.700182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.701717 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2711c472-f8c9-4e2e-9072-a3033151f6ba tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.443222 Oct 11 01:27:41.703303 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1171/2374] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:41 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:27:41.810041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:41.811175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:41.818669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.819482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.820168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:41.821147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:41.821847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:41.822473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:42.017831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:42.026445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1530d68-a389-4261-bc27-ebb6f2dcf638 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.354090 Oct 11 01:27:42.028465 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1204/2375] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:41 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:42.118340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:42.135078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d9fb8fc-b37c-4742-b354-4b0c1c38c6e6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.330469 Oct 11 01:27:42.136809 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1172/2376] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:41 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:27:42.693457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:42.694026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:42.702768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:42.703708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:42.705352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:42.706031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:42.707295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:42.708574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:42.709193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:42.709778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:42.730186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:42.730815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:42.740595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:42.741105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:42.742544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:42.743787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:42.744887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:42.745533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:43.512094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:43.526424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25e776dd-1ff0-47e0-85d5-e1a6150094dc tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1323 microversion: 2.1 time: 0.800445 Oct 11 01:27:43.544571 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1173/2377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:42 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:43.553904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4abbc3-9988-426d-bfc8-c41a5fef9e28", "name": "network-vif-plugged", "status": "completed", "tag": "ba51674b-0705-44d3-830e-8f5303de41c9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:43.592900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:43.593391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:43.593878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:43.621262 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] Creating event network-vif-plugged:ba51674b-0705-44d3-830e-8f5303de41c9 for instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 on n-h2-772273-9 Oct 11 01:27:43.638870 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b8d4baa5-8847-49a5-b7df-74d7b922c61f req-7ea7e9b8-d819-47e7-9756-8e9f5595f92f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092909 Oct 11 01:27:43.639813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1174/2378] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:43.645022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:43.645855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:43.664214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:43.664758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:43.665200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:43.669923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:43.670721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:43.672092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:43.789007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:43.901291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:43.914943 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-307247c4-35f6-491f-834d-e12d0b96fd53 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 1.226442 Oct 11 01:27:43.928449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1205/2379] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:42 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:43.933453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:43.934185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:43.954821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:43.957363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:43.958058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:43.959035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:43.959753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:43.960438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:44.266101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:44.280643 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-faadc3b7-fcc5-4dcd-a1a8-693ce24efe2f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1308 microversion: 2.1 time: 0.639374 Oct 11 01:27:44.315312 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1175/2380] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:43 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1308 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:44.510805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:44.521135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3117970b-92b7-42ef-8dc5-404fb447e4ec tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.591411 Oct 11 01:27:44.521923 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1206/2381] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:43 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:44.553086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:44.554129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:44.562218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:44.562838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:44.563411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:44.564216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:44.564785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:44.565307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:44.965365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:44.967731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:44.989355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:44.991093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:44.992976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:44.995769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:44.996252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:44.996688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:45.236280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:45.245445 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6bf5482-58ae-47dd-b906-d3c7ccc3b0d2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1515 microversion: 2.1 time: 0.696708 Oct 11 01:27:45.277441 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1176/2382] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:44 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1515 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:45.297194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:45.297827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 67b771e4-1918-4555-9f39-9129f8c34e8d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:45.322735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:45.323707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:45.324554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:45.326061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:45.326896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:45.327762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.159645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:46.173670 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2cb5c1f-5a09-4815-8934-f7667cd10f45 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 1.222998 Oct 11 01:27:46.175330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1207/2383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:44 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:46.188394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:46.189551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:46.202191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:46.211540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.212680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.215034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.216222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.217264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f82ffb34-fe1f-444a-b948-bb2aed43f716 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d" status: 200 len: 1515 microversion: 2.1 time: 0.928476 Oct 11 01:27:46.217952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.218548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1177/2384] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:45 2022] GET /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d => generated 1515 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:46.219948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.254470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:46.255103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:46.266456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.267145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.267796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.268700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.269350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.269942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.900421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:46.908304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-325df188-7947-4446-94e2-e4a94a8e577c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.674902 Oct 11 01:27:46.915543 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1178/2385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:46 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:46.925457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:46.926679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:46.945614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.946354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.946992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.947926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:46.948868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:46.949466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:46.954869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:46.964445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c0bcf27-1d84-44f0-870a-4c637d3148d2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1487 microversion: 2.1 time: 0.785411 Oct 11 01:27:46.965511 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1208/2386] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:46 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1487 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:46.998120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:47.016182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.017164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.018934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.122962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:27:47.178935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:47.224544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2646a14b-90b6-44ef-a7b4-fcb970267cfc tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28/action" status: 202 len: 0 microversion: 2.1 time: 0.230854 Oct 11 01:27:47.228685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1209/2387] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:46 2022] POST /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:27:47.246845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:47.252495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:47.273340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.275146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.277683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.279643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.281952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.284724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.313351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:47.323997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54fb52a6-5cee-431c-93e7-c693884a031e tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 200 len: 1516 microversion: 2.1 time: 0.405020 Oct 11 01:27:47.344059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1179/2388] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:46 2022] GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:47.350805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:47.351733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:47.358458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.359244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.359974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.360914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.361569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.362194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.921700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:47.949464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:47.953072 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff89578b-92e9-455a-a8ad-82d9350b1569 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.607873 Oct 11 01:27:47.954104 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1180/2389] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:47 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:47.963731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:47.972128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:47.981150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.984093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.986394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.989164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:47.991945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:47.994792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:47.995965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:48.004418 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f775137-3a45-4a60-ae08-cc05f5d59265 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.774061 Oct 11 01:27:48.008120 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1210/2390] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:47 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:48.021752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:48.027253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:48.044011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:27:48.052574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.053213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.056579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.057746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.058336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.058884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.212008 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2530cfc3-14dc-4e74-80ba-70574f34593c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 204 len: 0 microversion: 2.1 time: 0.256318 Oct 11 01:27:48.217853 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1181/2391] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:27:47 2022] DELETE /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:27:48.230116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:48.235210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:48.249023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.249400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.249863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.250613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.254374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.254938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.763021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:48.775704 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75b7a91a-0e38-4c18-99ac-a6219b9f6219 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.765374 Oct 11 01:27:48.795135 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1211/2392] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:48 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:48.795986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:48.805795 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-717437ca-a762-4565-9ff5-e87e397b9b9b tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 200 len: 1522 microversion: 2.1 time: 0.581305 Oct 11 01:27:48.806837 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1182/2393] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:48 2022] GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:48.811939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c51d4a-6553-4530-885e-5eca6bba61f9", "name": "network-vif-plugged", "status": "completed", "tag": "9e1f45cd-3a59-40ab-b205-b4de386555f8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:48.825953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.826686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.827260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.842812 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] Creating event network-vif-plugged:9e1f45cd-3a59-40ab-b205-b4de386555f8 for instance c6c51d4a-6553-4530-885e-5eca6bba61f9 on n-h1-772273-9 Oct 11 01:27:48.854984 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c0f816fa-04a1-4f90-abea-1060b4e4ae09 req-2e72529e-7886-450e-ab1b-4b42732ed97d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046699 Oct 11 01:27:48.856373 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1183/2394] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:48.978589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:48.979557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:48.996360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.996857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:48.997292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:48.998008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:48.998460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:49.005048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:49.014372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1464660865", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:49.107298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:27:49.767511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:49.780259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d8859ea-f551-44c9-8c46-22ac12065d7b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.805948 Oct 11 01:27:49.781828 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1184/2395] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:48 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:27:49.796925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:49.798435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:49.808237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:49.809149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:49.809625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:49.810475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:49.811317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:49.812025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:49.989164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:27:49.989698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:27:49.990388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:27:49.990972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:27:49.991807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:27:50.002258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.002741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.003174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.004088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.005580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.006143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.044496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Getting quotas for project 26ea60e7ee0040c3973093f1a640ec93. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:27:50.066457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Getting quotas for user 0951c4b4cb6e42cf989b8078b8889aed and project 26ea60e7ee0040c3973093f1a640ec93. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:27:50.085119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:27:50.087631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:27:50.143016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:50.152667 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b1ec0e5-fbeb-4249-9c01-d70a5c059c7e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1313 microversion: 2.1 time: 0.368961 Oct 11 01:27:50.168184 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1185/2396] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:49 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:50.175148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:50.176710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:50.183648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.184512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.184677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6e434c1-b298-4486-85be-e314fb3a8f66 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386999 Oct 11 01:27:50.185367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.186302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.187153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.187837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.188824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1212/2397] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:27:50.198312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:50.199196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:50.226685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.227198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.227679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.233224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.233554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.233998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.549214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:50.559377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-692a0669-fbf3-491f-8655-e24010cf7907 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.389145 Oct 11 01:27:50.564455 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1186/2398] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:50 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:50.573672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf94bc46-6862-42b5-9326-8ffaef14e1f8 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:50.576258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf94bc46-6862-42b5-9326-8ffaef14e1f8 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:50.592052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:50.602192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a06efcc-fb74-42ed-bbf4-a32c9ef592c3 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 200 len: 1522 microversion: 2.1 time: 0.412249 Oct 11 01:27:50.604494 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1213/2399] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:50 2022] GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:50.647948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf94bc46-6862-42b5-9326-8ffaef14e1f8 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:50.655908 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf94bc46-6862-42b5-9326-8ffaef14e1f8 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1217 microversion: 2.1 time: 0.089947 Oct 11 01:27:50.656668 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1187/2400] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:50 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:50.733224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a646e741-9f4c-410a-9c7d-33b285a4ce43 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Action: 'create', calling method: .version_select at 0x7f1138845940>, body: {"pool": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:50.807055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:50.808229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:50.826155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.826669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.827218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:50.827962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:50.833360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:50.834049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.195022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:51.204461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31d5fc4f-0981-4d21-a136-a86a6c0fd444 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.401320 Oct 11 01:27:51.209189 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1188/2401] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:50 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:27:51.237998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:51.238871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:51.253858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.254804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.256738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.258689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.258689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.258689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.569037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:51.583695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-337b2680-573a-4214-bba5-1da340edff17 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1462 microversion: 2.1 time: 0.357739 Oct 11 01:27:51.585743 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1189/2402] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:51 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:51.619083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b18b72-7398-451b-828d-c8e45afda1e0", "name": "network-vif-deleted", "tag": "a4385f15-1a56-4153-90e1-d4ac7468a21b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:51.649277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.650690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.651595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.671115 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] Creating event network-vif-deleted:a4385f15-1a56-4153-90e1-d4ac7468a21b for instance d3b18b72-7398-451b-828d-c8e45afda1e0 on n-h1-772273-9 Oct 11 01:27:51.679035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6c458eef-a766-4651-9af6-34615757f7c2 req-82c2c63c-de72-48d7-8fc2-cb6910ff48ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090932 Oct 11 01:27:51.680622 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1190/2403] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:51.689351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:51.690706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:51.707259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.708184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.708842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.709861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.710477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.711062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:51.943693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:51.955454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acdbafed-0984-417f-8d8d-721882ad31c4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.273345 Oct 11 01:27:51.960060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1191/2404] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:51 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:51.968773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:51.971292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:51.988171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:51.988881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:51.989541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.002122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:52.002906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:52.005263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.338743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:52.356505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:27:52.374757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:27:52.375572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:27:52.376052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:27:52.376463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:27:52.376877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:27:52.388052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:52.716576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5f01e7b-e4c2-4c47-b766-149b1a50bd15 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9/action" status: 202 len: 0 microversion: 2.1 time: 0.755401 Oct 11 01:27:52.717868 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1192/2405] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:27:51 2022] POST /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:27:52.724616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:52.725566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:52.732728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:52.733587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:52.734395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.735513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:52.740364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:52.741108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.758855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] HTTP exception thrown: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 HTTP/1.1 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:27:52.761749 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:27:52.763238 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd3b18b72-7398-451b-828d-c8e45afda1e0'} Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:52.763985 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:27:52.765132 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:52.768069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 404 to user: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:52.772162 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2296d75e-623c-4c40-9c18-e37a13e2b5cd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 404 len: 111 microversion: 2.1 time: 0.051377 Oct 11 01:27:52.774149 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1193/2406] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:52 2022] GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:27:52.786201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:52.787484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:52.804824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:52.805334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:52.805778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.806503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:52.806961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:52.807417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:52.963855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:52.980602 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1aace033-b15e-4c2b-9f5f-18d0e4d35561 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1275 microversion: 2.1 time: 0.205046 Oct 11 01:27:52.995379 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1194/2407] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:52 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:53.001864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:53.002769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:53.010489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:53.011308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:53.012069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:53.013057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:53.013749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:53.014442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:53.763297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:53.774476 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-827267fb-97de-49a5-9016-f7bb523a3e48 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.777543 Oct 11 01:27:53.803132 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1195/2408] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:52 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:53.828144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:53.829109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:53.852514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:53.853009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:53.853451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:53.854165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:53.854731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:53.869501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:54.659313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:54.688206 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e10d058-7500-4c2e-88f3-5b8457c23337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1471 microversion: 2.1 time: 0.880510 Oct 11 01:27:54.704308 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1196/2409] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:53 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1471 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:54.719918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:54.727220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:54.728707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:54.742236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:54.742902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:54.743487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:54.744599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:54.745503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:54.746170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:54.951406 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62e14571-7534-4795-8a22-1aa762d95a26 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.244705 Oct 11 01:27:54.952621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1197/2410] 10.222.0.66 () {58 vars in 1230 bytes} [Tue Oct 11 01:27:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:27:54.957639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:54.958552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:54.967135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:54.968004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:54.968612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:54.969699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:54.970333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:54.971026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:54.976707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:55.012700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a646e741-9f4c-410a-9c7d-33b285a4ce43 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.406063 Oct 11 01:27:55.022130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1214/2411] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:27:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:55.029013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:55.041367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:55.049315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.049803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.050236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.050945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.057222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.057805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.266871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:55.268711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:55.278996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3720fe74-13a4-45b3-8ccc-69adb1dc9d27 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1275 microversion: 2.1 time: 0.253186 Oct 11 01:27:55.279994 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1215/2412] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:55 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:55.280338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79f11c32-835e-4dee-ac1d-fd5dff8436fa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.326318 Oct 11 01:27:55.281514 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1198/2413] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:54 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:55.286891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:55.288120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:55.297927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-466b74c4-063b-48e1-8e4e-7ce148a86b62 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:55.304651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.305388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.305983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.306885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.307527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.308106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-466b74c4-063b-48e1-8e4e-7ce148a86b62 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:27:55.315529 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 01:27:55.316975 n-d-772273-9 devstack@n-api.service[120494]: action_args: {} Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:55.317803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:55.319171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:55.320392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:27:55.320392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:27:55.320392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 01:27:55.320392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:27:55.325780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-466b74c4-063b-48e1-8e4e-7ce148a86b62 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:55.329009 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-466b74c4-063b-48e1-8e4e-7ce148a86b62 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.044340 Oct 11 01:27:55.329728 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1199/2414] 10.222.0.66 () {58 vars in 1182 bytes} [Tue Oct 11 01:27:55 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:27:55.337959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50f05da3-ba82-4be0-b744-fd2ecb7e6692 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Action: 'create', calling method: .version_select at 0x7f11343000d0>, body: {"pool": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:55.666474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:55.676865 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9bb83e9-4db5-4524-96f3-d4204e821a0f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.395755 Oct 11 01:27:55.680412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1216/2415] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:55 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:55.685648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:55.713479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:55.713479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:55.726271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.726752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.727646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.730025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.733765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.748277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.795456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:27:55.857390 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e98ad1f1-0d15-4db3-960e-03f9273f442f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.175321 Oct 11 01:27:55.857829 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1217/2416] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:27:55 2022] GET /compute/v2.1/servers => generated 683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:55.868973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:55.869829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:55.882170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.884313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.887124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:55.888106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:55.889884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:55.893635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.296148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:56.310964 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99fbf642-6b4f-4202-949c-90a149d118ac tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1471 microversion: 2.1 time: 0.451419 Oct 11 01:27:56.312488 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1218/2417] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:55 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:56.333258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:56.344146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:56.344604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.servers [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Removing options 'limit' from query {{(pid=120493) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 01:27:56.345304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:56.353157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.353647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.354085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.355369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.355848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.356269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.409642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:27:56.451265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d0835af-7468-439e-96ae-78e31a60f019 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.137413 Oct 11 01:27:56.459621 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1219/2418] 10.222.0.66 () {58 vars in 1144 bytes} [Tue Oct 11 01:27:56 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:56.462616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:56.463309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:56.470324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.471726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.472163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.473346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.474648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.476469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.838172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:56.855306 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88ab54c5-8ce2-453d-b123-44c3b25a9e9c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.401635 Oct 11 01:27:56.857137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1220/2419] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:56 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:56.863602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:56.864796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:56.874443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.878069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.879070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:56.883097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:56.884467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:56.885947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:57.348961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:57.358236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-42696c8b-ea14-4761-adbb-a618ec729177 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.499400 Oct 11 01:27:57.361787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1221/2420] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:56 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:57.369369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a91639d4-e3e3-42fb-8408-7c5ba4042ef2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a91639d4-e3e3-42fb-8408-7c5ba4042ef2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:27:57.380428 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 01:27:57.381772 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '-1' Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:57.382753 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.384259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 01:27:57.385513 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:57.387566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a91639d4-e3e3-42fb-8408-7c5ba4042ef2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:57.389100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a91639d4-e3e3-42fb-8408-7c5ba4042ef2 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024704 Oct 11 01:27:57.389770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1222/2421] 10.222.0.66 () {58 vars in 1142 bytes} [Tue Oct 11 01:27:57 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:27:57.398126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:57.398997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:57.407660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:57.408544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:57.409086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:57.410051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:57.410572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:57.411201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:57.783530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:57.804514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf1214fa-d631-4808-9bc7-f89d3a891812 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.413510 Oct 11 01:27:57.808961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1223/2422] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:57 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:57.814666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:57.815882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:57.824744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:57.825582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:57.826244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:57.827241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:57.827961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:57.828598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:58.415330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:58.431041 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ea84066-8382-4291-b3e9-9861a7813baf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.620098 Oct 11 01:27:58.434199 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1224/2423] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:57 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:58.441413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7280b6d-ce0c-4fb5-8692-c65c9187cdf9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7280b6d-ce0c-4fb5-8692-c65c9187cdf9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:27:58.456085 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 01:27:58.457664 n-d-772273-9 devstack@n-api.service[120493]: action_args: {} Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'testing' Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:27:58.458545 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.460277 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 01:27:58.461649 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:27:58.464358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7280b6d-ce0c-4fb5-8692-c65c9187cdf9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:27:58.465414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7280b6d-ce0c-4fb5-8692-c65c9187cdf9 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029936 Oct 11 01:27:58.466475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1225/2424] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:27:58 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:27:58.472580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:58.474607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:58.492873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:58.493387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:58.493835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:58.494560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:58.495019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:58.495481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:58.767441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:58.781661 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04e23c79-2d2c-4da6-bc67-4ddd7ba35766 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.313898 Oct 11 01:27:58.798668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1226/2425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:58 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:58.872429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e90468bc-ed18-46bc-9069-780dc0f73079 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Action: 'create', calling method: .version_select at 0x7f11388454c0>, body: {"keypair": {"name": "tempest-keypair-724080920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVmmw6Er4xGyBtX4MaAqxyOsgC3RW0SMSrSo8x7oV+imiBb9I0Mgw+iAVXiS39ir4nX1ox81kfeOXLrhDoVdUgqXMlJuB6f7Oy+Z0QeHyYhS2GAkVH6kzbNDxZY/Sp7Kw=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:58.893261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e90468bc-ed18-46bc-9069-780dc0f73079 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for project e967a2d138324b878186862d1b6ee2e0. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:27:58.901034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e90468bc-ed18-46bc-9069-780dc0f73079 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for user 52a739b9413e414385c9a118b65ff828 and project e967a2d138324b878186862d1b6ee2e0. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:27:58.931397 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e90468bc-ed18-46bc-9069-780dc0f73079 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131450 Oct 11 01:27:58.932744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1227/2426] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:27:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:58.939043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:58.939979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:58.948530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:58.949442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:58.950189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:58.951266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:58.951828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:58.952324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.218823 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50f05da3-ba82-4be0-b744-fd2ecb7e6692 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.887768 Oct 11 01:27:59.227581 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1200/2427] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:27:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:59.230973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c51d983-3655-40ec-b406-463a99857c7d tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:59.236106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c51d983-3655-40ec-b406-463a99857c7d tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:59.236778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c51d983-3655-40ec-b406-463a99857c7d tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:59.252685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.servers [None req-0c51d983-3655-40ec-b406-463a99857c7d tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Flavor 'non_existing_flavor' could not be found {{(pid=120494) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 11 01:27:59.255525 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c51d983-3655-40ec-b406-463a99857c7d tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.035134 Oct 11 01:27:59.256825 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1201/2428] 10.222.0.66 () {58 vars in 1178 bytes} [Tue Oct 11 01:27:59 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:27:59.262182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:59.269257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:59.275140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.275879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.276586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.288477 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ce921cd-09fc-4462-8895-9e3a4659271a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.353716 Oct 11 01:27:59.289066 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1228/2429] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:58 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:59.293940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:59.294685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:59.301413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.302016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.302522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.303324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.304403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.305800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.307689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] Creating event network-changed:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:27:59.314585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2ef467b6-a119-460b-bed7-63e593ed5760 req-a9fe99b5-734d-4e4e-afbf-ed501bbaea7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055529 Oct 11 01:27:59.316837 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1202/2430] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:27:59.323693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-928067e2-dacd-4c6d-acc0-1f17303a22c0 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Action: 'create', calling method: .version_select at 0x7f11341e1c10>, body: {"pool": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:27:59.573167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:59.586519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e7bde2a-3a22-4e04-8c48-ed1b2b4f8cee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.295996 Oct 11 01:27:59.587980 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1229/2431] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:59 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:27:59.593042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:59.599036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:27:59.600226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:27:59.606951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.607875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.608542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.609549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.610374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.611024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.697703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:27:59.720875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6409bb85-d837-4c6b-ad68-da142a6d5449 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.131246 Oct 11 01:27:59.722251 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1230/2432] 10.222.0.66 () {58 vars in 1174 bytes} [Tue Oct 11 01:27:59 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:27:59.727745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:27:59.731944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:27:59.739720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.740605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.741747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:27:59.742729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:27:59.743484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:27:59.744125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.128875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:00.147851 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6800ead-1251-4a25-824c-124f8117bcce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.420154 Oct 11 01:28:00.152445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1231/2433] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:27:59 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:00.180202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:00.203932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:00.208916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:28:00.221189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.221675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.222105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.226941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.227565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.228016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.463654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96f9d3d1-6799-477f-a7ef-5d20e99b36bd tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.294853 Oct 11 01:28:00.466079 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1232/2434] 10.222.0.66 () {58 vars in 1184 bytes} [Tue Oct 11 01:28:00 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:28:00.484444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:00.486405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:00.493560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:00.504974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.505721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.506346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.507790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.510421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.511041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.653340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:00.759539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:00.769842 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ce10255-a6f2-4aac-8c2a-21a6f16d2019 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.302669 Oct 11 01:28:00.789716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1233/2435] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:00 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:00.800476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:00.801230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:00.813467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.813971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.814413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:00.820780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:00.824166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:00.824166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.149850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:01.159762 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14ed2578-09c5-4c94-a3d3-2ebbc58c08f3 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.368275 Oct 11 01:28:01.160564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1234/2436] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:00 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:01.166543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:01.185988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:01.187066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:28:01.193886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.195365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.195960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.196871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.197475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.198146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.231619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:28:01.275744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:01.294840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.296490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.296986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.638748 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cf7cf71-9148-456e-afc2-9ef4529a7e6c tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.475648 Oct 11 01:28:01.639627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1235/2437] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:28:01 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:01.645150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:01.645911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:01.658937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.661368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.663707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.664712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.667221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.667994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.865956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-928067e2-dacd-4c6d-acc0-1f17303a22c0 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.547079 Oct 11 01:28:01.867644 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1203/2438] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:27:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:01.883246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:01.884299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:01.892066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.892714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.893372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.894109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:01.894578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:01.898503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:01.943062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:01.954591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62c8f867-3391-484d-bc10-6ea50db78d78 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.313591 Oct 11 01:28:01.955558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1236/2439] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:01 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:01.962918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f1aa927-4a9a-414d-96b3-1aa751c64f73 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:01.969880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f1aa927-4a9a-414d-96b3-1aa751c64f73 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:01.984169 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f1aa927-4a9a-414d-96b3-1aa751c64f73 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025605 Oct 11 01:28:01.987891 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1237/2440] 10.222.0.66 () {58 vars in 1178 bytes} [Tue Oct 11 01:28:01 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:28:01.998225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:02.000777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:02.015520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.016584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.016584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:02.019021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.022629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.023500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:02.180863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:02.201259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5369db7-d378-4a01-a007-3a7a266ca2f5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.322257 Oct 11 01:28:02.220036 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1204/2441] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:01 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:02.227758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-97da762d-5cf1-4fb1-910b-4b22df03312a tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Action: 'create', calling method: .version_select at 0x7f113402fb80>, body: {"pool": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:02.271234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:02.289945 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d96c1bdd-758a-4f55-9d31-5997247ec54d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.302305 Oct 11 01:28:02.291444 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1238/2442] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:01 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:02.299102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:02.305601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:02.306288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Searching by: {'deleted': False, 'project_id': '4edd07cb225141e2913b7fcb0c884425'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:28:02.313116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.313721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.314165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:02.315796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.317201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.318492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:02.384208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:28:02.453219 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a77436f-2be6-4863-9db8-00bde3b6115f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.160581 Oct 11 01:28:02.456487 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1239/2443] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:28:02 2022] GET /compute/v2.1/servers => generated 683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:02.464726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:02.471694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:02.481912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.488600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.489010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:02.489860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:02.490472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:02.490992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.038050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:03.049287 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63d43904-08fa-4c7b-9e0c-c59bef43b449 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.591570 Oct 11 01:28:03.051653 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1240/2444] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:02 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:03.061405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:03.063466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:03.104389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.107053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.107696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.110236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.112652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.113106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.151082 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] HTTP exception thrown: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 HTTP/1.1 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:03.153686 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:03.155261 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd3b18b72-7398-451b-828d-c8e45afda1e0'} Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:03.156180 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:03.157564 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:03.204553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 404 to user: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:03.209235 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6348989-24dc-4f4a-8bbc-ced6524e199f tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 404 len: 111 microversion: 2.1 time: 0.156199 Oct 11 01:28:03.214050 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1241/2445] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:28:03 2022] DELETE /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:28:03.220586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:03.221448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:03.234597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.236359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.237019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.239432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.240086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.241183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.698560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:03.712555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa9d6a84-73b4-4ddd-a7b9-0393ef3ae6ec tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.493841 Oct 11 01:28:03.713643 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1242/2446] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:03 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:03.727392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:03.728679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 67b771e4-1918-4555-9f39-9129f8c34e8d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:03.741616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.742787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.743967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.745343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:03.747965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:03.750031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:03.798639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 67b771e4-1918-4555-9f39-9129f8c34e8d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:28:03.986693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ca7557c-ef2e-4c50-b566-31cf30786346 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "DELETE /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d" status: 204 len: 0 microversion: 2.1 time: 0.271133 Oct 11 01:28:03.990730 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1243/2447] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:28:03 2022] DELETE /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:28:04.002143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:04.003371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:04.026492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:04.027801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:04.028724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:04.038627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:04.041619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:04.043692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:04.457392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:04.465510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c7d586a-688c-4ff6-b92d-2fb417b3df8c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.471214 Oct 11 01:28:04.466314 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1244/2448] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:03 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:04.486651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:04.486856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:04.500103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:04.500284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:04.500661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:04.501375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:04.502424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:04.502424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:04.890171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:05.158102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:05.168169 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a808559e-ace7-436f-a6d2-04f06c1be189 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.685685 Oct 11 01:28:05.169011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1245/2449] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:04 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:05.184388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:05.184836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:05.194634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.195686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.197894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:05.199729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.200425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.201533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:05.232461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:28:05.252071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:05.329893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7178499f-7ab1-4c22-8b1f-64be7402e742 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 204 len: 0 microversion: 2.1 time: 0.159388 Oct 11 01:28:05.331412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1246/2450] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:28:05 2022] DELETE /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:28:05.339989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:05.341238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:05.347538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.348101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.348476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:05.349180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.349637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.350408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:05.655366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:05.669645 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-244729e5-0d37-49ac-ba50-5a72a739b1b4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1501 microversion: 2.1 time: 0.336383 Oct 11 01:28:05.670092 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1247/2451] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:05 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:05.684699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1331031732", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1fb45a93-24c8-48c1-abda-fb03680d8024"}], "security_groups": [{"name": "tempest-securitygroup--1287608999"}], "key_name": "tempest-keypair-724080920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:05.879323 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-97da762d-5cf1-4fb1-910b-4b22df03312a tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.657735 Oct 11 01:28:05.880281 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1205/2452] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 01:28:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:05.887637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:05.890608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:05.899930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.900885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.901496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:05.902540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:05.909021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] validate_networks() for [('1fb45a93-24c8-48c1-abda-fb03680d8024', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:28:05.914558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:05.916567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:06.674255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:06.684757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0497ea3-df5e-4785-a9b5-bc69309c9b43 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.801078 Oct 11 01:28:06.699423 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1206/2453] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:05 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:06.707016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:06.707910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: d3b18b72-7398-451b-828d-c8e45afda1e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:06.715854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:06.716647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:06.717377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:06.718280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:06.719680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:06.720327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:06.746889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] HTTP exception thrown: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 HTTP/1.1 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:28:06.749698 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:06.750937 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd3b18b72-7398-451b-828d-c8e45afda1e0'} Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:06.752008 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. Oct 11 01:28:06.753130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:06.755175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 404 to user: Instance d3b18b72-7398-451b-828d-c8e45afda1e0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:06.756599 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ddbacf11-e08e-4e8a-91c5-4b8419f0f039 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0" status: 404 len: 111 microversion: 2.1 time: 0.055556 Oct 11 01:28:06.758916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1207/2454] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:06 2022] GET /compute/v2.1/servers/d3b18b72-7398-451b-828d-c8e45afda1e0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:28:06.764464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:06.765402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:06.773144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:06.773994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:06.774674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:06.776132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:06.776883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:06.777679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.007837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:07.024851 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1c0d059-4bc6-4714-a94b-518959434568 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.256731 Oct 11 01:28:07.026086 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1208/2455] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:06 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:07.033555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25e6ef33-8a07-4a50-815b-d3f3c2a95eac"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:07.042582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:07.055564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.059715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.060463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.061976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.064092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.066494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.125471 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Cannot 'attach_volume' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state rescued Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/os-volume_attachments HTTP/1.1 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 74 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:28:07.127513 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: {"volumeAttachment": {"volumeId": "25e6ef33-8a07-4a50-815b-d3f3c2a95eac"}} Oct 11 01:28:07.128803 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'attach_volume' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state rescued Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': 'c9e8ad0e-ca96-49f3-8dd6-7c3754139535', 'body': {'volumeAttachment': {'volumeId': '25e6ef33-8a07-4a50-815b-d3f3c2a95eac'}}} Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:07.129485 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state rescued Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:07.130642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state rescued Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 409 to user: Cannot 'attach_volume' instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 while it is in vm_state rescued {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:07.131951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d491b902-2f64-4c02-8e1d-0838c78dd928 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.101683 Oct 11 01:28:07.137370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1209/2456] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:28:07 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:28:07.144725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5ca7fd9-09b2-4853-968a-ae0c62608701 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f113402fa60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:07.498042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for project e967a2d138324b878186862d1b6ee2e0. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:07.506642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for user 52a739b9413e414385c9a118b65ff828 and project e967a2d138324b878186862d1b6ee2e0. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:07.526286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:28:07.527010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:28:07.527685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:28:07.529070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:28:07.530252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:28:07.544620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.546746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.548754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.551793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.552554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.553303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.580455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for project e967a2d138324b878186862d1b6ee2e0. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:07.613599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Getting quotas for user 52a739b9413e414385c9a118b65ff828 and project e967a2d138324b878186862d1b6ee2e0. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:07.636040 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5ca7fd9-09b2-4853-968a-ae0c62608701 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/0d6b05f3-4fc0-4db1-9bca-b5e3055cc140" status: 200 len: 142 microversion: 2.1 time: 0.497359 Oct 11 01:28:07.637238 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1210/2457] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:28:07 2022] GET /compute/v2.1/os-floating-ips/0d6b05f3-4fc0-4db1-9bca-b5e3055cc140 => generated 142 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:07.644676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b771e4-1918-4555-9f39-9129f8c34e8d", "name": "network-vif-deleted", "tag": "2be78599-8905-41c2-9d67-10ec272bd21f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:07.647008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:28:07.650040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:28:07.673112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.673723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.674231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.688061 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] Creating event network-vif-deleted:2be78599-8905-41c2-9d67-10ec272bd21f for instance 67b771e4-1918-4555-9f39-9129f8c34e8d on n-h1-772273-9 Oct 11 01:28:07.699984 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7296e523-10e7-4f4d-842e-79ecdadbe451 req-9bd182bd-3a1d-4ca9-8970-7d0e68dcd9a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061170 Oct 11 01:28:07.701125 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1211/2458] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:07.707047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:07.708000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:07.709063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f94b4b6-c3b9-44ce-8c27-d22d7f1333e4 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.037896 Oct 11 01:28:07.712101 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1248/2459] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:28:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:28:07.715722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.716689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-plugged", "status": "completed", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:07.717147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.717824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.718774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.719487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.720151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.747370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.747954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.748405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.771940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] Creating event network-vif-plugged:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:28:07.784861 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-580e2c60-136c-4cae-a117-6af36322b920 req-fccf6ca1-ff6b-49ce-b5a3-f300e8fafa3e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071467 Oct 11 01:28:07.796988 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1249/2460] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:07.802890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:07.803614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 67b771e4-1918-4555-9f39-9129f8c34e8d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:07.821858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.822362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.835790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.837021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.837602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.838235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.866592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] HTTP exception thrown: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d HTTP/1.1 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:07.868880 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. Oct 11 01:28:07.870192 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '67b771e4-1918-4555-9f39-9129f8c34e8d'} Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:07.870888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. Oct 11 01:28:07.872483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:07.873906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 404 to user: Instance 67b771e4-1918-4555-9f39-9129f8c34e8d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:07.873906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77aa2052-1b42-4cc6-ba83-3cf655fd4255 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d" status: 404 len: 111 microversion: 2.1 time: 0.071767 Oct 11 01:28:07.873906 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1250/2461] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:07 2022] GET /compute/v2.1/servers/67b771e4-1918-4555-9f39-9129f8c34e8d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:28:07.881237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:07.881784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:07.896595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.897099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.897545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:07.898262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:07.899597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:07.901040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:08.017463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:08.033879 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-833d9e27-10b7-491b-a8b5-ea638d3439e1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1317 microversion: 2.1 time: 0.331326 Oct 11 01:28:08.035030 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1212/2462] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:07 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:08.040498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d79adcb-d759-44d2-bc1f-18f7447d32a9 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f112f9b1310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:08.062786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5b543c1-f692-4f78-9ad3-2d8835a6a6a4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action" status: 202 len: 0 microversion: 2.1 time: 0.188842 Oct 11 01:28:08.101353 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1251/2463] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:28:07 2022] POST /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:08.127847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:08.128817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:08.140051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:08.140560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:08.141077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:08.141689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:08.142142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:08.142570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:08.636380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:08.652323 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c9d6a455-7f8a-470e-9569-694309ab0b20 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.543781 Oct 11 01:28:08.652928 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1252/2464] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:08 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:08.661350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-987ce756-18c1-450e-8e95-f2865a60fa14 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:08.662219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-987ce756-18c1-450e-8e95-f2865a60fa14 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:09.056279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-987ce756-18c1-450e-8e95-f2865a60fa14 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:09.070640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-987ce756-18c1-450e-8e95-f2865a60fa14 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1277 microversion: 2.1 time: 0.416473 Oct 11 01:28:09.085336 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1253/2465] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:08 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:09.091036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:09.097659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:09.110872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.111393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.112008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.112726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.113180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.118292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.181483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.182571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.182694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.183217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lazy-loading 'fault' on Instance uuid 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:28:09.275061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3d667c276d4a2cbdcd375f2f11ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd07cb225141e2913b7fcb0c884425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:09.282509 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af67b04a-0950-4f40-944a-fc51c5b711c1 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 200 len: 1313 microversion: 2.1 time: 0.195787 Oct 11 01:28:09.290759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1254/2466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:09 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:09.290759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:09.290759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:09.298093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.299217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.299800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.301136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.301969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.302675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.622726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:09.632245 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3651cadd-4a0e-4d4b-9c1d-aa6149440c02 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.347559 Oct 11 01:28:09.643681 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1255/2467] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:09 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:09.643681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:09.643681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:09.651754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.652249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.652685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.653399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:09.653851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:09.654278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:09.987233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:10.059082 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab73b12a-2b44-4e8a-9f0b-99ec9ab1aa61 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1509 microversion: 2.1 time: 0.415398 Oct 11 01:28:10.063730 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1256/2468] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:09 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:10.097036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.097661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.116951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.120501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.120948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.121693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.124353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.128403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.196364 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d79adcb-d759-44d2-bc1f-18f7447d32a9 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/0d6b05f3-4fc0-4db1-9bca-b5e3055cc140" status: 202 len: 0 microversion: 2.1 time: 2.159800 Oct 11 01:28:10.202100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1213/2469] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:28:08 2022] DELETE /compute/v2.1/os-floating-ips/0d6b05f3-4fc0-4db1-9bca-b5e3055cc140 => generated 0 bytes in 2166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:10.207672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.208563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.249361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.250239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.252020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.254128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.255312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.256026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.615636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:10.624213 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-627e2373-95c6-4de8-bc71-414426d206e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1466 microversion: 2.1 time: 0.541130 Oct 11 01:28:10.629500 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1257/2470] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1466 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:10.634411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f", "name": "network-vif-deleted", "tag": "67aecee7-6830-4299-89b8-239f4f966c4c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:10.673573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.674165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.674558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.683738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:10.690464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] Creating event network-vif-deleted:67aecee7-6830-4299-89b8-239f4f966c4c for instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f on n-h2-772273-9 Oct 11 01:28:10.696926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-442b4852-b928-4a17-a5ff-941e8fcdce70 req-4cb3f053-bcdc-4908-9ff7-afa79237db7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065843 Oct 11 01:28:10.697862 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1258/2471] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:10.705778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.706673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.708587 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec151fed-a9ac-461c-bea3-c75caa8b6303 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.505038 Oct 11 01:28:10.712735 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1214/2472] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:10.718239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2bf1af67-b4d9-4794-93fb-759c1404a79f tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f112f9b1dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.720938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.721640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.722874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.729083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.729567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.730010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.910490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:10.924462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-80bd3de3-b0b1-4d72-a208-4f287ce2c139 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1329 microversion: 2.1 time: 0.224465 Oct 11 01:28:10.926218 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1259/2473] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1329 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:10.931074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.932104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] [instance: 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.938434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.939904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.940533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.941434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.942215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.943686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.960537 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] HTTP exception thrown: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Request method failure captured: Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f HTTP/1.1 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMZdSM3WY1Fy5WyDQ4txpYJ8AYy8H8pMQa69eLKwmSFVNYoC1eKk_-p-7RauRaAmngMqqjl-r6z5SEs3RFhQEFGcykO-ha1rTnnKzwReWL9PW3muUg6WktbGLzaDVvVJV1yEVgrhHRMzs96Hwh__ZmybWJKhg1cC2-CysZ_q2IUlB0c Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:10.963983 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4edd07cb225141e2913b7fcb0c884425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4edd07cb225141e2913b7fcb0c884425 Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1707882252 Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd3d667c276d4a2cbdcd375f2f11ba8f Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListServersNegativeTestJSON-1707882252-project Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. Oct 11 01:28:10.965776 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f'} Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:10.966624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. Oct 11 01:28:10.968099 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:10.970608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] Returning 404 to user: Instance 4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:10.971741 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-84851002-9fbe-4009-abe7-5908b3d17117 tempest-ListServersNegativeTestJSON-1707882252 tempest-ListServersNegativeTestJSON-1707882252-project] 10.222.0.66 "GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f" status: 404 len: 111 microversion: 2.1 time: 0.044338 Oct 11 01:28:10.974749 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1260/2474] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/servers/4dbe5d0a-aa04-4217-a97d-3d9cd134bb2f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:28:10.982350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1883775767", "metadata": {"image_type": "test"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:10.984321 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2bf1af67-b4d9-4794-93fb-759c1404a79f tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.270465 Oct 11 01:28:10.985534 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1215/2475] 10.222.0.66 () {58 vars in 1164 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:28:10.986023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.991596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:10.992474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:10.994287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.995085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.996148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:10.997051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:10.997690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:10.998300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:11.005291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:11.008591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:11.011561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:11.014896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:11.015662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:11.016321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:11.108839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Getting quotas for project 26ea60e7ee0040c3973093f1a640ec93. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:11.116461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:11.145776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Getting quotas for user 0951c4b4cb6e42cf989b8078b8889aed and project 26ea60e7ee0040c3973093f1a640ec93. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:11.465853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:11.476570 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e2df31d-ca00-4462-8455-0d7e270623eb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.489763 Oct 11 01:28:11.487435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1216/2476] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:10 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:11.495989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67be3719-ccac-46a9-aef3-4108a00e2208 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f11344cb820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:11.551541 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c510dd3a-eb8f-4db6-877d-d80d2b888a0d tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "POST /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e/action" status: 202 len: 0 microversion: 2.1 time: 0.575126 Oct 11 01:28:11.553571 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1261/2477] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:28:10 2022] POST /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:28:11.560135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:11.561748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:11.574951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:11.576014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:11.576694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:11.577739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:11.578411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:11.579070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:12.006535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:12.022876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-361648ea-5741-459b-b26f-095040c34b67 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1515 microversion: 2.1 time: 0.467634 Oct 11 01:28:12.035153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67be3719-ccac-46a9-aef3-4108a00e2208 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.548320 Oct 11 01:28:12.035574 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1262/2478] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:11 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:12.043361 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1217/2479] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:28:11 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:12.043786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:12.046556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:12.060578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc539180-105a-405c-aea1-b35bbdb095ec tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f11fee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:12.061912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:12.062509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:12.063149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:12.064054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:12.064627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:12.065170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:12.128867 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc539180-105a-405c-aea1-b35bbdb095ec tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.084266 Oct 11 01:28:12.130164 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1263/2480] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:12 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:12.135456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:12.136202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:12.144638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:12.145419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:12.146677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:12.147623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:12.148368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:12.148948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:12.156716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:12.264910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:12.293409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f966bf3-fc5a-4dcf-b614-06a8baf5e923 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1335 microversion: 2.1 time: 0.157658 Oct 11 01:28:12.294351 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1264/2481] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:12 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:12.305952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75bdceb4-6b97-4efa-b6f1-6128d637bf83 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f112f11f820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:13.253105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:13.266797 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5526b0f-37f4-4105-92f5-7234e9f83a1d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 1.228804 Oct 11 01:28:13.270221 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1218/2482] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:12 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:13.282222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:13.282862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:13.298504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:13.299012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:13.299479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:13.300206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:13.300666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:13.301097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:13.725228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:13.737475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2ed0623a-be3b-4249-af26-ca6e58b2484c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.466105 Oct 11 01:28:13.744227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1219/2483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:13 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:13.760805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d0a7c10-604b-429f-8fe0-22f7506880f3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112fa3f5e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:13.841616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d0a7c10-604b-429f-8fe0-22f7506880f3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.092414 Oct 11 01:28:13.843591 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1220/2484] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:13 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:13.856876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:13.857902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:13.879407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:13.882264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:13.882881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:13.884044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:13.886342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:13.886947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:14.807324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:14.821497 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc4bec02-4410-4988-a316-cc0710dd1c33 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.976473 Oct 11 01:28:14.822744 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1221/2485] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:13 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:14.828411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:14.829956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:14.837987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:14.838756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:14.839711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:14.839952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:14.840448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:14.840881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:15.246413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:15.258165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e289557-77e0-48ab-aa23-ac16dab99190 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.434116 Oct 11 01:28:15.259393 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1222/2486] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:14 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:15.266129 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75bdceb4-6b97-4efa-b6f1-6128d637bf83 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/4247716d-c930-4988-b6fe-11f6c0977c03" status: 202 len: 0 microversion: 2.1 time: 2.970475 Oct 11 01:28:15.266715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1265/2487] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:28:12 2022] DELETE /compute/v2.1/os-floating-ips/4247716d-c930-4988-b6fe-11f6c0977c03 => generated 0 bytes in 2972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:15.271234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1f28030-0939-4b35-ad7c-5553df1b4aa9 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: .version_select at 0x7f112f110700>, body: {"keypair": {"name": "tempest-keypair-240833512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoLToPuqBkGauPSe+YaXhLAxzv3OjrVh5DFKmIczhXtGwBbvxHbivd5pGpKn8WN9/TsUJKILn9anWXIpzBtZ9hbFIzvvJmcVLYGRfOiDz+61fk2AgYVKARy3NdH2a4y9g=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:15.281887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:15.282700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:15.296485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:15.296977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:15.297408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:15.303434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:15.303928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:15.304370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:15.306825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=25 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:15.322187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f1f28030-0939-4b35-ad7c-5553df1b4aa9 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:15.331916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f1f28030-0939-4b35-ad7c-5553df1b4aa9 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for user 5f9b009187ab4ad78d7fe88a44863179 and project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:15.363860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1f28030-0939-4b35-ad7c-5553df1b4aa9 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096060 Oct 11 01:28:15.377584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1266/2488] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:28:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:15.382721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d210562e-030b-45fe-8f6f-3b9727b5d018 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f110160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:15.433110 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d210562e-030b-45fe-8f6f-3b9727b5d018 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.054172 Oct 11 01:28:15.434048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1267/2489] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:15 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:15.443035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51b773ce-d737-4407-8771-0973fa47357b tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f112f11fee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:15.771147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:15.788251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3926b01-c3b4-406a-9d2b-027c88c5cd1d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.525032 Oct 11 01:28:15.790579 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1223/2490] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:15 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:15.800904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51d078e-694b-4d05-aa9c-73e770d883b5", "tag": "36bf633f-d382-4732-9e64-55e07eae5084"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:15.830344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:15.832629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:15.833660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:15.878170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] Creating event network-changed:36bf633f-d382-4732-9e64-55e07eae5084 for instance a51d078e-694b-4d05-aa9c-73e770d883b5 on n-h2-772273-9 Oct 11 01:28:15.888259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-35136093-42b7-43b2-a5ef-18c0520009a2 req-cfc17a76-0311-4ba7-a7d3-d5e175b9f187 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094759 Oct 11 01:28:15.889691 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1224/2491] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:15.899233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:15.900553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:15.909792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:15.911088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:15.911956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:15.913105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:15.913910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:15.914780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:16.799787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:16.813455 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0f49cce-9135-4fea-b3da-4cb0079b3721 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.921857 Oct 11 01:28:16.814771 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1225/2492] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:15 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:16.822826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:16.824444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:16.833567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:16.835147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:16.836020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:16.837741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:16.839438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:16.840416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:17.161750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:17.170325 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2ac8351-7bba-4c53-88a7-b809f2cda0ee tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.354109 Oct 11 01:28:17.171091 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1226/2493] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:16 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:17.188210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e50a7fde-dc85-411b-99d5-14e57b8faea4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f113402fb80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:17.255987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e50a7fde-dc85-411b-99d5-14e57b8faea4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.083409 Oct 11 01:28:17.265659 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1227/2494] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:17 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:17.271011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:17.271922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:17.279916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:17.280719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:17.281328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:17.282188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:17.282800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:17.283421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:17.569500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:17.667195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:17.671170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:17.688183 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caaf2010-dbd7-43c1-8f43-5462894a36a5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.420988 Oct 11 01:28:17.707701 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1228/2495] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:17 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:17.726269 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51b773ce-d737-4407-8771-0973fa47357b tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/61366cbb-f095-414c-a667-d1bd71da4133" status: 202 len: 0 microversion: 2.1 time: 2.290918 Oct 11 01:28:17.726936 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1268/2496] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:28:15 2022] DELETE /compute/v2.1/os-floating-ips/61366cbb-f095-414c-a667-d1bd71da4133 => generated 0 bytes in 2292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:17.750346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-455b20a5-0c6a-498d-b6c7-3aec753820a9 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] Calling method '.version_select at 0x7f1134a7d940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:17.837768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:17.838850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:17.846306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:17.847049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:17.847941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:17.848820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:17.849434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:17.850044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:18.519061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:18.527410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-975b83d2-0251-42e9-bf08-f2637b7cf854 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.693793 Oct 11 01:28:18.528542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1269/2497] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:17 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:18.533293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:18.534105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:18.540200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:18.540870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:18.541608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:18.543677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:18.544303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:18.544887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:19.043554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:19.055282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f194e5dc-ee67-4307-8e36-34ccc4f41aaf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 0.525417 Oct 11 01:28:19.055913 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1270/2498] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:18 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:19.086787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-504662e9-7ff6-4875-882d-3b063a72f7fa tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0e0dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:19.159630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-504662e9-7ff6-4875-882d-3b063a72f7fa tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.089921 Oct 11 01:28:19.160507 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1271/2499] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:19 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:19.165188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:19.165813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:19.179386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:19.180194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:19.181104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:19.182171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:19.183362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:19.183802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:19.362456 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-455b20a5-0c6a-498d-b6c7-3aec753820a9 tempest-FloatingIPDetailsTestJSON-1298898598 tempest-FloatingIPDetailsTestJSON-1298898598-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/10aec592-3dde-4f7e-b7b9-85d2f9e89eba" status: 202 len: 0 microversion: 2.1 time: 1.629607 Oct 11 01:28:19.363397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1229/2500] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:28:17 2022] DELETE /compute/v2.1/os-floating-ips/10aec592-3dde-4f7e-b7b9-85d2f9e89eba => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:19.468355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:19.493869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af33edfe-aaee-4de6-9101-b3e0be4d9793 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.332265 Oct 11 01:28:19.496520 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1272/2501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:19 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:19.550177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:19.551172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:19.561671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:19.562693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:19.563392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:19.564324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:19.564984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:19.565659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:19.789635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:19.802132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2271762e-5647-4a5c-ac3a-eedf1abb6924 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.255777 Oct 11 01:28:19.805237 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1230/2502] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:19 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:19.929106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-21972845", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9ccd50-81be-4dc9-b2d7-be4d2807b2b1"}], "security_groups": [{"name": "tempest-securitygroup--766548428"}], "key_name": "tempest-keypair-240833512", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:20.082262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:20.082993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:20.096489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:20.097280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:20.097841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:20.098669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:20.099219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:20.101722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:20.330722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] validate_networks() for [('bb9ccd50-81be-4dc9-b2d7-be4d2807b2b1', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:28:21.110374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:21.121545 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e9ad374-2602-4c74-95ba-27d7b67dc6b2 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1497 microversion: 2.1 time: 1.043226 Oct 11 01:28:21.131746 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1231/2503] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:20 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1497 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:21.140496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0d00eff-6e9a-48ad-a950-6b3636666d4e tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11349f98b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:21.237472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0d00eff-6e9a-48ad-a950-6b3636666d4e tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.104218 Oct 11 01:28:21.238079 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1232/2504] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:21 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:21.247268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:21.249865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:21.265424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:21.267039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:21.267528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:21.269508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:21.271677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:21.272172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:22.118251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:22.158343 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e435ee4c-3119-480b-853a-29cc16bbbc32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.909302 Oct 11 01:28:22.168007 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1233/2505] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:21 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:22.180888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-plugged", "status": "completed", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:22.241247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:22.244411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:22.247074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:22.311858 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] Creating event network-vif-plugged:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:28:22.329369 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-25b46b5a-d296-416a-8b8c-e355080e3c20 req-c9e6228c-9b63-4ac3-9409-cc76f76a4a0d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148416 Oct 11 01:28:22.332779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1234/2506] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:22.343747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:22.350546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:22.371586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:22.372194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:22.372718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:22.378727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:22.380404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:22.381134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:22.968601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:28:22.969603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:28:22.970294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:28:22.971063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:28:22.971757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:28:22.987155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:22.988002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:22.989058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:22.990029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:22.990704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:22.991370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:23.031412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:23.039106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Getting quotas for user 5f9b009187ab4ad78d7fe88a44863179 and project 77f6e510636f4606a54b10f4a651bfd6. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:23.044757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:23.055326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:28:23.058833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:28:23.059740 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-456fe4ea-9378-404f-a43d-c029675a77f2 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.724659 Oct 11 01:28:23.060335 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1235/2507] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:22 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:23.090647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:23.092437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:23.118607 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25020f04-57e3-4ba2-b6df-25d6846e1ac2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.193938 Oct 11 01:28:23.119265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=63 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:23.121346 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1273/2508] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:28:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 3197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:28:23.124271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:23.124778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:23.125297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:23.126021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:23.126484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:23.126912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:23.133464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58930564-5ec2-4404-b073-5e4431894694 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0cec10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:23.298112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58930564-5ec2-4404-b073-5e4431894694 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.174689 Oct 11 01:28:23.307632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1274/2509] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:23 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:23.314309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-848e26cf-afbf-4e28-b292-2fdd899703dd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:23.315055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-848e26cf-afbf-4e28-b292-2fdd899703dd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:23.664342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-848e26cf-afbf-4e28-b292-2fdd899703dd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:23.675922 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-848e26cf-afbf-4e28-b292-2fdd899703dd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1243 microversion: 2.1 time: 0.366238 Oct 11 01:28:23.676447 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1275/2510] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:23 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:23.694905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:23.696079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:23.709272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:23.709799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:23.711850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:23.712596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:23.713108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:23.713547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:23.919674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:23.940257 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a999dff-514d-48fb-831a-8f2a59792008 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 200 len: 1474 microversion: 2.1 time: 0.878810 Oct 11 01:28:23.941108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1236/2511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:23 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 1474 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:24.131423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1811368481", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:24.231942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:28:24.232251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:28:24.232928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:28:24.233823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:28:24.234506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:28:24.251292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.252258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.253135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.254116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.254816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.255488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.281554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Getting quotas for project 285e75374c0f4082877ab2c7a7bd9c6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:24.288877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Getting quotas for user 449f4c0c2dfa409b89dc6e8f36134ea5 and project 285e75374c0f4082877ab2c7a7bd9c6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:24.304398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:28:24.307099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:28:24.380494 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24d485b4-763d-4dfc-bfe5-d1266ce9ea46 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.436808 Oct 11 01:28:24.388367 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1237/2512] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:28:24.407788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1833195113"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:24.411043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:24.422382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.423268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.423952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.424860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.425517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.426149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.694500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a196003-fef4-4d60-9752-2b746a0af6e9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28/action" status: 202 len: 0 microversion: 2.1 time: 0.282928 Oct 11 01:28:24.696914 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1238/2513] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:28:24 2022] POST /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:28:24.704357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:24.705346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:24.723161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.723943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.725383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.727753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:24.728326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:24.734213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:24.751951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:24.765275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08e6e75d-ed2c-4555-b4e9-b867a080b2c8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 1.087744 Oct 11 01:28:24.784871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1276/2514] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:23 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:24.796566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e87bd5b-b21e-4962-a685-869381ae756c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1134f0a310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:24.896016 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e87bd5b-b21e-4962-a685-869381ae756c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.109311 Oct 11 01:28:24.897000 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1277/2515] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:24 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:24.910917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:24.912965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:25.147806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:25.170156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:25.176028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:25.184056 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c8d0f79-4576-486c-b27a-1561f2f832d7 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1281 microversion: 2.47 time: 0.284152 Oct 11 01:28:25.185918 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1278/2516] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:24 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:25.208021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:25.208904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:25.229168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:25.232913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:25.234256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:25.247453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:25.248706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:25.250369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:25.331423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:25.346162 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-718eb3cc-8938-4a46-9424-48759392567c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.646441 Oct 11 01:28:25.347518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1239/2517] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:24 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:25.360356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11bd5019-981a-4a83-b71a-22f12e7ea481 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1134241f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:25.454341 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11bd5019-981a-4a83-b71a-22f12e7ea481 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.104599 Oct 11 01:28:25.455551 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1240/2518] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:25 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:25.477429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51d078e-694b-4d05-aa9c-73e770d883b5", "name": "network-vif-plugged", "status": "completed", "tag": "36bf633f-d382-4732-9e64-55e07eae5084"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:25.492783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:25.495988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:25.496696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:25.512320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:25.522930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] Creating event network-vif-plugged:36bf633f-d382-4732-9e64-55e07eae5084 for instance a51d078e-694b-4d05-aa9c-73e770d883b5 on n-h2-772273-9 Oct 11 01:28:25.525029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4907354b-7958-41ac-b2fb-dac7af5449b6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1303 microversion: 2.1 time: 0.337828 Oct 11 01:28:25.530015 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1279/2519] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:25 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1303 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:25.547747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-83c68d41-299f-4cb8-b7d9-8bdafb394644 req-6dd79167-e4ec-4cfd-a0f8-8700e647d05c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089516 Oct 11 01:28:25.550027 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1241/2520] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:28:25.790131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:25.791449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:25.806278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:25.816891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:25.817876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:25.821455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:25.822177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:25.822952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:25.913882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23db2700-dfd3-4aea-bf49-bf65e41348c5 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f93a0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:26.006140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23db2700-dfd3-4aea-bf49-bf65e41348c5 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.097351 Oct 11 01:28:26.006749 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1242/2521] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:25 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:26.211051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:26.212063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:26.223535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.225921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.227615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:26.230199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.236697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.237695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:26.481940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:26.502158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:26.510513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:26.514220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-765a579f-197a-49c2-9238-6e341b36cecd tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1333 microversion: 2.47 time: 0.308150 Oct 11 01:28:26.517987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1243/2522] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:26 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1333 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:26.541403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:26.544137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:26.573593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.577320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.578172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:26.578325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:26.580754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.581425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.586299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:26.589651 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a8d5bb5-1375-4018-9387-0d57094b7886 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 0.801089 Oct 11 01:28:26.590914 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1280/2523] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:25 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:26.609880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-091ae23b-a912-4778-a5f0-99c893817e14 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f0e8af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:26.714145 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-091ae23b-a912-4778-a5f0-99c893817e14 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.112243 Oct 11 01:28:26.715872 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1281/2524] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:26 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:26.724814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:26.726967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:26.741452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.742122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.742867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:26.748257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:26.748970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:26.749650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:27.010108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:27.024192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd996271-3094-44a3-bca4-21132b459447 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1301 microversion: 2.1 time: 0.305905 Oct 11 01:28:27.042711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1282/2525] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:26 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1301 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:27.047977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7164022-6536-435b-a279-e33819d36343 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f12e9d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:27.140499 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a7164022-6536-435b-a279-e33819d36343 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.096212 Oct 11 01:28:27.142041 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1283/2526] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:27 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:27.238491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:27.250667 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbcb0e53-78a6-4d9f-9294-9973eed44088 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1403 microversion: 2.1 time: 0.725317 Oct 11 01:28:27.253543 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1244/2527] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:26 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1403 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:27.549823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:27.551734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:27.585108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:27.590108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:27.590822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:27.598912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:27.599557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:27.600112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:27.622903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:27.632042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:27.649729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:27.650240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:27.650689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:27.651456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:27.656043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:27.660135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:28.718223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:28.733597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:28.735424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:28.736574 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f6e9eaf-a0af-4ccf-8992-def73c50231b tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1333 microversion: 2.47 time: 1.194051 Oct 11 01:28:28.758692 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1284/2528] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:27 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1333 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:28.774581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f71ac82b-13c0-42ee-8f08-a4c11672afd8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f11f160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:28.884893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f71ac82b-13c0-42ee-8f08-a4c11672afd8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.124756 Oct 11 01:28:28.894125 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1285/2529] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:28 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:28.907828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:28.910342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:28.926256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:28.928459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:28.942932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:28.948221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:28.950392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:28.951528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:29.143900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:29.153509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91ce5253-6590-47c8-8dcf-ec72eb647b62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1476 microversion: 2.1 time: 1.536141 Oct 11 01:28:29.156321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1245/2530] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:27 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1476 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:29.162857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-703ed2e1-3a86-4cef-a303-cffe4cac054f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1134456550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:29.226776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-703ed2e1-3a86-4cef-a303-cffe4cac054f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.068993 Oct 11 01:28:29.227693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1246/2531] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:29 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:29.233342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:29.234743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:29.252718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:29.254173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:29.254836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:29.256120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:29.256846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:29.261926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:29.529193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:29.543798 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e39ab71b-9362-4dd7-8ba4-63ea0a1abfa7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.646931 Oct 11 01:28:29.544420 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1286/2532] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:28 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:29.766139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:29.766772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:29.779601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:29.780092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:29.780736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:29.781600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:29.782205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:29.784478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:29.922971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:29.937543 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ae6617c-a924-4a41-a17e-e5b02b7beac8 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1590 microversion: 2.1 time: 0.702028 Oct 11 01:28:29.938227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1247/2533] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:29 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1590 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:29.953388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01cd6965-b113-482f-9ff4-1c4e5d464066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f113416b0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:30.045074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01cd6965-b113-482f-9ff4-1c4e5d464066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.100920 Oct 11 01:28:30.045967 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1248/2534] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:29 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:30.054228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:30.069763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:30.093330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.094199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.097814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:30.098618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.099111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.099634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:30.124814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:30.151178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:30.160692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:30.162157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0f7432c2-abe2-49cb-8948-914e97853d0d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1339 microversion: 2.47 time: 0.399938 Oct 11 01:28:30.186787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1287/2535] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:29 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:28:30.204629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:30.205259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:30.226267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.226774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.227291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:30.228631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.229105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.229538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:30.467225 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90325eab-2454-4382-9ea2-ea18d174678c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.420007 Oct 11 01:28:30.467863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1249/2536] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:28:30 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5/os-interface => generated 284 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:30.474179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4273268d-b8b8-43ee-b4ce-520a46317ed3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112fa3f9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:30.601270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4273268d-b8b8-43ee-b4ce-520a46317ed3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.131748 Oct 11 01:28:30.603549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1250/2537] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:30 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:30.630773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:30.631435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:30.667634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.668169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.668621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:30.674199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:30.674691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:30.677292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:31.091729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:31.110625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93fb8e4e-da43-4890-b59a-78c1c728549b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1475 microversion: 2.1 time: 0.920183 Oct 11 01:28:31.112157 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1288/2538] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:30 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1475 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:31.118518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4abbc3-9988-426d-bfc8-c41a5fef9e28", "name": "network-vif-plugged", "status": "completed", "tag": "ba51674b-0705-44d3-830e-8f5303de41c9"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:31.144369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:31.145981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:31.145981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:31.165862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] Creating event network-vif-plugged:ba51674b-0705-44d3-830e-8f5303de41c9 for instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 on n-h2-772273-9 Oct 11 01:28:31.180811 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ce89b6dc-0fa5-4533-b558-aa8d08011b77 req-69d43cb5-3099-4cb6-a957-4ac1113bf58c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066248 Oct 11 01:28:31.190934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1289/2539] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:31.215275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-079eba2d-bef7-42ee-ba6e-2765cb81eea5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f17bd30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:31.285742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-079eba2d-bef7-42ee-ba6e-2765cb81eea5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.097314 Oct 11 01:28:31.287471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1290/2540] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:31 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:31.303470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:31.304232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:31.318204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:31.318618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:31.319059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:31.319785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:31.320421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:31.321005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:31.377540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:31.393066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52e3fc72-1fe5-4e0d-84f5-02095db8cd04 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.787567 Oct 11 01:28:31.396850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1251/2541] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:30 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:31.517034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:31.531596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:31.533843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:31.535939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7d6c6c2-3b25-4654-959a-2b3fb9c392b3 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1339 microversion: 2.47 time: 0.245891 Oct 11 01:28:31.537046 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1291/2542] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:31 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:31.623951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-060522d8-031c-44c8-a4cc-5afcf4ca9780 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112fa5e940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:31.677257 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-060522d8-031c-44c8-a4cc-5afcf4ca9780 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.062956 Oct 11 01:28:31.678326 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1252/2543] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:31 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:32.019606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:32.036863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.037208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.048124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.065751 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] Creating event network-changed:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:28:32.073297 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-915600d8-683e-49e0-8b22-fdfdbf78f850 req-d3a2c147-ed0a-4ea7-a745-7599e7514582 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057600 Oct 11 01:28:32.080127 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1292/2544] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:32.138378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:32.139483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:32.158964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.160201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.160865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.161939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.162583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.164833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.303500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff8a1109-7fde-454d-bb7f-73d174cc543b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f11f040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:32.379807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ff8a1109-7fde-454d-bb7f-73d174cc543b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.081240 Oct 11 01:28:32.382612 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1293/2545] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:32 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:32.420409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:32.421228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:32.427794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.428580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.429239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.431105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.431837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.433060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.790830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:32.805720 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3185b1b4-98c8-4c48-bbd4-818ef29d5fe9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1475 microversion: 2.1 time: 0.673286 Oct 11 01:28:32.806300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1253/2546] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:32 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1475 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:32.811743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:32.815332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:32.831442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.832160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.834596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.835721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:32.839272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:32.839946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:32.889941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:32.890881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:32.903310 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3df6b780-336a-48f9-815b-531970835b6a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.487411 Oct 11 01:28:32.903977 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1294/2547] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:32 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:32.925446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90aed94c-5572-4645-8017-a2851208ca61 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0e0820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:32.975352 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90aed94c-5572-4645-8017-a2851208ca61 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.057310 Oct 11 01:28:32.976617 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1295/2548] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:32 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:33.061172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:33.073769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:33.076248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:33.077773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7dcf225e-e98c-41cd-969b-4c93ba21b373 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1339 microversion: 2.47 time: 0.270376 Oct 11 01:28:33.079177 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1254/2549] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:32 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:33.212855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c51d4a-6553-4530-885e-5eca6bba61f9", "name": "network-vif-unplugged", "status": "completed", "tag": "9e1f45cd-3a59-40ab-b205-b4de386555f8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:33.219049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:33.240036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:33.240745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:33.241451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:33.282503 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Creating event network-vif-unplugged:9e1f45cd-3a59-40ab-b205-b4de386555f8 for instance c6c51d4a-6553-4530-885e-5eca6bba61f9 on n-h1-772273-9 Oct 11 01:28:33.297752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:28:33.319610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-dd9bebf9-5fdf-4e99-9961-d3148447f35a req-58ae6035-858b-4798-acbb-54cbf6e06d0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117283 Oct 11 01:28:33.322919 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1296/2550] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:33.402208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a89da8d9-f993-4aaf-9ef8-ec8d9604e703 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f770790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:33.492135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a89da8d9-f993-4aaf-9ef8-ec8d9604e703 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.097625 Oct 11 01:28:33.493138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1255/2551] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:33 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:33.836272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:33.837095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:33.853651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:33.854160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:33.854611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:33.855328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:33.855877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:33.856313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:33.930063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:33.931322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:33.942241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:33.943005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:33.956118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:33.957227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:33.957889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:33.958499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:34.266301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:34.299182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:34.679520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:34.693142 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c85109a2-ee44-43cc-86ba-f402d8d98218 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1473 microversion: 2.1 time: 0.861070 Oct 11 01:28:34.696001 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1297/2552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:33 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1473 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:34.710471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04e0436a-313b-47d4-8fb4-c202de910fcf tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11388091f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:34.748554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:34.761530 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a794c168-4c0d-4b73-8866-de3566a2ad29 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.832891 Oct 11 01:28:34.763708 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1256/2553] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:33 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:34.770245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:34.770880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:34.777960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:34.779586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:34.780301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:34.781192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:34.782353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:34.783315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:34.787703 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04e0436a-313b-47d4-8fb4-c202de910fcf tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1422 microversion: 2.1 time: 0.090246 Oct 11 01:28:34.788726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1298/2554] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:34 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:34.795403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6faaa45d-671a-4c91-b530-1c28ddc444d7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138845f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:34.867588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6faaa45d-671a-4c91-b530-1c28ddc444d7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.076959 Oct 11 01:28:34.869269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1299/2555] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:34 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:34.877221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:34.881217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:34.891332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:34.892109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:34.892788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:34.893864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:34.894543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:34.895186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:34.900056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:34.945162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:34.958993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:34.960935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '449f4c0c2dfa409b89dc6e8f36134ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285e75374c0f4082877ab2c7a7bd9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:34.962335 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b21374f1-0e60-41a4-a0c3-653663c6494d tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 200 len: 1360 microversion: 2.47 time: 0.196926 Oct 11 01:28:34.976847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1257/2556] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:34 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 1360 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:28:35.154497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=13 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:35.155009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51d078e-694b-4d05-aa9c-73e770d883b5", "tag": "36bf633f-d382-4732-9e64-55e07eae5084"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:35.179980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.180555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.182090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.194956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:35.206914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e68c899-baf2-4b90-a393-ee5743621caa tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1590 microversion: 2.1 time: 0.332819 Oct 11 01:28:35.207872 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1300/2557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:34 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1590 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:35.213736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] Creating event network-changed:36bf633f-d382-4732-9e64-55e07eae5084 for instance a51d078e-694b-4d05-aa9c-73e770d883b5 on n-h2-772273-9 Oct 11 01:28:35.218614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1983353410"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:35.228208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3e411a69-e010-4e03-928b-eb3b179df834 req-1c223d83-d591-479a-9fc5-3d7ca5135060 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241559 Oct 11 01:28:35.229495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1258/2558] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:35.231980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:35.247225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.249050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.252235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.253307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.253941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.254624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.641303 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdc4f4db-609e-4673-aa94-ae3abbbcb606 tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "POST /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9/action" status: 202 len: 52 microversion: 2.47 time: 0.431725 Oct 11 01:28:35.649767 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1301/2559] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:28:35 2022] POST /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9/action => generated 52 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:28:35.659563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:35.660346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:35.685847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.690133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.690925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.692293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.692869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.694429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.718651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:35.719443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:35.735734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.736655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.738321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.756636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:35.762022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:35.764780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:35.766521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:28:35.978970 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2001df4-9b28-4f97-b8c6-93e5f086f89a tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 204 len: 0 microversion: 2.47 time: 0.327760 Oct 11 01:28:35.980987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1259/2560] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:28:35 2022] DELETE /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:28:35.990320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:35.993494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:36.009181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:36.010437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:36.011888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:36.014388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:36.015912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:36.016517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:36.364257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:36.376851 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1209b97-e28b-48d7-85a9-8ff9b495ca2d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1470 microversion: 2.1 time: 0.663336 Oct 11 01:28:36.380826 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1302/2561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:35 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1470 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:36.408857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cbc0aa8-a848-4811-b48c-15f739a371d0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0f7e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:36.498582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:36.509710 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-565248e8-cfe7-4d17-8194-0ddee7afc45e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.527117 Oct 11 01:28:36.526542 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1260/2562] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:35 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:36.539049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5ac9ddb-274e-4de6-b760-4f6e99f42f95 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f735f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:45.727854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:46.003180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:28:46.201205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5ac9ddb-274e-4de6-b760-4f6e99f42f95 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 9.672230 Oct 11 01:28:46.201854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6cbc0aa8-a848-4811-b48c-15f739a371d0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1431 microversion: 2.1 time: 9.818736 Oct 11 01:28:46.203402 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1261/2563] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:36 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 9676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:46.206150 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1303/2564] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:36 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1431 bytes in 9824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:46.216919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:46.219705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:46.227611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:46.229779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] [instance: 2493d85d-aa94-40e8-9a76-868707208aa9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:46.249560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.250850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.254403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.256183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.258812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.260746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.261392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.262200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.265062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.268401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.268892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.269336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.369976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] HTTP exception thrown: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Request method failure captured: Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 HTTP/1.1 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMa3JMUc_WHU5bkR2jEFFfgdCVghSpywsLGEsYpj4EFMAnjjq4TxSmQ5sBIji60LBdYyIn5WL-C4xDqNM1uBf3oaqDubNkR6eB2FfQFdHQJvYFaOAhlrvIjD0LXWbZP6BRcs3aAIdVEAK62HMso-ikTyB3gzEBX0pSSNyE07hW_MBKo Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 285e75374c0f4082877ab2c7a7bd9c6c Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAaction247Test-1604048816 Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:28:46.373613 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/285e75374c0f4082877ab2c7a7bd9c6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_285e75374c0f4082877ab2c7a7bd9c6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/285e75374c0f4082877ab2c7a7bd9c6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/285e75374c0f4082877ab2c7a7bd9c6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAaction247Test-1604048816 Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 285e75374c0f4082877ab2c7a7bd9c6c Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAaction247Test-1604048816 Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAaction247Test-1604048816-project Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 449f4c0c2dfa409b89dc6e8f36134ea5 Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAaction247Test-1604048816-project Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. Oct 11 01:28:46.375233 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2493d85d-aa94-40e8-9a76-868707208aa9'} Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:46.376309 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. Oct 11 01:28:46.377818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:46.381773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] Returning 404 to user: Instance 2493d85d-aa94-40e8-9a76-868707208aa9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:46.384666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc01170d-0595-4c2c-849b-08e702ec20ec tempest-ServersAaction247Test-1604048816 tempest-ServersAaction247Test-1604048816-project] 10.222.0.66 "GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9" status: 404 len: 111 microversion: 2.47 time: 0.180111 Oct 11 01:28:46.386779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1262/2565] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:28:46 2022] GET /compute/v2.1/servers/2493d85d-aa94-40e8-9a76-868707208aa9 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:28:46.401757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:46.412160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:46.431839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.432356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.432824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.433528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.447703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.448603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.513455 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19e94214-b13f-4397-a5d6-f4e9997428c5 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9/action" status: 204 len: 0 microversion: 2.1 time: 0.305789 Oct 11 01:28:46.514165 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1304/2566] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:28:46 2022] POST /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9/action => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:28:46.545848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c51d4a-6553-4530-885e-5eca6bba61f9", "name": "network-vif-plugged", "status": "completed", "tag": "9e1f45cd-3a59-40ab-b205-b4de386555f8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:46.585297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.587074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.590319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.644009 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Creating event network-vif-plugged:9e1f45cd-3a59-40ab-b205-b4de386555f8 for instance c6c51d4a-6553-4530-885e-5eca6bba61f9 on n-h1-772273-9 Oct 11 01:28:46.678428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:28:46.700497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c5b80287-6f90-45bf-b1b1-141b41ef5652 req-59bc82e1-0b0f-4c96-88da-af7bb2167fc8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184371 Oct 11 01:28:46.701108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1305/2567] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:46.733602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f29eabe-cd9b-4fd8-b53e-6818b31e9133 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0e5310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:46.885688 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f29eabe-cd9b-4fd8-b53e-6818b31e9133 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 200 len: 1431 microversion: 2.1 time: 0.183355 Oct 11 01:28:46.886586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1306/2568] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:46 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 1431 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:46.898449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:46.899191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:46.915433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.915938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.916377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:46.917090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:46.917546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:46.917973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:47.361388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:47.370825 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eece925d-2462-4214-8b97-f85f60a3a257 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.981331 Oct 11 01:28:47.381273 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1263/2569] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:46 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:47.387733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:47.388629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:47.405307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:47.410537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:47.411949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:47.412870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:47.416191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:47.416885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:47.557978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:47.566290 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27efa1df-9667-4430-a781-9141efdc32ef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1470 microversion: 2.1 time: 0.678575 Oct 11 01:28:47.575635 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1307/2570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:46 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1470 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:47.582987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-150f9bcf-d410-461f-8627-249df5385bb0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f0e5310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:47.656664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-150f9bcf-d410-461f-8627-249df5385bb0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.076901 Oct 11 01:28:47.666652 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1308/2571] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:47 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:47.983177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85f15fd1-c6bd-4de3-beee-117a72e9c2bb tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f0e0160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1776322364", "description": "tempest-description-700184519"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:48.261470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:48.275942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e3f21d5-d77b-4243-adac-130c84504070 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1466 microversion: 2.1 time: 0.891966 Oct 11 01:28:48.278787 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1264/2572] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:47 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1466 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:48.301741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c616e125-e56e-46bd-80b0-32b9b8eaf394 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1134b40700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:48.401693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c616e125-e56e-46bd-80b0-32b9b8eaf394 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74" status: 200 len: 784 microversion: 2.1 time: 0.103917 Oct 11 01:28:48.406912 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1265/2573] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:48 2022] GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74 => generated 784 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:28:48.418376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:48.422733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:48.436235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:48.436906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:48.438105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:48.441687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85f15fd1-c6bd-4de3-beee-117a72e9c2bb tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.773208 Oct 11 01:28:48.442562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:48.442914 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1309/2574] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:28:47 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:48.446612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:48.447330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:48.448554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4a7d614-87e4-4ea1-9b34-c4fc410702ca tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:48.467655 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4a7d614-87e4-4ea1-9b34-c4fc410702ca tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023216 Oct 11 01:28:48.472067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1310/2575] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:28:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:48.486552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ccd6066-a693-4a2c-8df4-47227b15c8b4 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f0e0e50>, body: {"security_group_rule": {"parent_group_id": "56df3850-633a-48a3-902d-5f00a7cfbc10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:48.841600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:48.850432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fddd8839-c5e6-425a-8552-7d1c7e82a42f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.442012 Oct 11 01:28:48.851054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1266/2576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:48 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:48.878305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed8543a5-b865-4382-970e-fbea7818c779 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f93ac10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.048318 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ccd6066-a693-4a2c-8df4-47227b15c8b4 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.574834 Oct 11 01:28:50.049196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1311/2577] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:50.055325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.056178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:50.064509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.065003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.065455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.066286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.066696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.067509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.618327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed8543a5-b865-4382-970e-fbea7818c779 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "DELETE /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 204 len: 0 microversion: 2.1 time: 1.746204 Oct 11 01:28:50.619477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1267/2578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:48 2022] DELETE /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 0 bytes in 1768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:28:50.626013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4898bb3f-e55b-4352-8d50-dcadf6bfd6e4 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6d40d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.702642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4898bb3f-e55b-4352-8d50-dcadf6bfd6e4 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.081479 Oct 11 01:28:50.706324 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1268/2579] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:50 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:50.713873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "name": "network-vif-plugged", "status": "completed", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:50.746621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.747554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.748229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.773021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] Creating event network-vif-plugged:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:28:50.792585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9d95c759-dc6e-4c44-a97a-9958995dceb0 req-7c8c11cb-9000-4e33-a004-6489ef5b0cae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084916 Oct 11 01:28:50.793092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:50.793781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1269/2580] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:50.800293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.801261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:50.804857 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-141a730b-5170-4d09-ab56-1554a28e467f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1462 microversion: 2.1 time: 0.753839 Oct 11 01:28:50.805452 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1312/2581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:50 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1462 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:50.813719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.813965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d98faed-d05e-4ac5-bdaa-bc2edafc8237 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f08aaf0>, body: {"security_group_rule": {"parent_group_id": "56df3850-633a-48a3-902d-5f00a7cfbc10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:50.817438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.818273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.820753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.822857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.825582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.874325 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3d98faed-d05e-4ac5-bdaa-bc2edafc8237 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d98faed-d05e-4ac5-bdaa-bc2edafc8237 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 138 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:50.876021 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: {"security_group_rule": {"parent_group_id": "56df3850-633a-48a3-902d-5f00a7cfbc10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 01:28:50.877229 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: exception: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'security_group_rule': {'parent_group_id': '56df3850-633a-48a3-902d-5f00a7cfbc10', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:50.878511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.880655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d98faed-d05e-4ac5-bdaa-bc2edafc8237 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: This rule already exists in group 56df3850-633a-48a3-902d-5f00a7cfbc10 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:50.882629 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d98faed-d05e-4ac5-bdaa-bc2edafc8237 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.071029 Oct 11 01:28:50.882629 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1313/2582] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:50 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:28:50.883418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9083b53b-26bc-49ed-8427-2cb472378237 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f089ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.921283 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-9083b53b-26bc-49ed-8427-2cb472378237 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] HTTP exception thrown: Image not found. Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9083b53b-26bc-49ed-8427-2cb472378237 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Request method failure captured: Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 HTTP/1.1 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMaTTr7mnI2N8fV1NzwnXePXILyCwMwjnVFsQ5Fta9_L8QJkg3o29c3FQQbAGDQkNSxMYk6qFWU2BGins29Mt_QWkuHzK4a-KF5bIC2muaRT3idT1AuFLb9wVRCFYdTyucDAvW2lTP8OGd5mUMSn59Xopua2uRLrAgvZYL1_k-l3X80 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:50.924572 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0951c4b4cb6e42cf989b8078b8889aed Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4339e9a6-8484-4cf5-bc19-ed9b9c618a71'} Oct 11 01:28:50.925918 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:28:50.926694 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4339e9a6-8484-4cf5-bc19-ed9b9c618a71 Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:28:50.927874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4339e9a6-8484-4cf5-bc19-ed9b9c618a71 could not be found. Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:50.929043 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9083b53b-26bc-49ed-8427-2cb472378237 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:50.930128 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9083b53b-26bc-49ed-8427-2cb472378237 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 404 len: 62 microversion: 2.1 time: 0.046812 Oct 11 01:28:50.931942 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1314/2583] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:50 2022] GET /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:28:50.936823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:50.937628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:50.944294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.945104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.945737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:50.946661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:50.947312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:50.948008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:51.172371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:51.184018 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1e51bec-c48f-45ac-b078-a7c3d69cff3d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1368 microversion: 2.1 time: 0.386970 Oct 11 01:28:51.184961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1270/2584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:50 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:51.196622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5b51a27-d52d-48fa-b233-e21e56137fb7 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f112f93a9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:51.665418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:51.692541 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-611ae68e-330f-4a94-8bb6-dc9b82a549e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1462 microversion: 2.1 time: 0.759240 Oct 11 01:28:51.693186 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1315/2585] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:50 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1462 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:51.704691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-774389580"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:51.709902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:51.719952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:51.721242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:51.721808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:51.722740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:51.723547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:51.724586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:51.824323 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5b51a27-d52d-48fa-b233-e21e56137fb7 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/f135fca1-8da9-4961-8150-2dbbf0584fea" status: 202 len: 0 microversion: 2.1 time: 0.634755 Oct 11 01:28:51.826061 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1271/2586] 10.222.0.66 () {58 vars in 1287 bytes} [Tue Oct 11 01:28:51 2022] DELETE /compute/v2.1/os-security-group-rules/f135fca1-8da9-4961-8150-2dbbf0584fea => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:28:51.835091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e71014ff-0376-466e-a31b-dc68e788878a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6d0d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:52.326333 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e71014ff-0376-466e-a31b-dc68e788878a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.498623 Oct 11 01:28:52.331230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1272/2587] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:51 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:52.336739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ccf1845-292a-45e8-b89f-557219a57668 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'create', calling method: .version_select at 0x7f112f6d0ca0>, body: {"keypair": {"name": "tempest-keypair-908440325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQGSM5LwpzGhF7xVrtTNU0GgeWWsSdZvtp6RaA6sw3e1LCAQZKikGnFvj1sYwOVdCV6bbT/YQhFt+azaIr+7nEfvH/CQz5uUGrlZy5wxIsre/Zr51YJJnXdkR3aKfyh9w=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:52.378838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3ccf1845-292a-45e8-b89f-557219a57668 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:52.386851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3ccf1845-292a-45e8-b89f-557219a57668 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:52.448199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ccf1845-292a-45e8-b89f-557219a57668 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115145 Oct 11 01:28:52.456177 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1273/2588] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:28:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:52.465219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-873a83a0-111e-4205-9302-d98107202df8 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f93a160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1560502044", "description": "tempest-description-1817006197"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:52.499827 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d50d927b-d363-420c-b95d-b265c4407bee tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "POST /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e/action" status: 202 len: 0 microversion: 2.1 time: 0.794947 Oct 11 01:28:52.500630 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1316/2589] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:28:51 2022] POST /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:28:52.520798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:52.525724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:52.557343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:52.557878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:52.558331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:52.559926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:52.562254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:52.562708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:53.100655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:53.117437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d217e174-735d-4472-a94d-bdf7de583272 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1561 microversion: 2.1 time: 0.606841 Oct 11 01:28:53.125065 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1317/2590] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:52 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1561 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:53.140507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-878fc745-4ee5-4a8f-a59e-783f123b9875 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f11fa60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:53.212938 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-878fc745-4ee5-4a8f-a59e-783f123b9875 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.085913 Oct 11 01:28:53.214133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1318/2591] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:53 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:53.222677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:53.265672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:53.268600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:53.269277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:53.302457 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] Creating event network-vif-unplugged:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:28:53.314866 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a657f5e8-db04-4e96-ab47-90dc1e196e1b req-2c04a137-d85f-4c57-b2bb-674d051ed333 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095026 Oct 11 01:28:53.316782 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1319/2592] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:53.335472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:53.337520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:53.350298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:53.352174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:53.355108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:53.356247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:53.359224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:53.359974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:53.592061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bce25be2-2723-46e3-8a72-428aa241ee9d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273746 Oct 11 01:28:53.593144 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1320/2593] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:28:53 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:53.604103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2de5b183-0e29-4220-bfff-ae7a475ae3fe tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f11fc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:53.617748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-873a83a0-111e-4205-9302-d98107202df8 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.159957 Oct 11 01:28:53.618611 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1274/2594] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:28:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:53.632567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d642f54-5b53-48ef-99c7-a7d0ee1dcec6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f7289d0>, body: {"security_group_rule": {"parent_group_id": "acdb881f-8c3d-421a-be02-fa2d7f515486", "ip_protocol": "tcp", "from_port": 875401124, "to_port": 22}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:53.689459 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2de5b183-0e29-4220-bfff-ae7a475ae3fe tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.094978 Oct 11 01:28:53.696796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1321/2595] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:53 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:53.899919 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0d642f54-5b53-48ef-99c7-a7d0ee1dcec6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Invalid port range 875401124:22. Former value cannot be greater than the later Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d642f54-5b53-48ef-99c7-a7d0ee1dcec6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 145 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:28:53.902098 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: {"security_group_rule": {"parent_group_id": "acdb881f-8c3d-421a-be02-fa2d7f515486", "ip_protocol": "tcp", "from_port": 875401124, "to_port": 22}} Oct 11 01:28:53.903454 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid port range 875401124:22. Former value cannot be greater than the later Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'acdb881f-8c3d-421a-be02-fa2d7f515486', 'ip_protocol': 'tcp', 'from_port': 875401124, 'to_port': 22}}} Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 875401124:22. Former value cannot be greater than the later Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:53.904208 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 875401124:22. Former value cannot be greater than the later Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 875401124:22. Former value cannot be greater than the later Oct 11 01:28:53.905360 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.908724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d642f54-5b53-48ef-99c7-a7d0ee1dcec6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: Invalid port range 875401124:22. Former value cannot be greater than the later {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:53.909852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d642f54-5b53-48ef-99c7-a7d0ee1dcec6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.281274 Oct 11 01:28:53.910860 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1275/2596] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:53 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:28:53.920991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c54ea21-f7fc-449d-844b-486c60fe5bbd tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f17b040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1703784057", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:53.923972 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2c54ea21-f7fc-449d-844b-486c60fe5bbd tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Security group id should be uuid Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c54ea21-f7fc-449d-844b-486c60fe5bbd tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 131 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:53.927457 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1703784057", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:53.928736 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group id should be uuid Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1703784057', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:53.929507 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 11 01:28:53.930844 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:53.933578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c54ea21-f7fc-449d-844b-486c60fe5bbd tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: Security group id should be uuid {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:53.937094 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c54ea21-f7fc-449d-844b-486c60fe5bbd tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.020654 Oct 11 01:28:53.940497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1322/2597] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:53 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:28:53.952052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff711ceb-7708-44ee-9e91-de476d81260f tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f1134241430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1818453605", "description": "tempest-description-332527581"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:54.235612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b52b3e2-7e39-45fa-82e1-ae443bacfa68 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f08ac10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:54.334004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b52b3e2-7e39-45fa-82e1-ae443bacfa68 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.107325 Oct 11 01:28:54.339109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1323/2598] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:54 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:28:54.715574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57dcdbca-a5ee-437e-9bed-1ddf8a062e5b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f08a940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:54.790801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57dcdbca-a5ee-437e-9bed-1ddf8a062e5b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.081089 Oct 11 01:28:54.793707 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1324/2599] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:54 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:55.351040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4614670b-9af5-4b11-a9a6-8d14137ed700 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0f7280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:55.471089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4614670b-9af5-4b11-a9a6-8d14137ed700 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.124640 Oct 11 01:28:55.472262 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1325/2600] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:55 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:55.810351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58362f1e-31fd-4624-837a-74f15a24bdeb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f087670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:55.880005 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58362f1e-31fd-4624-837a-74f15a24bdeb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.074281 Oct 11 01:28:55.880599 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1326/2601] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:55 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:55.894319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff711ceb-7708-44ee-9e91-de476d81260f tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.947965 Oct 11 01:28:55.905217 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1276/2602] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:28:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:28:55.908849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5891493b-6127-4441-a7f0-55e66c689c32 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f087040>, body: {"security_group_rule": {"parent_group_id": "591550b6-114a-448f-8883-69b1977da1f6", "ip_protocol": "tempest-999-879305505", "from_port": 22, "to_port": 22}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:56.284698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5891493b-6127-4441-a7f0-55e66c689c32 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Invalid IP protocol tempest-999-879305505. Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5891493b-6127-4441-a7f0-55e66c689c32 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 156 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:56.286548 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: {"security_group_rule": {"parent_group_id": "591550b6-114a-448f-8883-69b1977da1f6", "ip_protocol": "tempest-999-879305505", "from_port": 22, "to_port": 22}} Oct 11 01:28:56.288309 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid IP protocol tempest-999-879305505. Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'security_group_rule': {'parent_group_id': '591550b6-114a-448f-8883-69b1977da1f6', 'ip_protocol': 'tempest-999-879305505', 'from_port': 22, 'to_port': 22}}} Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-879305505. Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:56.289163 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-879305505. Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-879305505. Oct 11 01:28:56.290501 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:56.292081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5891493b-6127-4441-a7f0-55e66c689c32 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: Invalid IP protocol tempest-999-879305505. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:56.293265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5891493b-6127-4441-a7f0-55e66c689c32 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.388340 Oct 11 01:28:56.295006 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1327/2603] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:55 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 391 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:28:56.305632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3c9bab1-cb10-4b92-9dd2-4547f8d6b3c6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f735940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-573981836", "description": "tempest-description-483305627"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:56.488463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f6da5ec0-7ded-4dc8-a5c6-2de35a7f3daa tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f08a3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:56.560963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f6da5ec0-7ded-4dc8-a5c6-2de35a7f3daa tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.077078 Oct 11 01:28:56.562000 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1328/2604] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:56 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:56.900182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8bf3b372-b196-47ae-bf1b-56f05e186bce tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f087c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:56.976134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8bf3b372-b196-47ae-bf1b-56f05e186bce tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1414 microversion: 2.1 time: 0.083881 Oct 11 01:28:56.977404 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1329/2605] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:56 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:57.494336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-76bb22a5-24a7-43dc-975b-c891a73c10a4 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '.version_select at 0x7f112f087550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:57.500718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76bb22a5-24a7-43dc-975b-c891a73c10a4 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:57.502868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76bb22a5-24a7-43dc-975b-c891a73c10a4 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:57.509512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76bb22a5-24a7-43dc-975b-c891a73c10a4 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:57.525128 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-76bb22a5-24a7-43dc-975b-c891a73c10a4 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.038285 Oct 11 01:28:57.530812 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1330/2606] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:28:57 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:57.552556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e25fd13-780f-4258-bb45-cbddb388e0cb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:57.590381 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e25fd13-780f-4258-bb45-cbddb388e0cb tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042686 Oct 11 01:28:57.592282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1331/2607] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:28:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:28:57.601159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d37a5006-b933-4ca2-ae46-eb38b4609ac3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f11f1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:57.686811 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d37a5006-b933-4ca2-ae46-eb38b4609ac3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.093271 Oct 11 01:28:57.687855 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1332/2608] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:57 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:57.697880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ba64238-0c36-4c63-8499-041e810967a1 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-273416801", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:57.740232 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ba64238-0c36-4c63-8499-041e810967a1 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.051065 Oct 11 01:28:57.743002 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1333/2609] 10.222.0.66 () {60 vars in 1146 bytes} [Tue Oct 11 01:28:57 2022] POST /compute/v2.1/flavors => generated 498 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:57.755397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61a8b540-6f75-4e57-842e-ead9412d14d1 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:57.777308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61a8b540-6f75-4e57-842e-ead9412d14d1 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024005 Oct 11 01:28:57.779167 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1334/2610] 10.222.0.66 () {58 vars in 1182 bytes} [Tue Oct 11 01:28:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:28:57.898862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3c9bab1-cb10-4b92-9dd2-4547f8d6b3c6 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.597942 Oct 11 01:28:57.899823 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1277/2611] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:28:56 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:57.912834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71ef293e-1066-4203-b68b-260adbdf531e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f1134f0a310>, body: {"security_group_rule": {"parent_group_id": "74378b0f-0795-4352-b36e-a6572f20e337", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:57.990666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1399276756", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "10f3b25d-8039-45f6-aee9-884505edf24e"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:58.066977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:28:58.244216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-71ef293e-1066-4203-b68b-260adbdf531e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71ef293e-1066-4203-b68b-260adbdf531e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 138 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:58.246722 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: {"security_group_rule": {"parent_group_id": "74378b0f-0795-4352-b36e-a6572f20e337", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 11 01:28:58.248281 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'security_group_rule': {'parent_group_id': '74378b0f-0795-4352-b36e-a6572f20e337', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:58.249114 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 01:28:58.250441 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:58.253420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71ef293e-1066-4203-b68b-260adbdf531e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:58.254326 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71ef293e-1066-4203-b68b-260adbdf531e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.345817 Oct 11 01:28:58.255138 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1335/2612] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:57 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:28:58.268622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cb33a8d8-a020-4514-acbc-28a285ccc949 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f0f7e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:58.324779 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cb33a8d8-a020-4514-acbc-28a285ccc949 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1423 microversion: 2.1 time: 0.063796 Oct 11 01:28:58.325937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1336/2613] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:58 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:58.331538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c63b501-fd55-4e92-8626-202d25516d9e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f112f17b430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-470983760", "description": "tempest-description-1883856527"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:59.211120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:28:59.211669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:28:59.212930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:28:59.213573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:28:59.214366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:28:59.234752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:59.237315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:59.239018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:59.241356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:59.242715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:59.248577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:59.284879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:28:59.299651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:28:59.337532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:28:59.341557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:28:59.425278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c63b501-fd55-4e92-8626-202d25516d9e tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.098021 Oct 11 01:28:59.426014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1337/2614] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:28:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:59.431576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b334304e-bc6e-4532-82e8-6f05eb6a7a47 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f12e790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:59.439918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ddb834d-1f2f-4bb5-8fb9-d337dd30ac7d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452853 Oct 11 01:28:59.441976 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1278/2615] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:28:59.458107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b1cd435-9076-4326-97fc-41ad3b161905 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f93a3a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:59.543663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b1cd435-9076-4326-97fc-41ad3b161905 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.091000 Oct 11 01:28:59.544892 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1279/2616] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:59 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:59.558287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-plugged", "status": "completed", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:59.563011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b334304e-bc6e-4532-82e8-6f05eb6a7a47 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 200 len: 1423 microversion: 2.1 time: 0.135239 Oct 11 01:28:59.565338 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1338/2617] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:28:59 2022] GET /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 1423 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:59.572718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:59.575610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:59.576271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:59.577075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:59.586041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:28:59.586882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:28:59.587580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:28:59.593928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] Creating event network-vif-plugged:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:28:59.603969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] Creating event network-changed:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:28:59.611794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bf4a159b-3efd-4647-b62a-d9c822e7225a req-fe7a7528-5a26-4609-aaac-aeebfe704a56 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044030 Oct 11 01:28:59.613144 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1339/2618] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:59.617518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3e3e5635-4483-4940-a3d1-37498aade649 req-a5e77240-6f61-4159-9789-9c7deb69f483 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070702 Oct 11 01:28:59.619633 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1280/2619] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:28:59.627920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3b1b580-6596-4ad3-9d5b-371a038a8207 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:59.629153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83890070-c1ea-40ae-a61d-47247c6ca913 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f1138727550>, body: {"security_group_rule": {"parent_group_id": "f6744a23-5e5e-4e7a-89a7-1c55eaf0960a", "ip_protocol": "tcp", "from_port": 22, "to_port": 696069111}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:59.631713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3b1b580-6596-4ad3-9d5b-371a038a8207 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:28:59.765222 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-83890070-c1ea-40ae-a61d-47247c6ca913 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83890070-c1ea-40ae-a61d-47247c6ca913 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 145 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:28:59.767978 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: {"security_group_rule": {"parent_group_id": "f6744a23-5e5e-4e7a-89a7-1c55eaf0960a", "ip_protocol": "tcp", "from_port": 22, "to_port": 696069111}} Oct 11 01:28:59.769568 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f6744a23-5e5e-4e7a-89a7-1c55eaf0960a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 696069111}}} Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:59.770450 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 Oct 11 01:28:59.771833 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.774320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83890070-c1ea-40ae-a61d-47247c6ca913 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 400 to user: Invalid port range 22:696069111. Valid TCP ports should be between 1-65535 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:28:59.776175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83890070-c1ea-40ae-a61d-47247c6ca913 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.161019 Oct 11 01:28:59.777126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1340/2620] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:59 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:28:59.784064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b8160e1-9aeb-4f1e-ab81-d9021b67a46d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f0f7670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:28:59.796615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3b1b580-6596-4ad3-9d5b-371a038a8207 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:28:59.816468 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3b1b580-6596-4ad3-9d5b-371a038a8207 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1279 microversion: 2.1 time: 0.195095 Oct 11 01:28:59.817059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1281/2621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:59 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:28:59.858854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Action: 'create', calling method: .version_select at 0x7f1134a3ef70>, body: {"security_group_rule": {"parent_group_id": "66aa7a5b-21e1-4a76-a535-88927a71c826", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:28:59.990263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:28:59.990865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Neutron security group 66aa7a5b-21e1-4a76-a535-88927a71c826 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:28:59.991429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:28:59.991429 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 138 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:28:59.994059 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: {"security_group_rule": {"parent_group_id": "66aa7a5b-21e1-4a76-a535-88927a71c826", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 01:28:59.995631 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'security_group_rule': {'parent_group_id': '66aa7a5b-21e1-4a76-a535-88927a71c826', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:28:59.996497 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 11 01:28:59.997975 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:28:59.999367 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] Oct 11 01:29:00.000712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.002826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 404 to user: Security group 66aa7a5b-21e1-4a76-a535-88927a71c826 does not exist Oct 11 01:29:00.002826 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-3c479885-cb1b-4a97-ac61-9a2cd699a17d'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:00.004105 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4efa8f6a-fe07-4182-9db7-4395d1d83460 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.163431 Oct 11 01:29:00.004848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1282/2622] 10.222.0.66 () {60 vars in 1195 bytes} [Tue Oct 11 01:28:59 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:29:00.018455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f1134a3ef70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:00.093845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:29:00.094476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Neutron security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 not found {{(pid=120494) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 11 01:29:00.095270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] HTTP exception thrown: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.095270 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Request method failure captured: Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-group-rules/611bd7f9-ac75-4e28-a491-39d4e35e71d0 HTTP/1.1 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMbP6bowNOgLtxDw3317jDsb7XWez79eHptPq50ihDH78s8eWbtelLXEJ4MiireuVss5uBhyPLmKAXZrvwZEFT3-GBOD-GX_8AdVMIdZGmXyt7_J_ToukWvh_fmKmNxNq-q3OmPzbOhsOVedalLzDsZPmA25_vgRYeGQOcwQjGRK0K8 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:29:00.097915 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9bb3f27d2f0847e7b4827c8365c3c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9bb3f27d2f0847e7b4827c8365c3c60e Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407 Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 355e50ddea9b4cfb819e06842f1ef7a2 Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.099215 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '611bd7f9-ac75-4e28-a491-39d4e35e71d0'} Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:29:00.099959 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 11 01:29:00.101039 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.102043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] Oct 11 01:29:00.103170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:00.106774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Returning 404 to user: Security group rule 611bd7f9-ac75-4e28-a491-39d4e35e71d0 does not exist Oct 11 01:29:00.106774 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-c5cdee64-e199-4625-bf45-3f0a304e3819'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:00.106774 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1ba087c-028d-442b-9c57-4bde82a9a55a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/611bd7f9-ac75-4e28-a491-39d4e35e71d0" status: 404 len: 199 microversion: 2.1 time: 0.096137 Oct 11 01:29:00.106774 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1283/2623] 10.222.0.66 () {58 vars in 1287 bytes} [Tue Oct 11 01:29:00 2022] DELETE /compute/v2.1/os-security-group-rules/611bd7f9-ac75-4e28-a491-39d4e35e71d0 => generated 199 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:29:00.117708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69d7aff7-6fd7-4fe1-8d83-e45a7ca804f0 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f112f6c10d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:00.917116 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b8160e1-9aeb-4f1e-ab81-d9021b67a46d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 204 len: 0 microversion: 2.1 time: 1.138302 Oct 11 01:29:00.922387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1341/2624] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:28:59 2022] DELETE /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:29:00.946925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f929f36-58ea-4525-90c8-273fc4832230 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1138727f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:01.034346 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f929f36-58ea-4525-90c8-273fc4832230 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.107471 Oct 11 01:29:01.034929 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1342/2625] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:00 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:01.053156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:01.054078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:01.065162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:01.066036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:01.069044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:01.070194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:01.071022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:01.071861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:01.266095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:01.275631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69d7aff7-6fd7-4fe1-8d83-e45a7ca804f0 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/f6744a23-5e5e-4e7a-89a7-1c55eaf0960a" status: 202 len: 0 microversion: 2.1 time: 1.161353 Oct 11 01:29:01.277065 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1284/2626] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:00 2022] DELETE /compute/v2.1/os-security-groups/f6744a23-5e5e-4e7a-89a7-1c55eaf0960a => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:29:01.287070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:01.287843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:01.297015 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d375bf7-0949-4115-9304-0301947e1129 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1331 microversion: 2.1 time: 0.255861 Oct 11 01:29:01.300306 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1343/2627] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:01 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:01.321387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:01.322098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:01.322567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:01.323291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:01.323777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:01.324211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:01.324659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c027fdbf-a876-47ba-901f-a36e089271d2 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f112f11f040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:01.363621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:29:01.501064 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c90a11c6-e7b8-48b0-b127-f56ebeffcba5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 204 len: 0 microversion: 2.1 time: 0.222116 Oct 11 01:29:01.502828 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1285/2628] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:29:01 2022] DELETE /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:29:01.693920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-245228408", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "11db0ee6-bf74-4f94-a889-16aabb18b472"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:01.780034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] validate_networks() for [('11db0ee6-bf74-4f94-a889-16aabb18b472', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:29:02.295321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c027fdbf-a876-47ba-901f-a36e089271d2 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/74378b0f-0795-4352-b36e-a6572f20e337" status: 202 len: 0 microversion: 2.1 time: 0.993642 Oct 11 01:29:02.297324 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1344/2629] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:01 2022] DELETE /compute/v2.1/os-security-groups/74378b0f-0795-4352-b36e-a6572f20e337 => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:02.305985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b5a8650d-6c29-4c7d-8b68-4768412b7a36 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f087f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:02.410034 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b5a8650d-6c29-4c7d-8b68-4768412b7a36 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.111207 Oct 11 01:29:02.410657 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1345/2630] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:02 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:02.421488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0cd71a57-fc80-4a0c-90d2-c4bb0715997f tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f112f0e88b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:02.998451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:29:03.000170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:29:03.004314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:29:03.005222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:29:03.005850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:29:03.018998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:03.020526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:03.021797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:03.022839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:03.023885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:03.024750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:03.035142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:03.060148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:03.067584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0cd71a57-fc80-4a0c-90d2-c4bb0715997f tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/591550b6-114a-448f-8883-69b1977da1f6" status: 202 len: 0 microversion: 2.1 time: 0.651211 Oct 11 01:29:03.069314 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1346/2631] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:02 2022] DELETE /compute/v2.1/os-security-groups/591550b6-114a-448f-8883-69b1977da1f6 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:03.075205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for user a0510e6acedd400f86f1c8f9e8a1c75d and project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:03.083070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:03.084288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:03.102037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:29:03.106291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:29:03.124755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:03.124755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:03.124755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:03.124755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:03.126211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:03.126211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:03.160571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:03.220353 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84772935-dbb0-4539-a6bc-325c247b2f35 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530895 Oct 11 01:29:03.221593 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1286/2632] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:29:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:29:03.227796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4abbc3-9988-426d-bfc8-c41a5fef9e28", "name": "network-vif-unplugged", "status": "completed", "tag": "ba51674b-0705-44d3-830e-8f5303de41c9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:03.266232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:03.267020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:03.270332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:03.291943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] Creating event network-vif-unplugged:ba51674b-0705-44d3-830e-8f5303de41c9 for instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 on n-h2-772273-9 Oct 11 01:29:03.302462 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-29578610-48d8-44f4-a4ec-a9c457cbcbf7 req-0adf53c8-a017-44fa-b6a5-080534b50a83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077468 Oct 11 01:29:03.305674 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1287/2633] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:03.313734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:03.314351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-657ab93a-acd9-4d1a-9e83-709146782c0a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f11349a6550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:03.324204 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f216c0a-05bc-44dc-830c-c272dc724296 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1337 microversion: 2.1 time: 0.253809 Oct 11 01:29:03.336080 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1347/2634] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:03 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1337 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:03.347684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5877091a-9220-40b7-a61e-1b222266269d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:03.348640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5877091a-9220-40b7-a61e-1b222266269d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:03.441709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5877091a-9220-40b7-a61e-1b222266269d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:03.466159 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5877091a-9220-40b7-a61e-1b222266269d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1207 microversion: 2.1 time: 0.122315 Oct 11 01:29:03.466769 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1348/2635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:03 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1207 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:03.484770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ae197b1-9302-4c36-8f5d-183e106ddc09 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0f93a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:03.566255 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ae197b1-9302-4c36-8f5d-183e106ddc09 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.094936 Oct 11 01:29:03.566828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1349/2636] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:03 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:03.881316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1919334124", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "98e3a6be-1b6f-4f02-98a7-27bd5cdd2e9f"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:04.037370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] validate_networks() for [('98e3a6be-1b6f-4f02-98a7-27bd5cdd2e9f', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:29:04.304336 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-657ab93a-acd9-4d1a-9e83-709146782c0a tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/acdb881f-8c3d-421a-be02-fa2d7f515486" status: 202 len: 0 microversion: 2.1 time: 0.997018 Oct 11 01:29:04.305282 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1288/2637] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:03 2022] DELETE /compute/v2.1/os-security-groups/acdb881f-8c3d-421a-be02-fa2d7f515486 => generated 0 bytes in 999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:04.313143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d0f46bd-0bf9-4ae5-be6d-58c96e558639 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] Calling method '.version_select at 0x7f112f735940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:04.981329 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d0f46bd-0bf9-4ae5-be6d-58c96e558639 tempest-SecurityGroupRulesNegativeTestJSON-2009811407 tempest-SecurityGroupRulesNegativeTestJSON-2009811407-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/56df3850-633a-48a3-902d-5f00a7cfbc10" status: 202 len: 0 microversion: 2.1 time: 0.671932 Oct 11 01:29:04.982650 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1289/2638] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:04 2022] DELETE /compute/v2.1/os-security-groups/56df3850-633a-48a3-902d-5f00a7cfbc10 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:04.990029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:04.993027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:05.020749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:05.021634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:05.022935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:05.023947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:05.025771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:05.026663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:05.918492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:05.934568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ceaa954-8461-4c71-ac3a-84398698dc2b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 0.950327 Oct 11 01:29:05.935205 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1290/2639] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:04 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:05.972329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:05.980248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:05.986509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:05.987821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:05.989810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.001727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.002495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.003703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.189943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:06.190100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:29:06.190569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:29:06.191027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:29:06.197316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:29:06.199916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:29:06.201313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cccbd23e-d651-4648-b63b-36fac6d4ae6e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1265 microversion: 2.1 time: 0.230969 Oct 11 01:29:06.202430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1291/2640] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:05 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:06.209287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5a2fddb-71da-4146-94c8-054110402d4b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f6dfc10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:06.225922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.226711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.227168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.230320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.230796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.231242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.272766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Getting quotas for project 2e3d9b3f542849aab94752df552f2830. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:06.288793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5a2fddb-71da-4146-94c8-054110402d4b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.084208 Oct 11 01:29:06.290818 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1292/2641] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:06 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:06.301605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Getting quotas for user 5cbdc269fbb74da690a14d7e346abe68 and project 2e3d9b3f542849aab94752df552f2830. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:06.306097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4abbc3-9988-426d-bfc8-c41a5fef9e28", "name": "network-vif-deleted", "tag": "ba51674b-0705-44d3-830e-8f5303de41c9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:06.331441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.333105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.333769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.337550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:29:06.342783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:29:06.364423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] Creating event network-vif-deleted:ba51674b-0705-44d3-830e-8f5303de41c9 for instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 on n-h2-772273-9 Oct 11 01:29:06.375238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-516cbc6c-f21e-42df-acf5-2d238c5a3cb9 req-4853746b-b56a-4a73-9467-72616052156c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080969 Oct 11 01:29:06.377929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1293/2642] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:06.473041 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c69e87a-ffe7-4966-8c3e-b276e93b0eeb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.898554 Oct 11 01:29:06.477316 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1350/2643] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:29:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:29:06.490783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75f4ed15-b6cc-4f05-a7b2-bf3473ca6925 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:06.491860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75f4ed15-b6cc-4f05-a7b2-bf3473ca6925 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:06.744335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f4ed15-b6cc-4f05-a7b2-bf3473ca6925 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:06.759621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75f4ed15-b6cc-4f05-a7b2-bf3473ca6925 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1225 microversion: 2.1 time: 0.275477 Oct 11 01:29:06.760776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1294/2644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:06 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1225 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:06.961615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:06.962589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:06.972024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.976023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.984722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:06.988190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:06.988957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:06.989981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:07.234649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:07.237798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:07.263757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:07.265105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:07.268154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:07.269219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:07.272023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:07.273948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:07.552033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:07.571950 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c8d04f9-c8e5-4949-94be-5190c694f338 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1265 microversion: 2.1 time: 0.345495 Oct 11 01:29:07.591433 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1295/2645] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:07 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:07.607108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37797f1b-bd58-44d7-b6bd-4357ea5d2b18 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f6eb9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:07.687884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37797f1b-bd58-44d7-b6bd-4357ea5d2b18 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.095196 Oct 11 01:29:07.688482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1296/2646] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:07 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:07.787226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:07.787895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:07.809863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:07.810858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:07.813014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:07.813982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:07.815104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:07.817599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:08.170399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:08.186527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fdbdc0b-5a6a-487f-bcda-936ae879b59a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1229 microversion: 2.1 time: 0.404275 Oct 11 01:29:08.188772 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1297/2647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:07 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1229 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:08.452492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:08.472473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:08.482359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:08.482359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:08.562028 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] Creating event network-changed:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:29:08.577225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:08.597671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-051a539b-27a0-46a4-8a79-f378a986ba6c req-3a30ba56-24ae-48d2-8901-62a2719249cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144044 Oct 11 01:29:08.600790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1298/2648] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:08.602954 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90720999-da37-4bd3-85df-c329c513a471 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 1.645465 Oct 11 01:29:08.607696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1351/2649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:06 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:08.653374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:08.663673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:08.704476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:08.707631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:08.709138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66b54f80-86c5-4be6-8616-993eb671e717 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1138845940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:08.712284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:08.713249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:08.718034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:08.721144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:08.829055 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66b54f80-86c5-4be6-8616-993eb671e717 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.128808 Oct 11 01:29:08.832356 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1352/2650] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:08 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:09.150234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:09.162225 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68905b20-5f02-4c21-b897-549dce544de3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.557165 Oct 11 01:29:09.166704 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1299/2651] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:08 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:09.214748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:09.215700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:09.239854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:09.241282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:09.241744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:09.248185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:09.251746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:09.252707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:09.513525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:09.525691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82b9f3c1-c317-4b38-8560-91b4152f916b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1285 microversion: 2.1 time: 0.316725 Oct 11 01:29:09.526279 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1353/2652] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:09 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:09.635047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:09.635691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:09.644784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:09.645533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:09.646237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:09.647273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:09.647913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:09.648783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:09.847603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27a123ee-3da9-4fb6-92c8-01bb22a5ed32 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0e05e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:09.946850 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27a123ee-3da9-4fb6-92c8-01bb22a5ed32 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.103984 Oct 11 01:29:09.947948 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1354/2653] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:09 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:10.016630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:10.025876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ecb5b5ea-11df-4db1-abea-650b8bce08be tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 0.395321 Oct 11 01:29:10.032819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1300/2654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:09 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:10.193337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:10.194560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:10.210442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:10.218168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:10.218835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:10.219778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:10.220426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:10.221014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:10.554954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:10.557656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:10.575791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:10.576917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:10.577610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:10.580513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:10.582252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:10.582921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:10.583231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:10.595022 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b41ea9f2-4454-403e-a796-dddedfeb69b6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.402599 Oct 11 01:29:10.608331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1355/2655] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:10 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:10.747870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:10.758819 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4ed8f77-2949-4c9d-8283-1d6e1fd6b7e6 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1283 microversion: 2.1 time: 0.211405 Oct 11 01:29:10.764683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1301/2656] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:10 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:10.964019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b4a5a49-de9e-4363-9dda-4e01624852c4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11387b2b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:11.050190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:11.050842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:11.055894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b4a5a49-de9e-4363-9dda-4e01624852c4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.097124 Oct 11 01:29:11.056495 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1356/2657] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:10 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:11.069584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:11.070922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:11.071812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:11.072941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:11.073309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:11.073755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:11.629244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:11.630317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:11.644371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:11.648771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:11.651381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:11.652397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:11.653186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:11.654624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:11.993303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:12.004621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0a36352-6cb5-4177-951c-d068382d9f29 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 0.957714 Oct 11 01:29:12.023241 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1302/2658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:11 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:12.037566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:12.042677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:12.058084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:12.058787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:12.062987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:12.064299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:12.067550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:12.074882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:12.206610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:12.217253 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ad91422-27a0-4828-991d-c39ee7fb831b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.594902 Oct 11 01:29:12.228500 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1357/2659] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:11 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:12.237792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b4850813-dbad-454d-85cc-2a41b886394a tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11387be550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:12.361796 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b4850813-dbad-454d-85cc-2a41b886394a tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.131213 Oct 11 01:29:12.362877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1358/2660] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:12 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:12.550185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:12.561801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-87881112-d461-4169-9236-2c28dcf0e852 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.535844 Oct 11 01:29:12.562669 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1303/2661] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:12 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:12.827172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-plugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:12.852073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:12.852916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:12.853588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:12.866447 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] Creating event network-vif-plugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:29:12.892120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-49ec7f65-7c27-4816-9adc-a78c92a899b7 req-fa0098e6-ca15-4566-802e-9b76c3d46756 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069077 Oct 11 01:29:12.893478 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1359/2662] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:13.030175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:13.030798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:13.046902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:13.047643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:13.049332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.050010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.050717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.051964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.052610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.053245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.275469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:13.278075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:13.307169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.308157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.314964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.315981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.317777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.318664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.460495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:13.482905 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec2c60ba-6f28-4470-98f5-344621c25e28 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 0.456394 Oct 11 01:29:13.483875 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1304/2663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:13 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:13.489314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3ad1c19-05ff-4e66-b2b3-e3348160ff19 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11350aa040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:13.549337 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3ad1c19-05ff-4e66-b2b3-e3348160ff19 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.064404 Oct 11 01:29:13.550174 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1305/2664] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:13 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:13.587404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:13.588265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:13.604530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.605254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.606302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.607918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:13.608361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:13.608861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:13.967834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:13.999730 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-20c121bb-f9f8-4fc4-ae7c-e2d4c2339e19 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.745295 Oct 11 01:29:14.000743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:14.005584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1360/2665] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:13 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:14.012179 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f13a051-e58c-4ee6-8fed-3138b38fd779 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.430127 Oct 11 01:29:14.012966 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1306/2666] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:13 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:14.037191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420", "tag": "c06b841f-93eb-4944-8773-319bc394c028"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:14.061101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:14.061869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:14.063078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:14.105137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] Creating event network-changed:c06b841f-93eb-4944-8773-319bc394c028 for instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 on n-h2-772273-9 Oct 11 01:29:14.113938 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b2a6c411-5761-4d73-ab24-6f1091f5f4d9 req-862a01f5-3d51-4f44-a617-8b534c136a46 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104717 Oct 11 01:29:14.115089 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1361/2667] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:14.511274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:14.512623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:14.522685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:14.523508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:14.524149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:14.525092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:14.525720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:14.526309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:14.570781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6653cf06-5001-484d-8cb6-f6adea9afc56 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11387bef70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:14.645442 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6653cf06-5001-484d-8cb6-f6adea9afc56 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.080719 Oct 11 01:29:14.648077 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1362/2668] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:14 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:14.916656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:14.930238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96d3b802-f6ba-4191-829f-d35ff75603e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1379 microversion: 2.1 time: 0.420663 Oct 11 01:29:14.930898 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1307/2669] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:14 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1379 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:15.026952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:15.028056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:15.041877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.042036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:15.042618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:15.056918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.058102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.058645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:15.059486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.060471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.060976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:15.061109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.062781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:15.064702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.065936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.070402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:15.393963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:15.394579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:15.424136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fcc60435-3370-43d1-8801-6abda461becf tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.401219 Oct 11 01:29:15.438318 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1363/2670] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:15 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:15.440156 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f67f75b-1dfa-4bc6-b42a-645c5e32e248 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.405761 Oct 11 01:29:15.457701 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1308/2671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:15 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:15.664788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8322f4c6-1893-450b-9a66-90bb85af12a0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11387b2a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:15.735141 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8322f4c6-1893-450b-9a66-90bb85af12a0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.075895 Oct 11 01:29:15.745851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1364/2672] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:15 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:15.956215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:15.958386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:15.976177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.976984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.978804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:15.979771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:15.980926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:15.982061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.159597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46900100-d06c-4e69-a298-5ca1239096c7", "tag": "d6962181-9644-4c2e-a11b-3eef7a9ec1e7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:16.166394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:16.203241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.204107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.204749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.250204 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] Creating event network-changed:d6962181-9644-4c2e-a11b-3eef7a9ec1e7 for instance 46900100-d06c-4e69-a298-5ca1239096c7 on n-h2-772273-9 Oct 11 01:29:16.271186 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9d0a7137-cdc4-4676-a8a9-5696e8cf937b req-692c426f-f88b-4c34-ab4d-88e775abc7b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115867 Oct 11 01:29:16.275441 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1365/2673] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:16.310139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:16.328509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d27e996-718d-4dc6-a80a-edad4e59d511 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1529 microversion: 2.1 time: 0.376401 Oct 11 01:29:16.333368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1309/2674] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:15 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1529 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:16.357848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:16.358816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:16.361582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:16.362818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:16.382201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.383001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.387282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.388293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.388923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.389519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.464338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:16.465272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:16.494415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.494921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.495373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.496094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.496543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.496968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.629040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:16.643431 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-01412d33-3a5e-4b10-a013-d8b0f34bcb94 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1529 microversion: 2.1 time: 0.287242 Oct 11 01:29:16.644121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1366/2675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:16 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1529 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:16.661486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:16.662279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:16.672779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.673952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.674561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.677525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:16.678005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:16.681566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:16.749451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=20 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:16.828470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:16.845086 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3355bac-24c3-4108-8928-f3c1011f30c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.385031 Oct 11 01:29:16.846290 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1310/2676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:16 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:16.851653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ea7d6a3-67c4-4dbd-b96f-ba443a79eec5 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:16.915857 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ea7d6a3-67c4-4dbd-b96f-ba443a79eec5 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/10f3b25d-8039-45f6-aee9-884505edf24e" status: 202 len: 0 microversion: 2.1 time: 0.068111 Oct 11 01:29:16.916801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1311/2677] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:29:16 2022] DELETE /compute/v2.1/flavors/10f3b25d-8039-45f6-aee9-884505edf24e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:16.929972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2674866-4f7d-42cd-8672-97125ddbe0d0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f93a160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:17.001783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:17.018113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b82d0f2b-3940-4e9b-a73c-e67de539bddb tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.372393 Oct 11 01:29:17.027494 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1367/2678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:16 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:17.046013 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2674866-4f7d-42cd-8672-97125ddbe0d0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.127781 Oct 11 01:29:17.047302 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1312/2679] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:16 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:17.055872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97e8ed9a-58f6-429b-955c-3057c7761f78 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:17.106784 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97e8ed9a-58f6-429b-955c-3057c7761f78 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076910 Oct 11 01:29:17.107642 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1368/2680] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:29:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:17.135179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:17.138064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:17.146814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.147608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.148231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:17.149111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.149757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.153800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:17.223095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:17.282358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:17.295013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Old instance type tempest-test_resize_flavor_-273416801, new instance type m1.heat {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:29:17.315176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:29:17.316021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:29:17.316772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:29:17.319178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:29:17.319911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:29:17.493454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e512f8af-246c-415c-8757-a4ac2bb23873 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54/action" status: 202 len: 0 microversion: 2.1 time: 0.362093 Oct 11 01:29:17.494682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1313/2681] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:29:17 2022] POST /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:17.503030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:17.503969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:17.520684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.522753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.523216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:17.527048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.527876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.528869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:17.872815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:17.873840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:17.883136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.885688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.886651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:17.888353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:17.888866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:17.900314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:18.005457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:18.018829 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4e03fb4-ae77-41a9-85e8-4f55356aedee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1538 microversion: 2.1 time: 0.519577 Oct 11 01:29:18.046429 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1369/2682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:17 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1538 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:18.058910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:18.059893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:18.077298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:18.081184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:18.081858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:18.083590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:18.086483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:18.091562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:18.551095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:18.561968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad4e438d-8e07-4779-98a9-cffe46f4eaa8 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.513862 Oct 11 01:29:18.562575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1370/2683] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:18 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:18.564772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:18.588518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b1ac4ea-1d49-4feb-bf78-7430f14b38d0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.719732 Oct 11 01:29:18.591955 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1314/2684] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:17 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:18.610205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1219b869-2a7c-4458-8b1b-2a0ae8e7f3b0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1138911310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:18.702722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1219b869-2a7c-4458-8b1b-2a0ae8e7f3b0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.123166 Oct 11 01:29:18.703319 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1371/2685] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:18 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:19.055506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:19.056375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:19.074779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.075281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.081629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:19.082409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.083471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.095287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:19.440345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:19.454297 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e0ad655-3d2c-4b99-a058-803606b87a4c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1538 microversion: 2.1 time: 0.403696 Oct 11 01:29:19.459034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1315/2686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:19 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1538 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:19.589253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:19.591955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:19.617932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:19.618543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:19.622003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.624545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.625242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:19.625952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.626424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.626847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:19.629009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.629569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.638549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:19.639610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:19.640236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:19.640857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:20.212761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:20.225305 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6d8913c-a636-4242-a035-ff578245517f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.611868 Oct 11 01:29:20.235419 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1316/2687] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:19 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:20.236357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-192ed6d5-035a-49cb-8b57-b742b72f38e2 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f9b18b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:20.316560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-192ed6d5-035a-49cb-8b57-b742b72f38e2 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.088378 Oct 11 01:29:20.317235 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1317/2688] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:20 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:20.339387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:20.352551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73cdc59d-9b94-4436-ab93-55c4356d4573 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.769802 Oct 11 01:29:20.353160 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1372/2689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:19 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:20.487095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:20.490358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:20.523960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:20.538801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:20.541104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:20.541887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:20.547713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:20.552917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:21.057916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:21.067921 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65bf6931-2576-48ca-8807-f3a4a1ca6299 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1538 microversion: 2.1 time: 0.586463 Oct 11 01:29:21.084524 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1318/2690] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:20 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1538 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:21.252942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:21.254131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:21.268700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:21.272593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:21.273940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:21.276275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:21.278236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:21.279553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:21.332185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47fd99d3-caf0-4725-8e0b-237d1d88fc52 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f6fca60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:21.398738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47fd99d3-caf0-4725-8e0b-237d1d88fc52 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.070537 Oct 11 01:29:21.399530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1319/2691] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:21 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:21.411747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:21.415785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:21.430556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:21.435631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:21.437976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:21.438991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:21.443937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:21.445323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:21.624797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:21.633830 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-607f2fe2-3f89-4117-83a2-23e521200865 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.384869 Oct 11 01:29:21.651732 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1373/2692] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:21 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:21.698518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:21.712674 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0eff2f0-d0a7-4872-83e4-ff7afd03e740 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.311831 Oct 11 01:29:21.713937 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1320/2693] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:21 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:22.097779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:22.098392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:22.119462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:22.119971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:22.120409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:22.121120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:22.121576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:22.121996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:22.415380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b61d66a6-1223-44bf-a688-b496f1f674d1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f9b1af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:22.499051 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b61d66a6-1223-44bf-a688-b496f1f674d1 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.088241 Oct 11 01:29:22.502487 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1321/2694] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:22 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:22.666622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:22.667247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:22.695075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:22.696305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:22.697925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:22.699397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:22.701093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:22.704576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:23.512204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:23.525311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:23.538594 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44acadc0-3946-4462-ac8f-490ba3af268d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.875849 Oct 11 01:29:23.540470 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55481f9b-a18d-4a03-a289-9625780ccfcf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1538 microversion: 2.1 time: 1.446595 Oct 11 01:29:23.544306 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1374/2695] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:22 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1538 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:23.549326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:23.550010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1322/2696] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:22 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:23.558312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d18f3d9e-c0ee-4e82-b53e-ca38cda06845 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112fa5e5e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:23.559238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:23.581491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:23.586619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:23.587551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:23.588523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:23.589153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:23.591626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:23.628528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d18f3d9e-c0ee-4e82-b53e-ca38cda06845 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.077246 Oct 11 01:29:23.636813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1323/2697] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:23 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:23.715754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420", "name": "network-vif-plugged", "status": "completed", "tag": "c06b841f-93eb-4944-8773-319bc394c028"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:23.740784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:23.741281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:23.741721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:23.761353 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] Creating event network-vif-plugged:c06b841f-93eb-4944-8773-319bc394c028 for instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 on n-h2-772273-9 Oct 11 01:29:23.775135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6df628aa-68da-4d01-b150-e4f14a14a7a2 req-f93fe7fe-4e66-46e6-9165-c75b373d3199 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062989 Oct 11 01:29:23.775848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1324/2698] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:29:23.946904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:23.960341 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02d90c68-a121-4a81-aa91-e96342623add tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.414666 Oct 11 01:29:23.961176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1375/2699] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:23 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:24.571074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:24.571881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:24.577255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:24.577877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:24.584185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:24.586661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:24.587980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:24.589586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:24.590244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:24.590712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:24.591053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:24.591322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:24.592513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:24.593510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:24.594148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:24.594586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:24.886534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:24.896104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0acbc2a9-6fdd-43e5-985a-be55d2f004e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.329601 Oct 11 01:29:24.920938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1325/2700] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:24 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:24.931867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c457d97-4d18-45ba-a46e-c63297a22000 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11341cf4c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:24.961269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:24.986704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:25.001528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-929aa8f0-a3ef-4947-a04b-132f5a00fc0d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.427309 Oct 11 01:29:25.004684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1376/2701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:24 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:25.026513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:25.027605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:25.045241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:25.047213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:25.047930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:25.048911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:25.049936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:25.050619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:25.100492 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c457d97-4d18-45ba-a46e-c63297a22000 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.178124 Oct 11 01:29:25.101404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1326/2702] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:24 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:25.373753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:25.384349 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15d7955d-3ce3-4cd5-8533-1acfcc9f4089 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.377550 Oct 11 01:29:25.385561 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1377/2703] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:25 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:25.926920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:25.927599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:25.938718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:25.940590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:25.943935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:25.944998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:25.947782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:25.948421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:26.041248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:26.042573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:26.054355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:26.057060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:26.059173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:26.060555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:26.061289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:26.061979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:26.251699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:26.262124 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-741a4993-6df0-4ac6-8b10-19e6f25a600d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.338785 Oct 11 01:29:26.283476 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1327/2704] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:25 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:26.316397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f3c1041-f663-405a-a784-b4d755068e4c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f11342bc670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:26.321177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:26.332920 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb7f0cfb-6701-43af-89c0-92e723ab5bca tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1307 microversion: 2.1 time: 0.295636 Oct 11 01:29:26.356167 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1378/2705] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:26 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:26.409579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:26.410120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f3c1041-f663-405a-a784-b4d755068e4c tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.125058 Oct 11 01:29:26.410727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:26.411463 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1328/2706] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:26 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:26.422775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:26.424303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:26.425947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:26.426855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:26.428089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:26.428691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:26.691982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:26.709133 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e654d38-b240-47ee-8c62-17e0bb2e99b3 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.298849 Oct 11 01:29:26.709873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1379/2707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:26 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:27.287040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:27.288409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:27.296396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.296876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.297315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.310862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.311424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.314487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.355881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:27.357528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:27.370571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.372287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.373181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.374838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.375749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.376527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.726583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:27.737641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-58beced8-3073-4f9e-96ec-2a18e3e2df89 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.455447 Oct 11 01:29:27.739792 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1329/2708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:27 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:27.749819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a82a94e8-ba18-4111-bbf1-ebb5e771dda3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1134b40ee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:27.806397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:27.823093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ae932a0-b62f-4ee1-8ba6-df47eefb607f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1486 microversion: 2.1 time: 0.470488 Oct 11 01:29:27.835858 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a82a94e8-ba18-4111-bbf1-ebb5e771dda3 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.094125 Oct 11 01:29:27.836116 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1380/2709] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:27 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1486 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:27.836863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1330/2710] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:27 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:27.851020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:27.852720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:27.862097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:27.862845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:27.863273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.867247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.868073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.869107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.869956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.873455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.883695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.884598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.886718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:27.899550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:27.904534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:27.905341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:28.049684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lazy-loading 'flavor' on Instance uuid cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:29:28.209059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0006c06-442d-42e1-8487-bc19a24bff61 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420/action" status: 202 len: 0 microversion: 2.1 time: 0.359836 Oct 11 01:29:28.210044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1331/2711] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:29:27 2022] POST /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:28.230050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:28.230948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:28.248798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:28.256050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:28.256631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:28.257612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:28.266940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:28.272828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:28.519415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:28.530995 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-326085b4-d7e1-4427-a954-88f46e9c810a tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.688723 Oct 11 01:29:28.539387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1381/2712] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:27 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:28.751743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:28.763697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:28.763835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68cc01e5-e149-4f5e-933c-1dee497a012f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1494 microversion: 2.1 time: 0.547244 Oct 11 01:29:28.764315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:28.765938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1332/2713] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:28 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1494 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:28.779686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:28.782331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:28.782788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:28.783573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:28.784044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:28.784479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:28.852479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42457961-1f6e-4f46-abea-73deeb08312f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f687280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:28.938763 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42457961-1f6e-4f46-abea-73deeb08312f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1426 microversion: 2.1 time: 0.090232 Oct 11 01:29:28.951119 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1333/2714] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:28 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:29.188953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2f12a3d-23df-4b70-ab06-b42a0f0f8ed7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Action: 'create', calling method: .version_select at 0x7f112f6a01f0>, body: {"keypair": {"name": "tempest-keypair-1608618256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsKrGkXXIklHt8XhVdow5WV+jDtwdSaRYOqlLIZDv1ogzvQD9xOiRSu558133P5hDOw5VqnT2K1XqEt4w6iC6LgBPdMsO5g05FUK0N5+jnDlVbEob2C7hKjmGlxIVaMSA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:29.213814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e2f12a3d-23df-4b70-ab06-b42a0f0f8ed7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Getting quotas for project 62941683f1424477a526145684d699c9. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:29.222619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e2f12a3d-23df-4b70-ab06-b42a0f0f8ed7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Getting quotas for user 498eb6f88cf54eee8cea0ee29497e1ea and project 62941683f1424477a526145684d699c9. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:29.275630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2f12a3d-23df-4b70-ab06-b42a0f0f8ed7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.212922 Oct 11 01:29:29.282676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1334/2715] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:29:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:29.293390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:29.301570 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-623179b0-296e-4b1c-9434-55e4dfc7f122 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.542636 Oct 11 01:29:29.319366 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1382/2716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:28 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:29.563732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:29.564612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:29.582797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:29.585094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:29.587452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:29.589736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:29.593856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:29.597011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:29.789586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:29.790564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:29.804206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:29.804722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:29.807329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:29.808109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:29.808768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:29.811316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:29.847010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:29.861339 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a669a42c-08f0-4042-965b-aecdb4d9135b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.297530 Oct 11 01:29:29.862203 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1335/2717] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:29 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:29.956401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20d22683-54d6-4388-ab57-d42ed49d84e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f687160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.030704 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20d22683-54d6-4388-ab57-d42ed49d84e4 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1435 microversion: 2.1 time: 0.078493 Oct 11 01:29:30.031929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1336/2718] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:29 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1435 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:30.045954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c6a239c-7160-473a-8c21-a9860b68c5c0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f6a0c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.118095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c6a239c-7160-473a-8c21-a9860b68c5c0 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 200 len: 1435 microversion: 2.1 time: 0.076022 Oct 11 01:29:30.118685 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1337/2719] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:30 2022] GET /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 1435 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:30.131991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46900100-d06c-4e69-a298-5ca1239096c7", "name": "network-vif-plugged", "status": "completed", "tag": "d6962181-9644-4c2e-a11b-3eef7a9ec1e7"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:30.151587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.151996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.152446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.160034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:30.174211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] Creating event network-vif-plugged:d6962181-9644-4c2e-a11b-3eef7a9ec1e7 for instance 46900100-d06c-4e69-a298-5ca1239096c7 on n-h2-772273-9 Oct 11 01:29:30.181171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c79ed1de-845d-44d1-ac53-81e434424063 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 200 len: 1477 microversion: 2.1 time: 0.394675 Oct 11 01:29:30.182084 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1383/2720] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:29 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:30.189364 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b745ab9f-a4b9-4755-8515-f39284b2648e req-11cf5c85-b487-4624-aa75-d02f34590469 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064620 Oct 11 01:29:30.189988 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1338/2721] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:30.198204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.198835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:30.211278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1723641032"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:30.211645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.212746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.213392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.214358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.215110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.215740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.224187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:30.242899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.243836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.244638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.249245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.250139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.250808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.295263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:30.564598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:30.577020 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f682249d-1ea6-4d0e-8706-e0694b878422 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1479 microversion: 2.1 time: 0.393624 Oct 11 01:29:30.578045 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1384/2722] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:30 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1479 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:30.588996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.600883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:30.607459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.608172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.608813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.609720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.610311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.610858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.630186 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66f41c07-e6cd-4866-b87e-994fd450b3e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420/action" status: 202 len: 0 microversion: 2.1 time: 0.421186 Oct 11 01:29:30.638066 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1339/2723] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:29:30 2022] POST /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:29:30.647762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6cb5a0aa-fcab-4853-a5e3-20193af8a61a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6873a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.735181 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6cb5a0aa-fcab-4853-a5e3-20193af8a61a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.095771 Oct 11 01:29:30.745042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1340/2724] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:30 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:30.888075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:30.888981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:30.890379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:30.898171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6260884-ac7e-4b21-85d0-993001c4fc8f tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.317803 Oct 11 01:29:30.902620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1385/2725] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:30 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:30.905040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.906127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.906750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:30.908275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:30.919587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:30.924615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:31.244223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "81081d62-4fbb-439d-b7b2-982e692f27a7"}], "security_groups": [{"name": "tempest-securitygroup--1914894963"}], "key_name": "tempest-keypair-1608618256", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:31.703811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:31.713100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7188dd2f-3444-4a4f-8428-e66b2164f7bc tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1325 microversion: 2.1 time: 0.829070 Oct 11 01:29:31.713703 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1341/2726] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:30 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1325 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:31.716268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] validate_networks() for [('81081d62-4fbb-439d-b7b2-982e692f27a7', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:29:31.731638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:31.732545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:31.739251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:31.740311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:31.741498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:31.742564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:31.743221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:31.743850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.078018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:32.088294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1746eac-3025-44b8-9bca-20024ca6e573 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1466 microversion: 2.1 time: 0.373246 Oct 11 01:29:32.089151 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1342/2727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:31 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1466 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:32.114682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dce339c-bc4d-476c-8d8d-f7d793223312 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6df040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:32.165263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dce339c-bc4d-476c-8d8d-f7d793223312 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.057024 Oct 11 01:29:32.166150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1343/2728] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:32 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:32.173100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a9177b1-f5d0-4364-b3b6-90172c33f851"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:32.176117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:32.185529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.186027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.186501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.187281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.187773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.188209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.465096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f27f8bf8-75bf-4a0f-ac03-77cd43cdbac8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297226 Oct 11 01:29:32.471473 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1344/2729] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:29:32 2022] POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:32.492211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:32.492211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:32.499615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.499615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.500089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.500751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.501214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.501643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.587577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:29:32.588060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:29:32.588564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:29:32.589055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:29:32.589563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:29:32.599064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.599663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.600868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.602027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.602566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.603068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.622650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Getting quotas for project 62941683f1424477a526145684d699c9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:32.629158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Getting quotas for user 498eb6f88cf54eee8cea0ee29497e1ea and project 62941683f1424477a526145684d699c9. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:32.642563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:29:32.645193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:29:32.705645 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2cfea775-6376-4063-9c58-153cb6efc775 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.466592 Oct 11 01:29:32.706964 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1386/2730] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:29:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:29:32.714068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61c9e075-8e18-4e0f-8165-6189364ab608 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f1138845040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:32.738927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:32.749108 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15bdbd6b-6028-485d-888c-e8f2444c4a92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.281971 Oct 11 01:29:32.750036 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1345/2731] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:32 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:32.755136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0cee41c5-1ad6-49af-902f-888d27ac9e61 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:32.756219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0cee41c5-1ad6-49af-902f-888d27ac9e61 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:32.833870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cee41c5-1ad6-49af-902f-888d27ac9e61 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:32.853801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0cee41c5-1ad6-49af-902f-888d27ac9e61 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1226 microversion: 2.1 time: 0.099951 Oct 11 01:29:32.860604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1346/2732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:32 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:32.870610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:32.871565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:32.882773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.883784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.884495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:32.885438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:32.886270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:32.886924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.269632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:33.310421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffa8235d-b160-4908-a613-67fd016e9e54 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1522 microversion: 2.1 time: 0.448485 Oct 11 01:29:33.310921 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1347/2733] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:32 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:33.344372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eac6c97f-6b99-4631-80d5-d18e855537da tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6eb430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.441880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eac6c97f-6b99-4631-80d5-d18e855537da tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.109196 Oct 11 01:29:33.442763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1348/2734] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:33 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:33.456903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.459316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:33.479720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.480866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.481451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.481972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.483651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.484152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.530342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] HTTP exception thrown: Instance is not a member of specified network Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Request method failure captured: Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7/ips/invalid HTTP/1.1 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMbfYKGwGIPf-4D8_TRYH5dVR3KUfkm2PvHFlELh4lziBhBIl-htpYi7_FELRVy7gTyp5Cqqh2-6ND-G91j18I9CcyYVA6M535UikeHMpW7N2K5-L0IofYx6EEs_cR7Uwp2Mn8Fh1UfjUNI7maiAUGHGgnlYhofxpEgXoY-z6o1vXpg Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:29:33.540642 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e3d9b3f542849aab94752df552f2830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5cbdc269fbb74da690a14d7e346abe68 Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance is not a member of specified network Oct 11 01:29:33.542012 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '46900100-d06c-4e69-a298-5ca1239096c7', 'id': 'invalid'} Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 11 01:29:33.542982 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.546168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:33.547067 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd0a6659-1467-4987-a02b-9b04e282f714 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.103324 Oct 11 01:29:33.547749 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1349/2735] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:29:33 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7/ips/invalid => generated 91 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:29:33.559650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.560164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Failed to fetch instance by id 999 {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:29:33.561618 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] HTTP exception thrown: Instance 999 could not be found. Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Request method failure captured: Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMbfYKGwGIPf-4D8_TRYH5dVR3KUfkm2PvHFlELh4lziBhBIl-htpYi7_FELRVy7gTyp5Cqqh2-6ND-G91j18I9CcyYVA6M535UikeHMpW7N2K5-L0IofYx6EEs_cR7Uwp2Mn8Fh1UfjUNI7maiAUGHGgnlYhofxpEgXoY-z6o1vXpg Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:29:33.563218 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e3d9b3f542849aab94752df552f2830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5cbdc269fbb74da690a14d7e346abe68 Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 999 could not be found. Oct 11 01:29:33.564890 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '999'} Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 11 01:29:33.565633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:33.567117 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41a1df2c-f086-4802-993f-70ec7afce0c1 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009298 Oct 11 01:29:33.569951 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1350/2736] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:29:33 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:29:33.576684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.577374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:33.589752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.590413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.591082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.591918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.592443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.592889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.652130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:29:33.798341 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d6d7716-dbb8-4dae-bfd4-85885f93a03b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "DELETE /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 204 len: 0 microversion: 2.1 time: 0.226761 Oct 11 01:29:33.798939 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1351/2737] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:29:33 2022] DELETE /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:29:33.807254 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61c9e075-8e18-4e0f-8165-6189364ab608 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "DELETE /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2" status: 204 len: 0 microversion: 2.1 time: 1.098032 Oct 11 01:29:33.808685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1387/2738] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:32 2022] DELETE /compute/v2.1/images/95f68c42-860d-479b-b77b-678cd0ff59d2 => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:29:33.813907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.814767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:33.829181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:33.830114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:33.838026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.838828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.839557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.839938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.840582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.840818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.841486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.842234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.842828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:33.856388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:33.857042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:33.857710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.300982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:34.305097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:34.313819 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b4baa7e4-ecbb-4aeb-8b59-30c7772d75d3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.503853 Oct 11 01:29:34.317438 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1388/2739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:33 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:34.330605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-753baffd-b6a4-4961-acdb-04eb1bc38a74 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '.version_select at 0x7f112f0e03a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:34.330805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-402515b7-139a-4dfe-af9a-8b06315e8759 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1528 microversion: 2.1 time: 0.507301 Oct 11 01:29:34.342021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1352/2740] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:33 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1528 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:34.347503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:34.348061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:34.356252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.356766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.357236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.358011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.358887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.359439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.367230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-753baffd-b6a4-4961-acdb-04eb1bc38a74 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] HTTP exception thrown: Image not found. Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-753baffd-b6a4-4961-acdb-04eb1bc38a74 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Request method failure captured: Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 HTTP/1.1 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMaTTr7mnI2N8fV1NzwnXePXILyCwMwjnVFsQ5Fta9_L8QJkg3o29c3FQQbAGDQkNSxMYk6qFWU2BGins29Mt_QWkuHzK4a-KF5bIC2muaRT3idT1AuFLb9wVRCFYdTyucDAvW2lTP8OGd5mUMSn59Xopua2uRLrAgvZYL1_k-l3X80 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:29:34.369917 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0951c4b4cb6e42cf989b8078b8889aed Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4339e9a6-8484-4cf5-bc19-ed9b9c618a71'} Oct 11 01:29:34.371248 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4339e9a6-8484-4cf5-bc19-ed9b9c618a71 to delete Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:34.372251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4339e9a6-8484-4cf5-bc19-ed9b9c618a71 could not be found. Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:34.373778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-753baffd-b6a4-4961-acdb-04eb1bc38a74 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:34.375212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-753baffd-b6a4-4961-acdb-04eb1bc38a74 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "DELETE /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71" status: 404 len: 62 microversion: 2.1 time: 0.052743 Oct 11 01:29:34.381160 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1389/2741] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:34 2022] DELETE /compute/v2.1/images/4339e9a6-8484-4cf5-bc19-ed9b9c618a71 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:29:34.392176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:34.415775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.418436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.420969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.438605 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] Creating event network-vif-unplugged:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:29:34.452216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0ceb9c61-8ab9-47b0-ac79-b881dd8ebf3c req-c79b2608-a349-4671-9b19-577c270634bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060607 Oct 11 01:29:34.453498 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1390/2742] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:34.461483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:34.462453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:34.469799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.470642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.471121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.471858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.472372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.472811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.475034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:34.489059 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6b9ec31-1661-4d94-b71c-7f04f1e8d14c tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1278 microversion: 2.1 time: 0.145836 Oct 11 01:29:34.490385 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1353/2743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:34 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:34.504433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:29:34.505559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-409495ac-cc2f-4a3b-83b6-74ab563f11df tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f93a0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:34.592599 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-409495ac-cc2f-4a3b-83b6-74ab563f11df tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.100210 Oct 11 01:29:34.594258 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1354/2744] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:34 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:34.609788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a36cd1f-a0c7-4ffb-b579-23abc5f0840f tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 204 len: 0 microversion: 2.1 time: 0.154614 Oct 11 01:29:34.610306 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1391/2745] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:29:34 2022] DELETE /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:29:34.618701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:34.619501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:34.626111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.626763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.627214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.627980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:34.628439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:34.628871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:34.990531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:35.001856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdf28f27-8f97-4edb-9d7a-3f6999537f0b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1472 microversion: 2.1 time: 0.387000 Oct 11 01:29:35.005605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1355/2746] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:34 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:35.344300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:35.345794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:35.357864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:35.359211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:35.361140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:35.361645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:35.362088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:35.362795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:35.363251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:35.365944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:35.371456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:35.372249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:35.373606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:35.376474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:35.379489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:35.380365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:36.490463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:36.500564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:36.508810 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4baf86ef-4b3e-4694-b896-44ffb1e31f40 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1528 microversion: 2.1 time: 1.153387 Oct 11 01:29:36.510011 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1356/2747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:35 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1528 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:36.510723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc746282-95a1-4cb6-94e8-75621a6683ff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 1.170759 Oct 11 01:29:36.524790 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1392/2748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:35 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:36.534048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:36.535921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ca3bfc6-3e0e-481b-9b83-16a85845ad96 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138937f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:36.536140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:36.550899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:36.553509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:36.554575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:36.555323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:36.557997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:36.558616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:36.589847 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ca3bfc6-3e0e-481b-9b83-16a85845ad96 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.063648 Oct 11 01:29:36.590696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1393/2749] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:36 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:36.595729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:36.596603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:36.603858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:36.604675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:36.605366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:36.606312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:36.607709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:36.608418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:36.967904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:36.970920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:36.985049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4505326b-0314-4661-934e-08985250558a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.462772 Oct 11 01:29:36.985659 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1357/2750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:36 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:36.995571 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-682eeb07-20c5-4dad-9168-5c4bc5f63345 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1472 microversion: 2.1 time: 0.397120 Oct 11 01:29:36.995571 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1394/2751] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:36 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:36.999303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420", "name": "network-vif-plugged", "status": "completed", "tag": "c06b841f-93eb-4944-8773-319bc394c028"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:37.034077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:37.034643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:37.035008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:37.058218 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] Creating event network-vif-plugged:c06b841f-93eb-4944-8773-319bc394c028 for instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 on n-h2-772273-9 Oct 11 01:29:37.064555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-070da99e-054b-41de-93fe-58b93458ea00 req-6218af65-f4c7-4b9c-b0c4-f6edbfda8f4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071280 Oct 11 01:29:37.069220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1395/2752] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:37.542033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:37.544139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:37.545207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:37.547523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:37.551262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:37.561613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:37.562541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:37.563003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:37.563594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:37.564146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:37.564628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:37.565407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:37.566191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:37.566736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:37.567438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:37.567979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:37.568481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:37.609488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:37.838472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:37.855256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9f5dda9-8950-47ef-b4e1-68c48e2e5dbe tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1528 microversion: 2.1 time: 0.323783 Oct 11 01:29:37.855913 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1358/2753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:37 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1528 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:37.865596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d165a74b-d3d7-4f3f-bb62-6fd7baff3252 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f93aee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:37.878075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:37.884000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:37.890371 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8055ca20-13ed-4fec-9f5f-52922481f3c9 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.356643 Oct 11 01:29:37.892146 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1396/2754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:37 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:37.938706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d165a74b-d3d7-4f3f-bb62-6fd7baff3252 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.081492 Oct 11 01:29:37.943390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1359/2755] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:37 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:38.035165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:38.035867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:38.038648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:38.039228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:38.053557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.054815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.055433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.056036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.056573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.057213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.058079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.058877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.059557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.060169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.060744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.061358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.338756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:38.355325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:38.369146 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a6ecc05-be1e-4245-84fe-8c7a07f8358b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1472 microversion: 2.1 time: 0.358344 Oct 11 01:29:38.369849 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-503f16ec-bc15-40b0-8fe2-0b7bf9136d76 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.362573 Oct 11 01:29:38.370649 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1397/2756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:38 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:38.371411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1360/2757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:38 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:38.379489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc854f84-87ac-4170-8912-6fa4ee0ce53d", "tag": "82616e45-b73d-4606-ae6d-94cbb9498ce8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:38.392495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.393298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.394022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.408229 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] Creating event network-changed:82616e45-b73d-4606-ae6d-94cbb9498ce8 for instance bc854f84-87ac-4170-8912-6fa4ee0ce53d on n-h1-772273-9 Oct 11 01:29:38.413238 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-778f78c9-1b91-4cae-b32a-59ac639075bb req-b969ec75-395d-49e7-af85-8cb65399cf64 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040238 Oct 11 01:29:38.414617 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1398/2758] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:38.880553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:38.881362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:38.897171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.899813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.900293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.904826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.906394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.908291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.922642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:38.925092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:38.946740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.951688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.952259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.953227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.953774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.954286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.995538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:38.996206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:38.996730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:38.997438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lazy-loading 'fault' on Instance uuid 46900100-d06c-4e69-a298-5ca1239096c7 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:29:39.136648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbdc269fbb74da690a14d7e346abe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d9b3f542849aab94752df552f2830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:39.145989 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21007134-f169-4101-9e34-4c59980d0f8b tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 200 len: 1315 microversion: 2.1 time: 0.271628 Oct 11 01:29:39.146894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1361/2759] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:38 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:39.152399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1bf49ee-dc1b-4542-9f16-63fa8059f424 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6d44c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:39.221765 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1bf49ee-dc1b-4542-9f16-63fa8059f424 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.073549 Oct 11 01:29:39.223071 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1362/2760] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:39 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:39.282351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:39.297514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-439eec44-2314-4203-9524-ec2d492d8bed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.383466 Oct 11 01:29:39.299000 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1399/2761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:38 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:39.397894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:39.399103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:39.402124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:39.406188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:39.408878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:39.409507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:39.409984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:39.410697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:39.411164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:39.411641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:39.428342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:39.430093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:39.432466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:39.435637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:39.437657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:39.441556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:39.527429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:39.532088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:39.532926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:39.533146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lazy-loading 'fault' on Instance uuid 4031c69a-2b7c-4b3b-b511-10c44436546e {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:29:39.645157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0951c4b4cb6e42cf989b8078b8889aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea60e7ee0040c3973093f1a640ec93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:39.655175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-421d8f15-ef27-497a-835c-ef10f244437b tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 200 len: 1307 microversion: 2.1 time: 0.261213 Oct 11 01:29:39.656209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1400/2762] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:39 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 1307 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:39.727316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:39.735686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d20b158-cff3-4007-bd6d-9211eb6632c9 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.347072 Oct 11 01:29:39.751635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1363/2763] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:39 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:40.170052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:40.170836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] [instance: 46900100-d06c-4e69-a298-5ca1239096c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:40.190323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.191193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.192024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.192974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.193645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.194306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.222027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] HTTP exception thrown: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Request method failure captured: Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 HTTP/1.1 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMbfYKGwGIPf-4D8_TRYH5dVR3KUfkm2PvHFlELh4lziBhBIl-htpYi7_FELRVy7gTyp5Cqqh2-6ND-G91j18I9CcyYVA6M535UikeHMpW7N2K5-L0IofYx6EEs_cR7Uwp2Mn8Fh1UfjUNI7maiAUGHGgnlYhofxpEgXoY-z6o1vXpg Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:29:40.224666 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e3d9b3f542849aab94752df552f2830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e3d9b3f542849aab94752df552f2830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 2e3d9b3f542849aab94752df552f2830 Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-238436794 Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5cbdc269fbb74da690a14d7e346abe68 Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-238436794-project Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. Oct 11 01:29:40.226266 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '46900100-d06c-4e69-a298-5ca1239096c7'} Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:40.227143 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. Oct 11 01:29:40.228830 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.233099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] Returning 404 to user: Instance 46900100-d06c-4e69-a298-5ca1239096c7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:40.234810 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a9702b0-6df6-428b-a6c5-4cdc37922b72 tempest-ServerAddressesNegativeTestJSON-238436794 tempest-ServerAddressesNegativeTestJSON-238436794-project] 10.222.0.66 "GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7" status: 404 len: 111 microversion: 2.1 time: 0.068322 Oct 11 01:29:40.235632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1401/2764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:40 2022] GET /compute/v2.1/servers/46900100-d06c-4e69-a298-5ca1239096c7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:29:40.239098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22d4d56e-cb54-4c80-aee9-6c96734b090b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6a6a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:40.313861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22d4d56e-cb54-4c80-aee9-6c96734b090b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.078869 Oct 11 01:29:40.316781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1364/2765] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:40 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:40.325727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:40.327032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:40.341710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.347206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.349627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.351322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.353939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.356924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.499085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46900100-d06c-4e69-a298-5ca1239096c7", "name": "network-vif-deleted", "tag": "d6962181-9644-4c2e-a11b-3eef7a9ec1e7"}, {"server_uuid": "4031c69a-2b7c-4b3b-b511-10c44436546e", "name": "network-vif-deleted", "tag": "1e820056-72ec-4f31-8278-43c9e67546ad"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:40.535248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.541433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.543602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.591479 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Creating event network-vif-deleted:d6962181-9644-4c2e-a11b-3eef7a9ec1e7 for instance 46900100-d06c-4e69-a298-5ca1239096c7 on n-h2-772273-9 Oct 11 01:29:40.600572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] Creating event network-vif-deleted:1e820056-72ec-4f31-8278-43c9e67546ad for instance 4031c69a-2b7c-4b3b-b511-10c44436546e on n-h2-772273-9 Oct 11 01:29:40.609654 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-82934665-92b2-4d97-bb2d-f2ab4a422b17 req-95793bd5-c5c8-4508-bb13-2178b1f947f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115664 Oct 11 01:29:40.610897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1365/2766] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:40.680704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:40.681522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] [instance: 4031c69a-2b7c-4b3b-b511-10c44436546e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:40.692468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.694323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.695027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.696570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.697526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:40.698231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.699863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.709052 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34adc807-fc8b-4c61-869c-d887348ac406 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.388576 Oct 11 01:29:40.709832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1402/2767] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:40 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:40.729439 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] HTTP exception thrown: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Request method failure captured: Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e HTTP/1.1 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMaTTr7mnI2N8fV1NzwnXePXILyCwMwjnVFsQ5Fta9_L8QJkg3o29c3FQQbAGDQkNSxMYk6qFWU2BGins29Mt_QWkuHzK4a-KF5bIC2muaRT3idT1AuFLb9wVRCFYdTyucDAvW2lTP8OGd5mUMSn59Xopua2uRLrAgvZYL1_k-l3X80 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:29:40.731849 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/26ea60e7ee0040c3973093f1a640ec93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 26ea60e7ee0040c3973093f1a640ec93 Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-613992763 Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0951c4b4cb6e42cf989b8078b8889aed Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerTestJSON-613992763-project Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. Oct 11 01:29:40.733558 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4031c69a-2b7c-4b3b-b511-10c44436546e'} Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:29:40.734460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. Oct 11 01:29:40.737664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:29:40.739686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] Returning 404 to user: Instance 4031c69a-2b7c-4b3b-b511-10c44436546e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:29:40.740798 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f79a76f-f3f7-4c64-a77a-7e5ea2384527 tempest-ImagesOneServerTestJSON-613992763 tempest-ImagesOneServerTestJSON-613992763-project] 10.222.0.66 "GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e" status: 404 len: 111 microversion: 2.1 time: 0.065161 Oct 11 01:29:40.746964 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1366/2768] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:40 2022] GET /compute/v2.1/servers/4031c69a-2b7c-4b3b-b511-10c44436546e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:29:40.759655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:40.760268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:40.768167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.768666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.769095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:40.769794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:40.776615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:40.778876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:41.332322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b653bc1-8a3d-41e5-afed-981f4ebeb55e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6a65e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:41.386871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:41.401070 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a16f9ee-7b13-4450-ae4c-50ddae81c4e5 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.642275 Oct 11 01:29:41.402680 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b653bc1-8a3d-41e5-afed-981f4ebeb55e tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.073789 Oct 11 01:29:41.411672 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1367/2769] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:41 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:41.416991 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1403/2770] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:40 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:41.741602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:41.743067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:41.751648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:41.752500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:41.753353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:41.754437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:41.755143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:41.755819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:42.418900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2334488e-47f8-4701-b6e7-763c7b229032 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11387bed30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:42.496121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2334488e-47f8-4701-b6e7-763c7b229032 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.081789 Oct 11 01:29:42.504575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1404/2771] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:42 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:42.512079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:42.513008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:42.521683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:42.523043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:42.524265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:42.525227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:42.526254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:42.527243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:42.613988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:42.637746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:42.798646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:42.811691 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80da3a78-48e5-4a0a-950d-c4684a42d7e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 1.072938 Oct 11 01:29:42.815132 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1368/2772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:41 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:43.156298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:43.168405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cbe22a46-cb8e-457a-b2d3-becfd286bd0a tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.662127 Oct 11 01:29:43.169603 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1405/2773] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:42 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:43.512763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3eea360-3068-4245-83cd-301681d5a6f0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f770dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:43.529837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:43.588425 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3eea360-3068-4245-83cd-301681d5a6f0 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.079937 Oct 11 01:29:43.590101 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1369/2774] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:43 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:43.847694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:43.849010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:43.858937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:43.859893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:43.860552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:43.861526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:43.862653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:43.864187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:44.200052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:44.201683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:44.226047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:44.227076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:44.227835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:44.228588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:44.231708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:44.232707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:44.393820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:44.408080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcbce31c-4a4e-49e7-87c6-bba2aef7c96b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1543 microversion: 2.1 time: 0.567703 Oct 11 01:29:44.410632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1406/2775] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:43 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1543 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:44.608289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b38fe16-b76c-46e5-8e39-172d11e5167c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388b8f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:44.683707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:44.703056 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c23a0ee1-baac-415c-b72e-e373e173d441 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.498887 Oct 11 01:29:44.705535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1370/2776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:44 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:44.738585 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b38fe16-b76c-46e5-8e39-172d11e5167c tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.138299 Oct 11 01:29:44.740818 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1407/2777] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:44 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:45.100978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc854f84-87ac-4170-8912-6fa4ee0ce53d", "name": "network-vif-plugged", "status": "completed", "tag": "82616e45-b73d-4606-ae6d-94cbb9498ce8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:45.124962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:45.125584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:45.127366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:45.157840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] Creating event network-vif-plugged:82616e45-b73d-4606-ae6d-94cbb9498ce8 for instance bc854f84-87ac-4170-8912-6fa4ee0ce53d on n-h1-772273-9 Oct 11 01:29:45.169382 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7fece2d4-8b68-4b67-9938-7763ba9945f2 req-ca7e1835-0b8c-4bc3-81c9-47c23be60732 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072873 Oct 11 01:29:45.173781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1371/2778] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:45.435389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:45.435952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:45.455500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:45.458858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:45.462208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:45.468912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:45.470503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:45.483787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:45.731946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:45.732660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:45.748635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:45.760670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:45.764403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:45.766072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:45.766554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:45.766996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:46.531145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:46.546095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-414fc276-00a7-4a21-a9dc-e3809e977332 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1542 microversion: 2.1 time: 1.116129 Oct 11 01:29:46.551445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1408/2779] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:45 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1542 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:46.613064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-421beabf-e0ef-41f0-b564-a623741bd1f1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388ebc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:46.684767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:46.705845 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-feeafb6f-279f-479e-b49d-46ba24481cd3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1352 microversion: 2.1 time: 0.976385 Oct 11 01:29:46.706967 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1372/2780] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:45 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1352 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:46.716752 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-421beabf-e0ef-41f0-b564-a623741bd1f1 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.118910 Oct 11 01:29:46.725926 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1409/2781] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:46 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:46.733450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:46.742129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:46.777657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:46.780909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:46.784619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:46.786914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:46.788778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:46.792194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:46.850770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'flavor' on Instance uuid 701db354-8bfa-4fc1-9b36-b8f3726ebb21 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:29:47.072530 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a7da0a06-7cea-4c0a-be11-08e5a7187e2c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/action" status: 200 len: 32 microversion: 2.1 time: 0.361008 Oct 11 01:29:47.088678 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1373/2782] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:29:46 2022] POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:29:47.089004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:47.089774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:47.091842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:47.106812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.109537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.109984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:47.113247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.114143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.116899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:47.576808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:47.577935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:47.588901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.592506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.593268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:47.594283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.594995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.598416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:47.734705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:47.744497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a6659cf-2868-499a-bdf1-30a49fa06e92 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.660239 Oct 11 01:29:47.749628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1410/2783] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:47 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:47.763629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d93d3a8e-e052-45b6-a032-f9e8eff75dc8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138932430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:47.864182 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d93d3a8e-e052-45b6-a032-f9e8eff75dc8 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.112642 Oct 11 01:29:47.866881 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1411/2784] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:47 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:47.872717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:47.873568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:47.887272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.888369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.888974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:47.889857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:47.890484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:47.891075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.293502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:48.307301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7dde6812-7072-46fe-b83c-520d741584e8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1542 microversion: 2.1 time: 0.734680 Oct 11 01:29:48.308290 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1374/2785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:47 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1542 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:48.381523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:48.405550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-136c5f41-fed5-41ba-a631-7e65903873e3 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1542 microversion: 2.1 time: 0.537348 Oct 11 01:29:48.406178 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1412/2786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:47 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1542 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:48.432095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:48.432991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:48.443315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:48.451909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:48.452680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.454470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:48.455209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:48.455903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.667523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e20a4b8f-0b37-4104-bb7f-1b5809da0615 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240027 Oct 11 01:29:48.668471 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1375/2787] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:29:48 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:29:48.777618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:48.778857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:48.788415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:48.796348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:48.796824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.797596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:48.802004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:48.802475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.823655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-unplugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:48.858115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:48.861313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:48.866835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:48.927753 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Creating event network-vif-unplugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:29:48.941685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:29:48.961256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0187c3e8-f332-4880-9be4-57e512987d95 req-807e2098-8e05-45fd-a171-2185feaca1d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143077 Oct 11 01:29:48.962443 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1376/2788] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:29:48.979784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-389d2c5a-02df-4f7b-9cdf-85f2eda5f222 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112fa5e430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:49.091979 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-389d2c5a-02df-4f7b-9cdf-85f2eda5f222 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.124222 Oct 11 01:29:49.092836 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1377/2789] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:48 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:49.334597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:49.335702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:49.357160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:49.357550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:49.358001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:49.358902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:49.359860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:49.360792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:50.060991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:50.074525 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8c1add7-8199-4848-92ac-5735013d2e80 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1474 microversion: 2.1 time: 0.743961 Oct 11 01:29:50.075497 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1378/2790] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:49 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1474 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:50.108543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8fb53b55-1b28-4e0a-9eeb-09343b19d000 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f113401b040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:50.147821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:50.159794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a1b648ff-517e-4afd-954d-d92dfbfa6fea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 1.386073 Oct 11 01:29:50.160397 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1413/2791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:48 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:50.184490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8fb53b55-1b28-4e0a-9eeb-09343b19d000 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.079779 Oct 11 01:29:50.185587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1379/2792] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:50 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:51.098264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:51.098891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:51.114296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:51.114859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:51.115561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:51.118565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:51.119280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:51.119999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:51.191105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:51.192922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:51.218592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:51.225295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:51.233379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:51.234610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:51.236323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:51.236766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:51.875027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:51.887195 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea089600-efd6-40be-b451-3f76f0b28e66 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1471 microversion: 2.1 time: 0.789485 Oct 11 01:29:51.887867 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1414/2793] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:51 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1471 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:51.898927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3cc801cd-d7c4-4e99-8568-69c3122eee01 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11389415e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:51.939881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:51.950227 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf157883-7e15-4c3d-a764-b73bca1d561e tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.765707 Oct 11 01:29:51.956433 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1380/2794] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:51 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:51.963385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc854f84-87ac-4170-8912-6fa4ee0ce53d", "tag": "82616e45-b73d-4606-ae6d-94cbb9498ce8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:51.986137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3cc801cd-d7c4-4e99-8568-69c3122eee01 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.097169 Oct 11 01:29:51.986723 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1415/2795] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:51 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:51.989889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.006615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:52.006859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.010019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:52.011132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.034791 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] Creating event network-changed:82616e45-b73d-4606-ae6d-94cbb9498ce8 for instance bc854f84-87ac-4170-8912-6fa4ee0ce53d on n-h1-772273-9 Oct 11 01:29:52.049670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.049917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c8268781-e318-4d37-8234-0a4531295f58 req-0ac755fd-938c-4d49-a4f0-98640c280dc3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091794 Oct 11 01:29:52.050176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.056891 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1381/2796] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:52.063669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.065121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.069616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.071594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.230265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.245088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.248802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.253186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.254513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.257303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.330880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:52.348967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:52.554904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:52.619970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c3855c34-3d4c-4fbf-8939-155c052d035a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54/action" status: 202 len: 0 microversion: 2.1 time: 0.631482 Oct 11 01:29:52.620798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1416/2797] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:29:51 2022] POST /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:29:52.630414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:52.631277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:52.646077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.646950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.648200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.651106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:52.651905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:52.654176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:52.998085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:52.999529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:53.014946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:53.015857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:53.016537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:53.017513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:53.018317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:53.018985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:53.220684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:53.227562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:29:53.234043 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66076d4c-66b5-46d6-972e-f53c3a5749b1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1470 microversion: 2.1 time: 0.608631 Oct 11 01:29:53.240596 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1382/2798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:52 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1470 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:53.251439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bcfea05-c542-4702-8932-9d8942705315 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6a6a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:53.336488 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bcfea05-c542-4702-8932-9d8942705315 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.093527 Oct 11 01:29:53.338060 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1383/2799] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:53 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:53.995293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:54.019696 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89a738e5-a257-489c-ae97-212fb9cd2b54 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 1.031657 Oct 11 01:29:54.030841 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1417/2800] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:52 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:54.319831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:54.319831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:54.319831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:54.319831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:54.321317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:54.321317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:54.321317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:54.321317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:54.363816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-979743dc-6e77-4351-978a-4a8e8954be34 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112fe5d9d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:54.487520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-979743dc-6e77-4351-978a-4a8e8954be34 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.137461 Oct 11 01:29:54.494521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1418/2801] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:54 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:55.060753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:55.062373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:55.083520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:55.097405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:55.098281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04c4a6d5-37da-479e-a0ff-b2f1c6f6cbec tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1470 microversion: 2.1 time: 0.833588 Oct 11 01:29:55.099290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:55.100003 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1384/2802] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:54 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1470 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:55.101878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:55.106494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:55.108106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:55.110246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:55.508942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2b4c6e9-8a59-4278-aed6-fdcfd368e945 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6a6dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:55.597885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2b4c6e9-8a59-4278-aed6-fdcfd368e945 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.092636 Oct 11 01:29:55.607668 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1385/2803] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:55 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:55.630545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:55.654146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9dc95466-3ba2-4610-86e0-56fea7cc318a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.611371 Oct 11 01:29:55.675799 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1419/2804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:55 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:55.895681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-plugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:55.925651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:55.926149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:55.926588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:55.958069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Creating event network-vif-plugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:29:55.968279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:29:55.981432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8634c9cd-d7c2-487e-9432-75641d192421 req-7e58e736-394b-457c-bcf8-d17cc21725b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097393 Oct 11 01:29:55.982845 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1386/2805] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:29:56.122926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:56.123589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:56.141822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:56.142366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:56.142826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:56.147483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:56.147988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:56.148442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:56.476669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:56.489535 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8dc36f21-bf65-413a-b747-5e8f8a01cc92 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1470 microversion: 2.1 time: 0.371285 Oct 11 01:29:56.492693 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1420/2806] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:56 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:56.615514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b37aaa79-5b88-4eea-95f7-f41ed8cdf468 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388b4ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:56.693802 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b37aaa79-5b88-4eea-95f7-f41ed8cdf468 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.082984 Oct 11 01:29:56.716325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1421/2807] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:56 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:56.727186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:56.727870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:56.736789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:56.737304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:56.737753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:56.738497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:56.738928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1261196152", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "4cd21dfb-0b79-409c-8856-06a8aeb68e46"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:29:56.739428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:56.739535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:56.856660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] validate_networks() for [('4cd21dfb-0b79-409c-8856-06a8aeb68e46', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:29:57.118456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:57.128198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e093c346-7f5c-4e78-bc08-a87f7509b17f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.410381 Oct 11 01:29:57.132094 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1422/2808] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:56 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:57.517076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:57.517696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:57.537204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:57.537706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:57.538358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:57.539144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:57.539637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:57.540071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:58.197948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:29:58.198452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:29:58.199074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:29:58.199604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:29:58.200072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:29:58.223136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:58.223995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:58.224641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:58.225922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:58.226551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:58.227161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:58.271241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:29:58.279170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for user 6d11c60413dc43ba8d71d6ce37823d1a and project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:29:58.283274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:58.291753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9a49da4-0d3b-442c-8e6b-1f7a792d90fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1470 microversion: 2.1 time: 0.777941 Oct 11 01:29:58.300306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:29:58.303860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:29:58.315640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1423/2809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:57 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:58.321943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03f69de7-4246-4ac7-a1b7-93d8ae4e7a53 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f113893a940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:58.399184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03f69de7-4246-4ac7-a1b7-93d8ae4e7a53 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.082239 Oct 11 01:29:58.408321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1424/2810] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:58 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:58.412660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:58.413501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:58.424302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:58.428857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:58.429418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:58.430302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:58.430879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:58.431313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:58.436886 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bc02923-62c9-4b0e-ac5a-3136d69fc073 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921749 Oct 11 01:29:58.439742 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1387/2811] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:29:58.472160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-97b35c34-4ad5-4f64-8cc0-f8309c8331e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:58.473044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-97b35c34-4ad5-4f64-8cc0-f8309c8331e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:58.603147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-97b35c34-4ad5-4f64-8cc0-f8309c8331e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:58.614063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-97b35c34-4ad5-4f64-8cc0-f8309c8331e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1225 microversion: 2.1 time: 0.150967 Oct 11 01:29:58.618227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1388/2812] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:58 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:58.966866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:59.000298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6705e523-a2ea-4ba4-ae6d-6ea42fe684a2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.591673 Oct 11 01:29:59.022620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1425/2813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:58 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:59.328708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:59.329549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:59.345011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:59.346739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:59.361819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:59.365157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:59.369420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:59.370293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:59.416803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe905f24-e988-4f1c-9910-126593d3e3b3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138937c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:59.547942 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe905f24-e988-4f1c-9910-126593d3e3b3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.135691 Oct 11 01:29:59.550129 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1426/2814] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:29:59 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:29:59.646224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:29:59.647511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:29:59.669074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:59.669761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:59.671833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:59.673915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:29:59.676359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:29:59.677097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:29:59.724757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:59.733334 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acc78819-ec05-40bc-b94e-d44a2954ea7c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1536 microversion: 2.1 time: 0.409935 Oct 11 01:29:59.737619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1389/2815] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:59 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1536 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:29:59.841058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:29:59.859279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f127a9c3-36ae-4d84-a383-936306d49823 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1221 microversion: 2.1 time: 0.214741 Oct 11 01:29:59.864231 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1427/2816] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:29:59 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:00.026489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:00.027122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:00.038525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.039663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.040508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:00.042860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.044747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.046457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:00.239709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:00.249079 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-616b4d0c-05aa-47cb-ba24-a635f95aa5a1 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.226468 Oct 11 01:30:00.251532 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1390/2817] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:00 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:00.580301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d05c588a-6805-4944-9990-dd6cd2a9eac3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388ebaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:00.706948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d05c588a-6805-4944-9990-dd6cd2a9eac3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.146646 Oct 11 01:30:00.708239 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1428/2818] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:00 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:00.764188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:00.765939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:00.778250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.780980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.787437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:00.794633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.796140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.799314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:00.891554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:00.892400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:00.911386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.918638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.927699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:00.932219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:00.933465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:00.935358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:01.421023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:01.444766 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0926a4d0-0ded-4bf8-9fca-b769d06189f1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1283 microversion: 2.1 time: 0.557275 Oct 11 01:30:01.456095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1429/2819] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:00 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1283 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:01.483149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:01.483910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:01.511364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:01.514501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:01.517703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:01.520109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:01.536488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:01.537063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.174440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.186389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83aeb2c7-9779-4c45-ad71-54f877431937 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1536 microversion: 2.1 time: 1.424725 Oct 11 01:30:02.187517 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1391/2820] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:00 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1536 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:02.192643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-faa326de-71db-4be2-8266-bea3beff0076 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f679b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:02.265345 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-faa326de-71db-4be2-8266-bea3beff0076 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.076603 Oct 11 01:30:02.265942 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1392/2821] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:02 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:02.274833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-unplugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:02.300436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.303987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.304655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.306284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:02.330844 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Creating event network-vif-unplugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:30:02.348985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:30:02.359981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-31d277a4-191c-4a8d-9f74-4eb7c063827a req-2bd4b24a-701e-4aea-94bf-e17e49c0c45d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090752 Oct 11 01:30:02.365023 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1393/2822] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:02.381995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:02.387930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.388987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Searching by: {'deleted': False, 'project_id': 'e967a2d138324b878186862d1b6ee2e0'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:30:02.402688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.403393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.404350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.406033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.412053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.412641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.413101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.425528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f7c83b0-0591-4331-8145-98be0628d96a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.966276 Oct 11 01:30:02.443385 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1430/2823] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:01 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:02.472550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:30:02.484781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:02.485563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:02.501181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.503208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.505733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.512511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.513447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.516195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.538501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e28b3db-c085-4591-839a-84a557f36e91 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.171893 Oct 11 01:30:02.539461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1394/2824] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:30:02 2022] GET /compute/v2.1/servers => generated 340 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:02.553074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:02.558481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.564083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Searching by: {'deleted': False, 'project_id': 'e967a2d138324b878186862d1b6ee2e0'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:30:02.574091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.577437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.581031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.582281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.582972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.585022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.648915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:30:02.715849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.725941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:02.726742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:02.727367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:02.732558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:02.756109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07d0b51b-83c7-4177-a420-5b064996b85f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1283 microversion: 2.1 time: 0.276762 Oct 11 01:30:02.757734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1431/2825] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:02 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:02.984167 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de917c6c-b5d1-476c-839e-3f9a598fc52b tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.434724 Oct 11 01:30:02.985380 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1395/2826] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:30:02 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:03.016332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95051c51-2fc8-4173-9e07-1bef52bfec7c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.036961 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95051c51-2fc8-4173-9e07-1bef52bfec7c tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028104 Oct 11 01:30:03.051257 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1432/2827] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:30:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:03.222594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.224713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:03.252768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.256437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.258825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.267962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.268904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.281908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-483c7d8a-2114-41e0-9521-52eb53e1d1c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138932b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.288601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.445710 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-483c7d8a-2114-41e0-9521-52eb53e1d1c5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1440 microversion: 2.1 time: 0.160018 Oct 11 01:30:03.446399 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1433/2828] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:03 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1440 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:03.469662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.470230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:03.519248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.519792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.529114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.529950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.530445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.540381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.614353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:03.750387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:03.783742 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e082fac8-154b-45c8-82cc-eda1e9438177 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1529 microversion: 2.1 time: 0.570117 Oct 11 01:30:03.785780 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1396/2829] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:03 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1529 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:03.816878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.818873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:03.833227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.835863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.838115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.839353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.840660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.841484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.900083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e9925b7-5b99-4e37-b0e7-ffd67bd38be9 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 204 len: 0 microversion: 2.1 time: 0.434995 Oct 11 01:30:03.908253 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1434/2830] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:03 2022] DELETE /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:03.922609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:03.924325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:03.935071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.935776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.936290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:03.937019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:03.937576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:03.938017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:04.134036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:04.145999 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b7c96fa-96b3-46cd-8898-2f26d50486d2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1283 microversion: 2.1 time: 0.235719 Oct 11 01:30:04.148358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1435/2831] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:03 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1283 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.168363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.169772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:04.178297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:04.179191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:04.179852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:04.180823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:04.181486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:04.182112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:04.285877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:04.301824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bae4e2d3-2747-42c2-8c4f-6b83223639d2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 0.496406 Oct 11 01:30:04.303013 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1397/2832] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:03 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.310644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.314389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:04.327295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:04.328055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:04.328690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:04.329622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:04.330253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:04.330844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:04.528333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:04.538449 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edad8e8c-a879-4abc-86a1-93f67c11acbd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1529 microversion: 2.1 time: 0.388582 Oct 11 01:30:04.540661 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1436/2833] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:04 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1529 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.548356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55dd35bd-a446-4b2f-a0b6-eae2e99eeaf6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1138937e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.625243 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55dd35bd-a446-4b2f-a0b6-eae2e99eeaf6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1449 microversion: 2.1 time: 0.080564 Oct 11 01:30:04.626430 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1437/2834] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:04 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1449 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.640333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3570bed-e85b-4010-9f6e-dd1524fbece7 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.655460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e3570bed-e85b-4010-9f6e-dd1524fbece7 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] HTTP exception thrown: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3570bed-e85b-4010-9f6e-dd1524fbece7 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Request method failure captured: Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/flavors/10f3b25d-8039-45f6-aee9-884505edf24e HTTP/1.1 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYsgnsa5R4RPdUfc_bEz3JhUc_6LKyTsX1ECgtQudYed7v-GykUJ5ieNV_y9rujTZPEBGptGVJD1dCkeFdnuPmAPDMO9Z1wevd53u33XmhjR5wIF5uMO46PTFpGVwBE1mxgFiYQ-IvvhETkrlQRgXwHw2A2c-vXq4MmHcAtCiQBGOw Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6675a10ce51b4e2c96130047f59b3ed8 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MigrationsAdminTest-1540238484 Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 01:30:04.666848 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6675a10ce51b4e2c96130047f59b3ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6675a10ce51b4e2c96130047f59b3ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6675a10ce51b4e2c96130047f59b3ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6675a10ce51b4e2c96130047f59b3ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MigrationsAdminTest-1540238484 Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6675a10ce51b4e2c96130047f59b3ed8 Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MigrationsAdminTest-1540238484 Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MigrationsAdminTest-1540238484-project-admin Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 9b57f10f33354f6ebb2ab44528b0c480 Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MigrationsAdminTest-1540238484-project-admin Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: exception: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. Oct 11 01:30:04.668286 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '10f3b25d-8039-45f6-aee9-884505edf24e'} Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:04.669098 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. Oct 11 01:30:04.670381 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:04.671526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3570bed-e85b-4010-9f6e-dd1524fbece7 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Returning 404 to user: Flavor 10f3b25d-8039-45f6-aee9-884505edf24e could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:04.671526 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3570bed-e85b-4010-9f6e-dd1524fbece7 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/10f3b25d-8039-45f6-aee9-884505edf24e" status: 404 len: 109 microversion: 2.1 time: 0.041002 Oct 11 01:30:04.671526 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1438/2835] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:04 2022] DELETE /compute/v2.1/flavors/10f3b25d-8039-45f6-aee9-884505edf24e => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:04.684918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f259c8da-6d2f-4a3a-bc42-4fdb9c922564 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11388d0c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.713137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:04.729637 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aeda1567-2eb9-4f29-8ff2-33da968cdffc tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1715 microversion: 2.1 time: 0.423131 Oct 11 01:30:04.734260 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1398/2836] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:04 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1715 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.774323 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f259c8da-6d2f-4a3a-bc42-4fdb9c922564 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 200 len: 1449 microversion: 2.1 time: 0.101739 Oct 11 01:30:04.774933 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1439/2837] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:04 2022] GET /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 1449 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:04.792579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d169faf6-b192-4702-8f02-b0068e27249d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11343d1b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:04.925289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2068513607", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:05.121491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:30:05.965859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d169faf6-b192-4702-8f02-b0068e27249d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 204 len: 0 microversion: 2.1 time: 1.177813 Oct 11 01:30:05.966300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1399/2838] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:04 2022] DELETE /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:05.972203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:05.973520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:05.991752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:05.994486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:05.995085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:05.995887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:05.998556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:05.999056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.145584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:30:07.146085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:30:07.146465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:30:07.147058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:30:07.147664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:30:07.177752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.184409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.190217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.191403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.195655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.196423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.252773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:07.279778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Getting quotas for user 1b5963412e234d698b2db2c737008fe2 and project 37136bfbc76b4dfb8fd90866e0be5b51. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:07.292962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:07.304759 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-236a51be-0541-4ea4-9513-ee1cea298f09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 1.336663 Oct 11 01:30:07.312233 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1400/2839] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:05 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:07.321842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:07.326813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:07.328221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:30:07.330243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:30:07.348459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.349262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.349926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.350861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.354516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.356157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.490079 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-193c1ee5-7797-4000-968f-e2d107e76dc8 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.570231 Oct 11 01:30:07.499118 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1440/2840] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:30:07.517976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:07.523923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:07.532214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.532931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.533603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:07.535246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:07.535991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:07.536635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:08.837951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:08.842198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:08.852093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47d1cf08-1eba-4ead-985d-0b9ce4bc01f0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1715 microversion: 2.1 time: 1.349729 Oct 11 01:30:08.858225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1441/2841] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:07 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1715 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:08.863978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:08.869061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:08.880421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eee6b6cd-d1ac-4314-a3ed-3787229b9c86 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1732 microversion: 2.1 time: 1.566809 Oct 11 01:30:08.881035 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1401/2842] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:07 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1732 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:08.883532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:08.884271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:08.887114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:08.888091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:08.891544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:08.892324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:08.894693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-plugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:08.920737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:08.923012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:08.923691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:08.924323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:08.969750 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] Creating event network-vif-plugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:30:08.976427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:08.981084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-324d5032-17a1-4931-b545-d0c451733f69 req-685d7427-44a3-4f2d-a821-154d889274d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093962 Oct 11 01:30:08.982536 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1402/2843] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:08.990843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:08.993195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:08.993578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:09.006552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:09.007538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:09.008240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:09.009805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:09.010596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:09.022518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:09.202590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5895e8b5-52e1-4f46-b05d-777789e02493 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 204 len: 0 microversion: 2.1 time: 0.342617 Oct 11 01:30:09.203583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1442/2844] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:08 2022] DELETE /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:09.222741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e7d1e-81f2-49a0-88c2-db59f40fbeda", "tag": "d839ca6f-bd05-44f6-94d9-ce25d51db0aa"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:09.264131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:09.265313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:09.265983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:09.288291 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] Creating event network-changed:d839ca6f-bd05-44f6-94d9-ce25d51db0aa for instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda on n-h2-772273-9 Oct 11 01:30:09.294341 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-98c57907-bc76-4f5c-b4cd-a5870f63c8a6 req-864760af-87c3-4cd0-9e27-7c41dfda5cf2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085807 Oct 11 01:30:09.298837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1443/2845] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:09.304629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:09.305428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:09.313465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:09.313955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:09.314436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:09.315144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:09.315632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:09.316431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:09.341660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:09.355316 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f2be6b7-fd23-491b-961e-bdb76de4b6f3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1265 microversion: 2.1 time: 0.368851 Oct 11 01:30:09.356372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1403/2846] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:08 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1265 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:09.411681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1916064695", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "11db0ee6-bf74-4f94-a889-16aabb18b472"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:09.502834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] validate_networks() for [('11db0ee6-bf74-4f94-a889-16aabb18b472', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:30:10.299879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:10.311109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50d44e84-8fa8-465e-ab7a-760c440e63e8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 1.010751 Oct 11 01:30:10.312544 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1444/2847] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:09 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:10.340670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:10.341297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:10.347237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:10.347765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:10.348211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:10.348915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:10.349380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:10.349814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:10.839234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:10.850201 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d2e992b-f93f-414b-909d-d3128d85aa85 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1715 microversion: 2.1 time: 0.513306 Oct 11 01:30:10.851013 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1445/2848] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:10 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1715 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:10.857014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:10.857819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:10.866427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:10.867701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:10.868542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:10.868859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:10.869321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:10.869753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.186229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:30:11.187417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:30:11.188106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:30:11.188525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:30:11.188937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:30:11.199901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.200929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.202238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.203168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.203843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.204746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.231453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:11.239615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Getting quotas for user a0510e6acedd400f86f1c8f9e8a1c75d and project 323766d0a64b43e1843bc9358c41678f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:11.255990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:30:11.259635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:30:11.275151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:11.293080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ed96de5-d9a2-44ec-bb18-c9c6cef077e4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1712 microversion: 2.1 time: 0.439556 Oct 11 01:30:11.293651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1446/2849] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:10 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1712 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:11.298274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:11.299066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:11.306092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.307254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.307984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.308945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.309623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.310282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.331081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76c0e769-7e6f-4bfa-a93f-988e94784330 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.926857 Oct 11 01:30:11.340545 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1404/2850] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:30:11.345585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51d078e-694b-4d05-aa9c-73e770d883b5", "name": "network-vif-unplugged", "status": "completed", "tag": "36bf633f-d382-4732-9e64-55e07eae5084"}, {"server_uuid": "cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420", "name": "network-vif-unplugged", "status": "completed", "tag": "c06b841f-93eb-4944-8773-319bc394c028"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:11.363466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.364263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.365320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.405800 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Creating event network-vif-unplugged:36bf633f-d382-4732-9e64-55e07eae5084 for instance a51d078e-694b-4d05-aa9c-73e770d883b5 on n-h2-772273-9 Oct 11 01:30:11.406611 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] Creating event network-vif-unplugged:c06b841f-93eb-4944-8773-319bc394c028 for instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 on n-h2-772273-9 Oct 11 01:30:11.414012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-729f4874-85c1-46c4-a033-73730513dadc req-976b4ccc-f056-4d79-9c6e-c3aa6ca7f35d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.072165 Oct 11 01:30:11.415164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1405/2851] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:11.423425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:11.424326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:11.433306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.434025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.434637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.435480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.436042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.436727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.471885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:11.481172 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7a7979a-b530-41a5-8b50-cf5c47917c4b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1265 microversion: 2.1 time: 0.186472 Oct 11 01:30:11.502198 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1447/2852] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:11 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:11.507211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-431e42a0-3404-4df8-9408-a0406ccdbb74 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:11.507727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-431e42a0-3404-4df8-9408-a0406ccdbb74 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:11.527616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:11.819403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-431e42a0-3404-4df8-9408-a0406ccdbb74 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:11.832321 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-431e42a0-3404-4df8-9408-a0406ccdbb74 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1208 microversion: 2.1 time: 0.325659 Oct 11 01:30:11.834428 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1448/2853] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:11 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:11.846525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:11.850060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:11.867815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.868602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.869764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:11.870960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:11.871724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:11.872345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.079612 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Cannot 'detach_volume' instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 while it is in vm_state rescued Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments/4a9177b1-f5d0-4364-b3b6-90172c33f851 HTTP/1.1 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:12.085052 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:12.087175 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'detach_volume' instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 while it is in vm_state rescued Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '701db354-8bfa-4fc1-9b36-b8f3726ebb21', 'id': '4a9177b1-f5d0-4364-b3b6-90172c33f851'} Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:12.088174 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 while it is in vm_state rescued Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 while it is in vm_state rescued Oct 11 01:30:12.089960 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:12.092459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 409 to user: Cannot 'detach_volume' instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 while it is in vm_state rescued {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:12.094203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8eaddd3-2300-452c-a3a9-662e192e23d4 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments/4a9177b1-f5d0-4364-b3b6-90172c33f851" status: 409 len: 152 microversion: 2.1 time: 0.257548 Oct 11 01:30:12.098300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1449/2854] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:30:11 2022] DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments/4a9177b1-f5d0-4364-b3b6-90172c33f851 => generated 152 bytes in 263 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:12.118224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:12.123326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:12.154847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.156757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.158522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.161309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.162169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.164544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.248893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:12.252806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:12.266545 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07f24b7f-0ac2-40dc-b224-cb5d79604406 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 0.849709 Oct 11 01:30:12.267100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1406/2855] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:11 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:12.281521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51d078e-694b-4d05-aa9c-73e770d883b5", "name": "network-vif-deleted", "tag": "36bf633f-d382-4732-9e64-55e07eae5084"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:12.305142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.305729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.306213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.336590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] Creating event network-vif-deleted:36bf633f-d382-4732-9e64-55e07eae5084 for instance a51d078e-694b-4d05-aa9c-73e770d883b5 on n-h2-772273-9 Oct 11 01:30:12.347883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-eb0a8fd5-fc9d-4e03-a5a6-404bcf842c60 req-f1ecf273-a1a1-41b4-9251-0fbfd3b79c9a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079443 Oct 11 01:30:12.352159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:12.362092 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1407/2856] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:12.369754 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d524560-6d7e-4c2b-9516-0f935b622c45 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1647 microversion: 2.1 time: 0.267244 Oct 11 01:30:12.372428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:12.375591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:12.384335 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1450/2857] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:12 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1647 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:12.390398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.394852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.396531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.398493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.401494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.405695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.509174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:12.521959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:12.545113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.545992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.546713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.547791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.548566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.549828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.608889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d27f0ef3-1770-4cc5-8cb6-016e9d2d3d7f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/action" status: 202 len: 0 microversion: 2.1 time: 0.243825 Oct 11 01:30:12.609597 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1408/2858] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:30:12 2022] POST /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:30:12.618764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:12.622942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:12.641310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.643266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.646620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.648988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.650788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.655376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.763805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:12.788085 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0881dcb8-d43d-41dd-8d08-7bb0b2425fad tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1265 microversion: 2.1 time: 0.283241 Oct 11 01:30:12.817046 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1451/2859] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:12 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:12.861994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:12.862811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:12.882574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.883437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.890841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:12.892988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:12.894457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:12.896052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.359859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:13.369278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ca53db6-3cad-4fb3-9158-21ccdb3d79fa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1260 microversion: 2.1 time: 0.512215 Oct 11 01:30:13.379667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1452/2860] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:12 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1260 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:13.384663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:13.385276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:13.412039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.412542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.412979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.429266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.430019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.430660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.549178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:13.558651 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8799058-b17a-4071-8294-1a0638a7e9c2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1720 microversion: 2.1 time: 0.944370 Oct 11 01:30:13.559247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1409/2861] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:12 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1720 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:13.564366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:13.565223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:13.587184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.588886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.590609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.595115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.597073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.597753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.690984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.691839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.692820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.693634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lazy-loading 'fault' on Instance uuid a51d078e-694b-4d05-aa9c-73e770d883b5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:30:13.803905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a739b9413e414385c9a118b65ff828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e967a2d138324b878186862d1b6ee2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:13.821263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb771955-3f78-4deb-81de-792d50b44580 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 200 len: 1367 microversion: 2.1 time: 0.260641 Oct 11 01:30:13.823009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1410/2862] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:13 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:13.844477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:13.845655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:13.854727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.857243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.858971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:13.863108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:13.866073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:13.866073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.020409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:14.043729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68a386f5-f355-44c9-bdfd-8d1872424bef tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1283 microversion: 2.1 time: 0.196367 Oct 11 01:30:14.046277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1411/2863] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:13 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:14.116356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:14.132227 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-06ee68ad-50a3-4076-8006-bd74a93772d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 0.750971 Oct 11 01:30:14.133551 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1453/2864] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:13 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:14.402828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:14.403470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:14.424896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.426534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.428331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.429091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.429552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.431966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.586956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:14.588119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:14.607792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.611049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.613216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.621757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.622915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.624909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.650001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:14.662409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fbe6bee-4cdb-4330-a44f-1a233ce26479 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1278 microversion: 2.1 time: 0.265480 Oct 11 01:30:14.668529 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1412/2865] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:14 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:14.849744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:14.850728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] [instance: a51d078e-694b-4d05-aa9c-73e770d883b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:14.858161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.858914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.859674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.860460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:14.861132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:14.861772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:14.877358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] HTTP exception thrown: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Request method failure captured: Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 HTTP/1.1 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMaelvZfSjdTBRX1YIO5hiRKV4Xg_VUJJ6SCDioF8bIG5vtx8sMQsk2fQqKbvqDYdxn8JnxrBb3wSvGrQK_JmbHJa0m9nl8ycsy4IK-otL0OdemAhqXfG-r9KYa2ma7KQr8VG32VAM2-TYRdXEDpZjoD_7fkovEn8HJ2cA6cafq1Lhs Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e967a2d138324b878186862d1b6ee2e0 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestManualDisk-1773782708 Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:14.879491 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e967a2d138324b878186862d1b6ee2e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e967a2d138324b878186862d1b6ee2e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e967a2d138324b878186862d1b6ee2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e967a2d138324b878186862d1b6ee2e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestManualDisk-1773782708 Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e967a2d138324b878186862d1b6ee2e0 Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestManualDisk-1773782708 Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestManualDisk-1773782708-project Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 52a739b9413e414385c9a118b65ff828 Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestManualDisk-1773782708-project Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. Oct 11 01:30:14.881012 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'a51d078e-694b-4d05-aa9c-73e770d883b5'} Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:14.881784 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. Oct 11 01:30:14.882965 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:14.885616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Returning 404 to user: Instance a51d078e-694b-4d05-aa9c-73e770d883b5 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:14.887484 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca95cd95-5d07-437b-a3df-5ebc8cc5ee2e tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5" status: 404 len: 111 microversion: 2.1 time: 0.040915 Oct 11 01:30:14.888643 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1413/2866] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:14 2022] GET /compute/v2.1/servers/a51d078e-694b-4d05-aa9c-73e770d883b5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:30:14.897187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7832a01a-fc74-4783-999d-5bbc593595b0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] Calling method '.version_select at 0x7f112f679dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:14.922037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7832a01a-fc74-4783-999d-5bbc593595b0 tempest-ServersTestManualDisk-1773782708 tempest-ServersTestManualDisk-1773782708-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724080920" status: 202 len: 0 microversion: 2.1 time: 0.029022 Oct 11 01:30:14.923545 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1414/2867] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724080920 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:30:15.066778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:15.068358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:15.079666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.081076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.081768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.083672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.084755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.085432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.470847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:15.478347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:15.480832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b66d6d4-df99-4700-8998-479311cba3f5 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1720 microversion: 2.1 time: 0.898815 Oct 11 01:30:15.492142 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1454/2868] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:14 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1720 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:15.497835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:15.498750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:15.499567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-569a969f-d091-4154-a8bf-9d1ff19deb12 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1271 microversion: 2.1 time: 0.436929 Oct 11 01:30:15.501859 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1415/2869] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:15 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1271 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:15.518396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.519943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.520672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.521612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.522282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.523034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.691929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:15.693241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:15.699865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.700661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.701344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.702359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:15.703034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:15.703706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:15.941689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:15.953224 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acd57b8c-b566-4fbb-8bdf-1f6bf71b96cd tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1266 microversion: 2.1 time: 0.264866 Oct 11 01:30:15.977250 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1416/2870] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:15 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:16.020595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:16.084585 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1ae3af4-1b0a-450a-99fa-da9c1014b856 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 0.564997 Oct 11 01:30:16.085760 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1455/2871] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:15 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:16.129553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420", "name": "network-vif-deleted", "tag": "c06b841f-93eb-4944-8773-319bc394c028"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:16.160735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.162883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.165376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.206218 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] Creating event network-vif-deleted:c06b841f-93eb-4944-8773-319bc394c028 for instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 on n-h2-772273-9 Oct 11 01:30:16.231225 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-dfe382d1-ad60-4c37-8026-fe490f0f8336 req-de673fb3-ed75-4aa0-81c4-0d0c9be596f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100930 Oct 11 01:30:16.232268 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1417/2872] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:16.462932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e7d1e-81f2-49a0-88c2-db59f40fbeda", "name": "network-vif-plugged", "status": "completed", "tag": "d839ca6f-bd05-44f6-94d9-ce25d51db0aa"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:16.488360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.488995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.489453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.513341 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] Creating event network-vif-plugged:d839ca6f-bd05-44f6-94d9-ce25d51db0aa for instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda on n-h2-772273-9 Oct 11 01:30:16.519854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:16.521278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:16.529485 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6790a784-030c-44ba-a8aa-deb02853b581 req-f5785dca-39f4-4dcd-bf84-7c5f5e43b8a5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070202 Oct 11 01:30:16.530679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1456/2873] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:16.532999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.534524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.536660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.539383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:16.539975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:16.540196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.541185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.541824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.569197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.569732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.570154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.570872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.571354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.571788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.853744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:16.869104 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f554f3c0-4e34-4358-8b78-701f82132fdf tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1271 microversion: 2.1 time: 0.335025 Oct 11 01:30:16.871456 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1457/2874] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:16 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:16.892162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:16.919575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5ba016b-5671-4e0c-937c-c118c5a43ce2 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1720 microversion: 2.1 time: 0.404637 Oct 11 01:30:16.920482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1418/2875] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:16 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1720 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:16.980518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:16.981052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:16.992306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.992918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.993341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:16.995684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:16.997045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:16.998054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.112721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:17.113663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:17.125087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.130541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.131027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.132013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.132653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.133254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.212171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:17.228310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:17.246332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32ac0c8b-fb87-40d9-9f2e-82f36a95fec7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1266 microversion: 2.1 time: 0.269713 Oct 11 01:30:17.246945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1458/2876] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:16 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:17.437821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:17.454035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-618da9af-995e-4031-9840-d08ff8b5c801 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1325 microversion: 2.1 time: 0.345933 Oct 11 01:30:17.468865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1419/2877] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:17 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:17.893842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:17.895482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:17.911130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.913837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.914630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.915564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.917926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.919602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.945602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:17.946237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:17.960290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.961345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.962041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.962992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:17.966506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:17.967242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:17.967796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:18.594495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:18.605925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:18.609049 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e66bdc31-aee4-4b6f-a2ff-f66abb7a0db7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.719235 Oct 11 01:30:18.617921 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1459/2878] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:17 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:18.625372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbb8a440-fb9e-4a3e-af33-43930d4e7c88 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1720 microversion: 2.1 time: 0.684317 Oct 11 01:30:18.625729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:18.625977 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1420/2879] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:17 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1720 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:18.626691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:18.630644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:18.631249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:18.635165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:18.636181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:18.637497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:18.638853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:18.639723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:18.640354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:18.655720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:18.656309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:18.656819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:18.657572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:18.658028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:18.658449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.186400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:19.201528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15433ab2-def9-450d-92e7-40f0580c8878 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.580727 Oct 11 01:30:19.202950 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1460/2880] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:18 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:19.249577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:19.268380 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5172d26-28b5-4993-bf24-66cbc3b77b20 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.640467 Oct 11 01:30:19.270383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1421/2881] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:18 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:19.298411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:19.299967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:19.309830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.312269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.313920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.315001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.315927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.316842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.604072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:19.616883 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-79555d9e-869c-42e4-bd6d-8302130536f9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.328033 Oct 11 01:30:19.617489 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1461/2882] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:19 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:19.641527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:19.642559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:19.655186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.656458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.657035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.659138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75ae29a1-77af-4bcc-a82b-bc58b812bc28 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-43809172", "metadata": {"": ""}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:19.659595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.660158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.661240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75ae29a1-77af-4bcc-a82b-bc58b812bc28 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action HTTP/1.1 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 105 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:19.669045 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-43809172", "metadata": {"": ""}}} Oct 11 01:30:19.670471 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-43809172', 'metadata': {'': ''}}}} Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'': ''} Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:19.671251 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.674449 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:19.678101 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:19.682120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75ae29a1-77af-4bcc-a82b-bc58b812bc28 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:19.683282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75ae29a1-77af-4bcc-a82b-bc58b812bc28 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action" status: 400 len: 170 microversion: 2.1 time: 0.032916 Oct 11 01:30:19.697193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1462/2883] 10.222.0.66 () {60 vars in 1279 bytes} [Tue Oct 11 01:30:19 2022] POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action => generated 170 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:30:19.707011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:19.710163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:19.723561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.724289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.724957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:19.725901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:19.726584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:19.727234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.354845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:20.367899 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04159c59-b28a-41ce-ba4b-b1205813eb11 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.734836 Oct 11 01:30:20.369719 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1422/2884] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:19 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:20.376369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:20.377338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:20.389547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.390458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.391093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.392276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.393229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.393832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.454802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:20.463647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48e355e1-a2b3-432e-a9aa-1c8c23f8bba7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1726 microversion: 2.1 time: 0.764746 Oct 11 01:30:20.464828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1463/2885] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:19 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1726 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:20.470211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:20.471011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:20.477835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.478946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.479575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.480777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.481506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.482157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.828182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:20.838561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c8415a3-20e9-4f81-bc11-1666177db9e7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.466972 Oct 11 01:30:20.841448 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1423/2886] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:20 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:20.853375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:20.853991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:20.872874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.873757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.874463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.875607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.876535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.877270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.891547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:20.903078 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c7b85c4-d99e-430f-96bf-790d6f899c51 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.435375 Oct 11 01:30:20.904187 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1464/2887] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:20 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:20.927290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:20.929774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:20.942452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.943523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.944468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:20.945454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:20.946155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:20.947034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.006390 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-549c967a-a8a3-4d7c-893e-3264f17fef8c tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162510 Oct 11 01:30:21.008383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1424/2888] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:30:20 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:21.015635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:21.034374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:21.035475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:21.036268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.052962 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] Creating event network-changed:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:30:21.060711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-47054e24-952d-49a5-b338-fe8332dac531 req-317be2b0-1f37-4550-939a-b6f0c24a6457 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050854 Oct 11 01:30:21.061969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1425/2889] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:21.389447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:21.390376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:21.395901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:21.397086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:21.405144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:21.405993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:21.406781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.409553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:21.410234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:21.411025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.426313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:21.444189 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ebcc47f4-0078-46a1-b598-518f29b2b119 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.538488 Oct 11 01:30:21.445434 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1465/2890] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:20 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:21.448657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:21.471879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-468496ab-416d-469f-916b-359875a640e4 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-771315850", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-468496ab-416d-469f-916b-359875a640e4 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action HTTP/1.1 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 618 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:21.476832 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:21.478361 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:30:21.479101 n-d-772273-9 devstack@n-api.service[120493]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-771315850", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 11 01:30:21.479101 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:21.479101 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-771315850', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 01:30:21.479329 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:21.480100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.481905 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:30:21.482796 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:21.484151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-468496ab-416d-469f-916b-359875a640e4 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:21.485216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-468496ab-416d-469f-916b-359875a640e4 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action" status: 400 len: 938 microversion: 2.1 time: 0.017843 Oct 11 01:30:21.486326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1466/2891] 10.222.0.66 () {60 vars in 1279 bytes} [Tue Oct 11 01:30:21 2022] POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:30:21.494158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:21.494782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:21.502953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:21.503480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:21.503928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.504641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:21.505100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:21.505529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:21.824283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:21.984932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:21.994662 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3aee1703-9fbf-4495-bf4f-28b8422514c1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.504246 Oct 11 01:30:22.003796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1467/2892] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:21 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:22.003796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:22.003796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:22.008423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:22.008607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.008999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.009444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:22.019028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.019572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.020107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:22.020361 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-743513f4-628b-40ea-b0d5-d4e7e99722c7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.632286 Oct 11 01:30:22.022117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1426/2893] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:21 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:22.033259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:22.033891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:22.041288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.042043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.042708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:22.045323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.045986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.046650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:22.451151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:22.461836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:22.463629 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34506956-f01c-4aba-83a1-45b438c0fe6e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.440331 Oct 11 01:30:22.478923 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1427/2894] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:22 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:22.488128 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9a1b091-e718-4b96-ad6e-e3f1614c93e7 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.491175 Oct 11 01:30:22.489339 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1468/2895] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:21 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:22.491041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d24bdc4-ea89-4c79-b7a1-eb80c70a380c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d24bdc4-ea89-4c79-b7a1-eb80c70a380c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action HTTP/1.1 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 285 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:22.494750 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:30:22.496396 n-d-772273-9 devstack@n-api.service[120494]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:30:22.497120 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:30:22.497754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:30:22.502130 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:30:22.504943 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:30:22.504943 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:22.504943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d24bdc4-ea89-4c79-b7a1-eb80c70a380c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:22.504943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d24bdc4-ea89-4c79-b7a1-eb80c70a380c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action" status: 400 len: 619 microversion: 2.1 time: 0.014861 Oct 11 01:30:22.505625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1428/2896] 10.222.0.66 () {60 vars in 1279 bytes} [Tue Oct 11 01:30:22 2022] POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:30:22.514231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:22.515148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:22.521999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.522763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.523223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:22.523965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:22.524457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:22.524889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.052460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:23.053672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:23.063896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.065098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.065917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.066981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.067716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.069127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.116014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:23.125392 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdf3a29a-6c18-4c87-a570-dd58657a6525 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.616716 Oct 11 01:30:23.126087 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1469/2897] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:22 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:23.150664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:23.151532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:23.158418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.159088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.159728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.160625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.161260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.162191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.484593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:23.487897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:23.495559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da474290-dbf7-4933-b9d4-e145f6fa0caf tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.348822 Oct 11 01:30:23.495742 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cbc7cff-8e71-4d3c-a6bd-def5839a8457 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.447211 Oct 11 01:30:23.496144 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1470/2898] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:23 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:23.497890 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1429/2899] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:23 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:23.504681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef2ff7a-e314-46ee-8251-6623a3867921", "tag": "375d79c2-23f3-4c0e-be7f-0e323de62773"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:23.516085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:23.516698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:23.517007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.517926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.518585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.525202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.525615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.532627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.533544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.534189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.534761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.556655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] Creating event network-changed:375d79c2-23f3-4c0e-be7f-0e323de62773 for instance aef2ff7a-e314-46ee-8251-6623a3867921 on n-h1-772273-9 Oct 11 01:30:23.587828 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0b172bc7-ac9f-4870-ad93-05413fc5c968 req-87192a8a-c6ed-4607-8281-e1941b0d46b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086994 Oct 11 01:30:23.591411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1430/2900] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:23.600706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1632337611"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:23.603828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:23.613943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.614812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.616652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.617700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:23.618506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:23.619159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:23.980741 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d5703bc-0ab8-4f5c-a4d5-fc0ca96b5319 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action" status: 202 len: 0 microversion: 2.1 time: 0.386620 Oct 11 01:30:23.985699 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1431/2901] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:30:23 2022] POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:30:24.000457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:24.047683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.048332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.048945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.063297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:24.071304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9abd764-46de-48fb-8308-522f5b1fe150 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.558897 Oct 11 01:30:24.075189 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1471/2902] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:23 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:24.091813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-161752053"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:24.100138 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] Creating event network-changed:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:30:24.103409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:24.120307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f394d590-2803-40d8-9bcd-dbc79d42261a req-d4a14c2b-54c9-4089-aab3-66e81979afb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132428 Oct 11 01:30:24.125123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.125650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.127567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.127567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.127952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.128392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.135549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1432/2903] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:24.194582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Cannot 'createImage' instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda while it is in task_state image_snapshot_pending Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action HTTP/1.1 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 84 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:24.196549 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-161752053"}} Oct 11 01:30:24.197859 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'createImage' instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda while it is in task_state image_snapshot_pending Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-161752053'}}} Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:24.198586 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda while it is in task_state image_snapshot_pending Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda while it is in task_state image_snapshot_pending Oct 11 01:30:24.199786 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:24.203329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 409 to user: Cannot 'createImage' instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda while it is in task_state image_snapshot_pending {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:24.204538 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0aa4a664-717f-4bd2-ac10-22547ac75194 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action" status: 409 len: 167 microversion: 2.1 time: 0.128214 Oct 11 01:30:24.205696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1472/2904] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:30:24 2022] POST /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda/action => generated 167 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:24.217493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6532e021-6bc3-47bc-84b8-4537c5135c5d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f112f6a0310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:24.429194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6532e021-6bc3-47bc-84b8-4537c5135c5d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/images/1fd44e69-7ba0-4a84-9838-db7bfeee0b23" status: 204 len: 0 microversion: 2.1 time: 0.218887 Oct 11 01:30:24.430840 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1433/2905] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:24 2022] DELETE /compute/v2.1/images/1fd44e69-7ba0-4a84-9838-db7bfeee0b23 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:30:24.438756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:24.439428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:24.449816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.451394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.458365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.459510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.460188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.462034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.523410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:24.524742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:24.541062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.541852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.542468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.543562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:24.545849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:24.546484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:24.790027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:24.802423 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7098467-8f6f-4880-971d-19eceaee01a5 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1543 microversion: 2.1 time: 0.367258 Oct 11 01:30:24.803888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1473/2906] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:24 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:24.847886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:24.863961 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-352a2fb3-6d7e-4682-8efb-c383a8a00e5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.344489 Oct 11 01:30:24.880248 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1434/2907] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:24 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:25.100628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:25.102606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:25.114213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:25.115510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:25.116172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:25.117502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:25.118390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:25.119028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:25.826059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:25.826686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:25.834505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:25.835197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:25.835937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:25.836830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:25.837636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:25.838220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:25.954601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:25.965900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f012f7a-60a8-459c-b392-54a728a6f53d tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.873985 Oct 11 01:30:25.966507 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1474/2908] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:25 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:25.977180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:25.977828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:26.000340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:26.000839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:26.001287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:26.001998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:26.002456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:26.002878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:26.484175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:26.492919 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bd949f5-9873-4421-80c7-edf7f500f496 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1535 microversion: 2.1 time: 0.670726 Oct 11 01:30:26.493843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1435/2909] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:25 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1535 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:26.498924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:26.518066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:26.518914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:26.519653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:26.535499 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] Creating event network-changed:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:30:26.541475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-40acfcda-a909-4f1b-93e3-78de7b26a5ff req-51f9670e-7ce4-488a-bea9-0ea7eb08dbcb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046076 Oct 11 01:30:26.542750 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1436/2910] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:26.977168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:26.993336 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b39d9d4-28c2-4c44-a1d3-9717c3895850 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 1.024457 Oct 11 01:30:26.994390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:26.994941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:26.999688 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1475/2911] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:25 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:27.002706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.003203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.003666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.004365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.004819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.005241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.519150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:27.519752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:27.537030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:27.537883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.538655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.539488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.540692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.541823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.542732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.552284 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29885d29-6899-4f40-a6a5-521c3c975946 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.562228 Oct 11 01:30:27.553577 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1437/2912] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:26 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:27.660835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef2ff7a-e314-46ee-8251-6623a3867921", "name": "network-vif-plugged", "status": "completed", "tag": "375d79c2-23f3-4c0e-be7f-0e323de62773"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:27.682074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.683205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.684197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.699373 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] Creating event network-vif-plugged:375d79c2-23f3-4c0e-be7f-0e323de62773 for instance aef2ff7a-e314-46ee-8251-6623a3867921 on n-h1-772273-9 Oct 11 01:30:27.708788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-871761dd-5b31-4b2e-a114-3c94ee1c7c6d req-942f4a27-22ff-451c-9b47-1cd9f3ddd503 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051401 Oct 11 01:30:27.710932 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1438/2913] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:30:27.971658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:27.972322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:27.992673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.994288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.995003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:27.996844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:27.997700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:27.998344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:28.097049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:28.261714 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c88cb1f9-5b1e-48b9-b59e-2f6212ccd298 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 204 len: 0 microversion: 2.1 time: 0.294208 Oct 11 01:30:28.262959 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1439/2914] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:27 2022] DELETE /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:30:28.271067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:28.276586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:28.288658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:28.289521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:28.290351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:28.291291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:28.292570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:28.293667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:28.433901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:28.446891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f5ece781-5090-40db-a658-b43d3274b12c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1541 microversion: 2.1 time: 0.932358 Oct 11 01:30:28.447546 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1476/2915] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:27 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1541 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:28.457807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:28.458345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:28.474985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:28.475527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:28.475965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:28.476736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:28.477142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:28.477574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.111367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:29.133707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94b08ff6-412c-41e0-9d62-e0dfe1340b84 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.866570 Oct 11 01:30:29.149067 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1440/2916] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:28 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:29.159428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:29.160056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:29.176271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:29.176772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:29.181576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.185728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:29.186472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:29.187882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.270942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:29.286387 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1870e19-34ea-4ffe-a9ae-0097484a3c9e tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1667 microversion: 2.1 time: 0.833130 Oct 11 01:30:29.288379 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1477/2917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:28 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1667 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:29.479133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:29.482559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:29.494653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:29.495215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:29.501546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.504695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:29.506114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:29.509714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.611877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:29.622922 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90dfd77a-9a6e-42ee-aa9b-81afd9bf6d1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1308 microversion: 2.1 time: 0.472398 Oct 11 01:30:29.627250 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1441/2918] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:29 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:29.633894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:29.854942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-plugged", "status": "completed", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:29.862083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:29.876185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:29.879908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:29.884050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:29.922520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] Creating event network-vif-plugged:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:30:29.945868 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9d939730-b072-4192-bbf4-7597b28798a3 req-985704f4-dedc-4143-978f-45ebd9dcf257 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091330 Oct 11 01:30:29.950290 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1442/2919] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:30.321444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1181258215", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "7b257dd9-f324-41bc-aebc-c2b664a804a9"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:30.430925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] validate_networks() for [('7b257dd9-f324-41bc-aebc-c2b664a804a9', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:30:30.759701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:30.771795 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aad5743b-9e57-4699-8574-e4356c269490 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1541 microversion: 2.1 time: 1.304262 Oct 11 01:30:30.784266 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1478/2920] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:29 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1541 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:30.801995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:30.803069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:30.810983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:30.813541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:30.816775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:30.820601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:30.824268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:30.824949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.187664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:30:31.188498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:30:31.190368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:30:31.190984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:30:31.191940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:30:31.199157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:31.212927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.214284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.214905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.216789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.223437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.223733 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36b352ba-ed10-48f3-ba1c-0324a6bbf331 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1313 microversion: 2.1 time: 0.428986 Oct 11 01:30:31.224359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1479/2921] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:30 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:31.224873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.240943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:31.241588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:31.253701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.254199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.255170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.256399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.257311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.257916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.264592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Getting quotas for project 5f64cac30d694eeb9e846cc6932481ff. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:31.278586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Getting quotas for user 3ccf3e2e724b4d5f939fdedc0559bc6d and project 5f64cac30d694eeb9e846cc6932481ff. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:31.318116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:30:31.321798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:30:31.407858 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe41d598-ed5a-4294-b3d5-855439d71456 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364443 Oct 11 01:30:31.408897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1443/2922] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:30:31.414072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:31.415066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:31.424535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.425610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.426160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.427722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.428350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.429313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.516579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:31.532663 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eefa9c32-a228-4fd8-8ad9-244f659bafe7 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1667 microversion: 2.1 time: 0.307260 Oct 11 01:30:31.533712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1480/2923] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:31 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1667 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:31.543967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1765ddaf-219c-4a2c-9c54-bef1ae591bb8 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:31.546898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1765ddaf-219c-4a2c-9c54-bef1ae591bb8 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:31.726518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1765ddaf-219c-4a2c-9c54-bef1ae591bb8 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:31.744647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1765ddaf-219c-4a2c-9c54-bef1ae591bb8 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1228 microversion: 2.1 time: 0.208836 Oct 11 01:30:31.747311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1481/2924] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:31 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1228 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:31.800639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:31.801667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:31.819965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.821016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.822245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.824347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.827752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.829780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.882497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:31.894424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-246489db-0e58-4c73-9806-1aa4e8a2bd38 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1488 microversion: 2.1 time: 0.484217 Oct 11 01:30:31.899215 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1444/2925] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:31 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1488 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:31.925320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1948967182"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:31.935510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:31.964563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.968149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.975192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:31.976226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:31.978151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:31.978766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.087960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:32.089289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:32.103508 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-176affbe-89c8-45b2-a71b-d1c310ce7420 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1536 microversion: 2.1 time: 0.309923 Oct 11 01:30:32.104759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1482/2926] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:31 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1536 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:32.110000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e7d1e-81f2-49a0-88c2-db59f40fbeda", "name": "network-vif-plugged", "status": "completed", "tag": "d839ca6f-bd05-44f6-94d9-ce25d51db0aa"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:32.129612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.131619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.136564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.197383 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] Creating event network-vif-plugged:d839ca6f-bd05-44f6-94d9-ce25d51db0aa for instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda on n-h2-772273-9 Oct 11 01:30:32.205662 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5968495e-31c9-4275-97f4-97e533cc3897 req-1e923b56-678a-494a-86e1-0aa2b05cacf7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099458 Oct 11 01:30:32.208821 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1483/2927] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:32.249759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.251098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:32.269765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.273454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.274260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.274898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.278113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.280582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.485598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9d889fd-15f5-4a6c-8290-c71839f7911a tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "POST /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921/action" status: 202 len: 0 microversion: 2.1 time: 0.565331 Oct 11 01:30:32.489813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1445/2928] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:30:31 2022] POST /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 01:30:32.518871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-939d101d-96b7-467a-b274-d3b5c7e40f68 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f655790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.606241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-939d101d-96b7-467a-b274-d3b5c7e40f68 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3" status: 200 len: 1414 microversion: 2.1 time: 0.108952 Oct 11 01:30:32.609781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1446/2929] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:32.641495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.648474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:32.666906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.668381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.669001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.679635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.680814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.682958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.686069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:32.695967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d56fbf5b-e225-41f7-ad36-7300db472aba tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1463 microversion: 2.1 time: 0.449936 Oct 11 01:30:32.711449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1484/2930] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1463 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:32.711449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-408d7890-887c-4573-a793-667107856e1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112fd79430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.782911 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-408d7890-887c-4573-a793-667107856e1f tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3" status: 200 len: 1414 microversion: 2.1 time: 0.084856 Oct 11 01:30:32.792927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1485/2931] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:32.799005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.802700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:32.821663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.822452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.823058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.824024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.824674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.829030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.901741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:32.916575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1de033c-685f-4ad4-ad1d-b0d76b8766b6 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1599 microversion: 2.1 time: 0.305433 Oct 11 01:30:32.918376 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1447/2932] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1599 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:32.941181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:32.942103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:32.948562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.949409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.950027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:32.950983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:32.952098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:32.952779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.081411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:33.096186 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8999147-0cdd-466f-bde4-441952d51538 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1224 microversion: 2.1 time: 0.159730 Oct 11 01:30:33.097363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1448/2933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:33.102079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6bc4b998-a732-473d-ba24-20bf3f0bceaa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6525e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:33.190528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5a084ff-a346-4616-9614-214abd524f98 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1614 microversion: 2.1 time: 0.396044 Oct 11 01:30:33.208823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1486/2934] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:32 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1614 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:33.227886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:33.228949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:33.238119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.238872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.239899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.241096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.241759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.242535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.431322 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6bc4b998-a732-473d-ba24-20bf3f0bceaa tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3" status: 204 len: 0 microversion: 2.1 time: 0.332734 Oct 11 01:30:33.432302 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1449/2935] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:33 2022] DELETE /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:33.440662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:33.441359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:33.475496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.478513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.479157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.485068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.486329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.500046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.661554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b57f10f33354f6ebb2ab44528b0c480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6675a10ce51b4e2c96130047f59b3ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:33.662175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] flavor_id is None. Assuming migration. {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 01:30:33.662619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:30:33.693519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:33.711161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5013683f-6b47-4c82-af47-b761cef26f1f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1523 microversion: 2.1 time: 0.497810 Oct 11 01:30:33.712385 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1487/2936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:33 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:33.723673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-945bb1ed-28a2-4c39-a2b1-24058067c7e5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f11342eeaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:33.823559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-945bb1ed-28a2-4c39-a2b1-24058067c7e5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Image not found. Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-945bb1ed-28a2-4c39-a2b1-24058067c7e5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 HTTP/1.1 Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:33.831383 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ea01d320-fa07-4d67-9f04-e19ff4ce0ed3'} Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:33.833362 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 Oct 11 01:30:33.834562 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:33.836058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 could not be found. Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:30:33.837556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:30:33.838984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:33.844000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-945bb1ed-28a2-4c39-a2b1-24058067c7e5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:33.846792 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-945bb1ed-28a2-4c39-a2b1-24058067c7e5 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3" status: 404 len: 62 microversion: 2.1 time: 0.132565 Oct 11 01:30:33.856150 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1488/2937] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:30:33 2022] GET /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:33.907180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:33.907766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:33.958956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.959513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.959955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:33.968513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:33.969205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:33.969662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.098610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:34.195031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-538ed1bd-58fe-40dd-b9f4-90c020dd99b0 tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8/action" status: 202 len: 0 microversion: 2.1 time: 0.736316 Oct 11 01:30:34.201430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1450/2938] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:30:33 2022] POST /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:30:34.236317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:34.237133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:34.299982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.302218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.302218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.302586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.306324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.308851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.334711 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99660d7a-6b95-4e2a-add3-853c8c9c7deb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 204 len: 0 microversion: 2.1 time: 0.473282 Oct 11 01:30:34.339650 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1489/2939] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:33 2022] DELETE /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:34.347021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc854f84-87ac-4170-8912-6fa4ee0ce53d", "name": "network-vif-deleted", "tag": "82616e45-b73d-4606-ae6d-94cbb9498ce8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:34.364175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.364924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.365458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.386552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] Creating event network-vif-deleted:82616e45-b73d-4606-ae6d-94cbb9498ce8 for instance bc854f84-87ac-4170-8912-6fa4ee0ce53d on n-h1-772273-9 Oct 11 01:30:34.392918 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-aebd3da9-b603-4eb7-a462-9eec2f090e22 req-9a7b6cd7-233e-4998-a7a2-fc19482ca2b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050878 Oct 11 01:30:34.395614 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1490/2940] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:34.402112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:34.403133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:34.412768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.413930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.413930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.414690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.415586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.416212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.467405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.468056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.468813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.469424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lazy-loading 'fault' on Instance uuid bc854f84-87ac-4170-8912-6fa4ee0ce53d {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:30:34.648360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498eb6f88cf54eee8cea0ee29497e1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62941683f1424477a526145684d699c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:34.666445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec07ede5-08ad-4949-9a4b-ba8f4d7409b1 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 200 len: 1316 microversion: 2.1 time: 0.268256 Oct 11 01:30:34.669706 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1491/2941] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:34 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:34.693140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:34.695422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:34.717387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.717894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.718340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:34.719079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:34.723995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:34.724515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:35.291898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:35.310035 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-522d6357-c2f9-4a40-bf89-cbae7353a628 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1288 microversion: 2.1 time: 0.637788 Oct 11 01:30:35.311950 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1492/2942] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:34 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1288 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:35.325391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:35.329585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:35.344988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:35.346180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:35.346888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:35.348725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:35.349434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:35.350085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:35.437200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:35.450989 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e6906f1-d789-41c4-95a9-6c081a9bd6c9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1506 microversion: 2.1 time: 1.246366 Oct 11 01:30:35.471375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1451/2943] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:34 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1506 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:35.471375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:35.472376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:35.487203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:35.505873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:35.509304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:35.510407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:35.512690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:35.513471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:35.960484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:35.970903 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-202a3a16-7991-4ec7-88d1-d5b0369c37fb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1472 microversion: 2.1 time: 0.655969 Oct 11 01:30:35.986202 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1493/2944] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:35 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:35.994022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e7d1e-81f2-49a0-88c2-db59f40fbeda", "name": "network-vif-unplugged", "status": "completed", "tag": "d839ca6f-bd05-44f6-94d9-ce25d51db0aa"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:36.026242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.033783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.034481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.073367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] Creating event network-vif-unplugged:d839ca6f-bd05-44f6-94d9-ce25d51db0aa for instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda on n-h2-772273-9 Oct 11 01:30:36.079895 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e3063768-9f9b-4529-b23b-001b4e1f8ee9 req-707ba397-347f-4cca-b415-c2e5b74517e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091651 Oct 11 01:30:36.081209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1494/2945] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:36.104205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:36.105394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] [instance: bc854f84-87ac-4170-8912-6fa4ee0ce53d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:36.124880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.128278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.129873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.134972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.135742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.136380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.174959 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] HTTP exception thrown: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Request method failure captured: Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d HTTP/1.1 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMb4sgzf4t9evp6fSTO-3MtBk-QqAVzV_u_bn7El_TsfhUgehcuE4SkI4vqH5Zn487Sw83qDu9UR_P0iBogDzDIifoPAOLkMfBcykFhySNiJUNB9og1JRYruMROKcnOZJt9L7a27_wimgNoM4CUrCRq9iH1gTaRZeCxRTdjq7Mz9Vu8 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 62941683f1424477a526145684d699c9 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestFqdnHostnames-506520116 Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:36.176711 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/62941683f1424477a526145684d699c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_62941683f1424477a526145684d699c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/62941683f1424477a526145684d699c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/62941683f1424477a526145684d699c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestFqdnHostnames-506520116 Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 62941683f1424477a526145684d699c9 Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-506520116 Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestFqdnHostnames-506520116-project Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 498eb6f88cf54eee8cea0ee29497e1ea Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestFqdnHostnames-506520116-project Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. Oct 11 01:30:36.178091 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'bc854f84-87ac-4170-8912-6fa4ee0ce53d'} Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:36.178888 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. Oct 11 01:30:36.181169 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:36.183629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:36.183814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Returning 404 to user: Instance bc854f84-87ac-4170-8912-6fa4ee0ce53d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:36.183814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1016b405-950d-48e8-9332-cc3c151e1c08 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d" status: 404 len: 111 microversion: 2.1 time: 0.095068 Oct 11 01:30:36.183814 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1495/2946] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:36 2022] GET /compute/v2.1/servers/bc854f84-87ac-4170-8912-6fa4ee0ce53d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:36.191180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b5427ae-0d83-4cd4-a5d9-c8b2d11e3924 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] Calling method '.version_select at 0x7f11349811f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:36.193885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12fc815a-63c6-4c4c-9a36-1b19d1f40509 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1529 microversion: 2.1 time: 0.726489 Oct 11 01:30:36.194867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1452/2947] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:35 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1529 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:36.227241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:36.242534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b5427ae-0d83-4cd4-a5d9-c8b2d11e3924 tempest-ServersTestFqdnHostnames-506520116 tempest-ServersTestFqdnHostnames-506520116-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608618256" status: 202 len: 0 microversion: 2.1 time: 0.057648 Oct 11 01:30:36.243091 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1496/2948] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608618256 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:30:36.335138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:36.335755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:36.346417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.357323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.359483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.364702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.365319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.366808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.492466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:36.493174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:36.531635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.532138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.532574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.538701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:36.540300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:36.543160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:36.680390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:36.697623 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-315e47d0-d5f0-42ce-ba92-4546c47233f1 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1286 microversion: 2.1 time: 0.367874 Oct 11 01:30:36.698600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1453/2949] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:36 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:37.021423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:37.022371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:37.043623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.044432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.045192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.046299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.047290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.048067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.107107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:37.119366 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a562bd88-97fe-4934-9ea7-2e9b6d8d0eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1506 microversion: 2.1 time: 0.637027 Oct 11 01:30:37.124162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1497/2950] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:36 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:37.221320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:37.222844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:37.250760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.257019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.259547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.262719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.265910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.267422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.528320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:37.542985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36811a41-ed57-4d2d-98ac-c18a456a578b tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1472 microversion: 2.1 time: 0.533683 Oct 11 01:30:37.543619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1454/2951] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:37 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:37.724367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:37.725752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:37.733355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.734076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.734673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.735583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:37.736310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:37.736940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:37.963027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:37.973391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:37.974663 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-463e2e31-a0fc-497e-a399-36d4854fe2de tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1529 microversion: 2.1 time: 0.758579 Oct 11 01:30:37.977543 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1498/2952] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:37 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1529 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:37.981801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a35ae9b-228c-490a-a415-e4b6ddec0d8d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1286 microversion: 2.1 time: 0.261301 Oct 11 01:30:37.993305 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1455/2953] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:37 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1286 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:38.121020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef2ff7a-e314-46ee-8251-6623a3867921", "name": "network-vif-plugged", "status": "completed", "tag": "375d79c2-23f3-4c0e-be7f-0e323de62773"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:38.130876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:38.132507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:38.133242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:38.147708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:38.148609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:38.157538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:38.162400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:38.163059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:38.163990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:38.165983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:38.167902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:38.172513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] Creating event network-vif-plugged:375d79c2-23f3-4c0e-be7f-0e323de62773 for instance aef2ff7a-e314-46ee-8251-6623a3867921 on n-h1-772273-9 Oct 11 01:30:38.185184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3a1dbe00-67e3-4eef-af13-6975845b67d7 req-96381628-f012-477f-a6c0-185aa1019a8b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066558 Oct 11 01:30:38.187127 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1499/2954] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:38.571115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:38.572155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:38.592719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:38.593438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:38.594089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:38.594985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:38.595710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:38.596323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:38.605382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:39.019526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:39.047965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1ee2e7e-263b-4e9b-b565-52cf70480066 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1488 microversion: 2.1 time: 0.904100 Oct 11 01:30:39.051610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1456/2955] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:38 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1488 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:39.062656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e7d1e-81f2-49a0-88c2-db59f40fbeda", "name": "network-vif-deleted", "tag": "d839ca6f-bd05-44f6-94d9-ce25d51db0aa"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:39.092537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.098269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.099747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.137581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] Creating event network-vif-deleted:d839ca6f-bd05-44f6-94d9-ce25d51db0aa for instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda on n-h2-772273-9 Oct 11 01:30:39.147778 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c9b70f5e-0b48-4e49-81d4-cd344a8b341d req-af90473a-5747-4584-87e4-ff9f9a061f4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094506 Oct 11 01:30:39.149298 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1457/2956] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:39.164796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:39.165656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:39.180789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.183884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.193196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.194367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.194956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.195565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.267806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.272099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.272707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.273282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lazy-loading 'fault' on Instance uuid 666e7d1e-81f2-49a0-88c2-db59f40fbeda {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:30:39.422949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:39.447115 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-570a67c8-1c75-42b1-8872-d8f4795ab3a3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1472 microversion: 2.1 time: 0.880665 Oct 11 01:30:39.472822 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1500/2957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:38 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1472 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:39.485185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:39.485842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:39.508429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.509212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.510277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.511208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:39.511701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:39.512163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:39.958815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:39.972531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ed159b0-3410-4d84-90f0-73e2b96eff16 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 200 len: 1315 microversion: 2.1 time: 0.820199 Oct 11 01:30:39.976996 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1458/2958] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:39 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:39.994114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:39.995775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:40.011404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.012687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.014317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:40.016677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.018443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.019571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:40.100938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:40.442069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a08f6de-068a-4eb9-a42e-28c53319338b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 204 len: 0 microversion: 2.1 time: 0.463497 Oct 11 01:30:40.463716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1459/2959] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:39 2022] DELETE /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:40.483840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cefda06d-2777-469f-b629-261b8ed7b533 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f770dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:40.536233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-cefda06d-2777-469f-b629-261b8ed7b533 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Image not found. Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cefda06d-2777-469f-b629-261b8ed7b533 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 HTTP/1.1 Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:40.538117 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ea01d320-fa07-4d67-9f04-e19ff4ce0ed3'} Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:40.539829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 to delete Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.540888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 could not be found. Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:40.542185 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cefda06d-2777-469f-b629-261b8ed7b533 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:40.543695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cefda06d-2777-469f-b629-261b8ed7b533 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3" status: 404 len: 62 microversion: 2.1 time: 0.074280 Oct 11 01:30:40.553883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1460/2960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:40 2022] DELETE /compute/v2.1/images/ea01d320-fa07-4d67-9f04-e19ff4ce0ed3 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:40.576977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:40.578150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:40.594541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.595319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.596592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:40.597640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.598939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.599668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:40.628593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:40.893982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:40.915061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e931d6a-ef37-492b-a45c-e4e1c6e1c21c tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 1.438250 Oct 11 01:30:40.934560 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1501/2961] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:39 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:40.947096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:40.950382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:40.962564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.965238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.965876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:40.967989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:40.969729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:40.970564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.060747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:41.064799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:41.074895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3c10b2d-f060-4910-b9f6-34564c10c0ee tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1472 microversion: 2.1 time: 0.519024 Oct 11 01:30:41.080542 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1461/2962] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:40 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:41.088645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:41.095109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:41.107751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.111565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.114205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.115617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.117972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.118615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.156311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda HTTP/1.1 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:41.158152 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:30:41.159835 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda'} Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:41.160727 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:30:41.162170 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:41.166938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:41.168119 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-876380bc-07ce-456d-bb3e-029f6c6ff878 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 404 len: 111 microversion: 2.1 time: 0.086380 Oct 11 01:30:41.170999 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1462/2963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:41 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:41.190793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-419eac67-012a-42e8-b133-0db7216a76d1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'create', calling method: .version_select at 0x7f112f638550>, body: {"keypair": {"name": "tempest-keypair-399104174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWgxAtEuF+J7YStGBV05wnHO/UVMzthX7xI6MZM+2FoiYSwnVpB2bSVCCiaj3BkkxHitDrRpepbdOrS5vKIW2vwOY2+s4ZsR7ELK3zgBpK6YebYD+00CJwe0rRyNntUKA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:41.248227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:41.250402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-419eac67-012a-42e8-b133-0db7216a76d1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:41.256014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.compute.api [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Instance is already in deleting state, ignoring this request Oct 11 01:30:41.257179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33902535-9101-432f-a526-2a7602323d03 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 204 len: 0 microversion: 2.1 time: 0.320858 Oct 11 01:30:41.262046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-419eac67-012a-42e8-b133-0db7216a76d1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for user 6d11c60413dc43ba8d71d6ce37823d1a and project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:41.266201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1502/2964] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:40 2022] DELETE /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:41.271558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:41.272320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:41.282689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.285064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.286304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.287292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.289667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.290188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.337803 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-419eac67-012a-42e8-b133-0db7216a76d1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155383 Oct 11 01:30:41.339358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1463/2965] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:30:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:41.740854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:41.818667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef2ff7a-e314-46ee-8251-6623a3867921", "name": "network-vif-unplugged", "status": "completed", "tag": "375d79c2-23f3-4c0e-be7f-0e323de62773"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:41.844227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.845525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.848263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.875460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:41.884786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b53b3fb-2d15-4063-be08-d0b74fdbb63b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1494 microversion: 2.1 time: 0.617027 Oct 11 01:30:41.885105 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] Creating event network-vif-unplugged:375d79c2-23f3-4c0e-be7f-0e323de62773 for instance aef2ff7a-e314-46ee-8251-6623a3867921 on n-h1-772273-9 Oct 11 01:30:41.885384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1503/2966] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:41 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1494 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:41.895631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7ab3a3c4-58b7-4083-9e78-c133fa441083 req-88afc51a-612c-46a1-8098-39ca6b7d205c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082266 Oct 11 01:30:41.897599 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1464/2967] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:30:41.938570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:41.939775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:41.949485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.951983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.955075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:41.956221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:41.956926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:41.957557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:42.104388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:42.105087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:42.120712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:42.121180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:42.121638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:42.123737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:42.125164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:42.125777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:42.393732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:42.467172 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0d54d71-4a30-4b89-8ee3-9a9cc37359bc tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.528864 Oct 11 01:30:42.478245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:42.483217 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1504/2968] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:41 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:42.495281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20b959b0-1cc5-4485-beee-4bd71cac8f1c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.396379 Oct 11 01:30:42.496739 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1465/2969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:42 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:42.908542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:42.909422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:42.933373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:42.934150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:42.934751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:42.935818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:42.936489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:42.937079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:43.193594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:43.206729 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f261ea08-ee18-4e73-8e6c-947df4b03f88 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1494 microversion: 2.1 time: 0.299335 Oct 11 01:30:43.207615 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1505/2970] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:42 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:43.505165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:43.505892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:43.525004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:43.525824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:43.536576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:43.537075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:43.544985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:43.546676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:43.548870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:43.549151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:43.549803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:43.551725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:43.552179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:43.552682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:43.555963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:43.557472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:44.159957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:44.169382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03669a7e-1543-4b1c-b3da-81f6032c5c50 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.649305 Oct 11 01:30:44.172341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1506/2971] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:43 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:44.179155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:44.183083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be48da4-e089-48e4-b37f-e2cd99286955", "tag": "9bb552b2-6ff3-4595-a44f-2656735dbb5e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:44.191161 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-437e68c6-8601-4be7-a6f9-9d5fae68ab0f tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.690652 Oct 11 01:30:44.192013 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1466/2972] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:43 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:44.220704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:44.221785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:44.223753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:44.232357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:44.234251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:44.247264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:44.250767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:44.252728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:44.255836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:44.256545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:44.259304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:44.269656 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] Creating event network-changed:9bb552b2-6ff3-4595-a44f-2656735dbb5e for instance 4be48da4-e089-48e4-b37f-e2cd99286955 on n-h2-772273-9 Oct 11 01:30:44.280884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fcca13d8-53c3-43c4-a8a7-4f343436ffa1 req-b2df9f2a-de39-458a-bc58-c311db0dc2e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105814 Oct 11 01:30:44.281769 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1507/2973] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:44.979924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:44.990293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-abb6879f-0d17-4ab2-9f4a-a6da2af7fc05 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1494 microversion: 2.1 time: 0.762601 Oct 11 01:30:45.000209 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1467/2974] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:44 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1494 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:45.199955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:45.200585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:45.207709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:45.208471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:45.214249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:45.215138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:45.219211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:45.222115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:45.222731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:45.223041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:45.226966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:45.227472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:45.228254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:45.229533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:45.234697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:45.235475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:45.919017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:45.932360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31a0e22c-f43f-422d-9ba4-fbbac818dc71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.719395 Oct 11 01:30:45.936054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1468/2975] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:45 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:46.029242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:46.031386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:46.042827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.044542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:46.045339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.046135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:46.047264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.048694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.049344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:46.055550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33f123e1-d008-47dd-bc82-39554ab17363 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.860998 Oct 11 01:30:46.056064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1508/2976] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:45 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:46.331376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef2ff7a-e314-46ee-8251-6623a3867921", "name": "network-vif-deleted", "tag": "375d79c2-23f3-4c0e-be7f-0e323de62773"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:46.365042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.365357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.370296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:46.414216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] Creating event network-vif-deleted:375d79c2-23f3-4c0e-be7f-0e323de62773 for instance aef2ff7a-e314-46ee-8251-6623a3867921 on n-h1-772273-9 Oct 11 01:30:46.432119 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eb980852-f6e5-424f-84d7-91b746641e7a req-223895b2-0801-463f-bc23-85e09696d1b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105796 Oct 11 01:30:46.433070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1509/2977] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:46.472146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.472654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.473104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:46.473570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lazy-loading 'fault' on Instance uuid aef2ff7a-e314-46ee-8251-6623a3867921 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:30:46.645580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0510e6acedd400f86f1c8f9e8a1c75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323766d0a64b43e1843bc9358c41678f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:46.652840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8384acdc-7e9b-4807-8fb3-f187bd6e13c3 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 200 len: 1298 microversion: 2.1 time: 0.628230 Oct 11 01:30:46.667600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1469/2978] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:46 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 1298 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:46.960730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:46.962223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:46.972870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.973762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.975422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:46.976488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:46.977210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:46.977860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.082314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.082940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.095555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.096387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.096991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.098545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.099285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.099923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.657009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:47.669589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:47.670145 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd7a781e-5865-49ef-93c3-9158b520e7ec tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.714220 Oct 11 01:30:47.673273 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1510/2979] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:46 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:47.682002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.682673 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37d74458-2248-4b33-b08b-8f49794f5a6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.604141 Oct 11 01:30:47.683293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: aef2ff7a-e314-46ee-8251-6623a3867921] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.687535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1470/2980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:47.710992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.712015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.712679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.713731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.714497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.715589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.733266 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 HTTP/1.1 Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:47.736313 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. Oct 11 01:30:47.737669 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'aef2ff7a-e314-46ee-8251-6623a3867921'} Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.738418 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. Oct 11 01:30:47.739631 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.742434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance aef2ff7a-e314-46ee-8251-6623a3867921 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.743664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11cd2b79-e27c-4b82-96ed-c99d842a3c83 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921" status: 404 len: 111 microversion: 2.1 time: 0.066884 Oct 11 01:30:47.744654 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1511/2981] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] GET /compute/v2.1/servers/aef2ff7a-e314-46ee-8251-6623a3867921 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:47.753860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c606bb8-1047-41f6-a92a-780a6607c1d6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f6798b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.769915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1846567260", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:47.780282 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7c606bb8-1047-41f6-a92a-780a6607c1d6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Image not found. Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c606bb8-1047-41f6-a92a-780a6607c1d6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 HTTP/1.1 Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:47.783115 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '30034532-d80a-4b22-8e49-cbad1df1e798'} Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.784493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 30034532-d80a-4b22-8e49-cbad1df1e798 to delete Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.785329 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30034532-d80a-4b22-8e49-cbad1df1e798 could not be found. Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.786435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:30:47.787656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.790789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c606bb8-1047-41f6-a92a-780a6607c1d6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.794294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c606bb8-1047-41f6-a92a-780a6607c1d6 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798" status: 404 len: 62 microversion: 2.1 time: 0.045478 Oct 11 01:30:47.802932 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1471/2982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] DELETE /compute/v2.1/images/30034532-d80a-4b22-8e49-cbad1df1e798 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:47.808007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.809449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.821252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.822369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.823019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.824124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.824809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.825520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.845055 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 HTTP/1.1 Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:47.847220 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.848562 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420'} Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.849418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.850633 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.851954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] validate_networks() for [('4cd21dfb-0b79-409c-8856-06a8aeb68e46', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:30:47.854179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.855413 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3906d439-d621-48eb-869d-48c743061eb9 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 404 len: 111 microversion: 2.1 time: 0.051068 Oct 11 01:30:47.859773 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1472/2983] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:47 2022] DELETE /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:47.864717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.865542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.871950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.872439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.872887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.873595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.874050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.874510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.889741 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 HTTP/1.1 Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:47.891463 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.892800 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420'} Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.893533 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. Oct 11 01:30:47.894880 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.895999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.895999 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cad977b2-684d-4def-8ef1-1063c5bf2610 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420" status: 404 len: 111 microversion: 2.1 time: 0.031927 Oct 11 01:30:47.895999 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1473/2984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] GET /compute/v2.1/servers/cc75f8c8-a7f9-4b37-a5c2-4a1ded78e420 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:47.901518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a41320a-3fc2-4c32-accb-8697ab01793b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f112f5bf8b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.923440 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-6a41320a-3fc2-4c32-accb-8697ab01793b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Image not found. Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a41320a-3fc2-4c32-accb-8697ab01793b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed HTTP/1.1 Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:47.926819 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0f8051da-42c5-481b-a6f8-281dc4937fed'} Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.928427 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f8051da-42c5-481b-a6f8-281dc4937fed to delete Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.929298 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f8051da-42c5-481b-a6f8-281dc4937fed could not be found. Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.930446 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a41320a-3fc2-4c32-accb-8697ab01793b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a41320a-3fc2-4c32-accb-8697ab01793b tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed" status: 404 len: 62 microversion: 2.1 time: 0.030814 Oct 11 01:30:47.932848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1474/2985] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] DELETE /compute/v2.1/images/0f8051da-42c5-481b-a6f8-281dc4937fed => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:30:47.936920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.937418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.944564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.945048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.945493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.946201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.946650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.947269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.962555 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 HTTP/1.1 Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:47.964473 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:47.965929 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'bc4abbc3-9988-426d-bfc8-c41a5fef9e28'} Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:47.966825 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:47.969098 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:47.971188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:47.972457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a7b189bf-9ac2-4506-adaf-7b6f3cccd0eb tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 404 len: 111 microversion: 2.1 time: 0.039183 Oct 11 01:30:47.976333 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1475/2986] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:47 2022] DELETE /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:47.981454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:47.982409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: bc4abbc3-9988-426d-bfc8-c41a5fef9e28] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:47.989419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.990229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.990860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:47.991820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:47.992473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:47.993095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.009005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 HTTP/1.1 Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:48.018430 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:48.019818 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'bc4abbc3-9988-426d-bfc8-c41a5fef9e28'} Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:48.020627 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. Oct 11 01:30:48.021865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.024636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance bc4abbc3-9988-426d-bfc8-c41a5fef9e28 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:48.028979 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c65a42d3-e37d-429c-a164-e366c5c93159 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28" status: 404 len: 111 microversion: 2.1 time: 0.050824 Oct 11 01:30:48.029577 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1476/2987] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:47 2022] GET /compute/v2.1/servers/bc4abbc3-9988-426d-bfc8-c41a5fef9e28 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:48.037778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9116276f-27fe-473c-b00a-24cb782af440 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '.version_select at 0x7f1134e71ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:48.065079 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9116276f-27fe-473c-b00a-24cb782af440 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Image not found. Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9116276f-27fe-473c-b00a-24cb782af440 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 HTTP/1.1 Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:48.068332 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5c4e07c6-66b4-4271-916e-ecb3da20e769'} Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:48.069913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c4e07c6-66b4-4271-916e-ecb3da20e769 to delete Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.071048 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c4e07c6-66b4-4271-916e-ecb3da20e769 could not be found. Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:48.072558 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.073923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9116276f-27fe-473c-b00a-24cb782af440 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:48.079753 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9116276f-27fe-473c-b00a-24cb782af440 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769" status: 404 len: 62 microversion: 2.1 time: 0.042147 Oct 11 01:30:48.079753 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1477/2988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:48 2022] DELETE /compute/v2.1/images/5c4e07c6-66b4-4271-916e-ecb3da20e769 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 01:30:48.091149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:48.095456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:48.107149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.107744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.108452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.109805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.110350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.110997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.129776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca HTTP/1.1 Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:48.131985 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.133368 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0efad7b2-813c-47f4-9b4b-efc6020658ca'} Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:48.134137 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.135365 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.138552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:48.139647 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab5d3dff-7370-4ccd-9945-3aa08be43b93 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 404 len: 111 microversion: 2.1 time: 0.056632 Oct 11 01:30:48.141483 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1478/2989] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:48 2022] DELETE /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:48.153597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:48.154531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] [instance: 0efad7b2-813c-47f4-9b4b-efc6020658ca] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:48.166551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.167697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.171751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.172774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.176190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.177140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.198446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] HTTP exception thrown: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Request method failure captured: Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca HTTP/1.1 Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYyvZuSe-3byCiMsHmIew_rzfHQ8WPULFzIcTW1AWaWgXYblC_xAAduasLDi62UHUnZ_-D4EvsLWFPOmBASLNdyYhc7Wozkpksfe7OI_5roYjefYfLHZmM6zb-ELRpW8Mdc8l6g2IP9qsBAOY6LJPdW2wtHOd_inXplcYQAryKSuOs Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:48.200159 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_323766d0a64b43e1843bc9358c41678f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/323766d0a64b43e1843bc9358c41678f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 323766d0a64b43e1843bc9358c41678f Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesTestJSON-1140061521 Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: a0510e6acedd400f86f1c8f9e8a1c75d Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesTestJSON-1140061521-project Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.201774 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0efad7b2-813c-47f4-9b4b-efc6020658ca'} Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:48.203084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. Oct 11 01:30:48.204373 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:48.206557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] Returning 404 to user: Instance 0efad7b2-813c-47f4-9b4b-efc6020658ca could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:48.206557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e40d065-54bc-4d4c-bead-64adf20c8672 tempest-ImagesTestJSON-1140061521 tempest-ImagesTestJSON-1140061521-project] 10.222.0.66 "GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca" status: 404 len: 111 microversion: 2.1 time: 0.059722 Oct 11 01:30:48.206557 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1479/2990] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:48 2022] GET /compute/v2.1/servers/0efad7b2-813c-47f4-9b4b-efc6020658ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:48.694658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:48.695314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:48.703890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:48.705690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.706376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.708010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:48.708855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:48.709438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:48.709937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:49.146050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:49.160299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c057b11a-cf3c-4268-8cd3-bbde441ec0eb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.469259 Oct 11 01:30:49.161736 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1480/2991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:48 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:49.167798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:49.169021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:49.184612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:49.185511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:49.186167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:49.187840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:49.188542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:49.189182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:49.335417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:30:49.336946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:30:49.338299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:30:49.338868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:30:49.339484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:30:49.352513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:49.353009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:49.353453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:49.354221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:49.354893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:49.355329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:49.376453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:49.382752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for user 6d11c60413dc43ba8d71d6ce37823d1a and project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:49.396375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:30:49.399801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:30:49.454854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b98b53a7-8194-4bb0-b04e-fdd27d22a4b7 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.690134 Oct 11 01:30:49.456153 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1512/2992] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:30:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:30:49.468662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-382b5d8f-789f-487f-85f1-416763e977fe tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:49.469565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-382b5d8f-789f-487f-85f1-416763e977fe tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:49.540753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:49.552492 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e20dbb56-a3bb-4f8e-944f-6067d148b8ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.388507 Oct 11 01:30:49.553276 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1481/2993] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:49 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:49.571294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-382b5d8f-789f-487f-85f1-416763e977fe tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:49.578892 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-382b5d8f-789f-487f-85f1-416763e977fe tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1225 microversion: 2.1 time: 0.115110 Oct 11 01:30:49.580076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1513/2994] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:49 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:50.184226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:50.184874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:50.196393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:50.196897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:50.197350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:50.198098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:50.198593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:50.204966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:50.218114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-542117216", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "7a2c5974-42d6-408e-9a95-5f7a06622a5b"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:50.331115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] validate_networks() for [('7a2c5974-42d6-408e-9a95-5f7a06622a5b', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:30:50.602101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:50.616181 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27fd17f0-ea7e-4a1d-8d7d-2ca4b6551e00 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.436076 Oct 11 01:30:50.632699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1514/2995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:50 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:50.638727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:50.640643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:50.653375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:50.654125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:50.654885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:50.655693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:50.656164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:50.662131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.008914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:51.022484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-17779fd8-2926-484d-9910-c4debb21a635 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.388427 Oct 11 01:30:51.023108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1515/2996] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:50 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:51.029510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:51.033863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:51.056524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.058587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.060228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.062635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.064026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.064479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.226395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:51.238400 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e17ca218-db72-4fc5-9132-a0b17c575c60 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1277 microversion: 2.1 time: 0.214003 Oct 11 01:30:51.257433 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1516/2997] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:51 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:51.284911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:51.310784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:30:51.311209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:30:51.311713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:30:51.312388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:30:51.313123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:30:51.328419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.329214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.330233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.330995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.331486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.332932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.359721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Getting quotas for project 2c1a6282d3094d6cadac646b4715a08c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:30:51.368045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Getting quotas for user 5865a0fe3af9436c8d75f66753327e06 and project 2c1a6282d3094d6cadac646b4715a08c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:30:51.411244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:30:51.416166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:30:51.546416 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3c3e764-b0ac-4350-abe5-44fa7a917a1f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554890 Oct 11 01:30:51.548713 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1482/2998] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:30:51.563475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f1dfe76-3b21-4e25-89c3-8ceef1a08e5d tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:51.564118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f1dfe76-3b21-4e25-89c3-8ceef1a08e5d tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:51.645452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:51.646380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:51.658148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.658978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.659653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.660715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:51.661373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:51.671784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:51.936476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8f1dfe76-3b21-4e25-89c3-8ceef1a08e5d tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:51.949420 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f1dfe76-3b21-4e25-89c3-8ceef1a08e5d tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1216 microversion: 2.1 time: 0.391034 Oct 11 01:30:51.951428 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1517/2999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:51 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1216 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:52.056001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:52.057982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:52.074718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:52.076986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:52.077776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:52.081502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:52.082321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:52.084157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:52.242802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:52.256074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5efdad0-554e-42f1-a61d-49fe1946aa96 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.615967 Oct 11 01:30:52.271505 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1483/3000] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:51 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:52.271505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:52.271505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:52.283971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:52.286359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:52.286943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:52.289349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:52.291197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:52.292592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:52.450807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:52.489892 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eff9c3fa-3402-4e5f-ab2b-f86371de0274 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1283 microversion: 2.1 time: 0.226866 Oct 11 01:30:52.492980 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1484/3001] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:52 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1283 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:52.509374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:52.522176 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-659a0e1e-8e31-4a90-97d3-4bfb5c778899 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.471444 Oct 11 01:30:52.542174 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1518/3002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:52 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:52.980824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:52.981950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:53.030116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.031655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.034680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.035728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.041160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.042746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.196053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:53.202679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be48da4-e089-48e4-b37f-e2cd99286955", "name": "network-vif-plugged", "status": "completed", "tag": "9bb552b2-6ff3-4595-a44f-2656735dbb5e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:53.206423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b96b6213-e632-4cc3-a74d-4f3fcd4e5bd0 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1268 microversion: 2.1 time: 0.234435 Oct 11 01:30:53.220125 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1485/3003] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:52 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:53.223228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.225312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.226905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.257301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] Creating event network-vif-plugged:9bb552b2-6ff3-4595-a44f-2656735dbb5e for instance 4be48da4-e089-48e4-b37f-e2cd99286955 on n-h2-772273-9 Oct 11 01:30:53.274045 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-57ad5ee7-ebd1-4d53-bfcd-e8ce6cf34042 req-82c956df-3905-45e9-b4d8-96ab50ecaee1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074794 Oct 11 01:30:53.275674 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1519/3004] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:53.292844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:53.297477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:53.316772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.318349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.319073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.321010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.321834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.322554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.527284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:53.528347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:53.535207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.535964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.540609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.541707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.542378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.543332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.898413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:53.910116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df8b9894-2ed6-4074-acd2-2d713780111e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.630337 Oct 11 01:30:53.915240 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1486/3005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:53 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:53.926214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:53.931001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:53.946756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.957143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.957573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:53.958337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:53.964978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:53.969360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:54.006616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:54.033039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:54.040148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:54.050456 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdff626e-ad24-47e9-bb9e-07b4b3cecb06 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.532147 Oct 11 01:30:54.057206 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1520/3006] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:53 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:54.232216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:54.233582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:54.245941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:54.250458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:54.251994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:54.255680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:54.256428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:54.257442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:54.706660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:54.764260 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc549780-e9f8-457f-ad55-45bbb0ffce67 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1274 microversion: 2.1 time: 0.522928 Oct 11 01:30:54.771971 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1521/3007] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:54 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1274 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:30:54.856211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:54.871735 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dca35253-7e1c-4831-9413-adaae68d9679 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.950232 Oct 11 01:30:54.873010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1487/3008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:53 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:54.934353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:54.935282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:54.946429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:54.948685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:54.949565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:54.952047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:54.952553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:54.953541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:55.078678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:55.079378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:55.092121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:55.094087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:55.094801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:55.097883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:55.098591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:55.099274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:55.510745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:55.526819 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf438340-1e80-41d3-b6ca-7a76e817335e tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1328 microversion: 2.1 time: 0.596161 Oct 11 01:30:55.539365 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1522/3009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:54 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1328 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:55.614830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:55.623902 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3835fbd-288c-45c8-b6ba-7eb89b670191 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.549411 Oct 11 01:30:55.624865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1488/3010] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:55 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:55.820578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:55.821209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:55.840135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:55.840530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:55.844108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:55.846916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:55.848476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:55.851655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:55.874742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df7bdd-3e95-446a-82b7-806b052d59a2", "tag": "5719963e-cf68-4dfe-baf0-6e0f1bf86b45"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:55.949525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:55.950527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:55.951979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.004842 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] Creating event network-changed:5719963e-cf68-4dfe-baf0-6e0f1bf86b45 for instance e5df7bdd-3e95-446a-82b7-806b052d59a2 on n-h1-772273-9 Oct 11 01:30:56.018471 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-090143ac-a600-49b7-a36f-f4b52ccc90c7 req-f4b8e687-3213-45a5-a25e-dc242049be50 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149102 Oct 11 01:30:56.019739 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1489/3011] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:30:56.025890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:56.027959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:56.038234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.039036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.045653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.047526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.048531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.050111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.425479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:56.438681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-957d28d6-f432-45a0-88cf-eec17085565a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.650722 Oct 11 01:30:56.442281 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1523/3012] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:55 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:56.492006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:56.493728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:56.503461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.504280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.504978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.505862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.506494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.507112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.611313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:56.622386 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0cba497-25b7-4b15-847d-d7856556cb6d tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.601091 Oct 11 01:30:56.623526 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1490/3013] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:56 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:56.632658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:56.633284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:56.647322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.648080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.651943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.653493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.653717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'services' on Instance uuid 701db354-8bfa-4fc1-9b36-b8f3726ebb21 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:30:56.654210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.654346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.771551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2b18e28-2233-4684-8bd7-444926cae206 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments/4a9177b1-f5d0-4364-b3b6-90172c33f851" status: 202 len: 0 microversion: 2.1 time: 0.285713 Oct 11 01:30:56.775598 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1524/3014] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:30:56 2022] DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments/4a9177b1-f5d0-4364-b3b6-90172c33f851 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:30:56.780368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:56.781356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:56.790441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.791171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.792812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:56.793863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:56.794593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:56.795482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.287510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:57.299772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f434950-c1be-4811-bcdf-579b583e0bfb tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1527 microversion: 2.1 time: 0.675074 Oct 11 01:30:57.300368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1491/3015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:56 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1527 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:57.309553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:57.311810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:57.334843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.340879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.341561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.342302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.342934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.344718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.395991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:57.409106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32516889-c7eb-4505-aadb-7a6c3b0b784b tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.634137 Oct 11 01:30:57.410233 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1525/3016] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:56 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:57.429791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:57.430464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:57.437524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.438883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.439600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.440649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.444576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.445315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.453083 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4fbac1c-bcd5-4ec7-a4ee-f40f1067eefd tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149627 Oct 11 01:30:57.453683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1492/3017] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:30:57 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:57.467571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:57.468950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:57.491949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.492442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.492881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.493592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:57.494048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:57.494473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:57.990565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:58.012874 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31056c27-dcb5-4ce0-9a22-6868fc2bf1f7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.550958 Oct 11 01:30:58.013535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1493/3018] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:57 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:58.041008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:58.041276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:58.041779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:58.050660 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a7eec36-f1af-473f-9544-c751b4a2db71 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1527 microversion: 2.1 time: 0.639855 Oct 11 01:30:58.055475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1526/3019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:57 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1527 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:58.058957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.061333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.061917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.063324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.067682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.068434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.394324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:58.394827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:58.401352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.401850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.402277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.402985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.411699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.417087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.446662 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] HTTP exception thrown: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Request method failure captured: Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 HTTP/1.1 Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMc1x76_1gWgbAUloGpxHujbrtIGjcQh7MP357EF42ZK-naCscl17y8P0AQmwLf4rJ-zZjgRX4VEgEsHBVVDXcS-Xy63VIFhGE86Q76l5l-rA6myOyoB5ZzLtbYiiMU_aYTXsnI3tr7MdsOO8Q1th2YFMGFPPgLH0hjgtF4CM03i0rs Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0785134ca1e14fa0b9157b91314b991a Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:30:58.450693 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0785134ca1e14fa0b9157b91314b991a Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1801996629-project Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b9a4ef3372c04332a6cc17dbbcf59756 Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629-project Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:58.452448 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4be48da4-e089-48e4-b37f-e2cd99286955'} Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:58.453946 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:58.455401 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:30:58.457711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Returning 404 to user: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:58.458759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a12adfe0-003d-4dc2-9ffd-d97ffb602c16 tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 404 len: 111 microversion: 2.1 time: 0.382598 Oct 11 01:30:58.459872 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1527/3020] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:58 2022] DELETE /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 111 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:58.465157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:58.469268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:58.470106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:58.475450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe23a746-bafa-4c97-8aa9-fe878b432d27 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.450549 Oct 11 01:30:58.482784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.483889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.484040 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1494/3021] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:58 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:58.484661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.485531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.486142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.486724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.496168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:58.497236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:58.510457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.511083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.511688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:58.513213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:58.514914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:58.516975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.045970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:59.057367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:59.072788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84c0e317-af4d-4a0b-bb26-90642a3894e9 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1527 microversion: 2.1 time: 0.587727 Oct 11 01:30:59.078817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1495/3022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:58 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1527 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:59.080715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ddc97cb3-4300-4b42-b21f-fd2b8a33588c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.616347 Oct 11 01:30:59.085773 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1528/3023] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:58 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:59.095557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:59.100477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:59.101105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.108278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.117411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.122295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.122889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.123821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.124402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.125828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.128347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.128860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.129299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.130007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.136683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.139064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.170406 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef73d302-0878-466d-969c-51bedbe334aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088046 Oct 11 01:30:59.173216 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1496/3024] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:30:59 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:30:59.178288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Action: 'update', calling method: >, body: {"server": {"name": "4be48da4-e089-48e4-b37f-e2cd99286955_new"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:30:59.181223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.191454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.193058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.194234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.195253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.196957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.197979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.228377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] HTTP exception thrown: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Request method failure captured: Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 HTTP/1.1 Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 64 Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMc1x76_1gWgbAUloGpxHujbrtIGjcQh7MP357EF42ZK-naCscl17y8P0AQmwLf4rJ-zZjgRX4VEgEsHBVVDXcS-Xy63VIFhGE86Q76l5l-rA6myOyoB5ZzLtbYiiMU_aYTXsnI3tr7MdsOO8Q1th2YFMGFPPgLH0hjgtF4CM03i0rs Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0785134ca1e14fa0b9157b91314b991a Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:30:59.231866 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0785134ca1e14fa0b9157b91314b991a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0785134ca1e14fa0b9157b91314b991a Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629 Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1801996629-project Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b9a4ef3372c04332a6cc17dbbcf59756 Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1801996629-project Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "4be48da4-e089-48e4-b37f-e2cd99286955_new"}} Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:30:59.233313 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4be48da4-e089-48e4-b37f-e2cd99286955', 'body': {'server': {'name': '4be48da4-e089-48e4-b37f-e2cd99286955_new'}}} Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:30:59.234180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:59.236041 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:30:59.242814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:30:59.246013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] Returning 404 to user: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:30:59.248419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-647b5851-500f-4107-ba5a-b61ee9de180a tempest-ServersNegativeTestMultiTenantJSON-1801996629 tempest-ServersNegativeTestMultiTenantJSON-1801996629-project] 10.222.0.66 "PUT /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 404 len: 111 microversion: 2.1 time: 0.072683 Oct 11 01:30:59.249608 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1497/3025] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:30:59 2022] PUT /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:30:59.261121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:59.262026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.270756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.271586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.272260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.273203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.273881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.275390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.312670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:30:59.366847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:30:59.486810 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df2a9544-2651-4b08-a193-d0c697fae07d tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 204 len: 0 microversion: 2.1 time: 0.230892 Oct 11 01:30:59.488142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1498/3026] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:30:59 2022] DELETE /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:30:59.499512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:59.501337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.511168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.517894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.518812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.519844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.520638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.521229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.533887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:30:59.543526 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c356ad2-b100-4b80-aba3-1761b66fb2d3 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.456585 Oct 11 01:30:59.546662 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1529/3027] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:59 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:30:59.577226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:30:59.582542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:30:59.604494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.605004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.614965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:30:59.617090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:30:59.617090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:30:59.617584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:00.689647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:00.702287 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e586e74-5b45-47b4-9ea7-03f79b120f6c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 1.141676 Oct 11 01:31:00.704216 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1530/3028] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:59 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:00.713326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55808322-1ef3-413d-80d1-7d4186203558", "tag": "2434bd01-6d2b-4581-954e-22c5ba9807ba"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:00.737598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:00.740678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:00.741296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:00.760822 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] Creating event network-changed:2434bd01-6d2b-4581-954e-22c5ba9807ba for instance 55808322-1ef3-413d-80d1-7d4186203558 on n-h2-772273-9 Oct 11 01:31:00.777155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7b993b62-adbd-4e44-9eb0-b7fa75f11b95 req-a030c98f-882a-4f7e-979c-471f4a8d20ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070867 Oct 11 01:31:00.782135 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1531/3029] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:00.794758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:00.798279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:00.815112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:00.817428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:00.818168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:00.820814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:00.821511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:00.823994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.349347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:01.381365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:01.394987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-abb9afc3-ef4c-4191-93ef-33c81a8541bf tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1533 microversion: 2.1 time: 1.902028 Oct 11 01:31:01.395628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1499/3030] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:30:59 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1533 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:01.411512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:01.414201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:01.426891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:01.431664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.432188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.433808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.434562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.435038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.435535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.515915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1945bf3-840f-4239-ae0a-c95507aa2dd8 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119126 Oct 11 01:31:01.520738 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1500/3031] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:31:01 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:01.532816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:01.533854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:01.545136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.546001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.546870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.548541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.549158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.549741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.562182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:01.572212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36a43856-7072-4fc0-989f-4fd8dba2276e tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.787610 Oct 11 01:31:01.578802 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1532/3032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:00 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:01.737619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:01.738960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:01.748648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.752262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.753134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.754123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:01.754815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:01.757469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:01.942938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:02.158859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:02.178823 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a92028a2-2ac1-4938-8e48-52e42a70c9dc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.656575 Oct 11 01:31:02.182059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1501/3033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:01 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:02.315782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:02.331627 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82abb28e-8e0a-4154-832a-2e5b019435a0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.597983 Oct 11 01:31:02.333463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1533/3034] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:01 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:02.423899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:02.425578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:02.447791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.448322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.448765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.449495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.450118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.450369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.532734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:02.535361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:02.543172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.544422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.545065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.545965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.546585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.547175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.586565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89b21048-b823-4698-9596-5454774b43e0 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057508 Oct 11 01:31:02.587434 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1534/3035] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:31:02 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:31:02.612806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:02.613443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:02.633282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.633928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.634388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.635258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:02.635757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:02.636239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:02.816818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:02.833928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af283559-ba2e-4173-8768-8d2c9317fe54 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1533 microversion: 2.1 time: 0.414410 Oct 11 01:31:02.850084 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1502/3036] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:02 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1533 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:02.979844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be48da4-e089-48e4-b37f-e2cd99286955", "name": "network-vif-deleted", "tag": "9bb552b2-6ff3-4595-a44f-2656735dbb5e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:02.994803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.004240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.012054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.066311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] Creating event network-vif-deleted:9bb552b2-6ff3-4595-a44f-2656735dbb5e for instance 4be48da4-e089-48e4-b37f-e2cd99286955 on n-h2-772273-9 Oct 11 01:31:03.086357 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b70594d6-a37a-4aa2-9c59-8b7d0854511a req-dc5519af-e3f4-4ef0-b289-6e09d181f641 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114731 Oct 11 01:31:03.087294 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1503/3037] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:03.088306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:03.114531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdb74758-4477-4ed2-9cd4-1e71dd8069ca tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.505647 Oct 11 01:31:03.115246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1535/3038] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:02 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:03.208023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:03.209960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:03.225682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.230188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.230825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.231891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.243551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.245654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.357448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:03.358341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:03.371459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:03.374713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.375215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.375908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.376829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.377759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.378505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.710237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:03.730441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dae80e25-e179-454a-ad24-c97990033a5b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.525484 Oct 11 01:31:03.732104 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1504/3039] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:03 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:03.742790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:03.746709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:03.764513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:03.771415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.772322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.772997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.774128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.774778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.774906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab8350ba-0805-40a2-8828-3803c38f39e1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.421427 Oct 11 01:31:03.775524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.780666 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1536/3040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:03 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:03.818591 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3098d0f6-6d8a-4581-a7d2-c500548890e7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083124 Oct 11 01:31:03.820155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1505/3041] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:31:03 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:03.863895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:03.864600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:03.867894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:03.877703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.886975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.887738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.888792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.889423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.890046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.959482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:03.960225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:03.960859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:03.961520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lazy-loading 'fault' on Instance uuid 4be48da4-e089-48e4-b37f-e2cd99286955 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:31:04.046644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccf3e2e724b4d5f939fdedc0559bc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f64cac30d694eeb9e846cc6932481ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:04.050943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:04.055244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35a02ba2-a90d-4bf8-911c-9371d6c60915 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 200 len: 1318 microversion: 2.1 time: 0.197974 Oct 11 01:31:04.060399 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1537/3042] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:03 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:04.131560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df7bdd-3e95-446a-82b7-806b052d59a2", "name": "network-vif-plugged", "status": "completed", "tag": "5719963e-cf68-4dfe-baf0-6e0f1bf86b45"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:04.144296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:04.145569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:04.157635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.159143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.169094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.170184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.170871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.171791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.175737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.176682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.182877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.215916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] Creating event network-vif-plugged:5719963e-cf68-4dfe-baf0-6e0f1bf86b45 for instance e5df7bdd-3e95-446a-82b7-806b052d59a2 on n-h1-772273-9 Oct 11 01:31:04.227632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7f2648a6-df0d-42c6-93cb-08cda0369e99 req-a0156571-ca83-4c8a-a040-f38aaa1d03e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099718 Oct 11 01:31:04.230986 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1506/3043] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:31:04.417030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:04.428173 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e71f455-d59f-4867-b758-6efe83c55b09 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.287929 Oct 11 01:31:04.430814 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1538/3044] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:04 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:04.759067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:04.759831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:04.770983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.771456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.771906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.772636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.773100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.773534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.801453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:04.802081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:04.819734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.820234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.820676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:04.821382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:04.821863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:04.822289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.288481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:05.303624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b36a825-713f-4935-bd59-e061dcc6259f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.542660 Oct 11 01:31:05.304494 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1507/3045] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:04 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:05.312200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:05.323865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.341395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.342301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.344176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.347797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.348607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.349426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.402135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47227372-35bd-4583-85d8-04faaf68f598 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092983 Oct 11 01:31:05.402902 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1508/3046] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:31:05 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:31:05.409075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:05.410210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] [instance: 4be48da4-e089-48e4-b37f-e2cd99286955] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.418691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.428508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.428664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.429738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.429853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.430228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.487097 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] HTTP exception thrown: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Request method failure captured: Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 HTTP/1.1 Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcl3vHz83uwJGhCpZQefOxmDBUsLGD2Es1nynQ3q2y6O65KyrI6ak2fHf_9MTZDr9-vl1Wh_C6jHZDdqSgYugzzfEnRaO_Pkm9pYGo6yeOaUD3597pRgtOBP4KvKgF7jfIWO8DZxTc3QoJpNfPrd73EI8qM6FDDkbUAL9IfZV2wcTY Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5f64cac30d694eeb9e846cc6932481ff Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1684315513 Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:05.489176 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5f64cac30d694eeb9e846cc6932481ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5f64cac30d694eeb9e846cc6932481ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f64cac30d694eeb9e846cc6932481ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f64cac30d694eeb9e846cc6932481ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1684315513 Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5f64cac30d694eeb9e846cc6932481ff Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1684315513 Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1684315513-project Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3ccf3e2e724b4d5f939fdedc0559bc6d Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1684315513-project Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:31:05.490617 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4be48da4-e089-48e4-b37f-e2cd99286955'} Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:05.491995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. Oct 11 01:31:05.493614 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.495846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] Returning 404 to user: Instance 4be48da4-e089-48e4-b37f-e2cd99286955 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:05.495846 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-227839b9-b4f7-4227-8daa-33a5abbbf9b4 tempest-ServersNegativeTestMultiTenantJSON-1684315513 tempest-ServersNegativeTestMultiTenantJSON-1684315513-project] 10.222.0.66 "GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955" status: 404 len: 111 microversion: 2.1 time: 0.086366 Oct 11 01:31:05.495846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1509/3047] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:05 2022] GET /compute/v2.1/servers/4be48da4-e089-48e4-b37f-e2cd99286955 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:05.526749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:05.526749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.541328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:05.557552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.558038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-43702a77-2528-496a-826c-031f3d223096 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1477 microversion: 2.1 time: 0.758526 Oct 11 01:31:05.558776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.559659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.560020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1539/3048] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:04 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1477 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:05.561342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.562048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.562754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.574950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:05.577346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.587074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.587604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.588051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.588771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.589231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.590048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.637596 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Cannot 'reboot' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action HTTP/1.1 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 28 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:05.639727 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: {"reboot": {"type": "HARD"}} Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:31:05.641066 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'reboot' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'aebf141b-9da6-4eab-8764-a77f0349d669', 'body': {'reboot': {'type': 'HARD'}}} Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aebf141b-9da6-4eab-8764-a77f0349d669 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:05.641936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.643232 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.644525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 409 to user: Cannot 'reboot' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:05.644525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a32b6bb0-8dda-4455-acf8-8b257296394d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action" status: 409 len: 145 microversion: 2.1 time: 0.080060 Oct 11 01:31:05.644525 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1540/3049] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:31:05 2022] POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action => generated 145 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:31:05.661020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:05.673314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.680501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.681008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.681448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.684476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.685143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.685884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.744782 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Cannot 'rebuild' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action HTTP/1.1 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 65 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:05.748531 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} Oct 11 01:31:05.749875 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'rebuild' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'aebf141b-9da6-4eab-8764-a77f0349d669', 'body': {'rebuild': {'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74'}}} Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aebf141b-9da6-4eab-8764-a77f0349d669 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.750687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.757525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 409 to user: Cannot 'rebuild' instance aebf141b-9da6-4eab-8764-a77f0349d669 while it is in vm_state rescued {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f53e2eef-8fe4-42cd-b128-00d403a695aa tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action" status: 409 len: 146 microversion: 2.1 time: 0.097752 Oct 11 01:31:05.758929 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1541/3050] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:31:05 2022] POST /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669/action => generated 146 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:31:05.785131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:05.788731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:05.809717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.814759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.815238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.817507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:05.820471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:05.821241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:05.861081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:05.981360 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e780d50-aeed-4e9c-b65d-ac29ec9e8cea tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 204 len: 0 microversion: 2.1 time: 0.219652 Oct 11 01:31:05.982563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1542/3051] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:05 2022] DELETE /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:05.992993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:05.994037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:06.002714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:06.004367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:06.005033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:06.006095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:06.006881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:06.007605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:06.018950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:06.028304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dabccc5c-4073-4f3c-ba19-716df63b308c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1325 microversion: 2.1 time: 0.535149 Oct 11 01:31:06.040111 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1510/3052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:05 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1325 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:06.327649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:06.328272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:06.342960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:06.350878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:06.351698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:06.352674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:06.353336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:06.354428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.257765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:07.269835 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1de119e9-e104-4f85-9d0f-e5dc39dc1979 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1686 microversion: 2.1 time: 1.281734 Oct 11 01:31:07.284614 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1543/3053] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:05 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1686 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:07.310190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:07.311112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:07.320561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:07.321851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:07.322459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.323384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:07.324088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:07.324676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.629602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:07.644586 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-127cd6af-e0d0-45cc-b455-8330d283d203 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 1.320124 Oct 11 01:31:07.645314 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1511/3054] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:06 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:07.662162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:07.662889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:07.666048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:07.669419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:07.671872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:07.672429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.675586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:07.676327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:07.676990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.691477 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c6f20f6-0931-4d98-904a-66deb8cd5337 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1476 microversion: 2.1 time: 0.384726 Oct 11 01:31:07.693828 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1544/3055] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:07 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:07.707741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-unplugged", "status": "completed", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:07.741384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:07.741876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:07.742313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:07.789973 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Creating event network-vif-unplugged:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h1-772273-9 Oct 11 01:31:07.803035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:31:07.860837 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-90e7aa5b-ccea-4c4a-8768-43bfb4692a44 req-a3dd6352-4fb9-44cb-8eab-c86bdc40c2bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164720 Oct 11 01:31:07.871777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1545/3056] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:08.358251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:08.373602 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-654a98f8-4076-457f-9b09-06b44b5a7d45 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1522 microversion: 2.1 time: 0.724885 Oct 11 01:31:08.374815 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1512/3057] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:07 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1522 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:08.403094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:08.409658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:08.422665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.424833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.425711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:08.428164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.429911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.430577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:08.638679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:08.641892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:08.648452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.649253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.650478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:08.651421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.652290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.652956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:08.768880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:08.791528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01703fbb-eb28-432b-9419-22917e4a24c8 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1522 microversion: 2.1 time: 0.392140 Oct 11 01:31:08.794140 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1513/3058] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:08 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:08.803325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:08.804969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:08.819989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.822556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.823434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:08.825195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:08.826450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:08.827199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.012577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:09.021538 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-840b2777-0ba5-4470-91d0-393f08125996 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1686 microversion: 2.1 time: 0.728543 Oct 11 01:31:09.022131 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1546/3059] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:08 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1686 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:09.032739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:09.036278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:09.048464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.048975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.049424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.050254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.050771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.051158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.085207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:09.093518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e04709f-e88a-454f-b3a8-c187910be28b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.297964 Oct 11 01:31:09.096097 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1514/3060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:08 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:09.101174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-751968537"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:09.103808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:09.110311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.111411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.111865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.112644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.113163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.113602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.292152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:09.303013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fa65112-e81a-44d9-b499-fb92634f05f7 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1476 microversion: 2.1 time: 0.274457 Oct 11 01:31:09.306032 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1547/3061] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:09 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:09.429904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1fcb87af-0928-49c5-aad1-e1a8ae6802d3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2/action" status: 202 len: 0 microversion: 2.1 time: 0.331947 Oct 11 01:31:09.430583 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1515/3062] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:31:09 2022] POST /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:31:09.446380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c1d4bf1-5fbb-4ec6-997d-511b38e7c081 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f11388b8ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:09.735183 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c1d4bf1-5fbb-4ec6-997d-511b38e7c081 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea" status: 204 len: 0 microversion: 2.1 time: 0.297510 Oct 11 01:31:09.736313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1548/3063] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:09 2022] DELETE /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:09.745114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6462de4b-f737-442b-af80-e4fb9d094a73 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f112f687b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:09.780844 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-6462de4b-f737-442b-af80-e4fb9d094a73 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Image not found. Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6462de4b-f737-442b-af80-e4fb9d094a73 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea HTTP/1.1 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:09.783038 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: exception: Image not found. Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '22509052-a2cc-4bde-b910-bde8a67d83ea'} Oct 11 01:31:09.784573 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:31:09.785849 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22509052-a2cc-4bde-b910-bde8a67d83ea Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:31:09.787034 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22509052-a2cc-4bde-b910-bde8a67d83ea could not be found. Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:09.788491 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:31:09.789865 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:09.791733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6462de4b-f737-442b-af80-e4fb9d094a73 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Image not found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:09.792600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6462de4b-f737-442b-af80-e4fb9d094a73 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea" status: 404 len: 62 microversion: 2.1 time: 0.052075 Oct 11 01:31:09.793170 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1516/3064] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:31:09 2022] GET /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:31:09.801485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:09.802446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:09.814655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.815424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.816096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:09.819949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:09.820603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:09.822276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:10.050764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:10.051649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:10.061838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:10.062661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:10.063322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:10.064457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:10.065153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:10.066044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:10.815110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:10.850042 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ecddc865-74f0-4811-b69e-fdbaeca41096 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1534 microversion: 2.1 time: 1.052422 Oct 11 01:31:10.855790 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1549/3065] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:09 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1534 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:10.889564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:10.893118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:10.908191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:10.908612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:10.909433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:10.909777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:10.910243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:10.910673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:11.229937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:11.244116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-873ff9e9-7a63-4708-88be-67560fb79aba tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1686 microversion: 2.1 time: 1.198144 Oct 11 01:31:11.246753 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1517/3066] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:10 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1686 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:11.264456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:11.267325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:11.284764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:11.285293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:11.287659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:11.288638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:11.289681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:11.290512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:11.675165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:11.689358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd34e715-dba5-4c7c-b834-e87528f1155f tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 0.831222 Oct 11 01:31:11.701560 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1550/3067] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:10 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:11.709170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55808322-1ef3-413d-80d1-7d4186203558", "name": "network-vif-plugged", "status": "completed", "tag": "2434bd01-6d2b-4581-954e-22c5ba9807ba"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:11.743317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:11.743838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:11.744279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:11.770893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] Creating event network-vif-plugged:2434bd01-6d2b-4581-954e-22c5ba9807ba for instance 55808322-1ef3-413d-80d1-7d4186203558 on n-h2-772273-9 Oct 11 01:31:11.795547 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8d4b12fa-1786-4a31-9f43-93baae978f7f req-a326f504-503a-41fc-8c29-3e720a42c5a7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092335 Oct 11 01:31:11.797629 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1551/3068] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:11.886546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:11.887375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:11.901011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:11.904114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:11.904584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:11.905347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:11.907245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:11.909857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.462294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:13.479435 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b697479-2801-42b9-918e-067962491b32 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1476 microversion: 2.1 time: 2.230291 Oct 11 01:31:13.491375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1518/3069] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:11 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1476 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:13.491375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:13.491375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:13.521597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:13.522359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:13.522905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.526432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:13.527055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:13.528735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.786833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:13.810489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e994de29-45fa-443a-b3f5-ba4f752011d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1540 microversion: 2.1 time: 1.929384 Oct 11 01:31:13.831379 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1552/3070] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:11 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1540 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:13.831379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:13.841399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:13.844275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:13.853297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:13.853959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:13.856768 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0332d2c1-3d8e-4af4-8fa7-7e8aa5773e2b tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1619 microversion: 2.1 time: 0.375175 Oct 11 01:31:13.858492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.859404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:13.860418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1519/3071] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:13 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1619 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:13.870571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:13.873027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:13.880299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.919899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:13.920390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:13.920827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:13.942475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Creating event network-changed:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h1-772273-9 Oct 11 01:31:13.955692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:31:13.976839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-476afb92-bf56-452d-9bb9-1013cafe08e4 req-2b873b63-ccce-497e-b730-9c40f176aae9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112176 Oct 11 01:31:13.977928 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1520/3072] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:14.523886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:14.526258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:14.535587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:14.543136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:14.544160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:14.544962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:14.547669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:14.548538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:14.559464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:14.834687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:14.852650 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-69c055c3-3f37-4cee-9b9f-695ed59d5807 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1316 microversion: 2.1 time: 1.034528 Oct 11 01:31:14.853564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1553/3073] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:13 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:14.884176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701db354-8bfa-4fc1-9b36-b8f3726ebb21", "name": "network-vif-deleted", "tag": "831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:14.930089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:14.934377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:14.941921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:14.951577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:14.973516 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b409ee04-bb31-42ee-b4d1-70d0f3216f63 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1476 microversion: 2.1 time: 0.466946 Oct 11 01:31:14.977617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1521/3074] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:14 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:14.986389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:14.997504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:15.014384 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] Creating event network-vif-deleted:831fb4e9-eaa1-4df3-8ecd-c5f9dd0a52d3 for instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 on n-h1-772273-9 Oct 11 01:31:15.023724 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0ad52bc1-a4ae-4dad-9f53-9dbbc290eea2 req-bbf1fbd2-183d-4de3-b507-c50b81b49ddf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167357 Oct 11 01:31:15.025894 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1554/3075] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:15.035218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.036113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.039841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:15.042775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:15.046353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.047241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.047777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.048256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.069670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.070690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.071316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.072282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.074224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.074938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.097596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:15.229003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.229512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.237332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.237841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'fault' on Instance uuid 701db354-8bfa-4fc1-9b36-b8f3726ebb21 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:31:15.457360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:15.463755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:15.466959 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-69271801-1f34-428e-bfb6-5ff4e1170be7 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1333 microversion: 2.1 time: 0.438706 Oct 11 01:31:15.470832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1555/3076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:15 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1333 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:15.878612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:15.879908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:15.896691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.897570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.900673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.902510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.903119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.905370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.935364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:15.943310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4117571c-7f07-4b6d-bcdd-afacd99bcd43 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1522 microversion: 2.1 time: 0.964592 Oct 11 01:31:15.943932 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1522/3077] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:14 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1522 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:15.969030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:15.969539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:15.989542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.990062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.990515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:15.992100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:15.992575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:15.999871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.088370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:16.269239 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-116aa9db-9768-4d0b-a007-10ee49040d68 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 204 len: 0 microversion: 2.1 time: 0.304591 Oct 11 01:31:16.270227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1523/3078] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:15 2022] DELETE /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:31:16.277873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:16.278647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:16.289310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.289812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.290258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.290976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.291478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.291908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.601582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:16.616927 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47f88852-afa9-4dde-afca-691997bc21d7 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1504 microversion: 2.1 time: 0.741611 Oct 11 01:31:16.616927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1556/3079] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:15 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:16.621122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:16.624738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:16.649751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.650883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.651362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.652111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.653195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.653648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.843692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:16.852581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-364ac366-4bcd-44f4-b8af-bd143712b7ce tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1474 microversion: 2.1 time: 0.581048 Oct 11 01:31:16.858571 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1524/3080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:16 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1474 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:16.864395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:16.873348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:16.888238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.891473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.892332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.895060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.895765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.896214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.966861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:16.968168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:16.968768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:16.969391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lazy-loading 'fault' on Instance uuid 701db354-8bfa-4fc1-9b36-b8f3726ebb21 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:31:17.680074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:17.714904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cb39382-f010-48a3-b46f-1515de3c303f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 200 len: 1333 microversion: 2.1 time: 0.853090 Oct 11 01:31:17.725936 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1525/3081] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:16 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 1333 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:17.734589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df7bdd-3e95-446a-82b7-806b052d59a2", "name": "network-vif-plugged", "status": "completed", "tag": "5719963e-cf68-4dfe-baf0-6e0f1bf86b45"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:17.739308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:17.752756 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b452810-0067-4b35-b075-909a12c8e653 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1528 microversion: 2.1 time: 1.134418 Oct 11 01:31:17.756115 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1557/3082] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:16 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1528 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:17.770175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.772286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.773013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.773279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:17.774234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:17.781777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.782286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.782735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.783563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.784031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.784466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.803607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] Creating event network-vif-plugged:5719963e-cf68-4dfe-baf0-6e0f1bf86b45 for instance e5df7bdd-3e95-446a-82b7-806b052d59a2 on n-h1-772273-9 Oct 11 01:31:17.816728 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-28b50251-d7b6-40c8-a54c-6f32a94f5cb9 req-d1344d36-e94e-499a-9087-88a712058b0d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087895 Oct 11 01:31:17.820753 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1526/3083] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:17.845742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad0e8a83-5bed-4218-ae9f-67178537847b tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips" status: 200 len: 108 microversion: 2.1 time: 0.076093 Oct 11 01:31:17.849097 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1558/3084] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:31:17 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips => generated 108 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:17.862670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:17.863270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:17.879916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.881894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.887021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:17.887908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:17.894729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.899268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.901385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.901853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.905046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.906554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.907318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.908970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:17.913913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:17.915900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:17.976181 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2bc29499-1126-4a8c-b7e3-56f487ac1c7e tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips" status: 200 len: 108 microversion: 2.1 time: 0.120430 Oct 11 01:31:17.979411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1527/3085] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:31:17 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips => generated 108 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:17.996096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:17.996875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:18.008341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.010413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.010979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.011911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.013629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.015761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.072538 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ae408dd-3a6b-4670-a287-83068902b877 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips/tempest-ServerAddressesTestJSON-151202458-network" status: 200 len: 93 microversion: 2.1 time: 0.083798 Oct 11 01:31:18.075211 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1528/3086] 10.222.0.66 () {58 vars in 1398 bytes} [Tue Oct 11 01:31:17 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558/ips/tempest-ServerAddressesTestJSON-151202458-network => generated 93 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:31:18.088461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:18.089274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:18.096353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.097130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.097784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.098702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.099353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.099953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.130764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:18.232909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d505e89e-dbe6-4d9a-a7d5-aef534fcbbc1 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "DELETE /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 204 len: 0 microversion: 2.1 time: 0.147891 Oct 11 01:31:18.238130 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1529/3087] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:18 2022] DELETE /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:18.246952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:18.248466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:18.256386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.257232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.257861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.259198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.259866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.260470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.655927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:18.672415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a140a2b-3567-41a9-85de-00ad3e235c5c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1474 microversion: 2.1 time: 0.788855 Oct 11 01:31:18.691684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1559/3088] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:17 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1474 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:18.705810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:18.715794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8d61b9f-b861-4e66-be69-6627cfc944bc tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1510 microversion: 2.1 time: 0.475586 Oct 11 01:31:18.722076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1530/3089] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:18 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:18.749447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:18.751407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: 701db354-8bfa-4fc1-9b36-b8f3726ebb21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:18.761091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.762672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.763387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.765045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.765878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.766532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.783532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:18.784415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:18.792447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.793056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.793575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.794501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:18.795043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:18.795583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:18.810926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 HTTP/1.1 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:18.819871 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. Oct 11 01:31:18.821350 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '701db354-8bfa-4fc1-9b36-b8f3726ebb21'} Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:18.822140 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. Oct 11 01:31:18.823395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:18.826353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 404 to user: Instance 701db354-8bfa-4fc1-9b36-b8f3726ebb21 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:18.830068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1109ce80-11b4-4afc-8463-bfc5e4d3d411 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21" status: 404 len: 111 microversion: 2.1 time: 0.083691 Oct 11 01:31:18.831589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1560/3090] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:18 2022] GET /compute/v2.1/servers/701db354-8bfa-4fc1-9b36-b8f3726ebb21 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:18.849526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f30bd126-05e9-4d3f-ad5f-6b1deda90214 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '.version_select at 0x7f112ff128b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:18.898304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f30bd126-05e9-4d3f-ad5f-6b1deda90214 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240833512" status: 202 len: 0 microversion: 2.1 time: 0.060020 Oct 11 01:31:18.899659 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1561/3091] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240833512 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:31:19.153070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:19.165724 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-160849b0-46e1-4b2a-a146-9b133ad145b1 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1528 microversion: 2.1 time: 0.384021 Oct 11 01:31:19.166650 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1531/3092] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:18 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1528 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:19.698605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:19.699526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:19.716894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:19.719157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:19.719871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:19.721747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:19.723601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:19.724237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:19.745685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:19.746621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:19.760998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:19.769596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:19.770304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:19.771228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:19.774385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:19.774954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.059575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:20.074196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab00ceb0-61ae-4a6d-b752-969da6dc1e6a tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1510 microversion: 2.1 time: 0.332551 Oct 11 01:31:20.074801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1532/3093] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:19 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:20.192247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:20.192868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:20.205610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:20.207454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:20.213092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.214676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:20.218682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:20.219534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.423966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:20.447551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5bdad51c-2a17-49f8-8bf1-c93f5438bced tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 200 len: 1486 microversion: 2.1 time: 0.249876 Oct 11 01:31:20.450462 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1533/3094] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:20 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 1486 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:20.464163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df7bdd-3e95-446a-82b7-806b052d59a2", "name": "network-vif-deleted", "tag": "5719963e-cf68-4dfe-baf0-6e0f1bf86b45"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:20.525728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:20.526583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:20.527220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.554090 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] Creating event network-vif-deleted:5719963e-cf68-4dfe-baf0-6e0f1bf86b45 for instance e5df7bdd-3e95-446a-82b7-806b052d59a2 on n-h1-772273-9 Oct 11 01:31:20.569833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-33e177c9-c1d6-4110-8b05-0bc4806d2aff req-5b204827-391c-47b2-ae54-9d97b83d2d3f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116741 Oct 11 01:31:20.571879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1534/3095] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:20.602783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:20.612532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a21afd3-65e3-4438-92b7-c79010660756 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1471 microversion: 2.1 time: 0.918159 Oct 11 01:31:20.639377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:20.640334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:20.641856 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1562/3096] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:19 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1471 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:20.656890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:20.657852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:20.659102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.660268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:20.661333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:20.661845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:20.712299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-832512331", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "054f280f-e08a-468c-9b35-776f190cdeeb"}, {"uuid": "e7819755-d5bb-4132-a44b-a1b44fa75bae"}, {"uuid": "054f280f-e08a-468c-9b35-776f190cdeeb"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:20.836077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] validate_networks() for [('054f280f-e08a-468c-9b35-776f190cdeeb', None, None, None, None, None), ('e7819755-d5bb-4132-a44b-a1b44fa75bae', None, None, None, None, None), ('054f280f-e08a-468c-9b35-776f190cdeeb', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:31:20.894354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:20.942344 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d7b03ad-39cc-4f6e-b3e1-e926a21ceb68 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "POST /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8/action" status: 202 len: 0 microversion: 2.1 time: 0.309102 Oct 11 01:31:20.947670 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1535/3097] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:31:20 2022] POST /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:31:20.979075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:20.981362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:20.998019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:21.004970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:21.005530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:21.006315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:21.006800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:21.007247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:21.664053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:21.673664 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f03602d-a5f8-4e71-a296-d73c0695dfc6 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 0.723991 Oct 11 01:31:21.694435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1536/3098] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:20 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:21.700190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:21.701159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:21.713103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:21.718557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:21.719261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:21.720210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:21.721693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:21.723878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:22.341735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5865a0fe3af9436c8d75f66753327e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1a6282d3094d6cadac646b4715a08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:22.354982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdb8e4f1-f052-4d33-8bb4-624e2d14c9ca tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 200 len: 1468 microversion: 2.1 time: 0.658844 Oct 11 01:31:22.356401 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1537/3099] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:21 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 1468 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:22.362608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:22.363662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:22.371454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:22.372135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:22.372733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:22.373658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:22.374266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:22.374899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:22.393845 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 HTTP/1.1 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:22.395988 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:31:22.397637 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e5df7bdd-3e95-446a-82b7-806b052d59a2'} Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:22.398545 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:31:22.400112 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:22.403304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:22.404766 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-829353c0-9821-43b5-b40c-593c1784a45c tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 404 len: 111 microversion: 2.1 time: 0.047199 Oct 11 01:31:22.405627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1538/3100] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:22 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:22.587566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1522027216", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:22.692716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] validate_networks() for [('4cd21dfb-0b79-409c-8856-06a8aeb68e46', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:31:25.896108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:31:25.896714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:31:25.897014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:31:25.897506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:31:25.897921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:31:25.923958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:25.924522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:25.924976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:25.926034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:25.926502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:25.926940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:25.961871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:31:25.962406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:31:25.962868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:31:25.963856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:31:25.964473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:31:25.980975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:31:25.994403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:25.996273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:25.996386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:25.997118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:25.999903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.000388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.001273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Getting quotas for user 6d11c60413dc43ba8d71d6ce37823d1a and project 0b8b490cd3f94bafb2ce436124dd09c0. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:31:26.044723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Getting quotas for project 3f027a594c0641af895ad9ef38720a33. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:31:26.051477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Getting quotas for user ffc2bd5b12f24d51b07a93b7ef7e7fea and project 3f027a594c0641af895ad9ef38720a33. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:31:26.052667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:31:26.064517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:31:26.084820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:31:26.093064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:31:26.248857 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c30f9ed9-89ae-4aff-848e-3de4f5099000 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.670899 Oct 11 01:31:26.252850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1539/3101] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:31:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:31:26.273308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55808322-1ef3-413d-80d1-7d4186203558", "name": "network-vif-deleted", "tag": "2434bd01-6d2b-4581-954e-22c5ba9807ba"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:26.307996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-df160056-b07a-4707-848b-b52a6306ebc7 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.602540 Oct 11 01:31:26.315948 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1563/3102] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:31:26.321777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.322276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.322718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.331648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:26.332288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:26.372793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.373309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.373759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.385206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.385818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.386277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.404620 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] Creating event network-vif-deleted:2434bd01-6d2b-4581-954e-22c5ba9807ba for instance 55808322-1ef3-413d-80d1-7d4186203558 on n-h2-772273-9 Oct 11 01:31:26.424189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d7fe710b-9682-491f-ad2e-f0928749a887 req-ff628a16-a276-4cd7-85cf-e677be1a61fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158282 Oct 11 01:31:26.439742 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1540/3103] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:26.451898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:26.461223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] [instance: 55808322-1ef3-413d-80d1-7d4186203558] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:26.516383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.517222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.518737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.519695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.520359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.520989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.538234 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] HTTP exception thrown: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Request method failure captured: Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 HTTP/1.1 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMdJXDBYNn0hBumtXQcRKHTpIl50xcHoNq_6z1KN5Itl_HDOP7t8OmIUzfd0FI_IZfnxTk8Ab1PyVTmy51fHUA1bdByOPlPwPOu5RM-MazVfLlE59aDcqCgZVbWLmRkNr_ka92whY5GWceD8N78qj5O07qP2z2g-a_jNo1flJ_z4uS0 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2c1a6282d3094d6cadac646b4715a08c Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerAddressesTestJSON-338782207 Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:26.552509 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c1a6282d3094d6cadac646b4715a08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c1a6282d3094d6cadac646b4715a08c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c1a6282d3094d6cadac646b4715a08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c1a6282d3094d6cadac646b4715a08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerAddressesTestJSON-338782207 Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2c1a6282d3094d6cadac646b4715a08c Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerAddressesTestJSON-338782207 Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerAddressesTestJSON-338782207-project Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5865a0fe3af9436c8d75f66753327e06 Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerAddressesTestJSON-338782207-project Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. Oct 11 01:31:26.554145 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '55808322-1ef3-413d-80d1-7d4186203558'} Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:26.555291 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. Oct 11 01:31:26.556926 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:26.558253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] Returning 404 to user: Instance 55808322-1ef3-413d-80d1-7d4186203558 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:26.558253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7d79169-989c-45d0-995f-2714f79a1d59 tempest-ServerAddressesTestJSON-338782207 tempest-ServerAddressesTestJSON-338782207-project] 10.222.0.66 "GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558" status: 404 len: 111 microversion: 2.1 time: 0.117007 Oct 11 01:31:26.558253 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1541/3104] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:26 2022] GET /compute/v2.1/servers/55808322-1ef3-413d-80d1-7d4186203558 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:26.564314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-plugged", "status": "completed", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:26.583172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:26.583701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:26.584147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:26.632034 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Creating event network-vif-plugged:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h1-772273-9 Oct 11 01:31:26.652208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:31:26.702437 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4589e420-ad1a-4c68-ac55-edd38a624f56 req-4c7425cf-9ef5-465b-9ed2-3931fd62d43a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142969 Oct 11 01:31:26.710066 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1542/3105] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:26.730320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25f8608f-baa3-4be4-97a7-bf9ac7a0042d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:26.732424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25f8608f-baa3-4be4-97a7-bf9ac7a0042d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:27.048530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25f8608f-baa3-4be4-97a7-bf9ac7a0042d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:27.056736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25f8608f-baa3-4be4-97a7-bf9ac7a0042d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1225 microversion: 2.1 time: 0.345099 Oct 11 01:31:27.067522 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1543/3106] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:26 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1225 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:27.073257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-600c0758-8382-4755-a920-6d55b6c84ea2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:27.074355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-600c0758-8382-4755-a920-6d55b6c84ea2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:27.514038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-600c0758-8382-4755-a920-6d55b6c84ea2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:27.521915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-600c0758-8382-4755-a920-6d55b6c84ea2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1212 microversion: 2.1 time: 0.453100 Oct 11 01:31:27.528021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1544/3107] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:27 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1212 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:27.787923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:27.809647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a38d501f-ce07-4a0c-8eb7-856bb816c2f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 1.492257 Oct 11 01:31:27.829364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1564/3108] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:26 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:28.098863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:28.100131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:28.151083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.152329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.152880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:28.153597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.154066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.154507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:28.543252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:28.557857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:28.558494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:28.568135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7208b057-7b71-49da-91aa-9724f7a7f08d tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1277 microversion: 2.1 time: 0.476619 Oct 11 01:31:28.580565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.581202 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1545/3109] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:28 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1277 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:28.581365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.581365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:28.581569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.583269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.586175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:28.769166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:28.803576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-088e72a2-b5ee-4c0e-961d-1e60ce2b1615 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1208 microversion: 2.1 time: 0.250604 Oct 11 01:31:28.805180 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1565/3110] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:28 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1208 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:28.835279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:28.835935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:28.853356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.853877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.854349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:28.856434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:28.858904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:28.860505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:29.595204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:29.605466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:29.647562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:29.683606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:29.687273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:29.689582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:29.693235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:29.693819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:30.051660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:30.063288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2998bb5a-21b3-42cc-9a6a-ab9ab8c5ca81 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1283 microversion: 2.1 time: 0.472762 Oct 11 01:31:30.082523 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1566/3111] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:29 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1283 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:30.094673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:30.096516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:30.119110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:30.125324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:30.126897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:30.129527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:30.135535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:30.137081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:30.159995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:30.172001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e1c38c4-3ffd-4afc-8315-d5a965b51641 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 1.341691 Oct 11 01:31:30.172591 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1546/3112] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:28 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:30.629558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:30.646389 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f06a404f-99ce-4d8c-b137-bacbfdad0d53 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1270 microversion: 2.1 time: 0.562387 Oct 11 01:31:30.649173 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1567/3113] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:30 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1270 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:31.089976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:31.093725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:31.105304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.106635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.107482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:31.109038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.109722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.110868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:31.200513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:31.201851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:31.212712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.214131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.214777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:31.218561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.219808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.220417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:31.301162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:31.315254 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5753bce-bf06-4420-89a3-c290a8eb5539 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1283 microversion: 2.1 time: 0.229763 Oct 11 01:31:31.319605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1547/3114] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:31 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:31.672987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:31.673625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:31.685471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.686189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.686643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:31.687378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:31.689321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:31.692264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:32.466258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:32.478865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26dcdd07-3df7-4af7-9c91-e9821980e43c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1270 microversion: 2.1 time: 0.810258 Oct 11 01:31:32.480119 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1548/3115] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:31 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1270 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:32.485219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-unplugged", "status": "completed", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:32.511226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:32.512240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:32.513339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:32.544435 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Creating event network-vif-unplugged:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:31:32.547608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:32.559119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:31:32.571419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f66709ab-17bd-4bc1-b2b9-d2798dd4662a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 1.374369 Oct 11 01:31:32.572471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1568/3116] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:31 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:32.592920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:32.600867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:32.622019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:32.628191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:32.629555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:32.632455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:32.633581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-21c80d0a-0342-46bc-a10e-b1d66fd5fd47 req-5d180f5d-f6a8-4cc3-a070-97183f5f5e1d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149446 Oct 11 01:31:32.637385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:32.637846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1549/3117] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:32.639127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:33.240567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:33.254566 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c158ab6-394e-4df5-948a-6364b4597358 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.673715 Oct 11 01:31:33.262642 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1569/3118] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:32 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:33.516299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:33.516939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:33.523384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:33.548340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:33.549563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:33.552158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:33.552861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:33.568170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:33.618961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1122169992", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "fbd4e4b4-e8f1-4899-9bd4-f4aa47ac9977"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:33.757600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] validate_networks() for [('fbd4e4b4-e8f1-4899-9bd4-f4aa47ac9977', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:31:33.861471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:33.873790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd334ce2-1af6-409d-a8d8-49fda2449f8e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1270 microversion: 2.1 time: 0.361301 Oct 11 01:31:33.874494 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1570/3119] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:33 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1270 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:33.892117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:33.893119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:33.908553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:33.909397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:33.909865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:33.910624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:33.911092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:33.911572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:34.450250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:34.468221 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a99b589-e66f-4fcf-82e9-e46fdc48ba2c tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 0.592252 Oct 11 01:31:34.483744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1571/3120] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:33 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:34.723304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66940603-575e-41ca-9b84-0b316efea748 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Action: 'create', calling method: .version_select at 0x7f112f74faf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-351084370", "metadata": {"Type": "work"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66940603-575e-41ca-9b84-0b316efea748 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 121 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:34.727199 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-351084370", "metadata": {"Type": "work"}}} Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:31:34.728684 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-351084370', 'metadata': {'Type': 'work'}}}} Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:34.729583 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:31:34.731032 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:31:34.732313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 01:31:34.732313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:34.732313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66940603-575e-41ca-9b84-0b316efea748 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:34.732313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66940603-575e-41ca-9b84-0b316efea748 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.243854 Oct 11 01:31:34.732313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1572/3121] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Oct 11 01:31:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:31:34.751355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:34.753410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:34.756704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:34.763194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:34.763753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:34.764205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:34.764950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:34.765419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:34.765857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:34.840486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:35.024737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cc0a0a4-e412-4dd3-8618-556fe75b92cb tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 204 len: 0 microversion: 2.1 time: 0.276768 Oct 11 01:31:35.025440 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1573/3122] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:34 2022] DELETE /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:35.033542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:35.034509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:35.047438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.047963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.048415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.049148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.049616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.050369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.073098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:35.156002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:31:35.156653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:31:35.157128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:31:35.157511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:31:35.157941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:31:35.178589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.179096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.179583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.180356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.180827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.181264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.223603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Getting quotas for project 9a0d1b1a34d240138c1d9ccd5be1a120. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:31:35.226351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:35.231890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Getting quotas for user e1de07cd80b94c2d855355cefd6a5e57 and project 9a0d1b1a34d240138c1d9ccd5be1a120. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:31:35.280106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:31:35.286754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:31:35.370256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1eb7706a-c5a0-4f0d-8f29-d8b4f3464ff7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.113129 Oct 11 01:31:35.371805 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1550/3123] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:31:35.381671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee4dae51-8365-4e6e-8ca9-f6e2a5481df1 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Action: 'create', calling method: .version_select at 0x7f112f638d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-880252245", "metadata": {"Type": "work"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee4dae51-8365-4e6e-8ca9-f6e2a5481df1 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 119 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:35.390724 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-880252245", "metadata": {"Type": "work"}}} Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:31:35.392574 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-880252245', 'metadata': {'Type': 'work'}}}} Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '0' Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:35.393619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:31:35.395288 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:31:35.396736 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 01:31:35.396736 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:35.397709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee4dae51-8365-4e6e-8ca9-f6e2a5481df1 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:35.398752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee4dae51-8365-4e6e-8ca9-f6e2a5481df1 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025744 Oct 11 01:31:35.399541 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1551/3124] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Oct 11 01:31:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:31:35.412702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:35.413652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:35.425255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.426040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.426669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.427597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.428224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.428820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.605878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:35.624083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de39d753-6d3f-4890-86e6-0477169d0c40 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.594825 Oct 11 01:31:35.625549 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1574/3125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:35 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:35.641199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:35.642393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:35.655703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.659854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.661003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.665752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.666307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.666923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.821492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:35.857254 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7a511b1-cd0c-4505-9e45-1ddb83fca001 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1312 microversion: 2.1 time: 0.447452 Oct 11 01:31:35.876118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1552/3126] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:35 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1312 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:35.883760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:35.900079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:35.902702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:35.903606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:35.934157 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Creating event network-changed:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:31:35.949653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:31:35.974972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f8fae919-b996-4f68-969d-615ee4ec044e req-6e4fc415-6376-4027-8311-836c953baa28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095445 Oct 11 01:31:35.977635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1553/3127] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:35.991379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:36.009401 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd504571-cf99-42a3-a10c-d9dba7cbb12d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1507 microversion: 2.1 time: 0.382410 Oct 11 01:31:36.019713 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1575/3128] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:35 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:36.021157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6cbb5b4e-3b9f-458f-878a-5d06c3dd3ca0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.022601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6cbb5b4e-3b9f-458f-878a-5d06c3dd3ca0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:36.029877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6c2b51d-337b-4ceb-b9ee-44d5af782bcf tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Action: 'create', calling method: .version_select at 0x7f112f9ac670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-375415277", "metadata": {"Type": "work"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6c2b51d-337b-4ceb-b9ee-44d5af782bcf tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 118 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:36.046061 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-375415277", "metadata": {"Type": "work"}}} Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:31:36.047540 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-375415277', 'metadata': {'Type': 'work'}}}} Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '' Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:36.048483 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:31:36.049850 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:31:36.051135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 01:31:36.051135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.065000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6c2b51d-337b-4ceb-b9ee-44d5af782bcf tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:36.068011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6c2b51d-337b-4ceb-b9ee-44d5af782bcf tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.046968 Oct 11 01:31:36.070388 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1576/3129] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Oct 11 01:31:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:31:36.072796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:36.075258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:36.083917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.084543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:36.094090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:36.094950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:36.095933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:36.097208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:36.098161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:36.098827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:36.287162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6cbb5b4e-3b9f-458f-878a-5d06c3dd3ca0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:36.297581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6cbb5b4e-3b9f-458f-878a-5d06c3dd3ca0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1216 microversion: 2.1 time: 0.318309 Oct 11 01:31:36.298959 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1554/3130] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:35 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1216 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:36.312699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d10e6690-ff6c-4b56-818e-8738e3584353 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Calling method '.version_select at 0x7f112f687c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.359506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d10e6690-ff6c-4b56-818e-8738e3584353 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] HTTP exception thrown: Volume tempest-invalid-1963193609 could not be found. Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d10e6690-ff6c-4b56-818e-8738e3584353 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1963193609 HTTP/1.1 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:36.363166 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: exception: Volume tempest-invalid-1963193609 could not be found. Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'tempest-invalid-1963193609'} Oct 11 01:31:36.364813 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1963193609 could not be found. (HTTP 404) (Request-ID: req-36a0f58c-4689-4fdd-9e87-5b944391bec0) Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.365913 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:31:36.367355 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1963193609 could not be found. Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:36.368806 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1963193609 could not be found. Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1963193609 could not be found. Oct 11 01:31:36.373014 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.375820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d10e6690-ff6c-4b56-818e-8738e3584353 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 404 to user: Volume tempest-invalid-1963193609 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:36.379831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d10e6690-ff6c-4b56-818e-8738e3584353 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1963193609" status: 404 len: 99 microversion: 2.1 time: 0.076594 Oct 11 01:31:36.381049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1555/3131] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:31:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1963193609 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:31:36.397725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57ad512f-183c-4e0c-b3bf-b164fcd5c4cc tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011334 Oct 11 01:31:36.398686 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1556/3132] 10.222.0.66 () {58 vars in 1140 bytes} [Tue Oct 11 01:31:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 01:31:36.408365 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd549391-8aec-4ad1-aaa9-c9bb65ac5495 tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004019 Oct 11 01:31:36.409415 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1557/3133] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:31:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 11 01:31:36.419797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e696cf3-fc03-4336-98bb-aceaa5fa9aca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Calling method '.version_select at 0x7f112f6384c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.458961 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2e696cf3-fc03-4336-98bb-aceaa5fa9aca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] HTTP exception thrown: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e696cf3-fc03-4336-98bb-aceaa5fa9aca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-volumes/108e9cda-e407-4007-9983-a1d09ff3603b HTTP/1.1 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:36.461174 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: exception: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '108e9cda-e407-4007-9983-a1d09ff3603b'} Oct 11 01:31:36.462516 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. (HTTP 404) (Request-ID: req-3ec330b1-c566-4ec7-b1a9-b906faa23393) Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.463369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:31:36.466532 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 01:31:36.467954 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e696cf3-fc03-4336-98bb-aceaa5fa9aca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 404 to user: Volume 108e9cda-e407-4007-9983-a1d09ff3603b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e696cf3-fc03-4336-98bb-aceaa5fa9aca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/108e9cda-e407-4007-9983-a1d09ff3603b" status: 404 len: 109 microversion: 2.1 time: 0.048157 Oct 11 01:31:36.469395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1558/3134] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:31:36 2022] DELETE /compute/v2.1/os-volumes/108e9cda-e407-4007-9983-a1d09ff3603b => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:36.484051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0a89f5a-8020-4631-9b60-450e3387b8ca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Calling method '.version_select at 0x7f112f687af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.532646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-b0a89f5a-8020-4631-9b60-450e3387b8ca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] HTTP exception thrown: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0a89f5a-8020-4631-9b60-450e3387b8ca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Request method failure captured: Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-volumes/1e19c67c-de26-46ba-91c9-3630802503e0 HTTP/1.1 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd1YTP2EyLOivwYD-7kLSrapwuF9zRDjdsgjypKO7Ur4cTMCd40QX3XtAfGTGek8RrtHjXehEDzTVJMTb6hY1oy5difIsB8xl_sjSMsFtIcYtW6BIU1fpQ5ymrm9sDzzazkfbl0W4SIB_0npZtpTtyN-N1V9Qz8OmfGFNpvTW3mALI Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:36.536651 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06a056976beb402884414d91a4716756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06a056976beb402884414d91a4716756"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06a056976beb402884414d91a4716756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 06a056976beb402884414d91a4716756 Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-767935071 Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0f96f1c62b0b4c40bc8d1b1a21704750 Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-767935071-project Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: exception: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1e19c67c-de26-46ba-91c9-3630802503e0'} Oct 11 01:31:36.538085 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. (HTTP 404) (Request-ID: req-b74f79cf-98ec-42f4-bd9f-03d7b50190de) Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.539100 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:31:36.540324 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 01:31:36.545839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. Oct 11 01:31:36.548612 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:36.554111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0a89f5a-8020-4631-9b60-450e3387b8ca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] Returning 404 to user: Volume 1e19c67c-de26-46ba-91c9-3630802503e0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:36.555330 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0a89f5a-8020-4631-9b60-450e3387b8ca tempest-VolumesNegativeTest-767935071 tempest-VolumesNegativeTest-767935071-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/1e19c67c-de26-46ba-91c9-3630802503e0" status: 404 len: 109 microversion: 2.1 time: 0.076370 Oct 11 01:31:36.556552 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1559/3135] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:31:36 2022] GET /compute/v2.1/os-volumes/1e19c67c-de26-46ba-91c9-3630802503e0 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:36.651546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:36.652616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:36.667630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:36.671674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:36.672582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:36.674206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:36.677514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:36.679510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:37.341821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:37.352064 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67a89c1b-d04c-4aaa-a155-0c732d3c20e4 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 1.279763 Oct 11 01:31:37.353867 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1577/3136] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:36 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:37.359764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:37.360676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:37.367937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:37.368727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:37.369392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:37.370309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:37.370976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:37.371677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:38.205439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:38.213845 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46d6bcfc-3d2f-48c6-8465-d75f60354979 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 1.567280 Oct 11 01:31:38.228111 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1560/3137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:36 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:38.236683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:38.238446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:38.245653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:38.246447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:38.247131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:38.248100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:38.249065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:38.249703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:38.952476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:38.963965 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe2dd903-69e5-4198-9374-dcaa1ed7cf2a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1312 microversion: 2.1 time: 1.608643 Oct 11 01:31:38.968356 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1578/3138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:37 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1312 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:38.983697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:38.985979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:39.007890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.010279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.017651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.019483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.020180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.021000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.098208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:39.110364 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fcd5a68-8f5c-4573-bbe5-ac550597342d tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1507 microversion: 2.1 time: 0.876888 Oct 11 01:31:39.113262 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1561/3139] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:38 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:39.123318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd030dc-7955-41a8-9b42-cf0ef0f00bc2", "tag": "5395fb25-705d-4b58-adc8-a713d4e724af"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:39.145722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.148152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.148891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.178621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] Creating event network-changed:5395fb25-705d-4b58-adc8-a713d4e724af for instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 on n-h2-772273-9 Oct 11 01:31:39.186191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8972cca2-673f-403c-90a4-bfa84402f9b6 req-e7e8bec8-6f25-46d7-b346-d80ee3345edc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070928 Oct 11 01:31:39.187529 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1562/3140] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:39.196334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:39.197423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:39.221608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.223815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.225605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.227854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.230248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.231912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.271409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:39.282510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0699b81d-549f-491d-969a-d4e541f8f0af tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1274 microversion: 2.1 time: 0.312382 Oct 11 01:31:39.286339 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1579/3141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:38 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:39.304571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:39.305491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:39.319255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.320067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.324791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:39.326593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:39.327791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:39.329427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.206501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:40.215717 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62843bcd-130f-4358-9cd4-5407235e2f3a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.927886 Oct 11 01:31:40.234566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1580/3142] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:39 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:40.253795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebf141b-9da6-4eab-8764-a77f0349d669", "name": "network-vif-deleted", "tag": "1d0a3e03-caac-4b71-b727-baa4cffde4b5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:40.263692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:40.278622 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11251317-85a7-4263-9b6a-40c11b458f62 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1470 microversion: 2.1 time: 1.089226 Oct 11 01:31:40.280031 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1563/3143] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:39 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1470 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:40.314213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.314721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.314999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:40.316306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:40.317549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.342849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.348122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.352224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.354140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.356871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.358344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.371849 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] Creating event network-vif-deleted:1d0a3e03-caac-4b71-b727-baa4cffde4b5 for instance aebf141b-9da6-4eab-8764-a77f0349d669 on n-h2-772273-9 Oct 11 01:31:40.384979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5f50ce0c-55e0-4cf0-bdf0-4559ef73fbf9 req-656977cd-5874-4a6b-afa8-94d0a80291c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147718 Oct 11 01:31:40.388361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1581/3144] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:40.416316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:40.423427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:40.446927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.453814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.454546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.458324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.458991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.459618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.805475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:40.829620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed4128f9-26c1-4812-9e1f-86db8e5a4f93 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 200 len: 1293 microversion: 2.1 time: 0.437271 Oct 11 01:31:40.849905 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1582/3145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:40 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 1293 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:40.885197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:40.898247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:40.912585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.913093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.921412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.922510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:40.925802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:40.928538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:40.979999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:41.010350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33a21dbb-f9c6-4adb-8155-37cb7986f50b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1333 microversion: 2.1 time: 0.720880 Oct 11 01:31:41.011040 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1564/3146] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:40 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1333 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:41.244824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:41.248344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:41.289108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.290303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.291125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:41.292409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.293642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.294399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:41.757671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:41.774497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1454fb58-8ad2-4fa4-9569-dbc699a734d4 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 0.921987 Oct 11 01:31:41.776149 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1583/3147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:40 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:41.801368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:41.802735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:41.811329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.812882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.813611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:41.814610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.815504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.816897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:41.894716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:41.903715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7565da79-c280-42ab-bbf4-c93841fa8838 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.663847 Oct 11 01:31:41.907619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1565/3148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:41 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:41.938621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:41.939676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: aebf141b-9da6-4eab-8764-a77f0349d669] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:41.952436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.953129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.956090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:41.958776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:41.961458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:41.962179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.012447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:42.014168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 HTTP/1.1 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:42.016758 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. Oct 11 01:31:42.018481 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'aebf141b-9da6-4eab-8764-a77f0349d669'} Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:42.020423 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. Oct 11 01:31:42.021994 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:42.030439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 404 to user: Instance aebf141b-9da6-4eab-8764-a77f0349d669 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:42.031211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4190e29b-9318-4a52-8172-f7ca219d09df tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669" status: 404 len: 111 microversion: 2.1 time: 0.122452 Oct 11 01:31:42.032966 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1566/3149] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:41 2022] GET /compute/v2.1/servers/aebf141b-9da6-4eab-8764-a77f0349d669 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:42.044920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:42.045859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:42.055219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.057204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.058035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.058978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.059775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.060426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.110336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:42.287036 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aac5253a-e38f-4f87-9e9a-0f75a0f1d377 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 204 len: 0 microversion: 2.1 time: 0.249459 Oct 11 01:31:42.288308 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1567/3150] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:42 2022] DELETE /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:42.296934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:42.301281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:42.311137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:42.311692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.312198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.312696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.313812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.314289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.315576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.326817 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdd12650-702d-4259-a84a-3d7e55e2adcd tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1463 microversion: 2.1 time: 0.549053 Oct 11 01:31:42.327864 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1584/3151] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:41 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:42.343562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:42.344458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:42.355824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.356456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.357029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.367791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:42.368637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:42.369350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:42.969458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:42.979498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef8e690d-d94e-42f6-bc4d-c410408172d5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1333 microversion: 2.1 time: 0.689580 Oct 11 01:31:42.987518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1568/3152] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:42 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1333 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:43.017998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:43.028304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5be1a344-05a3-4e26-9b5f-cba8e2e80c1f tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 0.699049 Oct 11 01:31:43.029181 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1585/3153] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:42 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:43.051859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:43.052760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:43.084689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.085484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.086043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:43.087578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.099373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.101145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:43.426670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:43.427243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:43.440161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.440676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.441678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:43.442409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.442877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.443312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:43.625848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:43.646991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91a0aab1-4804-4f21-8820-fe5240d12e85 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 0.604833 Oct 11 01:31:43.647871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1586/3154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:43 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:43.660945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:43.663171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:43.677993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.679627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.682013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:43.684629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:43.686088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:43.686861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:44.041920 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ada1d2df-e312-470e-9751-184e1ee7684a tempest-MigrationsAdminTest-1540238484 tempest-MigrationsAdminTest-1540238484-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1614 microversion: 2.1 time: 1.051506 Oct 11 01:31:44.042519 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1569/3155] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:42 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1614 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:44.105291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70794873-a818-440e-934e-c216935ac30b", "tag": "36df189f-9acd-4107-817d-f15ddcdd07fa"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:44.136705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:44.137204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:44.137656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:44.174984 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] Creating event network-changed:36df189f-9acd-4107-817d-f15ddcdd07fa for instance 70794873-a818-440e-934e-c216935ac30b on n-h1-772273-9 Oct 11 01:31:44.196101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-309bdb43-7db7-4b54-8570-280665828e85 req-1329225e-03d1-41e4-9d4f-2b576f3b3eba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102325 Oct 11 01:31:44.196726 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1570/3156] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:44.203824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:44.208074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:44.223357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:44.225433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:44.227309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:44.228516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:44.237185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:44.237653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:44.317254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:44.332377 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fce87b90-5681-49da-b920-50ada597462a tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.679390 Oct 11 01:31:44.335091 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1587/3157] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:43 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:44.353658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:44.356406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:44.388797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:44.389501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:44.390151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:44.391090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:44.391794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:44.392421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.206306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:45.303948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:45.321916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-571f1720-8f8f-4317-9afc-474db57c0d3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.122241 Oct 11 01:31:45.323576 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1571/3158] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:44 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:45.330356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:45.331311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:45.343283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.344931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.349084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.350750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.351623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.353278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.403879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:45.563573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:45.572764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf42f3ea-9748-4de4-8ace-80d3fe342ae6 tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1521 microversion: 2.1 time: 1.236251 Oct 11 01:31:45.580144 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1588/3159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:44 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1521 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:45.586106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f48e313d-b48a-446a-b7f0-68a8e8fe0d01 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 204 len: 0 microversion: 2.1 time: 0.257044 Oct 11 01:31:45.587091 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1572/3160] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:45 2022] DELETE /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:45.595483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:45.596344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:45.596677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-plugged", "status": "completed", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:45.605226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.608822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.609444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.610366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.610988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.611455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.622040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.623070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.628430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.675370 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] Creating event network-vif-plugged:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:31:45.695634 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a063cd70-c80b-48fa-a5a5-d2cec2a9e2ae req-c6cd6eaf-ce79-4808-9af8-f52fcfaa93e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106379 Oct 11 01:31:45.696272 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1573/3161] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:45.704495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:45.705382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:45.723193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.723726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.724172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:45.724894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:45.725356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:45.725789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:46.197087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:46.204809 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8cda8955-dab9-40e9-9b44-60bd7dea3e1f tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 0.623159 Oct 11 01:31:46.216126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1589/3162] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:45 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:46.221203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:46.222030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:46.230960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:46.245670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b36962c-d2e8-4867-bd04-09ebe35401ab tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.539204 Oct 11 01:31:46.246521 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1574/3163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:45 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:46.246845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:46.247666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:46.248262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:46.249173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:46.249627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:46.250050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:46.349798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:46.350691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:46.353301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=18 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:46.387538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:46.391226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:46.391866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:46.395605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:46.396111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:46.399277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.186857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:47.201013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f790685-1a53-443d-9ec4-4cd3df83cddb tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 200 len: 1469 microversion: 2.1 time: 0.982537 Oct 11 01:31:47.202303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1590/3164] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:46 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 1469 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:47.214883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:47.215772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:47.230875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.234146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.234855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.235786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.237078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.238782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.507801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b009187ab4ad78d7fe88a44863179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f6e510636f4606a54b10f4a651bfd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:47.522778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:47.537508 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c522fc17-6180-464b-b881-5acb31a783d8 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.191633 Oct 11 01:31:47.539550 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1575/3165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:46 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:47.551700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4417f17f-49a5-4043-9755-e589d2ca136a tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 200 len: 1479 microversion: 2.1 time: 0.336634 Oct 11 01:31:47.551700 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1591/3166] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:47 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 1479 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:47.565097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:47.565296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:47.565641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:47.571997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:47.595289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.596888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.600013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.601497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.602147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.604269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.604451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.604859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.605506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:47.610060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:47.610633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:47.611077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.716473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:48.720343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:48.730106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e31d1eb8-5fa6-4582-acbd-605069ed73a0 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 1.181197 Oct 11 01:31:48.730721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1592/3167] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:47 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:48.735695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e8ad0e-ca96-49f3-8dd6-7c3754139535", "name": "network-vif-deleted", "tag": "c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:48.751583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.752073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.752507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.780685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] Creating event network-vif-deleted:c8ef4bd0-d78f-44d4-8d7c-e1a8e3d683bc for instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 on n-h1-772273-9 Oct 11 01:31:48.786455 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d880bac0-fbfa-4f7e-bac0-c3876f5b7f6e req-b6956544-40eb-4aef-83d3-5b4f9b694217 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054504 Oct 11 01:31:48.787587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1593/3168] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:48.793450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f5d3-aa1c-44cb-a4e5-e073254b60d8", "name": "network-vif-deleted", "tag": "bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:48.805825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.806372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.807214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.821893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] Creating event network-vif-deleted:bb75dde7-3cd7-4ebb-8ef9-0cb9391a562a for instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 on n-h2-772273-9 Oct 11 01:31:48.828601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-45fd425b-0b01-4f17-95dd-e5993198de90 req-d9d4d6b0-b4a4-4dd5-9848-9d8f49c49634 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039620 Oct 11 01:31:48.830184 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1594/3169] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:48.838766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:48.840209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:48.849939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.851605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.852296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.853312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.854114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.855663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.875444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] HTTP exception thrown: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Request method failure captured: Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 HTTP/1.1 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYrmLb3tdS2aV_hMw6x9LOw6nmcC07Ra4tV4PuqEEUvGee_BPpOUaMdx4PcmNHNMTlwF8n608oj6KVNqicC3PbR12zd22nHADmET0fHqVEj1Gf1I0Xi3YUjdztodb-3yxZgcW75aELqPjWDBWZM37rCSjPgU7vV_mvYf6o6GTSrjb0 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:31:48.879509 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1b5963412e234d698b2db2c737008fe2 Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. Oct 11 01:31:48.881086 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6c72f5d3-aa1c-44cb-a4e5-e073254b60d8'} Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:48.881993 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. Oct 11 01:31:48.883416 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:31:48.885831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Returning 404 to user: Instance 6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:48.888017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0f4e645a-16f9-47e9-a65b-42ed1dcaa60a tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8" status: 404 len: 111 microversion: 2.1 time: 0.054496 Oct 11 01:31:48.888792 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1595/3170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:48 2022] GET /compute/v2.1/servers/6c72f5d3-aa1c-44cb-a4e5-e073254b60d8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:48.894485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd030dc-7955-41a8-9b42-cf0ef0f00bc2", "name": "network-vif-plugged", "status": "completed", "tag": "5395fb25-705d-4b58-adc8-a713d4e724af"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:48.922874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.923795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.924511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.945710 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] Creating event network-vif-plugged:5395fb25-705d-4b58-adc8-a713d4e724af for instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 on n-h2-772273-9 Oct 11 01:31:48.951930 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c4109318-e77d-4b29-b313-a15105b1ab80 req-a312a690-ab1f-4288-8c31-3cc1681f35dd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061597 Oct 11 01:31:48.953722 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1596/3171] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:48.972621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:48.973998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:48.986410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.987953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.989220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:48.990436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:48.991224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:48.992625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.505369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:49.517387 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31090581-420a-4fed-9062-257d3181ceda tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 1.957516 Oct 11 01:31:49.528783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1576/3172] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:47 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:49.543261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:49.544401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] [instance: c9e8ad0e-ca96-49f3-8dd6-7c3754139535] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:49.553442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.554231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.554875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.555892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.556529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.557294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.601189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] HTTP exception thrown: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Request method failure captured: Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 HTTP/1.1 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYuoCc7AwjPAOVXgzPk4VWvgKX7BeOwhiuOWutoKfvorgoA-LtEbIdXKUjtUWXItGnNQdsBhrMhpCOGi-ENIIG7NcnaWLzy5gvJ3O73hb-VthdMiuucRKDcqLCMmXGqLlm2rZ5xyjOp2ML0_wZzDfj23OJapQWWQTeKbR-exEzsCMQ Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:49.603678 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77f6e510636f4606a54b10f4a651bfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 77f6e510636f4606a54b10f4a651bfd6 Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-358198843 Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5f9b009187ab4ad78d7fe88a44863179 Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-358198843-project Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. Oct 11 01:31:49.605040 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c9e8ad0e-ca96-49f3-8dd6-7c3754139535'} Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:49.605925 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. Oct 11 01:31:49.607246 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:49.610844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] Returning 404 to user: Instance c9e8ad0e-ca96-49f3-8dd6-7c3754139535 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:49.612080 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fd8b52e-fe37-434c-91ff-40abad7ad1ce tempest-ServerRescueNegativeTestJSON-358198843 tempest-ServerRescueNegativeTestJSON-358198843-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535" status: 404 len: 111 microversion: 2.1 time: 0.081899 Oct 11 01:31:49.613105 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1577/3173] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:49 2022] GET /compute/v2.1/servers/c9e8ad0e-ca96-49f3-8dd6-7c3754139535 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:49.623327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:49.624108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:49.632975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.633881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.634541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.635773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.636420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.637159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.682138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:49.837718 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca829b9d-8c03-4a5a-986f-6a10f5c6eaed tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 204 len: 0 microversion: 2.1 time: 0.218595 Oct 11 01:31:49.855580 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1578/3174] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:49 2022] DELETE /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:49.864118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:49.868218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:49.882221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.882959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.884100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:49.885169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:49.885847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:49.887641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:50.245232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:50.261376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e840b5d5-ea84-4271-b999-4717f852218e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.305875 Oct 11 01:31:50.262465 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1597/3175] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:48 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:50.268871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:50.269549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:50.281463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:50.282176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:50.282773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:50.283696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:50.284312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:50.284895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:50.536601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:50.547883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db83b82c-e5e5-4e44-ad8d-267799d42ff2 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 0.689379 Oct 11 01:31:50.549018 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1579/3176] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:49 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:50.586683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:50.589963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:50.611371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:50.615121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:50.616005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:50.619229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:50.623829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:50.625793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:50.695449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:50.995864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:51.004767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00610467-e2a5-4a8f-b247-465d3b540663 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1535 microversion: 2.1 time: 0.741054 Oct 11 01:31:51.007844 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1598/3177] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:50 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1535 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:51.018184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "tag": "c6f56886-2532-4354-9744-3b6a7f7d7d75"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:51.051865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:51.052458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:51.056105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:51.076962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] Creating event network-changed:c6f56886-2532-4354-9744-3b6a7f7d7d75 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:31:51.093609 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-82a414da-51df-41f5-bb8c-2454fd18d3ce req-6bce9873-0a55-418f-8672-40bf4f4679e1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084294 Oct 11 01:31:51.094347 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1599/3178] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:51.292521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:51.293276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:51.312903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:51.313505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:51.315018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:51.317328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:51.318005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:51.318613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:51.478174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:51.489011 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8df4b13f-a58f-4593-a80c-0399266cea7f tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1325 microversion: 2.1 time: 0.936222 Oct 11 01:31:51.490762 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1580/3179] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:50 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1325 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:51.575360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:51.576238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:51.601401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:51.601753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:51.602201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:51.603582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:51.603582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:51.603939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:52.185853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:52.194334 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24b15933-945d-4f44-99e5-96ab5f580a35 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.907018 Oct 11 01:31:52.201721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1600/3180] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:51 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:52.216670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:52.217215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:52.230746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:52.231241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:52.231700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:52.232403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:52.232859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:52.233279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:53.020293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:53.034497 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ba7990b-e809-46ab-8bc2-dbb3d189c23e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 1.463276 Oct 11 01:31:53.038310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1581/3181] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:51 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:31:53.043087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:53.048102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:53.061165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:53.061903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:53.062541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:53.073225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:53.073950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:53.074585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:53.551714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:53.559951 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2e2ca7a-1aaa-43e8-bc61-58deffb452c1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1535 microversion: 2.1 time: 1.356936 Oct 11 01:31:53.576011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1601/3182] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:52 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1535 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:53.580966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:53.581596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:53.609200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:53.609919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:53.610368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:53.611090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:53.611590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:53.612024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:53.997055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:54.006365 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffe7988c-615d-4490-88dc-1b12454c0839 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1523 microversion: 2.1 time: 0.966820 Oct 11 01:31:54.007161 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1582/3183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:53 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1523 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:54.020541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70794873-a818-440e-934e-c216935ac30b", "name": "network-vif-plugged", "status": "completed", "tag": "36df189f-9acd-4107-817d-f15ddcdd07fa"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:54.038717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.042641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.043859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.070859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] Creating event network-vif-plugged:36df189f-9acd-4107-817d-f15ddcdd07fa for instance 70794873-a818-440e-934e-c216935ac30b on n-h1-772273-9 Oct 11 01:31:54.076743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-49c0b5c4-d8d0-4c1f-b99d-ddc4b6181a6a req-6d7b0920-1026-4f99-9f90-d3e67319248c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067753 Oct 11 01:31:54.077883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1583/3184] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:54.085616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:54.086684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:54.093616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.094342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.095320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.096801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.097445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.098074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.133518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:54.270848 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c2cd9de-b590-4bff-bd80-126a1fd7d336 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 204 len: 0 microversion: 2.1 time: 0.191273 Oct 11 01:31:54.272657 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1584/3185] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:54 2022] DELETE /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:54.280123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:54.281217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:54.290954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.291645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.292360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.293354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.294055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.299197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.441177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:54.500314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b28afda7-f39e-45ca-a792-9cfe9a0148a9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.922127 Oct 11 01:31:54.502182 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1602/3186] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:53 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:54.512219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "tag": "816b738e-5795-4137-a794-4e94c5544423"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:54.529037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.529896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.530532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.547599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] Creating event network-changed:816b738e-5795-4137-a794-4e94c5544423 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:31:54.564763 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ebc71fe5-4350-490d-a668-054f658ef5bb req-d051555a-e7af-4a83-8e58-4ca37694b700 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060862 Oct 11 01:31:54.565603 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1603/3187] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:54.572558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:54.573283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:54.584162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.590546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.591781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.595878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:54.597058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:54.599407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:54.997141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:55.006356 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61e0a7ad-1d1b-4a57-a936-9494e3beba7a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1316 microversion: 2.1 time: 0.732156 Oct 11 01:31:55.042272 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1585/3188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:54 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1316 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:55.049307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:55.049980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:55.065416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:55.065924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:55.070125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:55.071134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:55.073374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:55.074007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:55.156160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:55.157257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:55.158106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:55.158733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lazy-loading 'fault' on Instance uuid 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:31:55.346863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:55.359166 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11307a98-9ee6-426d-a609-1ad5d9594183 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 200 len: 1369 microversion: 2.1 time: 0.314858 Oct 11 01:31:55.360353 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1586/3189] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:55 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 1369 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:55.527181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:55.527368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:55.527854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:55.536044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:55.536553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:55.536997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:55.537781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:55.538415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:55.538845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:55.575601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89b95841-00fe-45e3-9071-abb825a7ddb9 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1529 microversion: 2.1 time: 1.004505 Oct 11 01:31:55.578146 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1604/3190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:54 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1529 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:56.036510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:56.037140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:56.050014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.050548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.051687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.054520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.055011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.056826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.747616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:56.750820 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ab9d865-abc0-4307-a439-f17128e20d84 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.227440 Oct 11 01:31:56.751671 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1587/3191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:55 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:56.757908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-unplugged", "status": "completed", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:56.768520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:31:56.779303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.780738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.781290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.800550 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] Creating event network-vif-unplugged:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:31:56.808506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-61b60603-0e15-483c-ad63-0698fc622aba req-6336cafc-c998-4979-bcfd-454c722adeb5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055549 Oct 11 01:31:56.809522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:56.813917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1588/3192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:56.819147 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-665d9cb3-f897-46d1-ad36-d010d5208f1a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1504 microversion: 2.1 time: 0.788441 Oct 11 01:31:56.823792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:56.825216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: 7f87c6a1-be67-4c8f-ac22-bab3ce014b54] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:56.836123 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1605/3193] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:56 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1504 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:56.842210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.842801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.843510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.844352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.844897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.845396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.848863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:56.849716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:56.861426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.862180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.862819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.864416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.865084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.865680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.873090 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] HTTP exception thrown: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Request method failure captured: Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 HTTP/1.1 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYrmLb3tdS2aV_hMw6x9LOw6nmcC07Ra4tV4PuqEEUvGee_BPpOUaMdx4PcmNHNMTlwF8n608oj6KVNqicC3PbR12zd22nHADmET0fHqVEj1Gf1I0Xi3YUjdztodb-3yxZgcW75aELqPjWDBWZM37rCSjPgU7vV_mvYf6o6GTSrjb0 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:31:56.875181 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 1b5963412e234d698b2db2c737008fe2 Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. Oct 11 01:31:56.876792 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '7f87c6a1-be67-4c8f-ac22-bab3ce014b54'} Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:31:56.877569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. Oct 11 01:31:56.878833 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:31:56.884286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Returning 404 to user: Instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:31:56.884286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1839032b-caec-41a0-af71-dd99d5f068fc tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54" status: 404 len: 111 microversion: 2.1 time: 0.062632 Oct 11 01:31:56.884286 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1589/3194] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:56 2022] GET /compute/v2.1/servers/7f87c6a1-be67-4c8f-ac22-bab3ce014b54 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:31:56.889039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87c6a1-be67-4c8f-ac22-bab3ce014b54", "name": "network-vif-deleted", "tag": "60c61ebf-66e2-423b-b21c-ee148385ca36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:56.903602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.904195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.904874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.920500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] Creating event network-vif-deleted:60c61ebf-66e2-423b-b21c-ee148385ca36 for instance 7f87c6a1-be67-4c8f-ac22-bab3ce014b54 on n-h1-772273-9 Oct 11 01:31:56.927403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-55c034b9-8864-4d95-980a-5764c5ad27a4 req-cb992b55-0191-4154-b043-224783fe5f46 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045591 Oct 11 01:31:56.928747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1590/3195] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:56.936057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:56.936773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:56.944304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.944804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.945845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.946692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:56.947161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:56.948349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:56.984624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:31:57.100840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9b2eb52-3add-4eb2-888a-037d49ae7028 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 204 len: 0 microversion: 2.1 time: 0.169074 Oct 11 01:31:57.101631 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1591/3196] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:56 2022] DELETE /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:31:57.112871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69b305db-1e45-4baa-b4fb-fd4998affb73 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '.version_select at 0x7f113419a700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:57.146027 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69b305db-1e45-4baa-b4fb-fd4998affb73 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908440325" status: 202 len: 0 microversion: 2.1 time: 0.039826 Oct 11 01:31:57.147241 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1592/3197] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908440325 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:31:57.153628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:57.155166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:57.167683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:57.168823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:57.169567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:57.170361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:57.172314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:57.173243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:57.517641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:57.533262 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c607b1e4-c92d-4f23-98fa-ef8f48a075f3 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1529 microversion: 2.1 time: 0.695968 Oct 11 01:31:57.544114 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1606/3198] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:56 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1529 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:57.803670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:57.813474 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d934248b-41ed-4c7e-8c25-3c9147e237c8 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1510 microversion: 2.1 time: 0.664739 Oct 11 01:31:57.827739 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1593/3199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:57 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1510 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:57.840117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:57.840763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:57.857317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:57.859692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:57.860583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:57.862168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:57.864553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:57.866963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:58.034288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8460d48a-1ea9-495b-8305-ba0a5c7fd80e tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] Calling method '.version_select at 0x7f112f9fa550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.143704 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8460d48a-1ea9-495b-8305-ba0a5c7fd80e tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673/defaults" status: 200 len: 371 microversion: 2.1 time: 0.409094 Oct 11 01:31:58.144555 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1607/3200] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:31:57 2022] GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673/defaults => generated 371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:58.156479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38968c6b-4852-41fc-a23c-7c3f4c4bab5a tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] Calling method '.version_select at 0x7f112f757dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.269590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38968c6b-4852-41fc-a23c-7c3f4c4bab5a tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673" status: 200 len: 371 microversion: 2.1 time: 0.116796 Oct 11 01:31:58.271490 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1608/3201] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:31:58.288336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf352e3f-4ab6-4f7b-8387-adb767f496dd tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] Calling method '.version_select at 0x7f112f7aad30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.389671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf352e3f-4ab6-4f7b-8387-adb767f496dd tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673/defaults" status: 200 len: 371 microversion: 2.1 time: 0.104464 Oct 11 01:31:58.400172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1609/3202] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673/defaults => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:31:58.405283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-036cb41a-4fee-430d-83df-5a4d6b1a9485 tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] Calling method '.version_select at 0x7f112fa5f1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.500578 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-036cb41a-4fee-430d-83df-5a4d6b1a9485 tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673" status: 200 len: 371 microversion: 2.1 time: 0.096574 Oct 11 01:31:58.507916 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1610/3203] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:58.514033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75281688-6ef2-4417-bf26-d7d624278b3e tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] Calling method '.version_select at 0x7f112faa0dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.732787 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75281688-6ef2-4417-bf26-d7d624278b3e tempest-QuotasTestJSON-1009182955 tempest-QuotasTestJSON-1009182955-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673?user_id=4236fb0239194071a4e86ff1285d8e2b" status: 200 len: 371 microversion: 2.1 time: 0.221447 Oct 11 01:31:58.733498 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1611/3204] 10.222.0.66 () {58 vars in 1323 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/os-quota-sets/d2b7afa6c92c41e688ff235dfb1d4673?user_id=4236fb0239194071a4e86ff1285d8e2b => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:58.746568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.747264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:58.762498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:58.763003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:58.766752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:58.767629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:58.768111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:58.768551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:58.845780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:58.860697 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a4b74c6-aba5-4989-9f7e-a6175a59fdd2 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.029670 Oct 11 01:31:58.864862 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1594/3205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:57 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:58.874328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:58.878800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:58.894677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:58.896487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:58.898024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:58.899222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:58.900660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:58.906159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:59.591813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d11c60413dc43ba8d71d6ce37823d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8b490cd3f94bafb2ce436124dd09c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:59.604003 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81898c7c-d733-4306-b1f7-843ba23f17bb tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 200 len: 1310 microversion: 2.1 time: 0.868955 Oct 11 01:31:59.605471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1612/3206] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 1310 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:59.622134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd030dc-7955-41a8-9b42-cf0ef0f00bc2", "name": "network-vif-deleted", "tag": "5395fb25-705d-4b58-adc8-a713d4e724af"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:31:59.638093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:59.639572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:59.640110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:59.655978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] Creating event network-vif-deleted:5395fb25-705d-4b58-adc8-a713d4e724af for instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 on n-h2-772273-9 Oct 11 01:31:59.662922 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8591a929-0ca2-402d-aad9-19b73f968554 req-57e189fb-fecb-4592-84e0-d2ba7c098f48 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054733 Oct 11 01:31:59.663816 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1613/3207] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:31:59.785004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:31:59.802031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34f31c3b-a455-4cbd-b6bf-1a68e1d4c14a tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1510 microversion: 2.1 time: 0.932523 Oct 11 01:31:59.803707 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1595/3208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:58 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1510 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:31:59.900817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:59.903009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:31:59.903819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:59.905101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:31:59.930979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:59.931760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:59.932987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:59.933693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:59.934564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:59.935197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:59.935779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:59.936601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:31:59.937833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:59.938832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:31:59.942974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:31:59.943502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:00.002399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:32:00.097429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:00.111527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39a15ff4-f6d0-499e-a142-32105c5ea673 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 204 len: 0 microversion: 2.1 time: 0.231558 Oct 11 01:32:00.112654 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1614/3209] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:31:59 2022] DELETE /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:32:00.123836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:00.125364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:00.133933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:00.134702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:00.135296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:00.136194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:00.136840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:00.137440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.282909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:01.294127 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35a42551-a6bb-42c3-a71b-b65c87b5b724 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.407920 Oct 11 01:32:01.298452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1596/3210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:31:59 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:01.307354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.308568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: afd030dc-7955-41a8-9b42-cf0ef0f00bc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:01.316194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.317924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.324202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.330066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.333458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.336248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.370455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:01.374093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. Oct 11 01:32:01.374672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 HTTP/1.1 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:01.377631 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. Oct 11 01:32:01.379155 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'afd030dc-7955-41a8-9b42-cf0ef0f00bc2'} Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:01.380685 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. Oct 11 01:32:01.382300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.386461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance afd030dc-7955-41a8-9b42-cf0ef0f00bc2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:01.386461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6415ea59-1da8-4d8c-aba9-7b13289c4676 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2" status: 404 len: 111 microversion: 2.1 time: 0.085516 Oct 11 01:32:01.387021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1597/3211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:01 2022] GET /compute/v2.1/servers/afd030dc-7955-41a8-9b42-cf0ef0f00bc2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:01.389621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3595a0ab-199f-4a6c-b535-0dc6d1a8d981 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1468 microversion: 2.1 time: 1.271780 Oct 11 01:32:01.391289 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1615/3212] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:00 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1468 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:01.394796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.396329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:01.408829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42dde9e7-9c6c-4fc0-92a2-c9371145fa66 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f112f88b0d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.411361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.421566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.422135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.423080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.423789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.424302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.454569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-42dde9e7-9c6c-4fc0-92a2-c9371145fa66 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Image not found. Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42dde9e7-9c6c-4fc0-92a2-c9371145fa66 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea HTTP/1.1 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:01.456487 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '22509052-a2cc-4bde-b910-bde8a67d83ea'} Oct 11 01:32:01.458695 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22509052-a2cc-4bde-b910-bde8a67d83ea to delete Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.459783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22509052-a2cc-4bde-b910-bde8a67d83ea could not be found. Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:01.461243 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42dde9e7-9c6c-4fc0-92a2-c9371145fa66 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:01.462759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-42dde9e7-9c6c-4fc0-92a2-c9371145fa66 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea" status: 404 len: 62 microversion: 2.1 time: 0.059126 Oct 11 01:32:01.463991 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1616/3213] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:01 2022] DELETE /compute/v2.1/images/22509052-a2cc-4bde-b910-bde8a67d83ea => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:32:01.474053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.474583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:01.484323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.484825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.485862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.486595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.487058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.487519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.503787 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 HTTP/1.1 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:01.506395 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.508104 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e5df7bdd-3e95-446a-82b7-806b052d59a2'} Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:01.509081 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.510675 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.513316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:01.514711 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f7abc50-c34d-4844-9716-eef3ef6581d6 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 404 len: 111 microversion: 2.1 time: 0.048012 Oct 11 01:32:01.515652 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1617/3214] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:01 2022] DELETE /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:01.524045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.525546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: e5df7bdd-3e95-446a-82b7-806b052d59a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:01.531761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.532285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.532731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.533458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.533912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.534460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.548835 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 HTTP/1.1 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:01.551838 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.557373 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e5df7bdd-3e95-446a-82b7-806b052d59a2'} Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:01.558240 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. Oct 11 01:32:01.559486 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:01.560605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance e5df7bdd-3e95-446a-82b7-806b052d59a2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:01.560605 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83dc2f9d-b456-4269-8c11-82aa5592a4e2 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2" status: 404 len: 111 microversion: 2.1 time: 0.033362 Oct 11 01:32:01.560605 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1618/3215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:01 2022] GET /compute/v2.1/servers/e5df7bdd-3e95-446a-82b7-806b052d59a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:01.563057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ebd287c9-4f78-4d82-9e47-c822fdbcf949 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f112f8f61f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:01.608112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ebd287c9-4f78-4d82-9e47-c822fdbcf949 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399104174" status: 202 len: 0 microversion: 2.1 time: 0.048863 Oct 11 01:32:01.608714 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1619/3216] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399104174 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:01.634929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1de07cd80b94c2d855355cefd6a5e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0d1b1a34d240138c1d9ccd5be1a120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:01.654947 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95322c8e-6769-452f-abac-3d48b0be636b tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 200 len: 1468 microversion: 2.1 time: 0.266619 Oct 11 01:32:01.663863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1598/3217] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:01 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 1468 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:01.730872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "tag": "91a0e83f-dbf8-4fee-8429-19b7064b6fc4"}, {"server_uuid": "70794873-a818-440e-934e-c216935ac30b", "name": "network-vif-deleted", "tag": "36df189f-9acd-4107-817d-f15ddcdd07fa"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:01.760859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:01.761396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:01.761873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:01.788773 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Creating event network-changed:91a0e83f-dbf8-4fee-8429-19b7064b6fc4 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:01.790992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] Creating event network-vif-deleted:36df189f-9acd-4107-817d-f15ddcdd07fa for instance 70794873-a818-440e-934e-c216935ac30b on n-h1-772273-9 Oct 11 01:32:01.819392 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-44ecd354-8c98-497c-9cb5-9aed33876c1a req-5bc49d8a-ef09-4fe1-8c36-7dcc3671bc2d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098565 Oct 11 01:32:01.820336 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1620/3218] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:02.323718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:02.324689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:02.338324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.338935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.339515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.342288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.342944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.343455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.418745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:02.421044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:02.441096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.444014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.444785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.447715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.450196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.451247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.486511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:02.912179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:02.921501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e4409f9-89d1-4666-b0f7-2ba421a0c4f3 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.603948 Oct 11 01:32:02.922122 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1599/3219] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:02 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:02.935762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:02.938135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:02.948034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:02.955935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.961118 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-229e3aec-c2ff-4601-bf96-976b93d45aaa tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1468 microversion: 2.1 time: 0.548250 Oct 11 01:32:02.961943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.962873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1621/3220] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:02 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1468 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:02.971645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.972753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:02.973487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:02.974875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:02.994069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b HTTP/1.1 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:02.996085 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:02.997815 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '70794873-a818-440e-934e-c216935ac30b'} Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:02.998783 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.000534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.002170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.002505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-71e46a73-5ba1-4e7b-8984-d97c967a8968 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 404 len: 111 microversion: 2.1 time: 0.072196 Oct 11 01:32:03.003095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1600/3221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:02 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:03.019971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-795498456", "metadata": {"image_type": "test"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:03.032318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.040251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.041140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.041848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.043020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.043828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.044508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.061932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b/action HTTP/1.1 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 111 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.064379 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-795498456", "metadata": {"image_type": "test"}}} Oct 11 01:32:03.065785 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '70794873-a818-440e-934e-c216935ac30b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-795498456', 'metadata': {'image_type': 'test'}}}} Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.066590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.068482 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.069771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.069771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.069771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.069771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.069771 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.072717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.073886 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f586ce97-cec3-4192-8455-82fd5cad4fc6 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "POST /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b/action" status: 404 len: 111 microversion: 2.1 time: 0.064241 Oct 11 01:32:03.075286 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1601/3222] 10.222.0.66 () {60 vars in 1279 bytes} [Tue Oct 11 01:32:03 2022] POST /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:03.086190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1792043059", "metadata": {"image_type": "test"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:03.089621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Failed to fetch instance by id tempest-invalid-2044243701 {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:32:03.090693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance tempest-invalid-2044243701 could not be found. Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/tempest-invalid-2044243701/action HTTP/1.1 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 112 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.092393 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1792043059", "metadata": {"image_type": "test"}}} Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.093784 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance tempest-invalid-2044243701 could not be found. Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'tempest-invalid-2044243701', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1792043059', 'metadata': {'image_type': 'test'}}}} Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2044243701 could not be found. Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.094688 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2044243701 could not be found. Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2044243701 could not be found. Oct 11 01:32:03.096551 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.097726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance tempest-invalid-2044243701 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.097726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-693a8e16-6b26-4bc9-89e6-9fc31017b5b7 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "POST /compute/v2.1/servers/tempest-invalid-2044243701/action" status: 404 len: 101 microversion: 2.1 time: 0.012940 Oct 11 01:32:03.097726 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1602/3223] 10.222.0.66 () {60 vars in 1249 bytes} [Tue Oct 11 01:32:03 2022] POST /compute/v2.1/servers/tempest-invalid-2044243701/action => generated 101 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:32:03.106501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1356869793"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:03.109741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:32:03.111025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 57 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.112586 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: {"createImage": {"name": "tempest-test-snap-1356869793"}} Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.114598 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1356869793'}}} Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.115465 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.117414 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.120299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.120299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99e4f54a-55f1-47e6-bb87-b63307f1ecf3 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013031 Oct 11 01:32:03.120299 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1603/3224] 10.222.0.66 () {60 vars in 1275 bytes} [Tue Oct 11 01:32:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:32:03.128557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1036047143"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:03.131676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:32:03.132194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 57 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.134493 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: {"createImage": {"name": "tempest-test-snap-1036047143"}} Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.136262 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1036047143'}}} Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.137117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 01:32:03.139004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.141806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.142856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82efd635-45eb-4935-b522-3ed382b80106 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019623 Oct 11 01:32:03.144025 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1604/3225] 10.222.0.66 () {60 vars in 1281 bytes} [Tue Oct 11 01:32:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:32:03.155090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.155862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.163694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.164389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.165042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.166044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.166928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.167477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.178206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8e9f623-e31e-46ef-be2e-4ee8cd054cd1 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Action: 'create', calling method: .version_select at 0x7f11388b84c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2132192005"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:03.198279 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b HTTP/1.1 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.200216 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.201863 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '70794873-a818-440e-934e-c216935ac30b'} Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.202872 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.204619 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.207799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.208901 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88810756-845f-48a6-a033-2290846dd493 tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 404 len: 111 microversion: 2.1 time: 0.059589 Oct 11 01:32:03.210089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1605/3226] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:03 2022] DELETE /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:03.224727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.226003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] [instance: 70794873-a818-440e-934e-c216935ac30b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.237639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.238291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.240456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.242188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.243015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.243736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.263692 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] HTTP exception thrown: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Request method failure captured: Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b HTTP/1.1 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMd0qW3kK28Mjw5P6Mv2V4EMY3MmLmhJrFDY17u9pRMQufiZ4gygsC9wDLmnk4jSImdzhqgvdW2_T4ETr46v2QMkQu6-R2dyQmu4-MqFwUqbVKMNd4r7XQmMxs9peG3BhhbsqALXVTxr1QnmC5xpEAbm_INQelcsuE3wot06HXMspbk Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:03.267073 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a0d1b1a34d240138c1d9ccd5be1a120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 9a0d1b1a34d240138c1d9ccd5be1a120 Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-953356122 Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e1de07cd80b94c2d855355cefd6a5e57 Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesNegativeTestJSON-953356122-project Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.268721 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '70794873-a818-440e-934e-c216935ac30b'} Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.269520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. Oct 11 01:32:03.271319 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.278345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] Returning 404 to user: Instance 70794873-a818-440e-934e-c216935ac30b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.279405 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a1a5f34-4765-43b6-a2f4-d1c8b65c950e tempest-ImagesNegativeTestJSON-953356122 tempest-ImagesNegativeTestJSON-953356122-project] 10.222.0.66 "GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b" status: 404 len: 111 microversion: 2.1 time: 0.065676 Oct 11 01:32:03.285495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1606/3227] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:03 2022] GET /compute/v2.1/servers/70794873-a818-440e-934e-c216935ac30b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:03.728913 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8e9f623-e31e-46ef-be2e-4ee8cd054cd1 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.756139 Oct 11 01:32:03.738737 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1622/3228] 10.222.0.66 () {60 vars in 1155 bytes} [Tue Oct 11 01:32:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 775 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 01:32:03.748375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88873b94-e258-446d-98f0-86aab837d7b4 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f11343af430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.749518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33167a16-f485-44ed-8c7e-6197d8d76517 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '.version_select at 0x7f112f88b310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.811807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-33167a16-f485-44ed-8c7e-6197d8d76517 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Image not found. Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33167a16-f485-44ed-8c7e-6197d8d76517 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/images/1fd44e69-7ba0-4a84-9838-db7bfeee0b23 HTTP/1.1 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:03.813870 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: exception: Image not found. Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1fd44e69-7ba0-4a84-9838-db7bfeee0b23'} Oct 11 01:32:03.815593 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1fd44e69-7ba0-4a84-9838-db7bfeee0b23 to delete Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.816452 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1fd44e69-7ba0-4a84-9838-db7bfeee0b23 could not be found. Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.819159 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.820660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33167a16-f485-44ed-8c7e-6197d8d76517 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Image not found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.822616 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33167a16-f485-44ed-8c7e-6197d8d76517 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/images/1fd44e69-7ba0-4a84-9838-db7bfeee0b23" status: 404 len: 62 microversion: 2.1 time: 0.074438 Oct 11 01:32:03.823739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1623/3229] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:03 2022] DELETE /compute/v2.1/images/1fd44e69-7ba0-4a84-9838-db7bfeee0b23 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:32:03.832629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.838877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.857511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.858215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.860254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.861322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.863927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.865694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.888769 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88873b94-e258-446d-98f0-86aab837d7b4 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 345 microversion: 2.1 time: 0.149678 Oct 11 01:32:03.889761 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1607/3230] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:03 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:03.903393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda HTTP/1.1 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:03.907962 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:03.912057 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda'} Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:03.913797 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:03.917591 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:03.923412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:03.925739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e09cc5cb-beac-4cc9-99c0-468112d301ed tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "DELETE /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 404 len: 111 microversion: 2.1 time: 0.097027 Oct 11 01:32:03.928731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1624/3231] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:03 2022] DELETE /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:03.935898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.936526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] [instance: 666e7d1e-81f2-49a0-88c2-db59f40fbeda] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.958818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.959495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:03.960127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:03.961747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.962372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.963124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.966247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.966733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:03.989103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:03.989620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:03.990069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:04.001901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:04.002158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:04.002609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:04.022882 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] HTTP exception thrown: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Request method failure captured: Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda HTTP/1.1 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMcU9gh0GScXgLW2Rs38iQdYQlhcKB-lPvu1Owg76oeB-ZbFyd3PleWvzLrLlhWDUfrV1Y0U8ET78a1lngakrOFqDcnKWEgho7c34KRyKv9QeOl-LHy6O3q2m0qcC251jLFTE8ifIsLTKjYXTtQm0W5rLVE1IGifkqTYAh0oEmSp4Gs Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:04.024524 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0b8b490cd3f94bafb2ce436124dd09c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 0b8b490cd3f94bafb2ce436124dd09c0 Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568 Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 6d11c60413dc43ba8d71d6ce37823d1a Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1131615568-project Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:04.026045 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '666e7d1e-81f2-49a0-88c2-db59f40fbeda'} Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:04.026888 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. Oct 11 01:32:04.028332 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:04.037643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] Returning 404 to user: Instance 666e7d1e-81f2-49a0-88c2-db59f40fbeda could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:04.038563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb0b08fb-3181-4d4a-8c1a-7835ca6be800 tempest-ImagesOneServerNegativeTestJSON-1131615568 tempest-ImagesOneServerNegativeTestJSON-1131615568-project] 10.222.0.66 "GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda" status: 404 len: 111 microversion: 2.1 time: 0.106991 Oct 11 01:32:04.039138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1608/3232] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:03 2022] GET /compute/v2.1/servers/666e7d1e-81f2-49a0-88c2-db59f40fbeda => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:32:04.056632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:04.058170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:04.066226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:04.066943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:04.068218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:04.069309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:04.069969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:04.070572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:04.250652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:04.265095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fe8758a-985b-476d-a97f-46de2d74c4f0 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1426 microversion: 2.1 time: 0.217878 Oct 11 01:32:04.265697 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1609/3233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:04 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1426 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:04.442762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c51d4a-6553-4530-885e-5eca6bba61f9", "name": "network-vif-deleted", "tag": "9e1f45cd-3a59-40ab-b205-b4de386555f8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:04.460561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:04.461155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:04.461816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:04.520972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] Creating event network-vif-deleted:9e1f45cd-3a59-40ab-b205-b4de386555f8 for instance c6c51d4a-6553-4530-885e-5eca6bba61f9 on n-h1-772273-9 Oct 11 01:32:04.542860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4c3b6ed7-3c2e-48b2-a0ee-f7bd96ea72c3 req-198d64b2-576e-41ae-bc38-aed8193598af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103936 Oct 11 01:32:04.544826 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1610/3234] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:04.839239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:04.859825 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f633f81-7b82-42e2-b1ac-49a7221faf89 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.915567 Oct 11 01:32:04.860795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1625/3235] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:03 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:04.908901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efa3be40-aa33-4888-a764-1a251f73b2bd tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f11350aa040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:05.047057 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efa3be40-aa33-4888-a764-1a251f73b2bd tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 345 microversion: 2.1 time: 0.142978 Oct 11 01:32:05.048767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1611/3236] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:04 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:05.290259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:05.291200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:05.307882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:05.308403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:05.308851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:05.313931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:05.314437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:05.314891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:05.441478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:05.442836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:05.443493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:05.444005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lazy-loading 'fault' on Instance uuid c6c51d4a-6553-4530-885e-5eca6bba61f9 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:32:05.798664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:05.809814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-080f2a94-b964-42ca-bb24-d1bd442699e3 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 200 len: 1303 microversion: 2.1 time: 0.525126 Oct 11 01:32:05.812927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1626/3237] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:05 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 1303 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:05.890918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:05.892046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:05.901698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:05.902451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:05.903357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:05.904968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:05.905809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:05.906593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:06.065278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35c3e9aa-96bc-490e-af19-fd2314076b08 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112fb8d160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:06.176498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35c3e9aa-96bc-490e-af19-fd2314076b08 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 346 microversion: 2.1 time: 0.116834 Oct 11 01:32:06.182194 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1627/3238] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:06 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:06.196311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e71b64db-22f2-480f-8a1b-67234fc2c8ec tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Action: 'create', calling method: .version_select at 0x7f112f7aad30>, body: {"snapshot": {"volume_id": "2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-617738015"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:06.639133 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e71b64db-22f2-480f-8a1b-67234fc2c8ec tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.447805 Oct 11 01:32:06.640095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1628/3239] 10.222.0.66 () {60 vars in 1162 bytes} [Tue Oct 11 01:32:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:06.735402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:06.753726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd8991e3-d215-4c49-8c24-e2db219a6200 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.867154 Oct 11 01:32:06.754334 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1612/3240] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:05 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:06.778095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe0bad9c-6ef0-43e8-8d00-208dd20036d3 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f5bf700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:06.831213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-76504663", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:06.902141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] validate_networks() for [('1d8b48cc-d1c9-4f1e-be91-729cd499a3c5', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:32:06.941383 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe0bad9c-6ef0-43e8-8d00-208dd20036d3 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.185416 Oct 11 01:32:06.942992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1613/3241] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:06 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:06.948371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:06.956507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: c6c51d4a-6553-4530-885e-5eca6bba61f9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:06.965306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:06.966057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:06.966676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:06.967576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:06.968192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:06.970807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:06.986805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] HTTP exception thrown: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Request method failure captured: Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 HTTP/1.1 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMYrmLb3tdS2aV_hMw6x9LOw6nmcC07Ra4tV4PuqEEUvGee_BPpOUaMdx4PcmNHNMTlwF8n608oj6KVNqicC3PbR12zd22nHADmET0fHqVEj1Gf1I0Xi3YUjdztodb-3yxZgcW75aELqPjWDBWZM37rCSjPgU7vV_mvYf6o6GTSrjb0 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:06.989131 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 1b5963412e234d698b2db2c737008fe2 Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. Oct 11 01:32:06.991473 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c6c51d4a-6553-4530-885e-5eca6bba61f9'} Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:06.992436 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. Oct 11 01:32:06.994015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:06.996266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Returning 404 to user: Instance c6c51d4a-6553-4530-885e-5eca6bba61f9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:06.997143 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a204a389-1352-424d-bddc-50acccac0d6e tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9" status: 404 len: 111 microversion: 2.1 time: 0.052957 Oct 11 01:32:06.997728 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1614/3242] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:06 2022] GET /compute/v2.1/servers/c6c51d4a-6553-4530-885e-5eca6bba61f9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:07.006861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5af43a46-7451-42a2-a437-be5e3bd66d42 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f11343afee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:07.078535 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5af43a46-7451-42a2-a437-be5e3bd66d42 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.076018 Oct 11 01:32:07.079359 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1615/3243] 10.222.0.66 () {58 vars in 1140 bytes} [Tue Oct 11 01:32:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:07.085138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:07.085839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:07.099675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:07.106084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:07.108189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:07.109117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:07.110136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:07.111450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:07.149095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:32:07.259371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce976cc8-838c-44de-84a8-c339f254ce74 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 204 len: 0 microversion: 2.1 time: 0.178482 Oct 11 01:32:07.267085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1616/3244] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:07 2022] DELETE /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:32:07.273151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98831a9d-eea0-41f9-832f-baf1c2be2cd6 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134235700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:07.314685 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98831a9d-eea0-41f9-832f-baf1c2be2cd6 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.045862 Oct 11 01:32:07.315269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1617/3245] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:07 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:07.320707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:07.321458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:07.339621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:07.340420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:07.341045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:07.341942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:07.342565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:07.344385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:08.701022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:08.962864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:08.980725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ca73a49-5e5e-4ca4-8ab9-1a76fa62ccc1 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1469 microversion: 2.1 time: 1.664109 Oct 11 01:32:08.982019 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1618/3246] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:07 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1469 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:08.987304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:08.988217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:09.010273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:09.011149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:09.011869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:09.013642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:09.014392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:09.015061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:09.639676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:09.648351 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbbed34b-b842-4a48-a6d4-96e340b354e6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.665014 Oct 11 01:32:09.648953 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1619/3247] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:08 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:09.666227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9622720-95a1-49e4-a7cf-eef53ab194b9 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f11343af160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:09.719715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9622720-95a1-49e4-a7cf-eef53ab194b9 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.063212 Oct 11 01:32:09.720324 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1620/3248] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:09 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:10.008315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:10.009818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:10.033737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.041356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.042115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.043932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.046734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.047812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.300579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:32:10.301141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:32:10.301850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:32:10.302935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:32:10.305500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:32:10.344596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5963412e234d698b2db2c737008fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37136bfbc76b4dfb8fd90866e0be5b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:10.354310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18f92b8f-2875-471a-bae7-cb5a46b2bc39 tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 200 len: 1427 microversion: 2.1 time: 0.350584 Oct 11 01:32:10.354898 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1621/3249] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:10 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 1427 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:10.365919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.368986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.370367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.373091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.374169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.375184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.379459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-plugged", "status": "completed", "tag": "c6f56886-2532-4354-9744-3b6a7f7d7d75"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:10.416873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.417738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.418605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.425860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Getting quotas for project 1cbf4da0b2e84c0e9485b8a40caa0d3a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:32:10.440514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Getting quotas for user 8526c0bfe1104b2b8cd177dd8dba41eb and project 1cbf4da0b2e84c0e9485b8a40caa0d3a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:32:10.451789 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] Creating event network-vif-plugged:c6f56886-2532-4354-9744-3b6a7f7d7d75 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:10.466271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-50509c8a-4c9c-4364-8b53-7c8a2314c7fd req-a86bc5e4-b6a4-4274-897b-6143cc5ceb57 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105513 Oct 11 01:32:10.468316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1622/3250] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:10.484155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:32:10.486196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7", "name": "network-vif-deleted", "tag": "28bc1f48-a4a4-43af-b807-729f446dc8db"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:10.493557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:32:10.546678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.554558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.555901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.620359 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] Creating event network-vif-deleted:28bc1f48-a4a4-43af-b807-729f446dc8db for instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 on n-h1-772273-9 Oct 11 01:32:10.628298 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c6e6166a-d34c-4043-a983-3ab5ac7e6145 req-ad82fa64-efee-4f44-b3e7-d61508cd1b52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157243 Oct 11 01:32:10.629197 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1623/3251] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:10.675717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:10.676832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:10.684421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c486b981-a689-403d-ba5a-1fffe141360f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.043030 Oct 11 01:32:10.690060 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1629/3252] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:32:10.692849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.693461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.694067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.695046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:10.695909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:10.696739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:10.709511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5045473-07e3-49a9-b149-4a85bfa438f4 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:10.719272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5045473-07e3-49a9-b149-4a85bfa438f4 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:11.832811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a5045473-07e3-49a9-b149-4a85bfa438f4 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:11.843170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5045473-07e3-49a9-b149-4a85bfa438f4 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1222 microversion: 2.1 time: 1.146708 Oct 11 01:32:11.844969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1630/3253] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:10 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1222 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:11.857894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6daf399c-6baf-4d75-8d9e-adb43ad8203d tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f9ddb80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:11.914084 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6daf399c-6baf-4d75-8d9e-adb43ad8203d tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 287 microversion: 2.1 time: 0.066842 Oct 11 01:32:11.920427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1631/3254] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:11 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:11.924513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:11.925948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] [instance: d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:11.942209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:11.945461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:11.947243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:11.949440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:11.950046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:11.950492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:11.975109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] HTTP exception thrown: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Request method failure captured: Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 HTTP/1.1 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMYrmLb3tdS2aV_hMw6x9LOw6nmcC07Ra4tV4PuqEEUvGee_BPpOUaMdx4PcmNHNMTlwF8n608oj6KVNqicC3PbR12zd22nHADmET0fHqVEj1Gf1I0Xi3YUjdztodb-3yxZgcW75aELqPjWDBWZM37rCSjPgU7vV_mvYf6o6GTSrjb0 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:11.978788 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37136bfbc76b4dfb8fd90866e0be5b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 37136bfbc76b4dfb8fd90866e0be5b51 Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MigrationsAdminTest-1092193154 Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1b5963412e234d698b2db2c737008fe2 Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MigrationsAdminTest-1092193154-project Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. Oct 11 01:32:11.980700 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7'} Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:11.981632 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. Oct 11 01:32:11.984235 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:11.988656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] Returning 404 to user: Instance d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:11.990237 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbd767a1-a00d-41f1-86c4-1ff4a6450aff tempest-MigrationsAdminTest-1092193154 tempest-MigrationsAdminTest-1092193154-project] 10.222.0.66 "GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7" status: 404 len: 111 microversion: 2.1 time: 0.073483 Oct 11 01:32:11.991064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1632/3255] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:11 2022] GET /compute/v2.1/servers/d1ba9efb-3c80-45ff-9a4c-1447e8d3f6a7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:11.996780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87d4cf95-e11a-422e-b5bf-e0593d0d8f19 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f757ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:12.136594 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87d4cf95-e11a-422e-b5bf-e0593d0d8f19 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 202 len: 0 microversion: 2.1 time: 0.144258 Oct 11 01:32:12.137394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1633/3256] 10.222.0.66 () {58 vars in 1254 bytes} [Tue Oct 11 01:32:11 2022] DELETE /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:12.151203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac7d0c44-5237-49ae-a3bc-3d094f549b83 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112fc2cf70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:12.218642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac7d0c44-5237-49ae-a3bc-3d094f549b83 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.075296 Oct 11 01:32:12.219471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1634/3257] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:12 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:12.799773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:12.809708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41067766-98fa-4766-862c-905de355bf12 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 2.138287 Oct 11 01:32:12.836527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1624/3258] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:10 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:12.874460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:12.875079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:12.904770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:12.905203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:12.905647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:12.906368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:12.906821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:12.907248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:13.241936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a661e69-48e0-4d42-9c4f-b95581f171eb tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134a3e310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:13.301815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:13.306538 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a661e69-48e0-4d42-9c4f-b95581f171eb tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.077796 Oct 11 01:32:13.307124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1625/3259] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:13 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:13.325935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51a10989-61ca-4ae0-87a6-ef13623f647d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1292 microversion: 2.1 time: 0.447325 Oct 11 01:32:13.340227 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1635/3260] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:12 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1292 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:13.851857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:13.852810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:13.866571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:13.867243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:13.868147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:13.869217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:13.869894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:13.870457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:14.304418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:14.319611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28b9b837-8ebe-46f2-85c0-f1af8fffd4a0 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f81aaf0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:14.327680 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b77d5c70-bf63-4d78-a6b8-138fb89fc391 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.482184 Oct 11 01:32:14.354954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1626/3261] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:13 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:14.365336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:14.365986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:14.381088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:14.381589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:14.382035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:14.382750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:14.387504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:14.388190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:14.404121 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28b9b837-8ebe-46f2-85c0-f1af8fffd4a0 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 200 len: 286 microversion: 2.1 time: 0.088956 Oct 11 01:32:14.405351 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1636/3262] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:14 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:14.707666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:14.734025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79144189-0483-4135-97c4-ca044435e35d tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1280 microversion: 2.1 time: 0.374198 Oct 11 01:32:14.748776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1627/3263] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:14 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:15.363051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:15.364010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:15.377535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:15.381402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:15.382834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:15.384253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:15.385893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:15.387083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:15.417085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91150f56-a98f-4bce-bf75-8a7902b2af2a tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134316b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:15.456568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-91150f56-a98f-4bce-bf75-8a7902b2af2a tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] HTTP exception thrown: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91150f56-a98f-4bce-bf75-8a7902b2af2a tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Request method failure captured: Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c HTTP/1.1 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeSqPd0rzqE3QIAqSbgxlNTtvOzYMAhvSHP1Kp3WPhaa0GNh_BdJA31FdC7SbZQi0NjsJ1mZmZp9dMPrD6Sn8ZunLexr6Cdv6KlMwFUZj62vPSQTCjjECcRuGHspVvbn358gq9OjC5_BT7M_g-G3Hdh_vjLBWeEmajrvVzoIlSu08M Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:15.461444 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 1f9cd9f29ee74b94a2c7de10007be79c Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: exception: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '93e05a80-2c89-48c3-953a-d3d7d40d804c'} Oct 11 01:32:15.463292 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. (HTTP 404) (Request-ID: req-3fd184ec-6175-469c-94f3-67da1f1c5f2d) Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.464323 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:15.465773 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 01:32:15.467269 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. Oct 11 01:32:15.468971 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:15.470693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91150f56-a98f-4bce-bf75-8a7902b2af2a tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Returning 404 to user: Snapshot 93e05a80-2c89-48c3-953a-d3d7d40d804c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:15.471757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91150f56-a98f-4bce-bf75-8a7902b2af2a tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c" status: 404 len: 111 microversion: 2.1 time: 0.058489 Oct 11 01:32:15.477367 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1628/3264] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 01:32:15 2022] GET /compute/v2.1/os-snapshots/93e05a80-2c89-48c3-953a-d3d7d40d804c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:32:15.483729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92872b2d-ac5f-4994-92fa-55c1d6723517 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134938b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:15.637348 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92872b2d-ac5f-4994-92fa-55c1d6723517 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 202 len: 0 microversion: 2.1 time: 0.158427 Oct 11 01:32:15.637991 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1629/3265] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:32:15 2022] DELETE /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:15.646764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f99ebfae-dc53-4ca5-849a-641f781dbd2c tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134218d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:15.727411 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f99ebfae-dc53-4ca5-849a-641f781dbd2c tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 345 microversion: 2.1 time: 0.084714 Oct 11 01:32:15.728005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1630/3266] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:15 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:15.766485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:15.767569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:15.778427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:15.787504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:15.788156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:15.789159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:15.789830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:15.790465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:15.823987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:15.838775 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-20466a26-d261-4838-947f-a990c9efeb37 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.480363 Oct 11 01:32:15.847060 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1637/3267] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:15 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:16.102255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-plugged", "status": "completed", "tag": "91a0e83f-dbf8-4fee-8429-19b7064b6fc4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:16.124016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:16.124723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:16.125161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:16.150347 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] Creating event network-vif-plugged:91a0e83f-dbf8-4fee-8429-19b7064b6fc4 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:16.161562 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1eddc74b-d2cf-444d-a1fd-d4d6abcb411c req-1d38d5a2-7954-454f-9ff1-2f426a087038 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063537 Oct 11 01:32:16.164376 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1638/3268] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:16.563801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:16.568622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:16.583327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-435e8348-151a-4c75-8d73-cec5bf6a5001 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.818680 Oct 11 01:32:16.585347 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1631/3269] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:15 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:16.745362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b62780d2-8f98-44e6-abd0-8d14575ff8a5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f94d1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:16.867429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:16.868344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:16.875279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b62780d2-8f98-44e6-abd0-8d14575ff8a5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 345 microversion: 2.1 time: 0.136723 Oct 11 01:32:16.876172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1639/3270] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:16 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:16.897496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:16.903853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:16.904395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:16.907821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:16.908713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:16.909375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:17.623912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:17.625154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:17.638534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:17.639992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:17.641175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:17.644604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:17.645366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:17.648166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:18.323202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:18.340752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a94670c1-4c45-46ad-8c65-f57658f705f1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 1.474871 Oct 11 01:32:18.342560 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1632/3271] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:16 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:18.354460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:18.377605 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50556b6d-0b6f-470d-b799-71c37cc15973 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.764690 Oct 11 01:32:18.380768 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1640/3272] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:17 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:18.382867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ebf8ad7-8205-4306-a4d1-801763c06cc3 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f1134456670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:18.404590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-plugged", "status": "completed", "tag": "816b738e-5795-4137-a794-4e94c5544423"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:18.439381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:18.440651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:18.448097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:18.491514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] Creating event network-vif-plugged:816b738e-5795-4137-a794-4e94c5544423 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:18.513868 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fcdf19f1-cf8c-4a3a-91af-e45b74d486f4 req-997f3b15-a5a6-4aaa-ac03-7cf0eaeb4937 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122403 Oct 11 01:32:18.515140 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1641/3273] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:18.523420 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ebf8ad7-8205-4306-a4d1-801763c06cc3 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 200 len: 345 microversion: 2.1 time: 0.178367 Oct 11 01:32:18.524755 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1633/3274] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:18 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:19.374710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:19.376732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:19.385632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:19.386626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:19.387435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:19.390017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:19.390893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:19.392281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:19.407975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:19.411518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:19.462927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:19.465155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:19.465656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:19.466410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:19.466882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:19.467352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:19.824710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:19.836148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37fe3bb4-9fdc-4299-a637-21ab94a13c72 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1354 microversion: 2.1 time: 0.463950 Oct 11 01:32:19.837121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1642/3275] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:19 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1354 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:19.845588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1882135f-f032-467c-8c88-17c95c44b9b5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f8e55e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:19.864231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:19.887196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a4ddc06-fdb7-44e9-a477-87f2a14b965b tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.480552 Oct 11 01:32:19.891746 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1634/3276] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:19 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:19.917278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1882135f-f032-467c-8c88-17c95c44b9b5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] HTTP exception thrown: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1882135f-f032-467c-8c88-17c95c44b9b5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Request method failure captured: Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd HTTP/1.1 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMeSqPd0rzqE3QIAqSbgxlNTtvOzYMAhvSHP1Kp3WPhaa0GNh_BdJA31FdC7SbZQi0NjsJ1mZmZp9dMPrD6Sn8ZunLexr6Cdv6KlMwFUZj62vPSQTCjjECcRuGHspVvbn358gq9OjC5_BT7M_g-G3Hdh_vjLBWeEmajrvVzoIlSu08M Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:19.924654 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1f9cd9f29ee74b94a2c7de10007be79c Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: exception: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd'} Oct 11 01:32:19.926507 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. (HTTP 404) (Request-ID: req-82761fa2-731c-429c-acbf-b6adb80852e2) Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:19.928400 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:19.929940 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 01:32:19.931512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:19.933172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:19.936093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1882135f-f032-467c-8c88-17c95c44b9b5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Returning 404 to user: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:19.936093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1882135f-f032-467c-8c88-17c95c44b9b5 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 404 len: 109 microversion: 2.1 time: 0.097669 Oct 11 01:32:19.936815 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1643/3277] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:19 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:19.953656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-994a57a2-7f61-4ebb-95e9-471fd1a286c7 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f112f81aee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:20.029571 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-994a57a2-7f61-4ebb-95e9-471fd1a286c7 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] HTTP exception thrown: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-994a57a2-7f61-4ebb-95e9-471fd1a286c7 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Request method failure captured: Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd HTTP/1.1 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMeSqPd0rzqE3QIAqSbgxlNTtvOzYMAhvSHP1Kp3WPhaa0GNh_BdJA31FdC7SbZQi0NjsJ1mZmZp9dMPrD6Sn8ZunLexr6Cdv6KlMwFUZj62vPSQTCjjECcRuGHspVvbn358gq9OjC5_BT7M_g-G3Hdh_vjLBWeEmajrvVzoIlSu08M Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:20.035116 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1f9cd9f29ee74b94a2c7de10007be79c Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: exception: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd'} Oct 11 01:32:20.038057 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. (HTTP 404) (Request-ID: req-e67a3d97-abc5-4fbe-a5e0-a7effaf96001) Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.041058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 01:32:20.043526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 01:32:20.045715 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.047437 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.051014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-994a57a2-7f61-4ebb-95e9-471fd1a286c7 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Returning 404 to user: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:20.052196 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-994a57a2-7f61-4ebb-95e9-471fd1a286c7 tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 404 len: 109 microversion: 2.1 time: 0.109038 Oct 11 01:32:20.053894 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1644/3278] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:32:19 2022] DELETE /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:20.062618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-063b2fcd-6c1c-4535-bafc-71998042378b tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Calling method '.version_select at 0x7f11341d3700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:20.145024 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-063b2fcd-6c1c-4535-bafc-71998042378b tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] HTTP exception thrown: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-063b2fcd-6c1c-4535-bafc-71998042378b tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Request method failure captured: Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd HTTP/1.1 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMeSqPd0rzqE3QIAqSbgxlNTtvOzYMAhvSHP1Kp3WPhaa0GNh_BdJA31FdC7SbZQi0NjsJ1mZmZp9dMPrD6Sn8ZunLexr6Cdv6KlMwFUZj62vPSQTCjjECcRuGHspVvbn358gq9OjC5_BT7M_g-G3Hdh_vjLBWeEmajrvVzoIlSu08M Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:20.148243 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce543bc9f5204cc980f899518f787ca9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ce543bc9f5204cc980f899518f787ca9 Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-548963412 Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 1f9cd9f29ee74b94a2c7de10007be79c Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-548963412-project Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: exception: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd'} Oct 11 01:32:20.149974 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. (HTTP 404) (Request-ID: req-9791ac78-5ead-46a8-bfc8-55f3be97d7bc) Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.151124 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:32:20.152667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 01:32:20.154153 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. Oct 11 01:32:20.155612 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:20.158675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-063b2fcd-6c1c-4535-bafc-71998042378b tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] Returning 404 to user: Volume 2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:20.160973 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-063b2fcd-6c1c-4535-bafc-71998042378b tempest-VolumesSnapshotsTestJSON-548963412 tempest-VolumesSnapshotsTestJSON-548963412-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd" status: 404 len: 109 microversion: 2.1 time: 0.102352 Oct 11 01:32:20.163858 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1645/3279] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:32:20 2022] GET /compute/v2.1/os-volumes/2b54cb4d-425b-49a6-93a2-f9ae4a4ef1fd => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:20.509254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:20.515792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1b1d99-8240-4a48-9534-932216996580", "tag": "46d954a6-2bb8-44a7-922f-8c4034cb22d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:20.572343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:20.573214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:20.573896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:20.583061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5cb80c7-3f3f-441c-ad68-ea3ebdcc77b6 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] Action: 'create', calling method: .version_select at 0x7f1134467940>, body: {"security_group": {"name": "tempest-securitygroup-1923719339", "description": "tempest-description-1900049595"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:20.603299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] Creating event network-changed:46d954a6-2bb8-44a7-922f-8c4034cb22d7 for instance eb1b1d99-8240-4a48-9534-932216996580 on n-h1-772273-9 Oct 11 01:32:20.613232 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-33ee0988-91bc-48a8-96f5-fb86da8a40ca req-4a69eb06-24df-443a-a293-531ff258534d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111517 Oct 11 01:32:20.619364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1646/3280] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:20.863951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:20.864678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:20.880475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:20.901075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:20.905814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:20.907319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:20.908208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:20.909718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:21.509292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:21.525599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-84707c31-4735-4e35-a9de-2991b1e3dff1 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1805 microversion: 2.1 time: 0.667001 Oct 11 01:32:21.536219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1647/3281] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:20 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1805 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:21.544193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:21.553261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:21.582909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:21.584652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:21.589280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:21.600057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:21.601223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:21.603697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:21.842207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:22.137991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:22.153727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16a35f19-a1c4-49e6-ad66-bb52b328acad tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.615430 Oct 11 01:32:22.154658 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1648/3282] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:21 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:22.159431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:22.159931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:22.174498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.174999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.175539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:22.176256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.176717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.177136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:22.236871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ee9c585-790f-4274-8e39-2e3faaa221ab tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242/ips" status: 200 len: 219 microversion: 2.1 time: 0.080718 Oct 11 01:32:22.246271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1649/3283] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:32:22 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242/ips => generated 219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:22.261808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:22.264174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:22.293002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.293829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.294620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:22.295623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.296293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.296967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:22.359227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:32:22.386478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5cb80c7-3f3f-441c-ad68-ea3ebdcc77b6 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.492919 Oct 11 01:32:22.387089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1635/3284] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:32:19 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:22.412202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b923dd7d-db06-4c3b-9501-3c36f64c1cd2 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] Action: 'create', calling method: .version_select at 0x7f1134b40430>, body: {"security_group": {"name": "tempest-securitygroup-546273929", "description": "tempest-description-147236709"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:22.570149 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e310f4e-bc53-49e9-9559-a5078ff9d5e0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "DELETE /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 204 len: 0 microversion: 2.1 time: 0.319222 Oct 11 01:32:22.576983 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1650/3285] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:22 2022] DELETE /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:32:22.592776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:22.593534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:22.609095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.609610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.610058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:22.611161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:22.611276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:22.611677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:23.115694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:23.126103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eccf92a7-ac7b-4731-b3b6-1f18dd1b0e65 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1811 microversion: 2.1 time: 0.545724 Oct 11 01:32:23.144191 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1651/3286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:22 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1811 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:23.183222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:23.187024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:23.205755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:23.206642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:23.207093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:23.208336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:23.208802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:23.209841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:23.273350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b923dd7d-db06-4c3b-9501-3c36f64c1cd2 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.876835 Oct 11 01:32:23.281850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1636/3287] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:32:22 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:23.498859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:23.508947 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8fdb492d-c487-48a4-8568-915524fddbf8 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.329863 Oct 11 01:32:23.510435 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1652/3288] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:23 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:23.652826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa8964a5-b90e-4e97-9c6d-edbaf2cddd34 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] Action: 'create', calling method: .version_select at 0x7f11344d7280>, body: {"security_group": {"name": "tempest-securitygroup-504189289", "description": "tempest-description-1978209180"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:24.150821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:24.151572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:24.165679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:24.166997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:24.175391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:24.176404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:24.177199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:24.178357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:24.220294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:24.223650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa8964a5-b90e-4e97-9c6d-edbaf2cddd34 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.938719 Oct 11 01:32:24.224482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1637/3289] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:32:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:24.239831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ba1bcae-7e0f-4a43-8c78-2d1a2c9f7fe1 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] Action: 'create', calling method: .version_select at 0x7f11344d7c10>, body: {"security_group": {"name": "tempest-securitygroup-2000200640", "description": "tempest-description-281590296"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:24.609618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:24.629804 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-833277a0-2562-43ab-b94f-536a1db11651 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1811 microversion: 2.1 time: 0.478457 Oct 11 01:32:24.631269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1653/3290] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:24 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1811 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:24.639884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:24.640945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:24.647676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:24.648184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:24.648632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:24.649360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:24.649904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:24.650345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:25.069319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ba1bcae-7e0f-4a43-8c78-2d1a2c9f7fe1 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.835385 Oct 11 01:32:25.070250 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1638/3291] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 01:32:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:25.082733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb41c658-3461-4faa-99e5-9884fb5324e2 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] Calling method '.version_select at 0x7f11343e8dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:25.106081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:25.114902 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-030d150c-dedc-4c9f-bc40-151c5d638014 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.480124 Oct 11 01:32:25.118832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1654/3292] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:24 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:25.198284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cd64a78-cfbe-4c98-b94c-8cf48a5e374d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f88b8b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:25.272146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cd64a78-cfbe-4c98-b94c-8cf48a5e374d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4" status: 200 len: 661 microversion: 2.1 time: 0.077047 Oct 11 01:32:25.273025 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1655/3293] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:25 2022] GET /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:25.289133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca64053e-5e60-49a2-bf15-9a6687c93995 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11388b8ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:25.345235 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca64053e-5e60-49a2-bf15-9a6687c93995 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4" status: 200 len: 661 microversion: 2.1 time: 0.060041 Oct 11 01:32:25.347898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1656/3294] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:25 2022] GET /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:25.430811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-deleted", "tag": "816b738e-5795-4137-a794-4e94c5544423"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:25.451389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:25.452262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:25.452951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:25.478851 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] Creating event network-vif-deleted:816b738e-5795-4137-a794-4e94c5544423 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:25.493391 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0879eb3a-73a8-4f05-b155-84c3a7dfda99 req-f882b81a-ed42-45ee-8fc1-6a324acbb752 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066275 Oct 11 01:32:25.495713 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1657/3295] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:25.657553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:25.658378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:25.677192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:25.678372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:25.678910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:25.679750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:25.680270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:25.680777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:26.478110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:26.488651 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-822fcc58-6c9f-40d8-b4f7-f7fe7901a45f tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1631 microversion: 2.1 time: 0.835355 Oct 11 01:32:26.489242 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1658/3296] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:25 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1631 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:26.507318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:26.510408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:26.524224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:26.525130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:26.525809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:26.527085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:26.527846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:26.528792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:26.940126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:26.949637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-245f9f83-eda6-4ac8-a7cb-e7a8b30a0bf9 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.459349 Oct 11 01:32:26.958013 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1659/3297] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:26 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:27.274086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75771b80-269e-4f9e-863b-3c64cc003aad tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f81a160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:27.366797 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75771b80-269e-4f9e-863b-3c64cc003aad tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349" status: 200 len: 659 microversion: 2.1 time: 0.106002 Oct 11 01:32:27.370022 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1660/3298] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:27 2022] GET /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349 => generated 659 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:27.378453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1b1d99-8240-4a48-9534-932216996580", "name": "network-vif-plugged", "status": "completed", "tag": "46d954a6-2bb8-44a7-922f-8c4034cb22d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:27.398853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:27.399572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:27.401660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:27.422113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] Creating event network-vif-plugged:46d954a6-2bb8-44a7-922f-8c4034cb22d7 for instance eb1b1d99-8240-4a48-9534-932216996580 on n-h1-772273-9 Oct 11 01:32:27.431675 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-43e925e5-1037-40a2-adf8-43d645b6c8f2 req-f66dbc74-7087-42f2-87f2-c9c5ac3ceafb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062172 Oct 11 01:32:27.433247 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1661/3299] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:27.441645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f7fd63e-a50f-4aea-88c4-f56a0fd10004 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11341d3700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:27.526163 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f7fd63e-a50f-4aea-88c4-f56a0fd10004 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349" status: 200 len: 659 microversion: 2.1 time: 0.090903 Oct 11 01:32:27.528564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1662/3300] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:27 2022] GET /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349 => generated 659 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:27.555972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:27.557619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:27.595000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:27.596728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:27.597280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:27.599173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:27.601306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:27.601751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:27.994085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:28.003747 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0497ec7e-e861-40e5-a618-e0c098b72239 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1610 microversion: 2.1 time: 0.473618 Oct 11 01:32:28.004348 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1663/3301] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:27 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1610 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:28.034154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-deleted", "tag": "91a0e83f-dbf8-4fee-8429-19b7064b6fc4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:28.049079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:28.049776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:28.050416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:28.064197 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] Creating event network-vif-deleted:91a0e83f-dbf8-4fee-8429-19b7064b6fc4 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:28.070119 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d77e8ed7-8daf-49c9-ba0d-6f35bafe17fd req-f580289a-a2b5-4a1d-8048-0c16efd551ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064595 Oct 11 01:32:28.071396 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1664/3302] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:28.080215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:28.081443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:28.091553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:28.092119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:28.092631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:28.093415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:28.093941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:28.094639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:28.460708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:28.468420 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef372f70-5702-4e95-b1ee-834ceae1906f tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 0.395603 Oct 11 01:32:28.469196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1665/3303] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:28 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:29.028281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:29.028898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:29.043509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:29.047796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:29.048568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:29.053821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:29.055815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:29.058184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:29.216136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:29.217126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:29.218599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:29.220587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lazy-loading 'fault' on Instance uuid 33cdf141-5b12-45d7-a56f-f98013195242 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:32:29.351050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:29.361715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59b48b29-ad69-4f67-8691-1dc76419e559 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 200 len: 1302 microversion: 2.1 time: 0.337320 Oct 11 01:32:29.367780 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1666/3304] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:29 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 1302 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:29.390666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd09ec56-e759-4a9f-8fbc-8881ba61cba8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f6d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:29.439027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:29.476029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd09ec56-e759-4a9f-8fbc-8881ba61cba8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417" status: 200 len: 662 microversion: 2.1 time: 0.091134 Oct 11 01:32:29.482330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1667/3305] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:29 2022] GET /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417 => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:29.500172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:29.515585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:29.524176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:29.529851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:29.531973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:29.532444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:29.533193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:29.533662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:29.534088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:29.883152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:30.676848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:30.690001 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9bc15809-da52-491e-a036-85f5db41dcc7 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1322 microversion: 2.1 time: 1.193264 Oct 11 01:32:30.690502 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb41c658-3461-4faa-99e5-9884fb5324e2 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] 10.222.0.66 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6317 microversion: 2.1 time: 5.611638 Oct 11 01:32:30.695461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1639/3306] 10.222.0.66 () {58 vars in 1191 bytes} [Tue Oct 11 01:32:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6317 bytes in 5613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:30.696661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-unplugged", "status": "completed", "tag": "c6f56886-2532-4354-9744-3b6a7f7d7d75"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:30.708374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1668/3307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:29 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1322 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:30.716108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:30.716868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:30.717474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:30.720485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a1bb527-ec71-49df-be4d-ffc19d92672e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fa5b160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:30.758721 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] Creating event network-vif-unplugged:c6f56886-2532-4354-9744-3b6a7f7d7d75 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:30.773767 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6726a8f2-1468-4680-8c07-7bdd1bc4ee64 req-8f14287f-7635-483e-a448-d0a7e8f2b586 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080873 Oct 11 01:32:30.774370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1640/3308] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:30.796370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:30.807303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:30.816121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:30.817028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:30.817710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:30.818789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:30.819591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:30.820543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:30.822261 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a1bb527-ec71-49df-be4d-ffc19d92672e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417" status: 200 len: 662 microversion: 2.1 time: 0.117620 Oct 11 01:32:30.823746 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1669/3309] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:32:30 2022] GET /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417 => generated 662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:30.832105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cdf141-5b12-45d7-a56f-f98013195242", "name": "network-vif-deleted", "tag": "c6f56886-2532-4354-9744-3b6a7f7d7d75"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:30.862118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:30.863928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:30.866295 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:32:30.866704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 HTTP/1.1 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:30.871430 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:32:30.873410 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '33cdf141-5b12-45d7-a56f-f98013195242'} Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:30.874508 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:32:30.876522 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:30.878282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:30.879952 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d52d66c-63f8-44c9-aa27-dc0a7930651b tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 404 len: 111 microversion: 2.1 time: 0.104421 Oct 11 01:32:30.891789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1641/3310] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:30 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:30.897769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] Creating event network-vif-deleted:c6f56886-2532-4354-9744-3b6a7f7d7d75 for instance 33cdf141-5b12-45d7-a56f-f98013195242 on n-h2-772273-9 Oct 11 01:32:30.899098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82d8b6b7-fe2d-4c57-9986-204593bd270a tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] Calling method '.version_select at 0x7f11344d7d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:30.907771 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7032bda1-5cb7-4077-b154-3e692cccee01 req-5f9dc9b2-3047-4aa6-bc8f-9437ed79767c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079383 Oct 11 01:32:30.909486 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1670/3311] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:31.097130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1228603551", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:31.201667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:32:31.801336 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82d8b6b7-fe2d-4c57-9986-204593bd270a tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.908269 Oct 11 01:32:31.802966 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1642/3312] 10.222.0.66 () {58 vars in 1191 bytes} [Tue Oct 11 01:32:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:31.822539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:31.823902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:31.835732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:31.837243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:31.837986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:31.839175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:31.840078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:31.840699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:32.023123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:32:32.023662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:32:32.024255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:32:32.024453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:32:32.031324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:32:32.046707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:32.047173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:32.047961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:32.048968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:32.049639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:32.050641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:32.101741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Getting quotas for project 32895d0af242461faed7d72736e13a35. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:32:32.114903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Getting quotas for user 0039fc3447f244ddb615297e0ec76fa4 and project 32895d0af242461faed7d72736e13a35. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:32:32.133375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:32:32.136619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:32:32.206304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6009f2b1-46c4-4722-9286-422252d0ff42 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113611 Oct 11 01:32:32.207357 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1671/3313] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:32:32.212438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4dd9d0c1-eef1-4cee-a375-f2261fc62e33 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] Calling method '.version_select at 0x7f112fb8d430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:32.763521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:32.796944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab053528-9848-4ab6-94d8-a39d2f457d78 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1518 microversion: 2.1 time: 0.989884 Oct 11 01:32:32.797995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1643/3314] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:31 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1518 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:32.830241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2052962851", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:32.988785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:32:33.505809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:32:33.506756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:32:33.507454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:32:33.508146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:32:33.510108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:32:33.539954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:33.540443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:33.540885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:33.541627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:33.542077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:33.542504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:33.612662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Getting quotas for project 32895d0af242461faed7d72736e13a35. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:32:33.626282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Getting quotas for user 0039fc3447f244ddb615297e0ec76fa4 and project 32895d0af242461faed7d72736e13a35. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:32:33.659470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:32:33.661945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:32:33.683918 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4dd9d0c1-eef1-4cee-a375-f2261fc62e33 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/6155c323-617a-4478-9018-099ecc42fa13" status: 202 len: 0 microversion: 2.1 time: 1.474856 Oct 11 01:32:33.684358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1672/3315] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:32 2022] DELETE /compute/v2.1/os-security-groups/6155c323-617a-4478-9018-099ecc42fa13 => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:33.691973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a75c296-6ee5-4668-88c7-9da3257d29aa tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1608276418", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a75c296-6ee5-4668-88c7-9da3257d29aa tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 243 Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:33.706987 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:32:33.708636 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1608276418", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1608276418', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1d8b48cc-d1c9-4f1e-be91-729cd499a3c5'}]}}} Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:32:33.710209 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:33.711733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a75c296-6ee5-4668-88c7-9da3257d29aa tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:33.713223 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a75c296-6ee5-4668-88c7-9da3257d29aa tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.023954 Oct 11 01:32:33.714069 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1673/3316] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:33 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:32:33.729503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9b599c0f-45fc-4975-adaa-11bb0d81c805 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] Calling method '.version_select at 0x7f112f8f0040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:33.852775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-160ebbbd-bb0e-4884-87c4-849d7e40b977 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052133 Oct 11 01:32:33.861481 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1644/3317] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:32:33.880743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:33.881289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: e8a96f4d-78bc-49b7-8a1f-650935015a80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:33.902572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] HTTP exception thrown: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e8a96f4d-78bc-49b7-8a1f-650935015a80/metadata HTTP/1.1 Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:33.923004 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:33.924691 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': 'e8a96f4d-78bc-49b7-8a1f-650935015a80'} Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:33.925534 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. Oct 11 01:32:33.926948 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:33.928643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 404 to user: Instance e8a96f4d-78bc-49b7-8a1f-650935015a80 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:33.934049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-206bd087-cfb9-4592-964d-bda99cb16639 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/e8a96f4d-78bc-49b7-8a1f-650935015a80/metadata" status: 404 len: 111 microversion: 2.1 time: 0.069170 Oct 11 01:32:33.938540 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1645/3318] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 01:32:33 2022] GET /compute/v2.1/servers/e8a96f4d-78bc-49b7-8a1f-650935015a80/metadata => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:33.957841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11e38add-13e4-42b2-b13f-1ef0999a8946 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:33.958465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11e38add-13e4-42b2-b13f-1ef0999a8946 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:34.406111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11e38add-13e4-42b2-b13f-1ef0999a8946 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:34.417065 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11e38add-13e4-42b2-b13f-1ef0999a8946 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1218 microversion: 2.1 time: 0.474923 Oct 11 01:32:34.421652 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1646/3319] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:33 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1218 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:34.434266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a4a10fa-791b-4e0f-84f3-0211a590fd94 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1557334836", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a4a10fa-791b-4e0f-84f3-0211a590fd94 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 499 Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:34.460107 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:34.461831 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1557334836", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1557334836', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1d8b48cc-d1c9-4f1e-be91-729cd499a3c5'}]}}} Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:34.462668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:34.472917 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:32:34.474334 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:32:34.475569 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:32:34.476469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:34.476469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:34.476469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a4a10fa-791b-4e0f-84f3-0211a590fd94 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:34.476760 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a4a10fa-791b-4e0f-84f3-0211a590fd94 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.038785 Oct 11 01:32:34.476760 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1647/3320] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:34 2022] POST /compute/v2.1/servers => generated 687 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:32:35.055614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb717773-6eaa-48b3-9c75-a34ab5f07a44 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-945294689", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb717773-6eaa-48b3-9c75-a34ab5f07a44 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 499 Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:35.065609 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.067215 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-945294689", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-945294689', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1d8b48cc-d1c9-4f1e-be91-729cd499a3c5'}]}}} Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:35.067944 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.068392 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:32:35.071803 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:32:35.075047 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:32:35.076664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.076664 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.079567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb717773-6eaa-48b3-9c75-a34ab5f07a44 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:35.094585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb717773-6eaa-48b3-9c75-a34ab5f07a44 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.047771 Oct 11 01:32:35.103138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1648/3321] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:35 2022] POST /compute/v2.1/servers => generated 689 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:32:35.246615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b9add7e-2840-4642-b093-e3267700cebb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1986978377", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b9add7e-2840-4642-b093-e3267700cebb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 754 Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:35.255387 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.257059 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:35.258027 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1986978377", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} Oct 11 01:32:35.258027 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:35.258027 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1986978377', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1d8b48cc-d1c9-4f1e-be91-729cd499a3c5'}]}}} Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:32:35.258438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:35.259079 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:32:35.263451 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:32:35.265232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:32:35.266573 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.266573 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.283392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b9add7e-2840-4642-b093-e3267700cebb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:35.288701 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b9add7e-2840-4642-b093-e3267700cebb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.044798 Oct 11 01:32:35.292653 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1649/3322] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:35 2022] POST /compute/v2.1/servers => generated 1197 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 11 01:32:35.445906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:35.446979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:35.462795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:35.463995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:35.466114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:35.468259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:35.469896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:35.470999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:35.761153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:35.781261 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d6bfd6a-3e0b-4ea9-aa38-ab9ea9a3b08b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1270 microversion: 2.1 time: 0.342669 Oct 11 01:32:35.785864 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1650/3323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:35 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1270 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:35.800802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96f7c09e-0b2d-4678-93fd-1ad0388cf205 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-882446962", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96f7c09e-0b2d-4678-93fd-1ad0388cf205 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 1265 Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:35.811706 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.813310 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:32:35.814062 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-882446962", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1d8b48cc-d1c9-4f1e-be91-729cd499a3c5"}]}} Oct 11 01:32:35.814062 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-882446962', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1d8b48cc-d1c9-4f1e-be91-729cd499a3c5'}]}}} Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.814252 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:32:35.818656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:32:35.825097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 01:32:35.825097 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.825097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96f7c09e-0b2d-4678-93fd-1ad0388cf205 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:35.825097 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96f7c09e-0b2d-4678-93fd-1ad0388cf205 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025032 Oct 11 01:32:35.825097 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1651/3324] 10.222.0.66 () {60 vars in 1148 bytes} [Tue Oct 11 01:32:35 2022] POST /compute/v2.1/servers => generated 2221 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 11 01:32:35.839420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:35.840224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: 8944285c-1e14-4b4c-baa8-f9ecef593a90] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:35.879694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] HTTP exception thrown: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/8944285c-1e14-4b4c-baa8-f9ecef593a90/metadata/test2 HTTP/1.1 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '8944285c-1e14-4b4c-baa8-f9ecef593a90', 'id': 'test2'} Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:35.881712 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:35.887725 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:35.887725 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:35.887725 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. Oct 11 01:32:35.887725 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:35.901793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 404 to user: Instance 8944285c-1e14-4b4c-baa8-f9ecef593a90 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:35.906107 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db1022ad-80a1-4076-b337-96dfcbd1788e tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/8944285c-1e14-4b4c-baa8-f9ecef593a90/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.073085 Oct 11 01:32:35.913625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1652/3325] 10.222.0.66 () {58 vars in 1281 bytes} [Tue Oct 11 01:32:35 2022] GET /compute/v2.1/servers/8944285c-1e14-4b4c-baa8-f9ecef593a90/metadata/test2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:35.927517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:35.929550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:35.941607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:35.943111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:35.943592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:35.944372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:35.944864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:35.945278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:36.040771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:32:36.231702 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2017f448-20e0-4e5b-b035-60614450cccb tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 204 len: 0 microversion: 2.1 time: 0.310620 Oct 11 01:32:36.237511 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1653/3326] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:32:35 2022] DELETE /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:32:36.250792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:36.255450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:36.270517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:36.272831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:36.273515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:36.274370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:36.276117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:36.277932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:36.815891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9b599c0f-45fc-4975-adaa-11bb0d81c805 tempest-SecurityGroupsTestAdminJSON-1202989454 tempest-SecurityGroupsTestAdminJSON-1202989454-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/ee6a225c-88d2-410a-914f-d53368aaf15e" status: 202 len: 0 microversion: 2.1 time: 3.101041 Oct 11 01:32:36.817684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1674/3327] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:33 2022] DELETE /compute/v2.1/os-security-groups/ee6a225c-88d2-410a-914f-d53368aaf15e => generated 0 bytes in 3103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:36.823838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:36.824734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:36.846485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:36.847489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:36.848186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:36.852613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:36.854455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:36.855125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:37.099168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:37.118901 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0402b360-a5d0-445d-9d30-fd8cfb525232 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1276 microversion: 2.1 time: 0.298173 Oct 11 01:32:37.135695 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1675/3328] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:36 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:37.146878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa0b221e-2a93-4274-a245-d87ca2d89f75 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] Calling method '.version_select at 0x7f112f799040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:37.620057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526c0bfe1104b2b8cd177dd8dba41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbf4da0b2e84c0e9485b8a40caa0d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:37.629542 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bbc308bd-f16f-406a-a8d7-7ac6bafc43fd tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 200 len: 1524 microversion: 2.1 time: 1.386517 Oct 11 01:32:37.664986 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1654/3329] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:36 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 1524 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:38.144922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:38.146013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:38.156582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:38.163234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:38.163944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:38.164906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:38.165589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:38.166202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:39.280801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:39.294764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a32eb935-6278-45be-b5cd-cdda76b329c1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1276 microversion: 2.1 time: 1.153901 Oct 11 01:32:39.309575 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1655/3330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:38 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1276 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:39.750970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aa0b221e-2a93-4274-a245-d87ca2d89f75 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/13e266ec-0283-4ed1-a80a-8f86c468c58c" status: 202 len: 0 microversion: 2.1 time: 2.613473 Oct 11 01:32:39.754640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1676/3331] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:37 2022] DELETE /compute/v2.1/os-security-groups/13e266ec-0283-4ed1-a80a-8f86c468c58c => generated 0 bytes in 2615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:39.846487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Calling method '.version_select at 0x7f112f93aca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:39.918018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:32:39.919159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.security_group_api [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Neutron security group 541811cb-447f-463e-83d5-2c0d738ce295 not found {{(pid=120494) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:32:39.919159 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] HTTP exception thrown: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.919159 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Request method failure captured: Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/541811cb-447f-463e-83d5-2c0d738ce295 HTTP/1.1 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMe2xTevNk7cQCxBqmdJxFPKtDX5ZqTC4X9-9XiQhZqbwhyO8_zVYqMF-CFW8Z3BVv24PEbxqdXxHHkMuKVTn9RHKG7t7hya_o3Q4WseM41Tt0qG3QSlurb5gCSS0GxNEB1Npus3iQD7HsoSZKuNOFBR0lfHI-Xys-MrCIQ6Po0xA5w Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3582478f65c04864a48ac0279bdfef20 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: exception: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '541811cb-447f-463e-83d5-2c0d738ce295'} Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:32:39.921192 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Returning 404 to user: Security group 541811cb-447f-463e-83d5-2c0d738ce295 does not exist Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-0a5ba2fb-95e6-44a7-984a-20eadd13528b'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c9420d2-c6d0-4ff9-9507-85888360554a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/541811cb-447f-463e-83d5-2c0d738ce295" status: 404 len: 194 microversion: 2.1 time: 0.624736 Oct 11 01:32:39.933017 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1656/3332] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:39 2022] DELETE /compute/v2.1/os-security-groups/541811cb-447f-463e-83d5-2c0d738ce295 => generated 194 bytes in 626 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:39.938105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:39.938581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] [instance: eb1b1d99-8240-4a48-9534-932216996580] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:39.964850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:39.965633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:39.966261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:39.969150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:39.969950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:39.971191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:39.996905 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] HTTP exception thrown: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Request method failure captured: Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 HTTP/1.1 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMeW9QisFuv8fMZRbOgRoTPGjxfjfjBT_C6yltPxZlNCwX0gVmq_jNOS8oZ2h6eJ04bInBs86-e3l_U_aXWRB8uca26ZbOvTL3xYdGuup4sIlIR-N7R18qnY58mTQfWzPc3Tvy7Z7x5_YdREQsocKVtNrHpS55LMb6iMLKPMMKwZcaM Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1cbf4da0b2e84c0e9485b8a40caa0d3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 1cbf4da0b2e84c0e9485b8a40caa0d3a Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2031538800 Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8526c0bfe1104b2b8cd177dd8dba41eb Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2031538800-project Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'eb1b1d99-8240-4a48-9534-932216996580'} Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:40.000416 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. Oct 11 01:32:40.005422 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:40.007673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] Returning 404 to user: Instance eb1b1d99-8240-4a48-9534-932216996580 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:40.010994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c1823e7-e500-47ad-a77b-8b47761c9940 tempest-ServerMetadataNegativeTestJSON-2031538800 tempest-ServerMetadataNegativeTestJSON-2031538800-project] 10.222.0.66 "GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580" status: 404 len: 111 microversion: 2.1 time: 0.083274 Oct 11 01:32:40.019964 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1657/3333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:39 2022] GET /compute/v2.1/servers/eb1b1d99-8240-4a48-9534-932216996580 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:40.027709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3e9c0a2-5e8f-44ec-a1f9-2b9b247bb2f5 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] Calling method '.version_select at 0x7f1134316670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:40.190516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1b1d99-8240-4a48-9534-932216996580", "name": "network-vif-deleted", "tag": "46d954a6-2bb8-44a7-922f-8c4034cb22d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:40.221866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:40.222620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:40.224598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:40.241818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] Creating event network-vif-deleted:46d954a6-2bb8-44a7-922f-8c4034cb22d7 for instance eb1b1d99-8240-4a48-9534-932216996580 on n-h1-772273-9 Oct 11 01:32:40.257216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-51f06b8e-3d5c-4db1-b17f-597d0780b87e req-138258fd-a3de-42e2-8bac-44ac6901d187 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503076 Oct 11 01:32:40.258807 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1677/3334] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:40.284076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a7bc5ac-8d1d-402a-9379-28e70a1afc8d tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.023125 Oct 11 01:32:40.285862 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1678/3335] 10.222.0.66 () {58 vars in 1164 bytes} [Tue Oct 11 01:32:40 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 01:32:40.320887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-acfb5bb4-4de8-4e06-9704-c416437e2862 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Calling method '.version_select at 0x7f112f8f05e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:41.162564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-acfb5bb4-4de8-4e06-9704-c416437e2862 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.854515 Oct 11 01:32:41.164555 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1679/3336] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:32:40 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:41.170050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:41.171077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:41.187908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:41.189969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:41.191097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:41.193728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:41.194501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:41.195271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:41.630577 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3e9c0a2-5e8f-44ec-a1f9-2b9b247bb2f5 tempest-SecurityGroupsTestAdminJSON-1645025694 tempest-SecurityGroupsTestAdminJSON-1645025694-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/813767a7-bcda-4144-9548-8a323165592f" status: 202 len: 0 microversion: 2.1 time: 1.608634 Oct 11 01:32:41.631427 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1658/3337] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:40 2022] DELETE /compute/v2.1/os-security-groups/813767a7-bcda-4144-9548-8a323165592f => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:32:41.641581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Calling method '.version_select at 0x7f1134cdba60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:42.070403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:42.127443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:42.200374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:42.209302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-43cf4488-c4cf-4ef1-89a2-918554c8e24e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 1.042970 Oct 11 01:32:42.231554 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1680/3338] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:41 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:43.103558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG neutronclient.v2_0.client [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120494) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:32:43.104297 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 11 01:32:43.104297 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Request method failure captured: Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-security-groups/1c30c85e-e903-45d0-ab42-fcee0fa14b4e HTTP/1.1 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMe2xTevNk7cQCxBqmdJxFPKtDX5ZqTC4X9-9XiQhZqbwhyO8_zVYqMF-CFW8Z3BVv24PEbxqdXxHHkMuKVTn9RHKG7t7hya_o3Q4WseM41Tt0qG3QSlurb5gCSS0GxNEB1Npus3iQD7HsoSZKuNOFBR0lfHI-Xys-MrCIQ6Po0xA5w Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 3582478f65c04864a48ac0279bdfef20 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: exception: Insufficient rights for removing default security group. Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1c30c85e-e903-45d0-ab42-fcee0fa14b4e'} Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:32:43.107084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: Neutron server returns request_ids: ['req-467996c0-f616-462d-816d-213f91616406'] {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbde5837-d504-4f8f-9cc3-6e3c68ee8b3a tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/1c30c85e-e903-45d0-ab42-fcee0fa14b4e" status: 400 len: 182 microversion: 2.1 time: 1.475828 Oct 11 01:32:43.114520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1659/3339] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 01:32:41 2022] DELETE /compute/v2.1/os-security-groups/1c30c85e-e903-45d0-ab42-fcee0fa14b4e => generated 182 bytes in 1477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:32:43.129641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Calling method '.version_select at 0x7f112f88b310>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:43.236833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:43.237463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:43.251624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:43.252131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:43.252580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:43.253561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:43.254339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:43.254976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:43.584267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:43.980495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:32:43.982103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Neutron security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:32:43.983455 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] HTTP exception thrown: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.983455 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Request method failure captured: Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-security-groups/c7e7966b-2691-468a-9394-e8e5fb3dd5ab HTTP/1.1 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMe2xTevNk7cQCxBqmdJxFPKtDX5ZqTC4X9-9XiQhZqbwhyO8_zVYqMF-CFW8Z3BVv24PEbxqdXxHHkMuKVTn9RHKG7t7hya_o3Q4WseM41Tt0qG3QSlurb5gCSS0GxNEB1Npus3iQD7HsoSZKuNOFBR0lfHI-Xys-MrCIQ6Po0xA5w Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3582478f65c04864a48ac0279bdfef20 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c7e7966b-2691-468a-9394-e8e5fb3dd5ab'} Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:32:43.986589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] Oct 11 01:32:43.992151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.000339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Returning 404 to user: Security group c7e7966b-2691-468a-9394-e8e5fb3dd5ab does not exist Oct 11 01:32:44.000339 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-8651d93f-a48b-4c9d-890d-39fbad65e434'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:44.001760 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-56122db4-8fc7-427b-afbd-43eab77503ff tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/c7e7966b-2691-468a-9394-e8e5fb3dd5ab" status: 404 len: 194 microversion: 2.1 time: 0.878027 Oct 11 01:32:44.004434 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1681/3340] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:32:43 2022] GET /compute/v2.1/os-security-groups/c7e7966b-2691-468a-9394-e8e5fb3dd5ab => generated 194 bytes in 881 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:44.043822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Action: 'update', calling method: .version_select at 0x7f11388eb4c0>, body: {"security_group": {"name": "tempest-sg-419092515", "description": "tempest-description-2045795937"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:44.239297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG neutronclient.v2_0.client [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist", "detail": ""}} {{(pid=120493) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 01:32:44.240371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Neutron security group 61c482db-f73f-4359-ade8-ee74e3528428 not found {{(pid=120493) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 01:32:44.242982 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] HTTP exception thrown: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.242982 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Request method failure captured: Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/os-security-groups/61c482db-f73f-4359-ade8-ee74e3528428 HTTP/1.1 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 101 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMe2xTevNk7cQCxBqmdJxFPKtDX5ZqTC4X9-9XiQhZqbwhyO8_zVYqMF-CFW8Z3BVv24PEbxqdXxHHkMuKVTn9RHKG7t7hya_o3Q4WseM41Tt0qG3QSlurb5gCSS0GxNEB1Npus3iQD7HsoSZKuNOFBR0lfHI-Xys-MrCIQ6Po0xA5w Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff91b0f3cff14555a108ed7138155e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ff91b0f3cff14555a108ed7138155e37 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-555026371 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 3582478f65c04864a48ac0279bdfef20 Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-555026371-project Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: {"security_group": {"name": "tempest-sg-419092515", "description": "tempest-description-2045795937"}} Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: exception: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '61c482db-f73f-4359-ade8-ee74e3528428', 'body': {'security_group': {'name': 'tempest-sg-419092515', 'description': 'tempest-description-2045795937'}}} Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 01:32:44.245732 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] Returning 404 to user: Security group 61c482db-f73f-4359-ade8-ee74e3528428 does not exist Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: Neutron server returns request_ids: ['req-b9a91f06-8f1c-4bff-a941-1e7aa0c86988'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c7a213a-9366-41dc-baa4-f210f162fad3 tempest-SecurityGroupsNegativeTestJSON-555026371 tempest-SecurityGroupsNegativeTestJSON-555026371-project] 10.222.0.66 "PUT /compute/v2.1/os-security-groups/61c482db-f73f-4359-ade8-ee74e3528428" status: 404 len: 194 microversion: 2.1 time: 0.229594 Oct 11 01:32:44.250711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1682/3341] 10.222.0.66 () {60 vars in 1290 bytes} [Tue Oct 11 01:32:44 2022] PUT /compute/v2.1/os-security-groups/61c482db-f73f-4359-ade8-ee74e3528428 => generated 194 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:32:44.410997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:44.666558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:44.686747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aebab01d-6733-4639-aa02-b34ca92e704b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 1.456452 Oct 11 01:32:44.687399 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1660/3342] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:43 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:45.725787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:45.731011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:45.760412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:45.767523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:45.768132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:45.775120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:45.776617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:45.778303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:45.880947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:45.936552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:45.937095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:45.938762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:45.982815 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] Creating event network-changed:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:32:46.000760 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-afa3035f-6617-4167-a09c-439f8c2e9711 req-3f95f78f-d18a-40f0-b9fb-1c5351c3d684 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126034 Oct 11 01:32:46.001959 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1661/3343] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:46.690840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:46.715376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65353215-3a54-48c5-a332-38feb9d2ab95 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 1.006303 Oct 11 01:32:46.733054 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1683/3344] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:45 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:47.743506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:47.744232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:47.756598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:47.757697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:47.758166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:47.758888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:47.766099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:47.768079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:48.142292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:48.150438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290745aa-d417-486a-992e-d62eae89a12c", "tag": "fc66c72e-d89b-4f1c-a1dc-05001344cfe4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:48.166456 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bef0cc0-3c16-4a6e-a365-c489ef9e7485 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.429801 Oct 11 01:32:48.173498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1662/3345] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:47 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:48.180524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:48.190120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:48.190586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:48.204879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] Creating event network-changed:fc66c72e-d89b-4f1c-a1dc-05001344cfe4 for instance 290745aa-d417-486a-992e-d62eae89a12c on n-h2-772273-9 Oct 11 01:32:48.217428 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d066c54f-7b5f-47d8-8365-339fda87083a req-e566f211-4476-4d59-9b93-8db685b9a3e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071844 Oct 11 01:32:48.218569 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1684/3346] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:48.885840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1609377293", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "c5baa4d6-d3d3-4256-99c4-940b1bd48191"}, {"uuid": "47f688f9-d51a-4020-894d-b087ac020fd1"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:49.022042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] validate_networks() for [('c5baa4d6-d3d3-4256-99c4-940b1bd48191', None, None, None, None, None), ('47f688f9-d51a-4020-894d-b087ac020fd1', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:32:49.196536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:49.197350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:49.216306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:49.216947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:49.217524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:49.218339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:49.219524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:49.220193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:49.740849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:49.763101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba6cda8b-f6b7-4ef8-9afd-b8defefea5f5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.567773 Oct 11 01:32:49.771938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1685/3347] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:49 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:50.799023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:50.800532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:50.809988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:50.810729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:50.813380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:50.814811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:50.816876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:50.820344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:51.687006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:51.696717 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-80fb0975-2a43-4b9f-bd14-d5247cc956ff tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.902942 Oct 11 01:32:51.706532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1686/3348] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:50 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:52.374460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:32:52.374999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:32:52.375607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:32:52.376132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:32:52.376632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:32:52.409127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:52.410681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:52.411432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:52.416470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:52.417233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:52.417960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:52.444679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Getting quotas for project 3f027a594c0641af895ad9ef38720a33. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:32:52.467602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Getting quotas for user ffc2bd5b12f24d51b07a93b7ef7e7fea and project 3f027a594c0641af895ad9ef38720a33. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:32:52.501376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:32:52.506156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:32:52.602982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76cd0ceb-b742-4757-b520-27572b3d9bf9 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.719486 Oct 11 01:32:52.607867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1663/3349] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:32:52.619089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-26cca85e-362d-4db5-817c-91d40806ed0a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:52.621024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26cca85e-362d-4db5-817c-91d40806ed0a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:52.731433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26cca85e-362d-4db5-817c-91d40806ed0a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:52.739978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-26cca85e-362d-4db5-817c-91d40806ed0a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1213 microversion: 2.1 time: 0.124846 Oct 11 01:32:52.755783 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1687/3350] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:52 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:52.761416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:52.762313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:52.770006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:52.770746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:52.771426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:52.772364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:52.773572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:52.774208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:53.024728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-504470766", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:53.100002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:53.106870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:32:53.119023 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1055936-5812-4d6e-82c6-420a79e6202b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.361714 Oct 11 01:32:53.125138 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1688/3351] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:52 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:53.625379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:32:53.626836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:32:53.627653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:32:53.628235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:32:53.629037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:32:53.645840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:53.646513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:53.647169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:53.652303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:53.653509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:53.655715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:53.726555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Getting quotas for project 912ed45552e34c4aa8f8ec56f1a0131b. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:32:53.752768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Getting quotas for user 68784d9b031d40dfa691e100a2b43467 and project 912ed45552e34c4aa8f8ec56f1a0131b. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:32:53.767768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:53.768342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:53.775910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:32:53.778469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:32:53.778769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:53.782531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:53.783104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:53.783984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:53.793438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:53.794010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:53.850466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:53.938558 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82f025b9-62c3-4be5-b6d9-744e2a1ddb59 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273467 Oct 11 01:32:53.945201 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1664/3352] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:32:53.948923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:53.966098 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8ad4bc5-ccbf-4ee4-9c69-ebe9496bb78a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1209 microversion: 2.1 time: 0.202582 Oct 11 01:32:53.966712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1689/3353] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:53 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1209 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:53.989076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4e3eed0-c242-4937-b727-e1366298fdba tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:53.989711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4e3eed0-c242-4937-b727-e1366298fdba tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:54.152564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:54.153190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:54.169730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:54.170399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:54.170863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:54.171670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:54.173572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:54.174014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:54.272251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4e3eed0-c242-4937-b727-e1366298fdba tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:54.295014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4e3eed0-c242-4937-b727-e1366298fdba tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1213 microversion: 2.1 time: 0.301458 Oct 11 01:32:54.295730 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1665/3354] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:53 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1213 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:54.525782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:54.546288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3c8d539-2171-48be-ac17-b022fbd1fbb9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.393639 Oct 11 01:32:54.548577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1690/3355] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:54 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:54.993825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:54.995188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:55.009310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.015019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.015678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.022071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.023555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.025265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.219744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:55.229025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47208cbf-5434-4f9b-abb8-5e356154683d tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1271 microversion: 2.1 time: 0.239047 Oct 11 01:32:55.229622 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1666/3356] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:54 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:55.318491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:55.320490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:55.339074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.339998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.340698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.341755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.342459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.346796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.572885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:55.573645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:55.585426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.588617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.591978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.592828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:55.593383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:55.593826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:55.690428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:55.700313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f23050ad-655c-44a8-8250-22da8aaf5e61 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1265 microversion: 2.1 time: 0.385555 Oct 11 01:32:55.704485 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1691/3357] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:55 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:56.116033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:56.140145 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5e665e0-f4f8-4b4f-9bc1-c8318cd0e8b2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.572653 Oct 11 01:32:56.149044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1667/3358] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:55 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:32:56.257087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:56.257761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:56.267379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:56.268281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:56.269529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:56.275073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:56.275809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:56.276455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:56.430108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:56.439530 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3abd1589-b0af-40e4-b245-5a1cd9e5f53c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1271 microversion: 2.1 time: 0.187087 Oct 11 01:32:56.458008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1692/3359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:56 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:56.734760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:56.735813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:56.747522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:56.748804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:56.750394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:56.751865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:56.754363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:56.756209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.009981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:57.028079 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54242531-53d1-48f9-85c7-32c844fb4e71 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1271 microversion: 2.1 time: 0.298152 Oct 11 01:32:57.032382 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1668/3360] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:56 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:57.175616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:57.177857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:57.187866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:57.188804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:57.200779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.203507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:57.204223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:57.205959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.448384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-plugged", "status": "completed", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:57.476939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:57.479149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:57.480165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.512095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] Creating event network-vif-plugged:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:32:57.533779 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9f636581-432d-4f40-b5ed-84e00f4033a5 req-cd3b0c58-6fac-4d99-97d6-34ff702151d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440670 Oct 11 01:32:57.534495 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1693/3361] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:32:57.547667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:57.550214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:57.567854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:57.568370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:57.568820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.569564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:57.573033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:57.573682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:57.952920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:57.970452 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1839583-62d7-4b07-9e6b-4aad4062e29f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.800321 Oct 11 01:32:57.972934 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1669/3362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:57 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:58.058165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:58.058800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:58.065954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:58.080506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:58.081582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:58.083197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:58.084172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:58.084842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:58.709164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:58.721950 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94ca6d26-4506-4e13-9ac0-64b5fefc0e15 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1271 microversion: 2.1 time: 0.664876 Oct 11 01:32:58.723743 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1670/3363] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:58 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1271 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:58.804078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:58.815723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13e5d3a5-78ce-40e1-944b-85279b491597 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1313 microversion: 2.1 time: 1.278006 Oct 11 01:32:58.816312 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1694/3364] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:57 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1313 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:59.000011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:59.001178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:59.004863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:59.010166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.011515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.012873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.014147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.014862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.016070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.039499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:59.173769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:32:59.184294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc4af891-bb15-44ef-973b-0fc0b2d19e32 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.188856 Oct 11 01:32:59.185856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1671/3365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:58 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:32:59.746592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:59.747725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:59.752266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:32:59.766094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.767744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.771201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.776054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.779615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.782995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.802566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290745aa-d417-486a-992e-d62eae89a12c", "name": "network-vif-plugged", "status": "completed", "tag": "fc66c72e-d89b-4f1c-a1dc-05001344cfe4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:32:59.830384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.837683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.838488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.897522 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] Creating event network-vif-plugged:fc66c72e-d89b-4f1c-a1dc-05001344cfe4 for instance 290745aa-d417-486a-992e-d62eae89a12c on n-h2-772273-9 Oct 11 01:32:59.921688 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-46d956ae-c155-45b2-a69b-3e10993f34b3 req-18098a8f-e3c9-4269-b4a1-17c9c0e66a2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121351 Oct 11 01:32:59.925157 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1672/3366] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:32:59.943166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:32:59.943855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:32:59.961797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.962337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.962927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:32:59.963799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:32:59.964532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:32:59.965307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:00.601768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:00.615014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:00.616301 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4bee002-cc68-4c5e-9552-a3686c2afbf9 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.873941 Oct 11 01:33:00.619703 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1695/3367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:59 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:00.633412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:00.635390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:00.640780 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c5f439c-afab-43c9-922a-6a96108c69b4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.711388 Oct 11 01:33:00.642363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1673/3368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:32:59 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:00.647055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:00.651053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:00.655570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:00.657658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:00.664574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:00.665545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:00.848254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:00.861288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8178434e-bd57-4455-88d2-15e656c52da3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1318 microversion: 2.1 time: 0.239335 Oct 11 01:33:00.876509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1696/3369] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:00 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:01.559004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9edea945-d344-4cd9-8015-deba577ad773", "tag": "e4b83979-321b-4918-8b70-964820007a75"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:01.579359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:01.584030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:01.584697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:01.607999 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] Creating event network-changed:e4b83979-321b-4918-8b70-964820007a75 for instance 9edea945-d344-4cd9-8015-deba577ad773 on n-h1-772273-9 Oct 11 01:33:01.624192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4722f716-aaad-47ee-b264-48cd46a1df16 req-1467293f-184d-4f9f-89fa-e23b1c42ccd8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069440 Oct 11 01:33:01.627095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1674/3370] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:01.640603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:01.641216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:01.650556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:01.651155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:01.651643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:01.652356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:01.652808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:01.653267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:01.676210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:01.677078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:01.686559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:01.687279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:01.688882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:01.689986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:01.690533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:01.691027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.063853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:02.076018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:02.076606 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d4ab5e4-84dd-4de1-93e7-ec5295fd1969 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.439684 Oct 11 01:33:02.083468 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1697/3371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:01 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:02.086528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0202749f-55ea-4413-a166-b41ab68b3f36 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.421286 Oct 11 01:33:02.087315 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1675/3372] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:01 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:02.091980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:02.092731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:02.103308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.107943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.108736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.109718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.110406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.111008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.314127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:02.327415 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6a8b35b-8caf-46b7-8d05-f354bb017c94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1468 microversion: 2.1 time: 0.242535 Oct 11 01:33:02.328900 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1698/3373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:02 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:02.355110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:02.355775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:02.362676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.363919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.365144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.366405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.367936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.368923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.549773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:02.561284 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5eb38182-0762-40a7-ac15-6ce4a47cd825 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1467 microversion: 2.1 time: 0.210910 Oct 11 01:33:02.563437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1676/3374] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:02 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1467 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:02.584721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-632485397"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:02.588265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:02.597024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.597917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.598604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.599579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:02.600487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:02.602653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:02.736401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:02.923716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9a61401-be77-4d81-869a-710b0a640201 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "POST /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e/action" status: 202 len: 0 microversion: 2.1 time: 0.339768 Oct 11 01:33:02.925759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1699/3375] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:33:02 2022] POST /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 01:33:02.936884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-add0edca-ee6a-4875-a83b-76abd416c8c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113408eca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:03.018500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-add0edca-ee6a-4875-a83b-76abd416c8c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.085461 Oct 11 01:33:03.020240 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1677/3376] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:02 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:03.112667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:03.118616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:03.121500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:03.124992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:03.147592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:03.149183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:03.152988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:03.153448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:03.154361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:03.155600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:03.156979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:03.157425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:03.158103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:03.160728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:03.161199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:03.161637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:03.589375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:03.598224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-69ed2e0f-7644-429f-9003-9087c916a980 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.499213 Oct 11 01:33:03.602746 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1700/3377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:03 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:03.681046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "tag": "afd1bf00-7390-49aa-a8ea-077f1b927375"}, {"name": "network-changed", "server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "tag": "964087fd-7e47-416d-9042-2353988e8bd3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:03.684887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:03.692797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:03.697472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fdee146-a5cb-4754-beb9-0dcb89165fad tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.587419 Oct 11 01:33:03.702386 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1678/3378] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:03 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:03.705089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:03.705734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:03.707097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:03.732090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Creating event network-changed:afd1bf00-7390-49aa-a8ea-077f1b927375 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:03.733461 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] Creating event network-changed:964087fd-7e47-416d-9042-2353988e8bd3 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:03.740065 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f98f4cab-6edf-4547-a2b0-bdcff1d86e8f req-31a1a8f1-455f-417d-a14d-1b099e829c75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064208 Oct 11 01:33:03.742844 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1701/3379] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:33:04.037102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52e0c57c-66bf-44cc-90e0-18fb655e1c1f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134467700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:04.113433 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52e0c57c-66bf-44cc-90e0-18fb655e1c1f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.081603 Oct 11 01:33:04.114823 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1679/3380] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:04 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:04.629813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:04.630557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:04.641248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:04.642317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:04.643612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:04.644566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:04.645225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:04.645845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:04.722939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:04.728986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:04.729331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:04.756981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:04.758426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:04.761285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:04.764436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:04.766276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:04.768182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:05.224108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:05.254209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f17493a-e02a-4e2d-9501-71da8abac9fb tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.524176 Oct 11 01:33:05.260619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1680/3381] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:04 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:05.277899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9242fc76-b97b-4616-ac03-933d749b5aa6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113495f940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:05.357788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:05.361182 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9242fc76-b97b-4616-ac03-933d749b5aa6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.096117 Oct 11 01:33:05.363254 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1681/3382] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:05 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:05.375537 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02aa42ba-774f-4985-ab8d-f2f950f3aaad tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.749234 Oct 11 01:33:05.377851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1702/3383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:04 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:06.281536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:06.282985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:06.301541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:06.309315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:06.317261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:06.318281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:06.321080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:06.321547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:06.378427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8940af5f-48f4-4ac1-a1ab-6d18a9c1898f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f7780d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:06.453567 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8940af5f-48f4-4ac1-a1ab-6d18a9c1898f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.076890 Oct 11 01:33:06.464727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1703/3384] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:06 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:06.477414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:06.480571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:06.507312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:06.508685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:06.509450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:06.510514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:06.511214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:06.512043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:06.965322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:06.979299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e8ca4e5-9211-4b50-8d8e-7459a09d194a tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.702611 Oct 11 01:33:07.002421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1682/3385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:06 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:07.339558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:07.370287 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7110d8d3-adbc-4d74-9885-1e4a495982d5 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.909369 Oct 11 01:33:07.376078 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1704/3386] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:06 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:07.472786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5a4765c-2984-4ae7-8f14-b387d655752d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113495fd30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:07.557206 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5a4765c-2984-4ae7-8f14-b387d655752d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.088897 Oct 11 01:33:07.565950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1683/3387] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:07 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:07.679900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9edea945-d344-4cd9-8015-deba577ad773", "name": "network-vif-plugged", "status": "completed", "tag": "e4b83979-321b-4918-8b70-964820007a75"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:07.705572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:07.706338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:07.706949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:07.733625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] Creating event network-vif-plugged:e4b83979-321b-4918-8b70-964820007a75 for instance 9edea945-d344-4cd9-8015-deba577ad773 on n-h1-772273-9 Oct 11 01:33:07.745212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1179c377-ec09-4636-812f-90f74cb4c275 req-8e77b5c1-c2b4-4cde-97db-31a730b1c8f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072059 Oct 11 01:33:07.759959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1705/3388] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:08.010576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:08.015709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:08.028279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:08.029051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:08.033018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:08.033774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:08.044123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:08.044576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:08.401493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:08.402228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:08.415194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:08.432503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:08.432503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:08.440289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:08.440779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:08.441221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:08.493309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:08.524150 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4be01a8-9d90-429f-9cc1-eb0038e9d595 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.517403 Oct 11 01:33:08.527047 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1684/3389] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:08 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:08.585181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5f8639d-ac9f-4bca-ace6-bb0b5d96fdba tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343008b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:08.715464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5f8639d-ac9f-4bca-ace6-bb0b5d96fdba tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.146778 Oct 11 01:33:08.716080 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1685/3390] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:08 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:08.975560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:08.985464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9af433bf-3af6-4319-a27c-f1f4c633b6a3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1313 microversion: 2.1 time: 0.588184 Oct 11 01:33:08.991965 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1706/3391] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:08 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:09.554488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:09.556463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:09.571300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:09.573431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:09.574378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:09.575997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:09.576784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:09.577618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:09.732493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd6e6313-77b8-416a-932f-17e33f7d4004 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11388b8ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:09.833313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd6e6313-77b8-416a-932f-17e33f7d4004 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.104169 Oct 11 01:33:09.835676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1707/3392] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:09 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:09.995573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-plugged", "status": "completed", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:10.042091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:10.053373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:10.053884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:10.108672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] Creating event network-vif-plugged:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:33:10.128894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2e569588-2c02-4c80-bed8-b8beb856627e req-d16b9ca2-f398-493a-a48a-01e9566c585e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138183 Oct 11 01:33:10.136203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1708/3393] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:33:10.150512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:10.158482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:10.193379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:10.194136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:10.196281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:10.200002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:10.201067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:10.211956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:10.291244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:10.332823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:10.350294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf67a500-2655-48af-8c24-e2f4b76cf291 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.800045 Oct 11 01:33:10.356344 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1686/3394] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:09 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:10.673403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:10.693258 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f70bcba-5dd4-4faf-a8a6-e26892191a46 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1463 microversion: 2.1 time: 0.555745 Oct 11 01:33:10.703018 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1709/3395] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:10 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1463 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:10.868085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0727ebc7-52a4-41a0-84a7-325c107556d8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f778820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:10.980093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0727ebc7-52a4-41a0-84a7-325c107556d8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.132689 Oct 11 01:33:10.982204 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1710/3396] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:10 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:11.349515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Calling method '.version_select at 0x7f11347f09d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:11.379319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:11.380164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:11.392980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.393634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.395074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.396456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.399598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.400202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.414165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.415188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.428933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.518274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.518945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.519230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.625081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34f18c8e-2ddd-480a-b116-8a27e2967b84 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/912ed45552e34c4aa8f8ec56f1a0131b?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129" status: 200 len: 694 microversion: 2.1 time: 0.902531 Oct 11 01:33:11.629770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1687/3397] 10.222.0.66 () {58 vars in 1412 bytes} [Tue Oct 11 01:33:10 2022] GET /compute/v2.1/os-simple-tenant-usage/912ed45552e34c4aa8f8ec56f1a0131b?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129 => generated 694 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:11.660077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '.version_select at 0x7f11348f0c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:11.703004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.706005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.709849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.772001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.774382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.779302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:11.780329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.794358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81c76ff3-90ff-4f44-8890-983e3e102120 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 0.420131 Oct 11 01:33:11.794973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1711/3398] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:11 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:11.879935 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d47f0a2c-0688-449e-a401-1e4099833d57 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/912ed45552e34c4aa8f8ec56f1a0131b?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129" status: 200 len: 694 microversion: 2.1 time: 0.234168 Oct 11 01:33:11.884721 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1688/3399] 10.222.0.66 () {58 vars in 1412 bytes} [Tue Oct 11 01:33:11 2022] GET /compute/v2.1/os-simple-tenant-usage/912ed45552e34c4aa8f8ec56f1a0131b?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129 => generated 694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:11.902754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Calling method '.version_select at 0x7f112ff128b0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:11.935629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.937709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.939940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.973737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:11.986471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:11.988372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:11.996995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64c631c1-ab15-4ade-a1af-ed4ff851036b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134a4e1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:12.129583 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-64c631c1-ab15-4ade-a1af-ed4ff851036b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.136835 Oct 11 01:33:12.131917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1689/3400] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:11 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:12.267816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "name": "network-vif-plugged", "status": "completed", "tag": "afd1bf00-7390-49aa-a8ea-077f1b927375"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:12.299378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.305324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.307189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.362751 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] Creating event network-vif-plugged:afd1bf00-7390-49aa-a8ea-077f1b927375 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:12.380918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2f8bd2fd-cb22-43ca-bbc6-5cd9be399881 req-c0d3678f-3aa1-4a9d-aed1-39404c7cc1a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124014 Oct 11 01:33:12.385352 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1690/3401] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:12.463258 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00cacf92-83c2-4903-bc22-20f221e40254 tempest-TenantUsagesTestJSON-1025668711 tempest-TenantUsagesTestJSON-1025668711-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129&detailed=1" status: 200 len: 42422 microversion: 2.1 time: 0.563061 Oct 11 01:33:12.464359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1712/3402] 10.222.0.66 () {58 vars in 1335 bytes} [Tue Oct 11 01:33:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T01%3A33%3A10.718129&end=2022-10-12T01%3A33%3A10.718129&detailed=1 => generated 42422 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:33:12.527831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:12.528698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:12.553682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.559414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.562655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.568378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.568875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.569317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.641846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:33:12.823564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:12.824551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:12.865752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.871187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.878986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.880144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.885765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.889240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.910347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2149c4b6-c94a-4150-ac50-1c3c9c15750f tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 204 len: 0 microversion: 2.1 time: 0.389278 Oct 11 01:33:12.911851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1691/3403] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:33:12 2022] DELETE /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:33:12.927145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:12.928263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:12.940872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.943982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.944666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:12.949150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:12.950039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:12.950660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:14.225513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:14.236135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-363ec251-36cd-4fa0-ae39-142e5f781955 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 1.418343 Oct 11 01:33:14.239957 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1713/3404] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:12 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:14.245264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:14.256770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-193aa7c6-1606-474d-9478-1f107d1fafd3 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1469 microversion: 2.1 time: 1.340371 Oct 11 01:33:14.261600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1692/3405] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:12 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1469 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:14.266448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d2c3671-61bc-41ac-b7a8-2ca3c250099a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f0550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:14.366658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d2c3671-61bc-41ac-b7a8-2ca3c250099a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.125346 Oct 11 01:33:14.371910 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1714/3406] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:14 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:14.401545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "name": "network-vif-plugged", "status": "completed", "tag": "964087fd-7e47-416d-9042-2353988e8bd3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:14.440844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:14.441530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:14.448161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:14.528749 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] Creating event network-vif-plugged:964087fd-7e47-416d-9042-2353988e8bd3 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:14.540555 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5637bb21-9988-4c51-8d11-effd83a78c68 req-02bbcaef-a689-4d9a-82fb-a3be19355fe3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142697 Oct 11 01:33:14.543778 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1693/3407] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:15.266242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:15.267046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:15.288827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:15.289570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:15.291734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:15.292107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:15.297738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:15.298221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:15.298687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:15.300309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:15.302020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:15.302968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:15.303869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:15.306163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:15.307798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:15.309318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:16.375482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:16.387228 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-136eef39-c194-483e-9ce5-120d8fd860f6 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1334 microversion: 2.1 time: 1.127507 Oct 11 01:33:16.398524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1715/3408] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:15 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1334 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:16.415562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-925f8001-b454-4d95-8a71-0321c762f923 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f739f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:16.425320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:16.435942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3e2f9c2-67ec-4a58-93e1-0989db9401a1 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1469 microversion: 2.1 time: 1.152012 Oct 11 01:33:16.436544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1694/3409] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:15 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1469 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:16.513906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-925f8001-b454-4d95-8a71-0321c762f923 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.111830 Oct 11 01:33:16.524449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1716/3410] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:16 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:17.099187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9edea945-d344-4cd9-8015-deba577ad773", "name": "network-vif-deleted", "tag": "e4b83979-321b-4918-8b70-964820007a75"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:17.121982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.128496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.131664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.191852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] Creating event network-vif-deleted:e4b83979-321b-4918-8b70-964820007a75 for instance 9edea945-d344-4cd9-8015-deba577ad773 on n-h1-772273-9 Oct 11 01:33:17.204381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8fcbbda9-36da-477f-bf8a-5142b7a82909 req-5a3f1f87-5f54-4909-b062-34688cacf563 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109272 Oct 11 01:33:17.210362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1695/3411] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:33:17.421763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:17.423156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:17.442621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.446615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.449771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.476430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:17.476430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:17.480607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.482735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.485689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.503298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.503298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.503298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.506956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.507594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.512638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.643914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:17.652539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:17.653753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:17.655433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lazy-loading 'fault' on Instance uuid 9edea945-d344-4cd9-8015-deba577ad773 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:33:18.869922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68784d9b031d40dfa691e100a2b43467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ed45552e34c4aa8f8ec56f1a0131b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:18.875939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:18.877773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b518ebe8-9b85-48e8-8d50-65f2af7439c0 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 200 len: 1303 microversion: 2.1 time: 1.419244 Oct 11 01:33:18.898034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1696/3412] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:17 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 1303 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:18.911094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43257235-04b6-481b-83b9-b0ab20be9527 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134151310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:19.000792 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43257235-04b6-481b-83b9-b0ab20be9527 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.101558 Oct 11 01:33:19.001515 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1697/3413] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:18 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:19.286200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:19.298536 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c0a16ab9-0d40-46c5-a8d8-c49bc379c0a5 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1670 microversion: 2.1 time: 1.882084 Oct 11 01:33:19.308165 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1717/3414] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:17 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1670 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:19.331084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:19.331612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:19.350784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.351265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.352586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.357441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.358299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.369163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.442940 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6542e03c-ea96-4796-bdce-b0054be994ce tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6/ips" status: 200 len: 180 microversion: 2.1 time: 0.115761 Oct 11 01:33:19.448453 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1698/3415] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:33:19 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6/ips => generated 180 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:19.460201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:19.460905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:19.475497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.478340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.479262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.480884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.482933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.484750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.537915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:33:19.734263 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1933f82-1e8f-4dcc-9a26-f95bc47feb3e tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 204 len: 0 microversion: 2.1 time: 0.271320 Oct 11 01:33:19.736122 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1718/3416] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:33:19 2022] DELETE /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:33:19.745820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:19.746726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:19.757925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.766312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.766783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.770381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.770883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.771324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.906902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:19.907802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] [instance: 9edea945-d344-4cd9-8015-deba577ad773] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:19.926220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.926730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.927166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.929211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:19.929690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:19.930166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:19.996095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] HTTP exception thrown: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Request method failure captured: Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 HTTP/1.1 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMfCK2cbulhTmyeuU8rzjUh9kMbsqzjHbnbPTDSzkBSMGyFySH_DHNw7xSogoaGRPzBjCBNdTogMfBOizom8TcfuU1-6CMWr0xALtM73GcLWBBfJq04K4gkgmpYVkmv0katZSuHZbI0eLiCLk7ysDkzlvoW8krhyPu3jlPaLf1C5sBw Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 912ed45552e34c4aa8f8ec56f1a0131b Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TenantUsagesTestJSON-834175409 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/912ed45552e34c4aa8f8ec56f1a0131b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_912ed45552e34c4aa8f8ec56f1a0131b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/912ed45552e34c4aa8f8ec56f1a0131b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/912ed45552e34c4aa8f8ec56f1a0131b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TenantUsagesTestJSON-834175409 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 912ed45552e34c4aa8f8ec56f1a0131b Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TenantUsagesTestJSON-834175409 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TenantUsagesTestJSON-834175409-project Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 68784d9b031d40dfa691e100a2b43467 Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TenantUsagesTestJSON-834175409-project Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9edea945-d344-4cd9-8015-deba577ad773'} Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:20.002013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] Returning 404 to user: Instance 9edea945-d344-4cd9-8015-deba577ad773 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:20.007074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-005c3b19-b3ad-466e-9a2a-29ad7dfaac80 tempest-TenantUsagesTestJSON-834175409 tempest-TenantUsagesTestJSON-834175409-project] 10.222.0.66 "GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773" status: 404 len: 111 microversion: 2.1 time: 0.104541 Oct 11 01:33:20.013308 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1719/3417] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:19 2022] GET /compute/v2.1/servers/9edea945-d344-4cd9-8015-deba577ad773 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:20.033492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d82f038-ea3e-44db-879c-728a0dc175ea tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f0700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:20.172520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d82f038-ea3e-44db-879c-728a0dc175ea tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.158056 Oct 11 01:33:20.173379 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1720/3418] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:20 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:20.434601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:20.445861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4767baab-cd7b-4485-8483-d718cac2a886 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1676 microversion: 2.1 time: 0.705959 Oct 11 01:33:20.446352 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1699/3419] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:19 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1676 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:21.190711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-609ff69f-c816-42b9-94f9-41cde47a368a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f7810d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:21.293156 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-609ff69f-c816-42b9-94f9-41cde47a368a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.107629 Oct 11 01:33:21.299824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1721/3420] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:21 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:21.477005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:21.482798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:21.492016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:21.498210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:21.498933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:21.500175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:21.500865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:21.501901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:21.765666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:22.003164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:22.020725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0306b45-ac34-41eb-a07e-95bc9c6395db tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1676 microversion: 2.1 time: 0.550928 Oct 11 01:33:22.021343 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1700/3421] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:21 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1676 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:22.310528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:22.315756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c596218-4c17-4a89-abdf-af1817af5b94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f781040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:22.421790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c596218-4c17-4a89-abdf-af1817af5b94 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.112023 Oct 11 01:33:22.422966 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1722/3422] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:22 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:23.048418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:23.049824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:23.068656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:23.074491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:23.075826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:23.077482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:23.078776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:23.080172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:23.439069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e5788091-9d53-47c2-939a-1b629ce639a7 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f6d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:23.558210 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e5788091-9d53-47c2-939a-1b629ce639a7 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.124396 Oct 11 01:33:23.559126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1723/3423] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:23 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:23.568838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "name": "network-vif-deleted", "tag": "964087fd-7e47-416d-9042-2353988e8bd3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:23.601897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:23.617206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:23.617893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:23.660502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] Creating event network-vif-deleted:964087fd-7e47-416d-9042-2353988e8bd3 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:23.674815 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eb050e74-7fb2-4d09-8394-d161c72ed529 req-dc1f0c9b-1a63-4dc2-9993-5c10c5b3a1ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113919 Oct 11 01:33:23.676073 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1724/3424] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:24.061431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:24.080632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbe64cb6-7a0d-40d4-9cb4-35e0c3d850b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1655 microversion: 2.1 time: 1.035974 Oct 11 01:33:24.081252 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1701/3425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:23 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1655 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:24.574440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7df1a0f6-ec43-46b6-8bb1-0cbd3a03b84f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6fe550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:24.674735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7df1a0f6-ec43-46b6-8bb1-0cbd3a03b84f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.103793 Oct 11 01:33:24.675759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1725/3426] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:24 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:25.105301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:25.105751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:25.126480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:25.129906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:25.130398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:25.131160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:25.139944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:25.140467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:25.691574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61838ab5-ac7c-4d16-a6e6-578b50e2b2a8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f65e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:25.786099 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61838ab5-ac7c-4d16-a6e6-578b50e2b2a8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.098477 Oct 11 01:33:25.795290 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1726/3427] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:25 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:25.813498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a42822-d085-451c-9bf3-d88ebe6aeda6", "name": "network-vif-deleted", "tag": "afd1bf00-7390-49aa-a8ea-077f1b927375"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:25.851267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:25.852083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:25.856000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:25.920057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] Creating event network-vif-deleted:afd1bf00-7390-49aa-a8ea-077f1b927375 for instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 on n-h1-772273-9 Oct 11 01:33:25.935486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-76c54d54-75e2-4916-a8c2-5ddfc96953c9 req-b5958e2c-b273-4406-a44a-c37dc9bed08c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138554 Oct 11 01:33:25.942803 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1727/3428] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:25.975198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc2bd5b12f24d51b07a93b7ef7e7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f027a594c0641af895ad9ef38720a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:25.986757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5ed00a2-c215-4ad2-9c45-ef71c581005c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 200 len: 1454 microversion: 2.1 time: 0.886419 Oct 11 01:33:25.998723 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1702/3429] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:25 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 1454 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:26.802506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e8d4bae-7567-42d3-ac26-14ce031e8c4d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6cf3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:26.923666 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e8d4bae-7567-42d3-ac26-14ce031e8c4d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.125148 Oct 11 01:33:26.924277 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1728/3430] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:26 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:27.018101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:27.018777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:27.043434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:27.043962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:27.044475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:27.045180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:27.045679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:27.046084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:27.136363 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 HTTP/1.1 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '60a42822-d085-451c-9bf3-d88ebe6aeda6'} Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:27.138144 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:27.145942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:27.147113 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9256338c-4f48-412f-a578-de953e2934b0 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 404 len: 111 microversion: 2.1 time: 0.125427 Oct 11 01:33:27.151671 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1703/3431] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:27 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:27.940723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16d15ac9-ec27-4cb8-b235-d8893a4cf97e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11388b8a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:28.069977 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16d15ac9-ec27-4cb8-b235-d8893a4cf97e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.133591 Oct 11 01:33:28.087623 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1729/3432] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:27 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:29.094624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15e8bd4a-9ab5-47f6-a3a7-87e5f6e8c25b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113441ef70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:29.207030 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15e8bd4a-9ab5-47f6-a3a7-87e5f6e8c25b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.116258 Oct 11 01:33:29.209905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1704/3433] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:29 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:30.225929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a7f1b41-12e6-454d-9c15-39bcadaa9b03 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6eb820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:30.351191 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a7f1b41-12e6-454d-9c15-39bcadaa9b03 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.130030 Oct 11 01:33:30.372170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1730/3434] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:30 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:31.381119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2542df4f-3776-4ad4-979c-a6fd8cb65211 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f17b670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.410704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-289e86bf-f198-4b48-bdb2-4ba74cf6c6b8 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.414683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:31.439575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-289e86bf-f198-4b48-bdb2-4ba74cf6c6b8 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.583268 Oct 11 01:33:31.451675 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1705/3435] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:31.484553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24c119db-1bb3-4706-8669-cb110f2351d0 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.497497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2542df4f-3776-4ad4-979c-a6fd8cb65211 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.113508 Oct 11 01:33:31.498180 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1731/3436] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:31.592458 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24c119db-1bb3-4706-8669-cb110f2351d0 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.139465 Oct 11 01:33:31.600736 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1706/3437] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:31.621692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c58f762e-7aef-4dca-900e-80b2883e9459 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.624995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:31.643319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c58f762e-7aef-4dca-900e-80b2883e9459 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026940 Oct 11 01:33:31.662405 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1732/3438] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:31.676536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ea2f1fd-205b-43c8-a20a-1513de43e7cf tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.689371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ea2f1fd-205b-43c8-a20a-1513de43e7cf tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017344 Oct 11 01:33:31.707886 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1707/3439] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:31.719851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eaeb6bc1-1346-4df9-914a-df1736236e90 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.879560 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eaeb6bc1-1346-4df9-914a-df1736236e90 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.135879 Oct 11 01:33:31.880599 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1733/3440] 10.222.0.66 () {58 vars in 1165 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:31.899689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51fd2265-c890-47f5-af9e-07e7ab6f72ac tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.919189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51fd2265-c890-47f5-af9e-07e7ab6f72ac tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023287 Oct 11 01:33:31.920387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1708/3441] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:31.934113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6771ccc5-6316-47e3-81ae-a29aad073dc2 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:31.994000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6771ccc5-6316-47e3-81ae-a29aad073dc2 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.064086 Oct 11 01:33:31.995377 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1734/3442] 10.222.0.66 () {58 vars in 1169 bytes} [Tue Oct 11 01:33:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.013913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-913736f4-21d1-4f97-8b60-e5e163addd03 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.037022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-913736f4-21d1-4f97-8b60-e5e163addd03 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.028142 Oct 11 01:33:32.037639 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1709/3443] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:32.054335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58cf630e-4d1e-43a0-aee6-5b7042ffaa9b tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.074769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58cf630e-4d1e-43a0-aee6-5b7042ffaa9b tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024749 Oct 11 01:33:32.077622 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1735/3444] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:33:32.097594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-346d128e-a642-48cb-b2d4-dbdc5baf2ffb tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.262277 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-346d128e-a642-48cb-b2d4-dbdc5baf2ffb tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.173026 Oct 11 01:33:32.264476 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1710/3445] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.281478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8455705e-6001-42e6-a1ea-e19284aba68c tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.306998 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8455705e-6001-42e6-a1ea-e19284aba68c tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027735 Oct 11 01:33:32.310206 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1736/3446] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:32.326005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4ca39bf-e0d7-4274-a2c6-5e154b243699 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.414195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4ca39bf-e0d7-4274-a2c6-5e154b243699 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.095613 Oct 11 01:33:32.416724 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1711/3447] 10.222.0.66 () {58 vars in 1144 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.435992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7f1d4c3-074b-4029-a1a8-2f8af901e4fc tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.457411 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7f1d4c3-074b-4029-a1a8-2f8af901e4fc tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026886 Oct 11 01:33:32.460755 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1737/3448] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:32.475587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b65d199a-d72c-4b44-8613-602f7dd1d592 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.517408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-09ec6682-c600-4e32-b1e4-10817b9985bf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f739790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.564268 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b65d199a-d72c-4b44-8613-602f7dd1d592 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.095848 Oct 11 01:33:32.567652 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1712/3449] 10.222.0.66 () {58 vars in 1148 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.582701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71e12408-421c-49a7-a90d-fa02f6a9183a tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.624701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-09ec6682-c600-4e32-b1e4-10817b9985bf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.114266 Oct 11 01:33:32.632582 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1738/3450] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:32.642283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-71e12408-421c-49a7-a90d-fa02f6a9183a tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.056865 Oct 11 01:33:32.643245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1713/3451] 10.222.0.66 () {58 vars in 1140 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:32.658834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ce18721-ecff-4e29-b62b-50d1e8776248 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.701473 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ce18721-ecff-4e29-b62b-50d1e8776248 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049330 Oct 11 01:33:32.702738 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1739/3452] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:32.716405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-905231de-f53b-4d5a-bc29-0b198a2783db tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.784366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-905231de-f53b-4d5a-bc29-0b198a2783db tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.072689 Oct 11 01:33:32.789267 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1714/3453] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.812724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-276ae400-2e80-4829-81ce-7d9919320317 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.890860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-276ae400-2e80-4829-81ce-7d9919320317 tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085149 Oct 11 01:33:32.910948 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1740/3454] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:32.932758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90185d86-0539-464a-b504-251696ab5bda tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:32.955529 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90185d86-0539-464a-b504-251696ab5bda tempest-FlavorsV2TestJSON-1235551054 tempest-FlavorsV2TestJSON-1235551054-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028339 Oct 11 01:33:32.961432 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1715/3455] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:33:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:33.641954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c1243e4-8e03-4d51-bcac-b2931e68903c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f778c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:33.739009 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c1243e4-8e03-4d51-bcac-b2931e68903c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.102166 Oct 11 01:33:33.742150 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1741/3456] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:33 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:34.357984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:34.363244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:34.421012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.422213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.422827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.423767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.424392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.425130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.456019 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 HTTP/1.1 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '60a42822-d085-451c-9bf3-d88ebe6aeda6'} Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:34.463622 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.469152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.474109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:34.475215 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60b5c53a-ce13-46a3-b307-2558298430a4 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 404 len: 111 microversion: 2.1 time: 0.156751 Oct 11 01:33:34.486727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:34.487414 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1716/3457] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:33:34 2022] DELETE /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:34.487557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 60a42822-d085-451c-9bf3-d88ebe6aeda6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:34.501157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.501754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.502093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.502816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.511319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.511899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.575992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 HTTP/1.1 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '60a42822-d085-451c-9bf3-d88ebe6aeda6'} Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.579876 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. Oct 11 01:33:34.584636 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.590720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 60a42822-d085-451c-9bf3-d88ebe6aeda6 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:34.591920 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f5402e5-79ed-41a7-b78e-6ce82eff3f60 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6" status: 404 len: 111 microversion: 2.1 time: 0.109554 Oct 11 01:33:34.597846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1742/3458] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:34 2022] GET /compute/v2.1/servers/60a42822-d085-451c-9bf3-d88ebe6aeda6 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:34.605405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:34.606069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:34.619393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.620816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.621980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.624255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.625446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.626039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.667925 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 HTTP/1.1 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '33cdf141-5b12-45d7-a56f-f98013195242'} Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:34.675566 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:34.680087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d515202c-ee60-447f-9302-8650dac78c26 tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "DELETE /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 404 len: 111 microversion: 2.1 time: 0.081383 Oct 11 01:33:34.685947 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1717/3459] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:33:34 2022] DELETE /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:34.709596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:34.713373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] [instance: 33cdf141-5b12-45d7-a56f-f98013195242] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:34.730599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.731413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.732073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.734647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:34.739878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:34.740813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:34.756765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2ecd1cd-ae75-4a70-915b-76086549d7d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113407eb80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:34.801259 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] HTTP exception thrown: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Request method failure captured: Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 HTTP/1.1 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMdefpIM4s9YZmG4Qbn2_en_QDCrBb2oZlt8E4ABwKbtMUo1ggQlgQKOf9GsIt55EtfYKJ80VgAB6sdJGyGUMyk04-F52tBXPTf7XdX_qJm0l0L1-O4DzpIhNd_1JDwFu7Smgckd3FZAlDGPelvx171eTrhuMoPYfUxSJCmGD45Hl7w Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3f027a594c0641af895ad9ef38720a33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3f027a594c0641af895ad9ef38720a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 3f027a594c0641af895ad9ef38720a33 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestMultiNic-1175835920 Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ffc2bd5b12f24d51b07a93b7ef7e7fea Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestMultiNic-1175835920-project Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '33cdf141-5b12-45d7-a56f-f98013195242'} Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:34.803281 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. Oct 11 01:33:34.808151 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:34.814441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] Returning 404 to user: Instance 33cdf141-5b12-45d7-a56f-f98013195242 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:34.817478 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16b2adb6-0864-4145-b8c6-3e1e6b35885c tempest-ServersTestMultiNic-1175835920 tempest-ServersTestMultiNic-1175835920-project] 10.222.0.66 "GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242" status: 404 len: 111 microversion: 2.1 time: 0.130600 Oct 11 01:33:34.820197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1743/3460] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:34 2022] GET /compute/v2.1/servers/33cdf141-5b12-45d7-a56f-f98013195242 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:33:34.865801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2ecd1cd-ae75-4a70-915b-76086549d7d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.113671 Oct 11 01:33:34.867456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1718/3461] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:34 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:35.881553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-753738d8-f7d1-4d78-9f4d-f4a5c29cf0db tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f778ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:35.987507 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-753738d8-f7d1-4d78-9f4d-f4a5c29cf0db tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.109632 Oct 11 01:33:35.995460 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1744/3462] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:35 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:37.004205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4680a19-fdb1-4c58-ab92-6bc487ab5a13 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134438040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:37.091833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4680a19-fdb1-4c58-ab92-6bc487ab5a13 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.093306 Oct 11 01:33:37.102441 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1719/3463] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:36 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:38.109416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b55e33e2-2c4d-40a0-8975-93f576cd722a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6fe280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:38.197971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b55e33e2-2c4d-40a0-8975-93f576cd722a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.093703 Oct 11 01:33:38.198887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1745/3464] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:38 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:39.218314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e6a3eaa-da38-4d24-8b1e-37e0d03bc2af tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134151310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:39.318259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e6a3eaa-da38-4d24-8b1e-37e0d03bc2af tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.098991 Oct 11 01:33:39.323819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1720/3465] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:39 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:40.336373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1c5a3b3-41df-4604-b623-3e44068720d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8f0940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:40.421535 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1c5a3b3-41df-4604-b623-3e44068720d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.088680 Oct 11 01:33:40.423319 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1746/3466] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:40 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:41.440479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11f42e38-28a0-425e-8dee-274be4e60885 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134467670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:41.534066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11f42e38-28a0-425e-8dee-274be4e60885 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.099607 Oct 11 01:33:41.545247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1721/3467] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:41 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:42.551771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-853643bd-fb71-41cc-9e98-1b43722ac744 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134255d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:42.608565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c52a3e1-8c50-4c8f-8970-33c6dec78c51 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f112f88b8b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzW0ACVsW+RAHzez08ysJChzjNgOHJ4/c+/mOMSS5c2R7SSxBo6dRz2f33pfw6okn7pDeRZELmHU7fYcAbEVM00uKoarmTnZDQgqkbM0LMu+XEqjYEPnnDw3OcYBxd3wQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c52a3e1-8c50-4c8f-8970-33c6dec78c51 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 257 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzW0ACVsW+RAHzez08ysJChzjNgOHJ4/c+/mOMSS5c2R7SSxBo6dRz2f33pfw6okn7pDeRZELmHU7fYcAbEVM00uKoarmTnZDQgqkbM0LMu+XEqjYEPnnDw3OcYBxd3wQ=="}} Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzW0ACVsW+RAHzez08ysJChzjNgOHJ4/c+/mOMSS5c2R7SSxBo6dRz2f33pfw6okn7pDeRZELmHU7fYcAbEVM00uKoarmTnZDQgqkbM0LMu+XEqjYEPnnDw3OcYBxd3wQ=='}}} Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 11 01:33:42.613808 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 01:33:42.622508 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.629124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c52a3e1-8c50-4c8f-8970-33c6dec78c51 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:42.629124 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c52a3e1-8c50-4c8f-8970-33c6dec78c51 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.915658 Oct 11 01:33:42.641421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-853643bd-fb71-41cc-9e98-1b43722ac744 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.093824 Oct 11 01:33:42.649566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1747/3468] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:41 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 923 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:33:42.651712 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1722/3469] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:42 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:42.673793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f11388099d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1190423041", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:42.736655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:42.760720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for user 4648efe55ab24fd7a53a5a65470584c6 and project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:42.798337 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 2167 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1190423041", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:33:42.820987 n-d-772273-9 devstack@n-api.service[120493]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1190423041', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:42.824697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1bf1acc-6601-4b55-b691-b56d31fb78e8 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.169993 Oct 11 01:33:42.828148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1748/3470] 10.222.0.66 () {60 vars in 1160 bytes} [Tue Oct 11 01:33:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:33:42.847255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47d1cef5-d117-4a17-b190-26801b4518f6 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f113441e4c0>, body: {"keypair": {"name": "tempest-keypair-518970165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3hb4BG2W6U5iGofEBiKdgQ1mlQZ2tL1cc438QWlGgtk5atMH5fJ+guHQfysWpfurH8RCLJeiUyzGFm0iU2ZJ0i9tY73vg5vt6adMtoRhn4kgwzm9XQPcHI+xRD19aazA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:42.924279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-47d1cef5-d117-4a17-b190-26801b4518f6 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:42.940607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-47d1cef5-d117-4a17-b190-26801b4518f6 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for user 4648efe55ab24fd7a53a5a65470584c6 and project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:43.057338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47d1cef5-d117-4a17-b190-26801b4518f6 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221087 Oct 11 01:33:43.069275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1723/3471] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:43.074447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f112f1109d0>, body: {"keypair": {"name": "tempest-keypair-518970165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv2DoqtgoMOKXI8enB/twaa38EPVX0Nvpvp/GzXe3nI6XnKQ4vcmKgZyrhWXgaG9i+fzv4Y1q5p97SlsJfUjW+T5B3yMz3YndpFLg/mPE09ByVny7588YWXAeLA46v9vQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:43.164204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:43.187014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for user 4648efe55ab24fd7a53a5a65470584c6 and project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:43.293891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] HTTP exception thrown: Key pair 'tempest-keypair-518970165' already exists. Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 272 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: {"keypair": {"name": "tempest-keypair-518970165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv2DoqtgoMOKXI8enB/twaa38EPVX0Nvpvp/GzXe3nI6XnKQ4vcmKgZyrhWXgaG9i+fzv4Y1q5p97SlsJfUjW+T5B3yMz3YndpFLg/mPE09ByVny7588YWXAeLA46v9vQ=="}} Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: exception: Key pair 'tempest-keypair-518970165' already exists. Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-518970165', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv2DoqtgoMOKXI8enB/twaa38EPVX0Nvpvp/GzXe3nI6XnKQ4vcmKgZyrhWXgaG9i+fzv4Y1q5p97SlsJfUjW+T5B3yMz3YndpFLg/mPE09ByVny7588YWXAeLA46v9vQ=='}}} Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4648efe55ab24fd7a53a5a65470584c6-tempest-keypair-518970165' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 01:33:43.305059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result.read() Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 01:33:43.312578 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4648efe55ab24fd7a53a5a65470584c6-tempest-keypair-518970165' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 1, 33, 43, 268140), 'updated_at': None, 'name': 'tempest-keypair-518970165', 'user_id': '4648efe55ab24fd7a53a5a65470584c6', 'fingerprint': '35:0f:71:91:ee:a8:9e:d9:7f:6f:a0:9b:38:b7:db:e7', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv2DoqtgoMOKXI8enB/twaa38EPVX0Nvpvp/GzXe3nI6XnKQ4vcmKgZyrhWXgaG9i+fzv4Y1q5p97SlsJfUjW+T5B3yMz3YndpFLg/mPE09ByVny7588YWXAeLA46v9vQ==', 'type': 'ssh'}] Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi keypair.create() Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._create() Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-518970165' already exists. Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 11 01:33:43.327106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-518970165' already exists. Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-518970165' already exists. Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 409 to user: Key pair 'tempest-keypair-518970165' already exists. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07b13cad-974c-4185-ad29-78656b85de9d tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.245903 Oct 11 01:33:43.332747 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1749/3472] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:43 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 249 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 01:33:43.334893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-787ada70-f8b6-4d19-a5bf-8b507ab983b1 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Calling method '.version_select at 0x7f11343dfc10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:43.390477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-787ada70-f8b6-4d19-a5bf-8b507ab983b1 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518970165" status: 202 len: 0 microversion: 2.1 time: 0.070545 Oct 11 01:33:43.398362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1724/3473] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518970165 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:33:43.403088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8860a15-fbf1-4927-a59c-9af3039fd24b tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f11388631f0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD0P+8FQGdNX+pSsd4xocv5fhcrSMV4NokJzI4llEFOwS5hak1U49/VPCIQT7a3LA9yKXK0W+ZEmRnFeqPkhpfxnXpVXkS2PbvO8HovBtYXTqT7IxrCbg9XFSjJILKakA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8860a15-fbf1-4927-a59c-9af3039fd24b tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 247 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD0P+8FQGdNX+pSsd4xocv5fhcrSMV4NokJzI4llEFOwS5hak1U49/VPCIQT7a3LA9yKXK0W+ZEmRnFeqPkhpfxnXpVXkS2PbvO8HovBtYXTqT7IxrCbg9XFSjJILKakA=="}} Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD0P+8FQGdNX+pSsd4xocv5fhcrSMV4NokJzI4llEFOwS5hak1U49/VPCIQT7a3LA9yKXK0W+ZEmRnFeqPkhpfxnXpVXkS2PbvO8HovBtYXTqT7IxrCbg9XFSjJILKakA=='}}} Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '' Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:33:43.407247 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8860a15-fbf1-4927-a59c-9af3039fd24b tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c8860a15-fbf1-4927-a59c-9af3039fd24b tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009567 Oct 11 01:33:43.416512 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1750/3474] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:43 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:33:43.420911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f1134c0e1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1846580745", "public_key": " "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:43.465032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:43.483177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for user 4648efe55ab24fd7a53a5a65470584c6 and project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:43.525536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 95 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1846580745", "public_key": " "}} Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1846580745', 'public_key': ' '}}} Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.532369 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.540051 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.560210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.562876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d23c23e-cfe7-4e41-8bf1-18a808be54ba tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.147854 Oct 11 01:33:43.571862 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1725/3475] 10.222.0.66 () {60 vars in 1158 bytes} [Tue Oct 11 01:33:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:33:43.584323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08b4844a-b13d-43c5-b0d8-c656c06f0872 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f11388093a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0D/v4KFzrujh9f1PuyoRotSj7fsKlnvBIXs8H3d4kj6Gz+uBw0NiVRw+gz/xK/7C06X9+ztEaEAqsvlgEk4jyIB1tslvbieOEIwmRISyXahClZufHeOU29XFuqRhea4w=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08b4844a-b13d-43c5-b0d8-c656c06f0872 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 507 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0D/v4KFzrujh9f1PuyoRotSj7fsKlnvBIXs8H3d4kj6Gz+uBw0NiVRw+gz/xK/7C06X9+ztEaEAqsvlgEk4jyIB1tslvbieOEIwmRISyXahClZufHeOU29XFuqRhea4w=="}} Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0D/v4KFzrujh9f1PuyoRotSj7fsKlnvBIXs8H3d4kj6Gz+uBw0NiVRw+gz/xK/7C06X9+ztEaEAqsvlgEk4jyIB1tslvbieOEIwmRISyXahClZufHeOU29XFuqRhea4w=='}}} Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 01:33:43.593745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.598109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08b4844a-b13d-43c5-b0d8-c656c06f0872 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.606019 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08b4844a-b13d-43c5-b0d8-c656c06f0872 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.022577 Oct 11 01:33:43.606019 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1751/3476] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:43 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:33:43.609253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Action: 'create', calling method: .version_select at 0x7f1134151d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1328712298", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:43.645008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:43.652401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Getting quotas for user 4648efe55ab24fd7a53a5a65470584c6 and project 6376e50063a44ac599bef84d6fd7e10a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:43.659422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9add9dd6-a159-4998-98ce-36f9a1f11a9c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1138863ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:43.673862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 118 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1328712298", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1328712298', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 01:33:43.676829 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.682090 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04e2e7a0-6e9f-46ac-b299-03fdbdbaf075 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076285 Oct 11 01:33:43.684645 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1726/3477] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:33:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:33:43.693626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-949f7791-fa7f-4540-9656-d353f801f8e5 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Calling method '.version_select at 0x7f1134c29af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:43.737825 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-949f7791-fa7f-4540-9656-d353f801f8e5 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-949f7791-fa7f-4540-9656-d353f801f8e5 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Request method failure captured: Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1459323821 HTTP/1.1 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMf1McjOh83okaQk1BRq6aE5EndDPm19rqvxwZ25m1A1URtfuHoO220lWrxv4qLyROj84LZRSx4S0wAxxH1TLtepMOHHr2qET1eZ3WVMZKdyF3_DaGDotp9-DPJBXu3Om7FLnV6Pa-KmAQF3cYdtQTCBWoKQqiokHqY1DJJUECTjEEI Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6376e50063a44ac599bef84d6fd7e10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6376e50063a44ac599bef84d6fd7e10a Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186381267 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186381267-project Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: method: Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: exception: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'tempest-keypair-non-existent-1459323821'} Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.740574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-949f7791-fa7f-4540-9656-d353f801f8e5 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1459323821 not found for user 4648efe55ab24fd7a53a5a65470584c6 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-949f7791-fa7f-4540-9656-d353f801f8e5 tempest-KeyPairsNegativeTestJSON-1186381267 tempest-KeyPairsNegativeTestJSON-1186381267-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1459323821" status: 404 len: 145 microversion: 2.1 time: 0.054347 Oct 11 01:33:43.745209 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1727/3478] 10.222.0.66 () {58 vars in 1260 bytes} [Tue Oct 11 01:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1459323821 => generated 145 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:33:43.753130 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9add9dd6-a159-4998-98ce-36f9a1f11a9c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1454 microversion: 2.1 time: 0.096951 Oct 11 01:33:43.763169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1752/3479] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:43 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:44.769815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=34 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:44.774513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a32296f8-4879-462d-bd72-1bec0e5da0ca tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134c0e3a0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:44.871169 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a32296f8-4879-462d-bd72-1bec0e5da0ca tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1463 microversion: 2.1 time: 0.105536 Oct 11 01:33:44.872544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1728/3480] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:44 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:44.894172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-572097a7-b05d-4829-8a55-6a0387e98322 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f110e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:44.909834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:44.975676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-572097a7-b05d-4829-8a55-6a0387e98322 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 200 len: 1463 microversion: 2.1 time: 0.091722 Oct 11 01:33:44.985189 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1753/3481] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:44 2022] GET /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:44.994463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:44.995496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:45.002113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:45.003440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:45.004150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:45.005077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:45.005718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:45.006717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:45.315136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:45.323709 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c0f21ad-c364-4228-8f57-6cc701452eb1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1480 microversion: 2.1 time: 0.336126 Oct 11 01:33:45.327164 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1729/3482] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:44 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1480 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:46.354330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:46.356135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:46.366391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:46.366895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:46.373124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:46.374263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:46.375526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:46.376778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:46.671723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:33:46.687565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a60de860-69e9-48f3-bf9a-9894d2f2c336 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1467 microversion: 2.1 time: 0.338234 Oct 11 01:33:46.689934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1754/3483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:33:46 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1467 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:46.734441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-865205440"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:46.744409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:33:46.761520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:46.762863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:46.763928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:46.785965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:46.787913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:46.789115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:47.189346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35baa210-9a0c-48b1-a63b-eae88c1f0112 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "POST /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c/action" status: 202 len: 0 microversion: 2.1 time: 0.460560 Oct 11 01:33:47.194621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1730/3484] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:33:46 2022] POST /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:33:47.206398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abf382b9-c91f-4ddf-bde9-4ac1b0ddc432 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1138809a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:47.280533 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abf382b9-c91f-4ddf-bde9-4ac1b0ddc432 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.078327 Oct 11 01:33:47.281504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1755/3485] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:47 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:47.804570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-unplugged", "status": "completed", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:47.824377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:47.827244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:47.828478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:47.856620 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] Creating event network-vif-unplugged:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:33:47.864951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8b25d00e-c644-4e5a-b5f2-76a830f526e9 req-bc5fad05-ad32-4c1f-b1f6-4c310dbdbd0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065369 Oct 11 01:33:47.866406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1731/3486] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:48.301457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-87b6cd82-deb8-4dc7-a52b-71504511d5fd tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6fe280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:48.393613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-87b6cd82-deb8-4dc7-a52b-71504511d5fd tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.100097 Oct 11 01:33:48.396715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1756/3487] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:48 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:49.411853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14b3a36e-c643-40ed-80b8-efdb048314c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387b19d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:49.544889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14b3a36e-c643-40ed-80b8-efdb048314c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.136707 Oct 11 01:33:49.556667 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1732/3488] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:49 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:50.500416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Calling method '.version_select at 0x7f112f17b280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:50.536489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:50.537724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:50.538346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:50.540305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:50.545183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:50.546009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:50.564288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2bb478fd-8f4c-4991-9788-136e1717879c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387d9b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:50.637906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11f8fea0-78c5-48e6-a555-66a95b5e76db tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] 10.222.0.66 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.637824 Oct 11 01:33:50.644673 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1757/3489] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Oct 11 01:33:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:33:50.665492 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2bb478fd-8f4c-4991-9788-136e1717879c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.106096 Oct 11 01:33:50.666417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1733/3490] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:50 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:51.085971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-365294553", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:51.207888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:33:51.685098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10863690-eb86-45af-aa27-c6ce773312e3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113419adc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:51.767728 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10863690-eb86-45af-aa27-c6ce773312e3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.089118 Oct 11 01:33:51.770927 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1734/3491] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:51 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:52.402521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Getting quotas for project f43b6167f6844dbf927fab0245b17283. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:33:52.413288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Getting quotas for user 705afac40f3d4809ae12c69d6f78d06d and project f43b6167f6844dbf927fab0245b17283. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:33:52.445613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Request method failure captured: Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 1751 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMf9fe5hr6KrDZjTX97Bet4ftBgETPrTfx01VYttWEXqLox-NQSgtr49AO2g5w-lLzsdVGDmTmWSPCN5B4fvYu-0Tzjfr9aLLfFHEt3zqs5BlEjuAsD0R7NZKTZ8djjORgP_KP9jHKdnjF7T2cjPQ7yn_AOtZMDbmlD_4vjYHFm1Rxo Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f43b6167f6844dbf927fab0245b17283 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1921827427 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f43b6167f6844dbf927fab0245b17283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f43b6167f6844dbf927fab0245b17283"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f43b6167f6844dbf927fab0245b17283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f43b6167f6844dbf927fab0245b17283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1921827427 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f43b6167f6844dbf927fab0245b17283 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1921827427 Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 705afac40f3d4809ae12c69d6f78d06d Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-365294553", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:33:52.447677 n-d-772273-9 devstack@n-api.service[120493]: exception: Maximum number of metadata items exceeds 128 Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-365294553', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:52.450899 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 11 01:33:52.454924 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:33:52.465356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:33:52.466184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5315a7f9-be18-4341-aa12-2acc265c72bc tempest-AbsoluteLimitsNegativeTestJSON-1921827427 tempest-AbsoluteLimitsNegativeTestJSON-1921827427-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.385159 Oct 11 01:33:52.473212 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1758/3492] 10.222.0.66 () {60 vars in 1148 bytes} [Tue Oct 11 01:33:51 2022] POST /compute/v2.1/servers => generated 87 bytes in 1392 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:33:52.787782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-822543c3-019e-4f79-bfbe-eab7cc714094 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d1b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:52.903259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-822543c3-019e-4f79-bfbe-eab7cc714094 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.121321 Oct 11 01:33:52.905089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1735/3493] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:52 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:33:53.921280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c393e143-3383-4782-bf95-0099a39e8161 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fa5f1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:53.999395 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c393e143-3383-4782-bf95-0099a39e8161 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.081048 Oct 11 01:33:54.001132 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1759/3494] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:53 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:55.020095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-518fe897-0180-4e75-950a-35667a52c4a3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11344385e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:55.027613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:33:56.107254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290745aa-d417-486a-992e-d62eae89a12c", "name": "network-vif-plugged", "status": "completed", "tag": "fc66c72e-d89b-4f1c-a1dc-05001344cfe4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:33:56.122725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:33:56.123212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:33:56.123676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:33:56.165130 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] Creating event network-vif-plugged:fc66c72e-d89b-4f1c-a1dc-05001344cfe4 for instance 290745aa-d417-486a-992e-d62eae89a12c on n-h2-772273-9 Oct 11 01:33:56.184289 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-00a96ff5-4903-458e-9b1c-e3b5a9fda8ee req-14f2d204-aa01-4adb-b2a5-1418f969f6f5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080150 Oct 11 01:33:56.187852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1760/3495] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:33:56.539932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-518fe897-0180-4e75-950a-35667a52c4a3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 1.526570 Oct 11 01:33:56.549879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1736/3496] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:55 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:33:57.562695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3bb38b0b-ad96-4f5d-8fb6-2f150611ecfa tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6fec10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:33:59.342201 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3bb38b0b-ad96-4f5d-8fb6-2f150611ecfa tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 1.787712 Oct 11 01:33:59.352543 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1761/3497] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:33:57 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:00.360843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0db52335-c68c-4e71-b123-d1f389530280 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d11f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:00.381288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:00.382451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:05.848063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0db52335-c68c-4e71-b123-d1f389530280 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 5.492948 Oct 11 01:34:05.849284 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1737/3498] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:00 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 5495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:06.865065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91f5d726-3326-480f-8549-da4f8213bdca tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f739b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:06.883966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:06.892881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:06.896744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:06.900485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:07.067592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91f5d726-3326-480f-8549-da4f8213bdca tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.206517 Oct 11 01:34:07.068526 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1762/3499] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:06 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:08.085994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-deebd400-cf7b-4a16-a2f2-c5ff8b2cb52b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6ebc10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:08.198557 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-deebd400-cf7b-4a16-a2f2-c5ff8b2cb52b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.110253 Oct 11 01:34:08.204283 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1763/3500] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:08 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:08.256507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-793649156", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "30166e65-bda8-4584-9029-1e1c5fa83901"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:08.414161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] validate_networks() for [('30166e65-bda8-4584-9029-1e1c5fa83901', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:34:09.215944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0c912b65-d6fe-4aaa-a7f3-5dfc0427ffaf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f739160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:09.351266 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0c912b65-d6fe-4aaa-a7f3-5dfc0427ffaf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.140764 Oct 11 01:34:09.353972 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1764/3501] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:09 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:10.370246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3de8d7fb-7ed0-419b-a1aa-5689af1e40f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387b4a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:10.516856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3de8d7fb-7ed0-419b-a1aa-5689af1e40f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.152243 Oct 11 01:34:10.518017 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1765/3502] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:10 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:10.792674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:34:10.793313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:34:10.793617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:34:10.794076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:34:10.794603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:34:10.840864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:10.841360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:10.841801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:10.842537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:10.842995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:10.843460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:10.918606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Getting quotas for project fc65fc21b134473f8df1f133a5ef5991. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:10.939799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Getting quotas for user 20b673ccee934e6a9089166dec557499 and project fc65fc21b134473f8df1f133a5ef5991. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:11.068090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:34:11.068090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:34:11.206722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62859e42-577e-4a46-9c15-efacc4fa89e1 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.700525 Oct 11 01:34:11.215678 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1738/3503] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:34:11.224010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9368970-0e1e-442e-b356-2aee18576c4d tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:11.224908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a9368970-0e1e-442e-b356-2aee18576c4d tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:11.347458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9368970-0e1e-442e-b356-2aee18576c4d tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:11.358624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9368970-0e1e-442e-b356-2aee18576c4d tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1215 microversion: 2.1 time: 0.134733 Oct 11 01:34:11.374878 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1766/3504] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:11 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:11.533263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbd63e82-ef8c-4819-a2f2-2e5e5440d2e2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134cdba60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:11.654885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbd63e82-ef8c-4819-a2f2-2e5e5440d2e2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.124279 Oct 11 01:34:11.658763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1739/3505] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:11 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:12.383997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d31d2f14-4f49-475b-a93b-e8fe8a4962ac tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:12.385363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d31d2f14-4f49-475b-a93b-e8fe8a4962ac tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:12.636084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d31d2f14-4f49-475b-a93b-e8fe8a4962ac tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:12.650405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d31d2f14-4f49-475b-a93b-e8fe8a4962ac tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1215 microversion: 2.1 time: 0.270178 Oct 11 01:34:12.651596 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1767/3506] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:12 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:12.675469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ebd3c81-5bb6-4c52-86ee-0563c1c4cdc0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343df1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:12.788758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ebd3c81-5bb6-4c52-86ee-0563c1c4cdc0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.118579 Oct 11 01:34:12.792995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1740/3507] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:12 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:13.674557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:13.678869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:13.719480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:13.731329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:13.741379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:13.747303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:13.756872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:13.760659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:13.812063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0bba31ea-0b7c-4994-ae5c-8a17f607758c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8faa60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:13.941170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0bba31ea-0b7c-4994-ae5c-8a17f607758c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.135337 Oct 11 01:34:13.954583 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1741/3508] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:13 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:14.310600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:14.319670 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89eb4ba5-c5e3-43fd-b840-b62a0081672a tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1267 microversion: 2.1 time: 0.649335 Oct 11 01:34:14.347169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1768/3509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:13 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1267 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:14.962405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-116e634a-12f2-4358-9b23-3fc82381415d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fabe310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:15.127592 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-116e634a-12f2-4358-9b23-3fc82381415d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.169363 Oct 11 01:34:15.128890 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1742/3510] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:14 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:15.350842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:15.351863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:15.366237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:15.366741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:15.367188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:15.375817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:15.376322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:15.376773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:15.590467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:15.607169 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-06228b81-3467-417b-b8b2-b5d85d5be182 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1273 microversion: 2.1 time: 0.266810 Oct 11 01:34:15.608001 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1769/3511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:15 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:16.144418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd432b06-1daa-4184-a1d8-e1429451b1cd tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8fa160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:16.282220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd432b06-1daa-4184-a1d8-e1429451b1cd tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.135282 Oct 11 01:34:16.283126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1743/3512] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:16 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:16.630131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:16.632813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:16.665571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:16.666246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:16.669354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:16.673960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:16.675064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:16.680670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:16.955812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:16.983676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98c09ef7-a53d-4341-a36b-d01612e1deae tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1273 microversion: 2.1 time: 0.354505 Oct 11 01:34:16.986049 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1770/3513] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:16 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:17.301665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6f786e5-e17b-4643-a6cb-ce8e210ec29a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134cdbca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:17.362334 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6f786e5-e17b-4643-a6cb-ce8e210ec29a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.067678 Oct 11 01:34:17.373080 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1744/3514] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:17 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:18.013117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:18.013753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:18.048190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:18.053416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:18.059756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:18.064857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:18.068554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:18.073792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:18.389448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51232c45-561c-41af-865a-e18d2ce502df tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1138775160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:18.506696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51232c45-561c-41af-865a-e18d2ce502df tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.131956 Oct 11 01:34:18.518080 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1745/3515] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:18 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:18.572113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:18.592239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96c6bb6e-8947-49a2-910e-8ed1ad70cce3 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 0.578903 Oct 11 01:34:18.593618 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1771/3516] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:18 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:19.526565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00112f3e-1265-4975-960b-81bd88c9f342 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d1430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:19.621099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:19.621749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:19.624268 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00112f3e-1265-4975-960b-81bd88c9f342 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.102986 Oct 11 01:34:19.625142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1746/3517] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:19 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:19.640052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:19.640545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:19.647849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:19.648926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:19.651747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:19.655417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:20.046925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:20.055308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6be8b7b3-b127-4eb0-90df-509ed9bd45c7 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 0.441737 Oct 11 01:34:20.066533 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1772/3518] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:19 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:20.423252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-474857734", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:20.495350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:34:20.640949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5379ef9f-2ebb-4e0c-be4c-2af108750baf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f781550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:20.722936 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5379ef9f-2ebb-4e0c-be4c-2af108750baf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.086044 Oct 11 01:34:20.723912 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1773/3519] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:20 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:20.862537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:20.888919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:20.968247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:21.089834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:21.091978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:21.108286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:21.109289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:21.110126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:21.127959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:21.129150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:21.132677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:21.581729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:34:21.582417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:34:21.584457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:34:21.585667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:34:21.586375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:34:21.620494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:21.624052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:21.625668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:21.630462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:21.631834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:21.633712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:21.721830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:21.747128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:21.798283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:34:21.807199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:34:21.824998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:21.845376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e173469-f7c1-41d0-bad4-54812be697cd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 0.759462 Oct 11 01:34:21.860111 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1774/3520] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:21 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:21.884522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d759754d-11d8-4809-9a62-9fb44271eb80", "tag": "c6a47a82-3898-403d-920d-4cb06167c3e2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:21.924245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:21.925941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:21.929789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:21.943381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c40f231-ad4e-4d83-9703-a0de9c1ffb0e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272356 Oct 11 01:34:21.948127 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1747/3521] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:34:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:34:21.963708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf172825-db72-4c25-82e4-0b0ee436bf8f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134296940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:22.008363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] Creating event network-changed:c6a47a82-3898-403d-920d-4cb06167c3e2 for instance d759754d-11d8-4809-9a62-9fb44271eb80 on n-h1-772273-9 Oct 11 01:34:22.044606 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e09948a6-73cd-4552-89b2-eec76d6d43d5 req-6716e3b2-5d60-4a03-bd45-b2ef9ec5b71f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171558 Oct 11 01:34:22.048467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1775/3522] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:22.081480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd1ff6ce-7b8d-40e7-b917-2720328eb4c3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:22.086763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd1ff6ce-7b8d-40e7-b917-2720328eb4c3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:22.095595 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf172825-db72-4c25-82e4-0b0ee436bf8f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.145296 Oct 11 01:34:22.096280 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1748/3523] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:21 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:22.393140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd1ff6ce-7b8d-40e7-b917-2720328eb4c3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:22.403262 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd1ff6ce-7b8d-40e7-b917-2720328eb4c3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1214 microversion: 2.1 time: 0.349223 Oct 11 01:34:22.404247 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1776/3524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:22 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:22.877907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:22.878544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:22.915090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:22.932836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:22.933305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:22.940193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:22.940694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:22.950939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:23.112856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-066b0303-acc5-4d7a-b883-1d1b30b4fa0a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f110ee0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:23.213397 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-066b0303-acc5-4d7a-b883-1d1b30b4fa0a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.104202 Oct 11 01:34:23.223025 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1777/3525] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:23 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:23.428943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5bf6180d-f5bc-4e2f-8ac5-f6f6e97e0916 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:23.429661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5bf6180d-f5bc-4e2f-8ac5-f6f6e97e0916 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:23.630480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:23.652009 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca80a5ea-c293-4ce6-a7ca-8769c46bdedf tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 0.779866 Oct 11 01:34:23.656390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1749/3526] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:22 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:23.715816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5bf6180d-f5bc-4e2f-8ac5-f6f6e97e0916 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:23.731736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5bf6180d-f5bc-4e2f-8ac5-f6f6e97e0916 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1214 microversion: 2.1 time: 0.301292 Oct 11 01:34:23.750596 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1778/3527] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:23 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1214 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:24.242476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f3d1ae0-ee74-4e22-8c51-c9d98d5204cf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fa641f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:24.348994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f3d1ae0-ee74-4e22-8c51-c9d98d5204cf tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.110786 Oct 11 01:34:24.370947 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1750/3528] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:24 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:24.686737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:24.688086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:24.706507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:24.707270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:24.711076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:24.712167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:24.712853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:24.713577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:24.757438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:24.758446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:24.770633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:24.771480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:24.772144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:24.776354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:24.777110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:24.783971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:25.533652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:25.561149 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72986fa7-c1d0-430d-a10c-d33c35e52c50 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1274 microversion: 2.1 time: 0.803749 Oct 11 01:34:25.575602 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1751/3529] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:24 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1274 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:25.582885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e8c108b-b460-4cf4-9722-7ad102fa9db2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8fa550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:25.678867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e8c108b-b460-4cf4-9722-7ad102fa9db2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.115588 Oct 11 01:34:25.687595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1752/3530] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:25 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:25.689111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:25.705698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1873ea34-e64d-4dce-bd0e-bcce13973aba tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 1.024752 Oct 11 01:34:25.730498 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1779/3531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:24 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:26.591206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:26.592170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:26.612879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:26.615189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:26.615859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:26.619628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:26.620605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:26.621756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:26.693935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b234279e-120c-4b77-b6ff-d391e2f9e7d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11388099d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:26.794681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b234279e-120c-4b77-b6ff-d391e2f9e7d3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.104340 Oct 11 01:34:26.802581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1780/3532] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:26 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:26.802581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:26.815774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:26.854363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:26.855300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:26.856127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:26.857502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:26.858027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:26.858669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:27.529891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:27.542432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99735276-2042-457e-b40b-c11af0a5c25e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.957600 Oct 11 01:34:27.545285 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1753/3533] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:26 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:27.810726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40449cf6-dffa-4ccd-a99c-8f9b15062de9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fa64280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:27.889207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40449cf6-dffa-4ccd-a99c-8f9b15062de9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.082906 Oct 11 01:34:27.897789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1754/3534] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:27 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:28.573334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:28.574160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:28.592290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:28.594497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:28.595878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:28.602277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:28.603241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:28.603885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:28.949592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:28.957669 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-06a512ad-c4b6-479c-b4b1-3f45aa30e211 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 2.160945 Oct 11 01:34:28.958258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1781/3535] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:26 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:28.994166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0552edff-9f4a-4f01-b7be-e60a1d7cb176 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fbe4d30>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:29.087101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0552edff-9f4a-4f01-b7be-e60a1d7cb176 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.106480 Oct 11 01:34:29.088117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1782/3536] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:28 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:29.730001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:29.741551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a344789-6996-41d7-aedf-ee1b29871e2c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 1.174049 Oct 11 01:34:29.752051 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1755/3537] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:28 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:29.986892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:29.988996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:30.009424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:30.027250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:30.029141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:30.030103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:30.032680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:30.033266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:30.103323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d3c6ded-e2da-487f-8ef0-70f401c52930 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8fad30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:30.188356 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d3c6ded-e2da-487f-8ef0-70f401c52930 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.088768 Oct 11 01:34:30.199552 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1756/3538] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:30 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:30.214928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d759754d-11d8-4809-9a62-9fb44271eb80", "name": "network-vif-plugged", "status": "completed", "tag": "c6a47a82-3898-403d-920d-4cb06167c3e2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:30.236513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:30.237009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:30.237451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:30.253820 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] Creating event network-vif-plugged:c6a47a82-3898-403d-920d-4cb06167c3e2 for instance d759754d-11d8-4809-9a62-9fb44271eb80 on n-h1-772273-9 Oct 11 01:34:30.271286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a32a2519-1230-4b91-ac64-74abce264408 req-c79da821-48fc-4c24-870a-5d6c850b7d78 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070312 Oct 11 01:34:30.274280 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1757/3539] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:30.780026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:30.780826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:30.790004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:30.791735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:30.792242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:30.797647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:30.798683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:30.799370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:30.801047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:31.031852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:31.045254 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b6f3479-3a22-4d49-b80c-a90008fc0997 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1315 microversion: 2.1 time: 1.063265 Oct 11 01:34:31.048019 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1783/3540] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:29 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:31.176141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:31.187306 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9d8e292-5f49-400f-9764-31911c7641e3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.412884 Oct 11 01:34:31.195788 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1758/3541] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:30 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:31.207270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4f41ec1-39ad-4de1-baae-ad50141b4e01 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387b4040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:31.303578 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4f41ec1-39ad-4de1-baae-ad50141b4e01 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.100145 Oct 11 01:34:31.313937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1784/3542] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:31 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:32.070807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:32.072670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:32.087102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:32.094617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:32.109337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:32.111819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:32.112949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:32.120800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:32.121240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:32.121696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:32.221135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:32.221778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:32.254493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:32.259624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:32.260302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:32.265223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:32.269720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:32.271289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.426073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:33.440466 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7bfaaf6e-e4b5-4548-869f-c8e7b07154fd tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1502 microversion: 2.1 time: 1.373908 Oct 11 01:34:33.441469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1759/3543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:32 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1502 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:33.528477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:33.528477 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cda5834b-dae9-4733-b76a-07b83361a803 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 1.287908 Oct 11 01:34:33.528477 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1785/3544] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:32 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:33.528477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-233307e0-7a4b-4013-b5f7-f5a25e20094c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387b4160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:33.602200 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-233307e0-7a4b-4013-b5f7-f5a25e20094c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.091685 Oct 11 01:34:33.603588 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1786/3545] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:33 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:33.616433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:33.616964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:33.643869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.644388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.644834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.645561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.646027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.652315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.753173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4099b2-9ca5-4e0f-9ae4-22daf5577341", "tag": "07c71681-6c3f-49f7-adf0-af577d2e759d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:33.786293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.800114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.800578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.812759 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] Creating event network-changed:07c71681-6c3f-49f7-adf0-af577d2e759d for instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 on n-h2-772273-9 Oct 11 01:34:33.817497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:33.829730 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3db25caa-1d8d-4e0b-afef-667a40629500 req-66038673-b636-40eb-8bf6-07b062274423 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386744 Oct 11 01:34:33.830360 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1760/3546] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:33.834109 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c85a6c0-7e9d-4a8d-846a-3346d76b7e48 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.227641 Oct 11 01:34:33.834746 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1787/3547] 10.222.0.66 () {58 vars in 1296 bytes} [Tue Oct 11 01:34:33 2022] DELETE /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80/os-server-password => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:34:33.845930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:33.846576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:33.860560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.861259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.861855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.862957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.863863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.864472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.920399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c9b561c-0ade-42e4-b729-815ba5cd4e37 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.078706 Oct 11 01:34:33.922169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1761/3548] 10.222.0.66 () {58 vars in 1293 bytes} [Tue Oct 11 01:34:33 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80/os-server-password => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:34:33.935906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:33.937227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:33.950169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.951136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.951865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:33.953024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:33.954413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:33.955100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:34.026403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:34:34.219505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e3c27cf-a1f9-4912-b3eb-12ed01c2e068 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 204 len: 0 microversion: 2.1 time: 0.290449 Oct 11 01:34:34.221667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1788/3549] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:34:33 2022] DELETE /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:34:34.229957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:34.230615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:34.244207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:34.245219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:34.246846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:34.249004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:34.249642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:34.250230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:34.540318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:34.541134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:34.561018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:34.562390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:34.564711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:34.565652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:34.569330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:34.571217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:34.762190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:34.773104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a0756c4-90ed-44cb-bb20-964f0ff93c67 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1508 microversion: 2.1 time: 0.547258 Oct 11 01:34:34.778049 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1762/3550] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:34 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:34.783846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fcee61c-899f-4446-9023-75bdc3c029e5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134dc7ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:34.866556 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fcee61c-899f-4446-9023-75bdc3c029e5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1454 microversion: 2.1 time: 0.087142 Oct 11 01:34:34.870755 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1763/3551] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:34 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:35.045715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:35.055852 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-162cf012-0b49-44da-8057-3708d8d20eeb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.522046 Oct 11 01:34:35.064393 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1789/3552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:34 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:35.818479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:35.819384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:35.846867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:35.848466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:35.849185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:35.850474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:35.851152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:35.851802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:35.886570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59f6b2c9-4a36-4e0e-a19a-4b447e4e5419 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f17b040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:35.979100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59f6b2c9-4a36-4e0e-a19a-4b447e4e5419 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1463 microversion: 2.1 time: 0.089907 Oct 11 01:34:35.980387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1790/3553] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:35 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1463 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:35.997396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d74f28f-976d-4539-8aa8-e25bffc8afd0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6eb9d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:36.078285 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d74f28f-976d-4539-8aa8-e25bffc8afd0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 200 len: 1463 microversion: 2.1 time: 0.087852 Oct 11 01:34:36.079230 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1791/3554] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:35 2022] GET /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:36.091234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:36.095734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:36.120657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:36.121370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:36.121913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:36.122747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:36.125271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:36.125842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:36.158562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:36.361605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:36.370008 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa7d5ef5-dead-48db-aab3-d48b66483a4c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1508 microversion: 2.1 time: 0.557249 Oct 11 01:34:36.370923 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1764/3555] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:35 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:36.375722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:36.376641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:36.383590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:36.384327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:36.385047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:36.386562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:36.387282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:36.387800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:36.552804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:36.561056 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-42a24e14-c29e-49c5-88ba-e9e0c314507f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.477324 Oct 11 01:34:36.561809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1792/3556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:36 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:37.324731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:37.334874 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce95ecb8-c509-4af5-b711-3841874b0a0e tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1481 microversion: 2.1 time: 0.962666 Oct 11 01:34:37.336253 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1765/3557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:36 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1481 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:37.396998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:37.398257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:37.404972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:37.412402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:37.413091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:37.414916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:37.416663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:37.417322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:37.418116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:37.594636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:37.596354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:37.602987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:37.603890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:37.604608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:37.607416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:37.608121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:37.608754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:38.014990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b673ccee934e6a9089166dec557499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc65fc21b134473f8df1f133a5ef5991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:38.025347 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf8d77f5-8f82-4253-bd37-19b3edbcefb0 tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 200 len: 1508 microversion: 2.1 time: 0.634959 Oct 11 01:34:38.032436 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1793/3558] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:37 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:38.181353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d759754d-11d8-4809-9a62-9fb44271eb80", "name": "network-vif-deleted", "tag": "c6a47a82-3898-403d-920d-4cb06167c3e2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:38.205715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:38.206614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:38.207286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:38.238609 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] Creating event network-vif-deleted:c6a47a82-3898-403d-920d-4cb06167c3e2 for instance d759754d-11d8-4809-9a62-9fb44271eb80 on n-h1-772273-9 Oct 11 01:34:38.250316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-104ef779-c92e-470d-952c-9c962e71e8be req-ecbd75ee-ee45-407a-aedb-095932fbb594 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071955 Oct 11 01:34:38.254253 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1794/3559] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:34:38.361082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:38.364746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:38.389939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:38.396588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:38.399409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:38.402030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:38.402698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:38.404256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:38.638932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:38.653096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8f1aec0-2ae3-4452-bae2-759a56f50c6d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 1.072017 Oct 11 01:34:38.654904 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1766/3560] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:37 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:38.984517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-422118447", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "77b8a9ff-84d1-4310-bc9d-728c0fb03714"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:39.081634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] validate_networks() for [('77b8a9ff-84d1-4310-bc9d-728c0fb03714', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:34:39.313278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:39.329481 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d44e19b-c5fc-4fa8-9442-5c256b692f1a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1468 microversion: 2.1 time: 0.972753 Oct 11 01:34:39.330827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1795/3561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:38 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1468 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:39.337191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:39.338216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] [instance: d759754d-11d8-4809-9a62-9fb44271eb80] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:39.351946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:39.354142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:39.355865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:39.356768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:39.358088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:39.364009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:39.391602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] HTTP exception thrown: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Request method failure captured: Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 HTTP/1.1 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgOj_Jcc8cvqUc10KgrytMj-x_Bhad1uk2jtovxEPuvsY3sRJQicflW532IDMEVRZBSQvdS2-SMOk11OYMhiNBCMQQgsUv6cr59F0QYmbrKcLgPW0YpFFwC3jupyB7AuT0cmic8isH7AucysGEV5fpZy_zzY24C-kKYwOWQwI7mPV4 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: fc65fc21b134473f8df1f133a5ef5991 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerPasswordTestJSON-1324361761 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fc65fc21b134473f8df1f133a5ef5991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fc65fc21b134473f8df1f133a5ef5991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fc65fc21b134473f8df1f133a5ef5991"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fc65fc21b134473f8df1f133a5ef5991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerPasswordTestJSON-1324361761 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: fc65fc21b134473f8df1f133a5ef5991 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1324361761 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerPasswordTestJSON-1324361761-project Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 20b673ccee934e6a9089166dec557499 Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerPasswordTestJSON-1324361761-project Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd759754d-11d8-4809-9a62-9fb44271eb80'} Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:34:39.392787 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. Oct 11 01:34:39.396119 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:39.407610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] Returning 404 to user: Instance d759754d-11d8-4809-9a62-9fb44271eb80 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:34:39.413151 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36bd887c-0797-4a5c-9e86-4cbfc207241c tempest-ServerPasswordTestJSON-1324361761 tempest-ServerPasswordTestJSON-1324361761-project] 10.222.0.66 "GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80" status: 404 len: 111 microversion: 2.1 time: 0.080550 Oct 11 01:34:39.421711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1796/3562] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:39 2022] GET /compute/v2.1/servers/d759754d-11d8-4809-9a62-9fb44271eb80 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:34:39.456414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-874920985"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:39.463677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:39.474325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:39.475148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:39.475860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:39.477603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:39.478295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:39.478954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:40.018221 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-23851add-c488-494d-84ee-bc766264f498 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "POST /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e/action" status: 202 len: 0 microversion: 2.1 time: 0.580896 Oct 11 01:34:40.022215 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1797/3563] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:34:39 2022] POST /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:34:40.036037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:40.039745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:40.097316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:40.101630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:40.102707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:40.107381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:40.109396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:40.110929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:40.207750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:34:40.208997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:34:40.209650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:34:40.210390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:34:40.211008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:34:40.225065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:40.225812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:40.226524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:40.227642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:40.228343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:40.229725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:40.257874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Getting quotas for project 84bd554df69748cab5206c359fa9be13. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:40.281034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Getting quotas for user bd9c6800db6148a99b479f616282f254 and project 84bd554df69748cab5206c359fa9be13. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:40.327392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:34:40.334127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:34:40.465403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ebeed577-f04a-4288-8528-7da8fb725bcc tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808194 Oct 11 01:34:40.466496 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1767/3564] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:34:40.477038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acc7c605-2464-4739-8edc-5dc2712661d1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d11f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:40.549386 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acc7c605-2464-4739-8edc-5dc2712661d1 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.081779 Oct 11 01:34:40.550649 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1768/3565] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:40 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:40.576693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-909f6d35-2718-4e95-89f6-d55406e8f090 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:40.581591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-909f6d35-2718-4e95-89f6-d55406e8f090 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:40.632056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:40.647097 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f22abc04-9cf5-47e3-aeee-aa5e9e2862ab tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.622512 Oct 11 01:34:40.647952 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1798/3566] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:40 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:40.755862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-909f6d35-2718-4e95-89f6-d55406e8f090 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:40.769003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-909f6d35-2718-4e95-89f6-d55406e8f090 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1213 microversion: 2.1 time: 0.216952 Oct 11 01:34:40.771789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1769/3567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:40 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:41.058039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290745aa-d417-486a-992e-d62eae89a12c", "name": "network-vif-unplugged", "status": "completed", "tag": "fc66c72e-d89b-4f1c-a1dc-05001344cfe4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:41.081069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:41.082207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:41.084020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:41.115790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] Creating event network-vif-unplugged:fc66c72e-d89b-4f1c-a1dc-05001344cfe4 for instance 290745aa-d417-486a-992e-d62eae89a12c on n-h2-772273-9 Oct 11 01:34:41.131084 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-77c45c65-6d8a-4544-98b6-f5d560726c00 req-b011f166-a1da-4b45-a1f1-d2bfa65aab60 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079048 Oct 11 01:34:41.135459 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1799/3568] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:41.565782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c44a36c1-2205-4d09-91a5-606b098c96b5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d1f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:41.634808 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c44a36c1-2205-4d09-91a5-606b098c96b5 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.072930 Oct 11 01:34:41.638535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1770/3569] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:41 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:41.675003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:41.675761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:41.690002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:41.691324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:41.692272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:41.696122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:41.698752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:41.702552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:41.800362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:41.801334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:41.811329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:41.812056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:41.812562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:41.813775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:41.814505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:41.818987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:41.968805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:41.979231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-400e8483-066c-4c8d-b0df-582d6cb79ebe tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1265 microversion: 2.1 time: 0.185471 Oct 11 01:34:41.983794 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1771/3570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:41 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:42.221478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:42.232977 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ffda1517-c308-4da0-ad54-77cbd6fa6c79 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.565178 Oct 11 01:34:42.234781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1800/3571] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:41 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:42.654628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-956eba3c-aaec-4712-915a-8e302feff210 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f8fa8b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:42.748014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-956eba3c-aaec-4712-915a-8e302feff210 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.098289 Oct 11 01:34:42.750998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1772/3572] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:42 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:43.009449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:43.019043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:43.037933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:43.038653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:43.039236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:43.040112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:43.040908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:43.043021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:43.163276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4099b2-9ca5-4e0f-9ae4-22daf5577341", "name": "network-vif-plugged", "status": "completed", "tag": "07c71681-6c3f-49f7-adf0-af577d2e759d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:43.173022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:43.184202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:43.184873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:43.185492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:43.187606 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9e37881-9d39-4b58-92e2-eece982fec2a tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1271 microversion: 2.1 time: 0.182744 Oct 11 01:34:43.188537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1801/3573] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:43 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:43.198614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] Creating event network-vif-plugged:07c71681-6c3f-49f7-adf0-af577d2e759d for instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 on n-h2-772273-9 Oct 11 01:34:43.205380 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-55623b3c-2be9-4578-80e4-a117bf63ec2b req-93e1931d-776f-4012-8688-cc6add998337 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Oct 11 01:34:43.205993 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1773/3574] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:43.269157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:43.271492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:43.285492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:43.287131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:43.287603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:43.292311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:43.293053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:43.293655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:43.544899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-97517031-6d66-4180-8caa-e9fc2ff5e139 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Action: 'create', calling method: .version_select at 0x7f11387d99d0>, body: {"keypair": {"name": "tempest-keypair-641881539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtxUuRmT5PxHa1b7ObfGMCsLDBqaoFfUwioMsgQj6Df6ozGu7puNSMFf5s5qBYSj98wcCMWb62lgea9/vyk0RzpTDm6DiGWuYuj9u/9bl1AuFIBSUu8sN92hyOtzQm/EA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:43.581826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-97517031-6d66-4180-8caa-e9fc2ff5e139 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Getting quotas for project 785964fd74584eeb95457d62851b721a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:43.598651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-97517031-6d66-4180-8caa-e9fc2ff5e139 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Getting quotas for user 8fdff778671b491ab31aebca665bb3b9 and project 785964fd74584eeb95457d62851b721a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:43.654242 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-97517031-6d66-4180-8caa-e9fc2ff5e139 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.114113 Oct 11 01:34:43.655784 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1774/3575] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:34:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:34:43.769047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-429bd839-18fb-4d83-ba0e-0eb5f01598fe tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1138775dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:43.799464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:43.811813 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8db7b23-ca05-484b-910a-5a9736ca0ac1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.554819 Oct 11 01:34:43.813261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1802/3576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:43 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:43.834892 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-429bd839-18fb-4d83-ba0e-0eb5f01598fe tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.074035 Oct 11 01:34:43.835734 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1775/3577] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:43 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:44.226023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:44.227483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:44.239325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:44.240605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:44.241680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:44.242819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:44.245780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:44.246496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:44.414086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:44.430224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83d042f4-1a22-4b65-94b7-48d8d8100228 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1271 microversion: 2.1 time: 0.216057 Oct 11 01:34:44.435394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1803/3578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:44 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:44.844168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:44.849175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:44.863018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:44.864000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:44.865217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:44.866173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:44.866903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:44.868074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:45.172913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:45.181326 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59a45e0f-21dc-4129-b960-d7e9f17d1406 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1314 microversion: 2.1 time: 0.350322 Oct 11 01:34:45.184813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1776/3579] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:44 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:45.192311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8bea0ad-5e3d-4eef-a80e-430ad0ab48b0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134c0e1f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:45.274248 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8bea0ad-5e3d-4eef-a80e-430ad0ab48b0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.085634 Oct 11 01:34:45.275560 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1777/3580] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:45 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:45.316901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Calling method '.version_select at 0x7f112f12e430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:45.318964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:45.319748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:45.320207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:45.351112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:45.352396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:45.352956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:45.370626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:45.371128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:45.371593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:45.378615 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-916087e9-519b-4b93-86ce-6286ae22e6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-659387172-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.531352 Oct 11 01:34:45.386199 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1804/3581] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:34:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:34:45.461522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:45.462473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:45.471897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:45.472793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:45.477365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:45.478611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:45.479479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:45.481052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:46.160820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:46.173891 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59cfa5e9-dc7f-4bce-be85-3e3b7977c476 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 0.721303 Oct 11 01:34:46.174486 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1778/3582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:45 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:46.218285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:46.221546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:46.241672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:46.244735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:46.245981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:46.246987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:46.249044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:46.250287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:46.299698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a545101-54a7-469c-8de6-00f91500f4f0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f5bf670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:46.387534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a545101-54a7-469c-8de6-00f91500f4f0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.098825 Oct 11 01:34:46.389503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1779/3583] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:46 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:46.853762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:46.865185 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70c32270-a02d-491c-b6aa-656a8c52d7ac tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1500 microversion: 2.1 time: 0.658078 Oct 11 01:34:46.866022 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1805/3584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:46 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1500 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:46.900656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:46.902338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:46.916474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:46.917377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:46.918122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:46.919697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:46.920165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:46.920592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:46.958586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:34:47.002007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:47.082164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7cac63b-2b5b-4e44-b1a1-6c69665d07d4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 204 len: 0 microversion: 2.1 time: 0.193071 Oct 11 01:34:47.083757 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1780/3585] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:34:46 2022] DELETE /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:34:47.093265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:47.094340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:47.102079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:47.103052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:47.104969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:47.105908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:47.106525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:47.107561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:47.202858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:47.204285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:47.215472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:47.216326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:47.218827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:47.221527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:47.222626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:47.222923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:47.367294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:47.386234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab7a84d9-dd4e-4aa4-9a8e-7601164f58cc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1506 microversion: 2.1 time: 0.298010 Oct 11 01:34:47.388966 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1806/3586] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:47 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:47.407958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfbfa6b0-592e-4854-a248-6462a5186744 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f7815e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:47.478529 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfbfa6b0-592e-4854-a248-6462a5186744 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.078378 Oct 11 01:34:47.481343 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1807/3587] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:47 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:47.567596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:47.577254 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b2e88c7-03a5-4559-a48e-175a2c47c157 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 0.382807 Oct 11 01:34:47.577857 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1781/3588] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:47 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:48.159879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3452aa64-424a-4102-816d-266e272707c6", "tag": "c3f68d05-fddc-44c5-98ba-37992dbd8e6e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:48.180688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.191483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.193856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.226454 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] Creating event network-changed:c3f68d05-fddc-44c5-98ba-37992dbd8e6e for instance 3452aa64-424a-4102-816d-266e272707c6 on n-h1-772273-9 Oct 11 01:34:48.241555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8eb0bbbe-c11e-4e34-bd62-004c38187ab7 req-91efe6d4-b80e-43a1-a139-bcae0e0b2f2b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080825 Oct 11 01:34:48.243383 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1808/3589] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:34:48.319197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-plugged", "status": "completed", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:48.354215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.354946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.355565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.372100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] Creating event network-vif-plugged:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:34:48.378675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-094be81c-a6ab-4f2f-b211-17c46196f691 req-d614445d-515b-476c-9f78-37ccc36fcb3b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065290 Oct 11 01:34:48.379686 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1782/3590] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:48.412521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:48.413447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:48.443470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.443470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.443470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.443470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.443470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.443934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.497546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5df868a-ebb7-4bcf-acb8-6791e6397751 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11342fa5e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:48.573183 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5df868a-ebb7-4bcf-acb8-6791e6397751 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.080348 Oct 11 01:34:48.574309 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1783/3591] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:48 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:48.603777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:48.605324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:48.626122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.626962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.627648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.629933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:48.633057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:48.633791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:48.757787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:48.766736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-198b1d3b-b267-477c-851d-ff25b33ba53a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1506 microversion: 2.1 time: 0.360337 Oct 11 01:34:48.779563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1809/3592] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:48 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:49.131008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:49.142248 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43810620-1000-4e0e-9d91-4796f5a787c2 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 0.544670 Oct 11 01:34:49.156318 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1784/3593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:48 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:49.603803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28cad94b-806c-4f1b-bceb-52cbe06e1961 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f12e1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:49.700700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28cad94b-806c-4f1b-bceb-52cbe06e1961 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.115097 Oct 11 01:34:49.702192 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1810/3594] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:49 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:49.792291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:49.793681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:49.805888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:49.806719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:49.808848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:49.812503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:49.813228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:49.817236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:50.102463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:50.137716 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc4c9b42-dd11-42c9-8bd1-54aca6700101 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 200 len: 1464 microversion: 2.1 time: 0.343515 Oct 11 01:34:50.142743 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1785/3595] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:49 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:50.169524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:50.170425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:50.190489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:50.196644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:50.197266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:50.201720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:50.202501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:50.205597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:50.238086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4099b2-9ca5-4e0f-9ae4-22daf5577341", "name": "network-vif-deleted", "tag": "07c71681-6c3f-49f7-adf0-af577d2e759d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:50.260575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:50.266871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:50.269889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:50.273686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:50.329477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] Creating event network-vif-deleted:07c71681-6c3f-49f7-adf0-af577d2e759d for instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 on n-h2-772273-9 Oct 11 01:34:50.343070 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-37fdac59-7093-4c1d-9fcf-e1bd956212cb req-1669be34-eb7f-4b92-a1ae-3fff405638a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108989 Oct 11 01:34:50.345543 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1786/3596] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:34:50.720705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed11beb4-15a3-4310-b5df-28583383c36a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387758b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:50.795082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed11beb4-15a3-4310-b5df-28583383c36a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.078906 Oct 11 01:34:50.795756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1787/3597] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:50 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:50.805583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:50.811169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-64262110", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d2470847-61b3-4219-a8ed-5f92bc83cac0"}, {"port": "52d6107a-faad-4585-82b7-209fc2869a8a", "tag": "port-1"}, {"port": "a001d4dc-bce3-4733-9a21-4df812b8cd37", "tag": "port-2"}, {"uuid": "e6787a08-5438-4827-9b99-8fbe7d273174", "tag": "net-1"}, {"uuid": "e6787a08-5438-4827-9b99-8fbe7d273174"}, {"uuid": "be8d3882-422e-4833-9248-5b627a52bef5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "be8d3882-422e-4833-9248-5b627a52bef5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "99cf7a94-1b8b-447c-951a-31e1adaa5958", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "37717fe4-be8f-49a9-96b4-73a7934ec7d4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2723bad2-2556-4093-b9fe-6bd4afa4e1de", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1830123393"}], "key_name": "tempest-keypair-641881539", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:50.827929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc721131-ef4d-4d82-8f83-6cd14c8ea21e tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 0.663129 Oct 11 01:34:50.845108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1811/3598] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:50 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:51.076072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] validate_networks() for [('d2470847-61b3-4219-a8ed-5f92bc83cac0', None, None, None, None, None), (None, None, '52d6107a-faad-4585-82b7-209fc2869a8a', None, None, None), (None, None, 'a001d4dc-bce3-4733-9a21-4df812b8cd37', None, None, None), ('e6787a08-5438-4827-9b99-8fbe7d273174', None, None, None, None, None), ('e6787a08-5438-4827-9b99-8fbe7d273174', None, None, None, None, None), ('be8d3882-422e-4833-9248-5b627a52bef5', '10.2.2.100', None, None, None, None), ('be8d3882-422e-4833-9248-5b627a52bef5', '10.2.2.200', None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:34:51.164912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:51.178940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:51.193917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:51.197070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:51.197532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:51.199994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:51.200503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:51.201847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:51.240879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:51.244543 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 HTTP/1.1 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4e4099b2-9ca5-4e0f-9ae4-22daf5577341'} Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:34:51.249313 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2e5281f-e962-48f3-a293-28f6c3c2573a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 404 len: 111 microversion: 2.1 time: 0.093267 Oct 11 01:34:51.253522 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1812/3599] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:51 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:34:51.483799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1193809153", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:51.651719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:34:53.614568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:34:54.755269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:34:54.755269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:34:54.755269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:34:54.756046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:34:54.756709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:34:54.781232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:54.781232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:54.781567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:54.782234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:54.782694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:54.783545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:54.828592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:54.840640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:54.871702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:34:54.882597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:34:55.042819 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e065333c-c169-4864-b0e6-cce3db03f500 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573178 Oct 11 01:34:55.043509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1813/3600] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:34:55.055257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-22db805a-4b8e-412a-a69a-5aef03a3512c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113898c3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:55.187171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-22db805a-4b8e-412a-a69a-5aef03a3512c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.135616 Oct 11 01:34:55.201421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1814/3601] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:55 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:55.212530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:55.213322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:55.236978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:55.237651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:55.241632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:55.242537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:55.243029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:55.249430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:55.564402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:55.581492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be1ce3de-9bae-42f2-a97e-3cfb4d3eb9ca tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 0.378851 Oct 11 01:34:55.597716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1815/3602] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:55 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:55.630560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3452aa64-424a-4102-816d-266e272707c6", "name": "network-vif-plugged", "status": "completed", "tag": "c3f68d05-fddc-44c5-98ba-37992dbd8e6e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:34:55.658291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:55.663119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:55.664054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:55.687891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] Creating event network-vif-plugged:c3f68d05-fddc-44c5-98ba-37992dbd8e6e for instance 3452aa64-424a-4102-816d-266e272707c6 on n-h1-772273-9 Oct 11 01:34:55.719253 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-32440c9e-68ad-4b87-8393-a0761ff50b04 req-f8d666de-fbc5-4dcb-901e-53f46143a474 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117116 Oct 11 01:34:55.720488 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1816/3603] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:34:55.728051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:55.729698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:55.902141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:55.909498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1215 microversion: 2.1 time: 0.187578 Oct 11 01:34:55.917219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1817/3604] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:55 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:55.918470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:55.919418 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e5a4484e-d075-4ae8-8e49-108489218d9b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001356 Oct 11 01:34:55.922007 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1818/3605] 10.222.0.66 () {56 vars in 886 bytes} [Tue Oct 11 01:34:55 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 01:34:56.204538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f12790a-527c-4028-929a-49cc88781583 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6ad940>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:56.267975 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f12790a-527c-4028-929a-49cc88781583 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.067171 Oct 11 01:34:56.268812 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1819/3606] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:56 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:56.610166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:56.611059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:56.622446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:56.624334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:56.628334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:56.630845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:56.633517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:56.635157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:57.624851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:57.657551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b72189ba-3864-42bc-86b0-8be350adaf16 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1313 microversion: 2.1 time: 1.051892 Oct 11 01:34:57.679324 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1820/3607] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:56 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1313 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:34:57.686570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:57.687423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:57.697559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:57.699583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:57.700193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:57.704591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:57.705285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:57.705910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:57.846753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:57.863205 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9b2fbe8-e50f-42dc-bf3b-7afb1dbef899 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1273 microversion: 2.1 time: 0.174870 Oct 11 01:34:57.864176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1821/3608] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:57 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:57.884070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1438cff3-0284-4aa4-9a01-9c40c8ccff30 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f69fb80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:57.970602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1438cff3-0284-4aa4-9a01-9c40c8ccff30 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.105156 Oct 11 01:34:57.971480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1822/3609] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:57 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:58.439626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:34:58.440091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:34:58.440527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:34:58.441001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:34:58.441386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:34:58.465302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:58.465822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:58.466277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:58.479791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:58.483429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:58.483905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:58.518382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Getting quotas for project 785964fd74584eeb95457d62851b721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:34:58.525877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Getting quotas for user 8fdff778671b491ab31aebca665bb3b9 and project 785964fd74584eeb95457d62851b721a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:34:58.687464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:58.688261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:58.701620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:58.702424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:58.705798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:58.707577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:58.709194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:58.709912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:58.859179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:34:58.862622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='99cf7a94-1b8b-447c-951a-31e1adaa5958',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='37717fe4-be8f-49a9-96b4-73a7934ec7d4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2723bad2-2556-4093-b9fe-6bd4afa4e1de',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:34:59.577616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-257262fb-faa7-40c8-823b-c7d9ea52528c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.780818 Oct 11 01:34:59.578389 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1788/3610] 10.222.0.66 () {62 vars in 1189 bytes} [Tue Oct 11 01:34:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 8782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:34:59.593206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:59.593865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:34:59.613586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:59.615772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:59.616437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:59.617371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:34:59.618001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:34:59.618609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:34:59.815414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:34:59.831259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6afc6bf-efc4-4187-a76d-da9d213e0f65 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1273 microversion: 2.1 time: 0.251857 Oct 11 01:34:59.833841 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1789/3611] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:59 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:59.851138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42d22c3b-f199-4852-b7f7-05a605536e21 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11341519d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:59.958196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42d22c3b-f199-4852-b7f7-05a605536e21 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.121692 Oct 11 01:34:59.968322 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1790/3612] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:34:59 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:34:59.985583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:34:59.987088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:00.114925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:00.134492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-360c925e-ca2f-4978-9647-f92d7580e68d tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1497 microversion: 2.1 time: 1.452416 Oct 11 01:35:00.152333 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1823/3613] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:34:58 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1497 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:00.426296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:00.445094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:00.447300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:00.450726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a2c35ae-0be1-4c4b-9ce5-17d93a80bc5d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1283 microversion: 2.42 time: 0.480402 Oct 11 01:35:00.455851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1791/3614] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:34:59 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1283 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:00.862690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:00.863826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:00.887809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:00.895273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:00.898061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:00.904438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:00.905818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:00.911989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:00.975835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cdbef57-1a7b-4fd8-a250-e05e3a98951c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343d11f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:01.086379 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cdbef57-1a7b-4fd8-a250-e05e3a98951c tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.115620 Oct 11 01:35:01.087293 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1792/3615] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:00 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:01.487751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:01.488371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:01.491021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:02.127991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:02.146611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:02.168508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:02.169923 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5567cf0-43e0-4aaa-8117-7c46f93a8c24 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1283 microversion: 2.42 time: 0.687334 Oct 11 01:35:02.173604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1793/3616] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:01 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1283 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:02.180661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d72ff72-ff24-4bff-9845-1ab2c7f53e3a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f5bf430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:02.222073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:02.233875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-339b7f76-a341-4a84-a27f-c63bffbfac6a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.380017 Oct 11 01:35:02.237235 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1824/3617] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:00 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:02.264505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d72ff72-ff24-4bff-9845-1ab2c7f53e3a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.089576 Oct 11 01:35:02.265099 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1794/3618] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:02 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:03.205159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:03.206063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:03.228846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:03.230965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:03.231465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:03.234725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:03.235220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:03.240388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:03.260245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:03.262350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:03.273187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:03.279220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:03.280012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:03.280888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:03.281473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:03.282138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:03.695437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:03.721764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:03.723405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:03.724625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81445b10-60cc-4c50-bfef-17721a8e5c87 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1573 microversion: 2.42 time: 0.529337 Oct 11 01:35:03.725197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1825/3619] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:03 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1573 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:03.745659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ff1aa67-cc45-44e5-a19e-194599ad1a54 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6eb700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:03.890036 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ff1aa67-cc45-44e5-a19e-194599ad1a54 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.159474 Oct 11 01:35:03.892079 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1826/3620] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:03 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:04.326551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:04.352967 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de1290c4-ba73-4ba6-88b1-4845cd5d5743 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.097944 Oct 11 01:35:04.373029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1795/3621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:03 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:04.792139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:04.793362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:04.803831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:04.804356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:04.805448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:04.806209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:04.806673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:04.807105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:04.808308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:04.909825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ab389d4-4dae-4bc8-b928-d94af9398c7b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134296940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:04.992590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ab389d4-4dae-4bc8-b928-d94af9398c7b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.088509 Oct 11 01:35:04.993633 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1796/3622] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:04 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:05.071406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:05.086712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:05.089705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:05.093710 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8686ff86-54ba-496b-a362-f00986ed1b98 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1591 microversion: 2.42 time: 0.307105 Oct 11 01:35:05.099397 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1827/3623] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:04 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1591 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:05.382862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:05.384273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:05.427794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:05.433403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:05.433884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:05.434665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:05.445746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:05.446247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:05.648793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:05.649588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:05.669524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:05.672578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:05.674244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:05.675161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:05.676751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:05.677832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:05.734247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:35:05.908936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:05.986602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72929c9e-2633-4510-9085-699b88d0f013 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 204 len: 0 microversion: 2.1 time: 0.341238 Oct 11 01:35:05.987863 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1828/3624] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:35:05 2022] DELETE /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:35:05.997972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:06.000263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:06.017191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:06.018521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:06.019510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:06.021975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:06.023370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:06.027038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:07.073770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:07.086963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a9ebd26-aa5b-40ef-a10d-c53349d0331d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.710434 Oct 11 01:35:07.087681 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1797/3625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:05 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:07.114558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c488ec9-58e1-4fbc-93a2-bd3a8a943464 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387d9940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:07.247397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c488ec9-58e1-4fbc-93a2-bd3a8a943464 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.136631 Oct 11 01:35:07.248011 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1798/3626] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:07 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:07.258304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:07.266982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:07.292890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:07.293322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:07.293809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:07.294546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:07.295018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:07.303938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:08.508468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:08.624172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:08.653478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:08.670898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:08.680401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-634c9f0d-e4bc-4f39-b157-f279ca93171a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1591 microversion: 2.42 time: 1.431289 Oct 11 01:35:08.686863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1799/3627] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:07 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1591 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:08.710493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e979900a-3ee2-4724-9f4e-df4c446c8a32", "tag": "b9b209f7-b400-4589-bdf5-39231a98e38f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:08.744890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:08.745438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:08.745866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:08.760084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] Creating event network-changed:b9b209f7-b400-4589-bdf5-39231a98e38f for instance e979900a-3ee2-4724-9f4e-df4c446c8a32 on n-h2-772273-9 Oct 11 01:35:08.766655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-491920a3-6925-4040-8a19-f67ec1b17038 req-30d4f423-1811-4fca-bae5-73bad4286162 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065104 Oct 11 01:35:08.770494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:08.795541 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1800/3628] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:08.800388 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e621997-462f-4881-8365-61d24f7a8afb tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1503 microversion: 2.1 time: 2.801270 Oct 11 01:35:08.814374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1829/3629] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:05 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1503 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:08.833315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:08.835515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:08.843301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e1f3d9f-b409-4ee3-812f-049a1ccd1a63 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f12eca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:08.862087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:08.865958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:08.866899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:08.869491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:08.871081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:08.871842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:08.943030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e1f3d9f-b409-4ee3-812f-049a1ccd1a63 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.125658 Oct 11 01:35:08.951547 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1830/3630] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:08 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:09.575147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:09.584140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca5b0716-8d45-4090-8047-0adb302cdf93 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 0.787057 Oct 11 01:35:09.588148 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1801/3631] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:08 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:09.720785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:09.721707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:09.737769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:09.743659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:09.746311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:09.749641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:09.751156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:09.751825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:09.752422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:09.829615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:09.830617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:09.842476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:09.848194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:09.850574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:09.853731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:09.855636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:09.857611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:09.985474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:10.003315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:10.010686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:10.013672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd77a11d-c26b-4ac5-8e97-37031b28d20e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1591 microversion: 2.42 time: 0.298149 Oct 11 01:35:10.029484 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1831/3632] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:09 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1591 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:10.042909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75326b2c-beb2-4a3b-812b-8e2bf4db0a20 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f6b3820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:10.105105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75326b2c-beb2-4a3b-812b-8e2bf4db0a20 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.073661 Oct 11 01:35:10.105973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1832/3633] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:10 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:10.361416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:10.387279 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b654dce-2bb0-4019-b5cf-50316eebab57 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1503 microversion: 2.1 time: 0.561679 Oct 11 01:35:10.409683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1802/3634] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:09 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:10.615011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:10.616345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:10.643368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:10.645967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:10.652135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:10.658305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:10.660258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:10.663565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.060653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:11.061349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:11.083179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.083723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.090268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.091712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.095116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.095623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.193461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:11.208184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8d39291-31ee-43fd-92b9-3802ac04eab4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 0.601716 Oct 11 01:35:11.228561 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1833/3635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:10 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:11.238263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3452aa64-424a-4102-816d-266e272707c6", "name": "network-vif-deleted", "tag": "c3f68d05-fddc-44c5-98ba-37992dbd8e6e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:11.266867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.267656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.268480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.309018 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] Creating event network-vif-deleted:c3f68d05-fddc-44c5-98ba-37992dbd8e6e for instance 3452aa64-424a-4102-816d-266e272707c6 on n-h1-772273-9 Oct 11 01:35:11.330767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2d677f3c-5545-4b5a-ad85-03761f55ee0b req-9e5a41df-bcb8-4ff7-bcb1-eba234faa3c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093510 Oct 11 01:35:11.332129 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1834/3636] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:11.346920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b321952a-bebf-435a-ac50-efb076935344 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f133af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:11.376677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:11.397870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:11.405705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:11.408360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9fa5d47-4849-45bb-a3dc-c314993ad783 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1591 microversion: 2.42 time: 0.353428 Oct 11 01:35:11.409868 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1803/3637] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:11 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1591 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:11.420630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:11.423035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:11.440536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.441041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.441488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.445025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.452293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.453204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.484072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b321952a-bebf-435a-ac50-efb076935344 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.147495 Oct 11 01:35:11.485133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1835/3638] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:11 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:11.529161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:11.529714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:11.530187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:11.530630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lazy-loading 'fault' on Instance uuid 3452aa64-424a-4102-816d-266e272707c6 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:35:11.908365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9c6800db6148a99b479f616282f254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bd554df69748cab5206c359fa9be13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:11.927322 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8fee12c3-ac90-4fd3-8849-133f244344c3 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 200 len: 1303 microversion: 2.1 time: 0.513633 Oct 11 01:35:11.930083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1804/3639] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:11 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 1303 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:12.255309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:12.260342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:12.279392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:12.281413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:12.283368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:12.286633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:12.290118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:12.292543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:12.440282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:12.441549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:12.448740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:12.467487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:12.467991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:12.474179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:12.476152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:12.480079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:12.481620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:12.871083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:12.888565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:12.896582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:12.906958 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9fda034-1a7d-4d9d-9b4a-c72b96ad4e1a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1659 microversion: 2.42 time: 0.472131 Oct 11 01:35:12.914291 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1805/3640] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:12 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1659 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:12.919500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85bd5e0f-1d83-4547-9b15-59f695980636 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f953550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:12.977231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:12.988609 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c9710fa3-d5b7-4756-8e70-364666a1e7fb tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 0.756117 Oct 11 01:35:12.990086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1836/3641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:12 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:12.996448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:12.997661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] [instance: 3452aa64-424a-4102-816d-266e272707c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:13.025930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85bd5e0f-1d83-4547-9b15-59f695980636 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.110161 Oct 11 01:35:13.027169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1806/3642] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:12 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:13.033499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:13.034108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:13.034649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:13.040441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:13.043523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:13.045476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:13.070826 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] HTTP exception thrown: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Request method failure captured: Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 HTTP/1.1 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgnhBd32BMndByF4YUtZGjxPs--6zG-MJhZ2Ih7W4nMauLXN-6_qCvg1L7Csdzar1a20n_OBWxJVa6_gC3kCcC6sqbZg9IuqYe-BwWcgUFrF-3q9OLUsYFZbUq3m40bZolDnkwocfzm6Z-x6KyQz2dZ8eKAx9ONzEC-eCQkiWa7GEE Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 84bd554df69748cab5206c359fa9be13 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesActionsTest-294432266 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/84bd554df69748cab5206c359fa9be13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_84bd554df69748cab5206c359fa9be13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/84bd554df69748cab5206c359fa9be13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/84bd554df69748cab5206c359fa9be13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesActionsTest-294432266 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 84bd554df69748cab5206c359fa9be13 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesActionsTest-294432266 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesActionsTest-294432266-project Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: bd9c6800db6148a99b479f616282f254 Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesActionsTest-294432266-project Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '3452aa64-424a-4102-816d-266e272707c6'} Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:13.079072 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. Oct 11 01:35:13.083065 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:13.087140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] Returning 404 to user: Instance 3452aa64-424a-4102-816d-266e272707c6 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:35:13.088199 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a51500d-edc4-46fd-9f9f-6a42d03f5f59 tempest-VolumesActionsTest-294432266 tempest-VolumesActionsTest-294432266-project] 10.222.0.66 "GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6" status: 404 len: 111 microversion: 2.1 time: 0.096853 Oct 11 01:35:13.094481 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1837/3643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:12 2022] GET /compute/v2.1/servers/3452aa64-424a-4102-816d-266e272707c6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:35:13.946007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:13.948702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:13.965914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:13.967932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:13.971395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:13.973010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:13.973657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:13.974935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:14.019929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:14.021310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:14.037993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:14.042815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:14.047228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:14.050310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:14.051269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:14.055405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:15.176331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:15.192632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:15.194425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:15.200432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a26de6e-64b6-4104-89f2-7c63ca10fa45 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1659 microversion: 2.42 time: 1.270129 Oct 11 01:35:15.204671 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1807/3644] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:13 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1659 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:15.216419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c900009-ebfc-41ea-b2ac-ad1eb7d95c1d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f9c1a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:15.298991 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c900009-ebfc-41ea-b2ac-ad1eb7d95c1d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1454 microversion: 2.1 time: 0.086873 Oct 11 01:35:15.307469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1808/3645] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:15 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:15.730627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:15.744092 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6770ac6-00d8-4519-92a3-79d402f90f11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.730636 Oct 11 01:35:15.759645 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1838/3646] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:14 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:16.231853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:16.232462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:16.249231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:16.249746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:16.250158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:16.250865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:16.251312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:16.267797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:16.383828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:17.076645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Calling method '.version_select at 0x7f11387b1ee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:17.079281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.079964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.080574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.115415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:17.147302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:17.148358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.150172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.151598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.165034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:17.195280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:17.199533 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08f50a44-b0bb-42d6-ade1-811603209c25 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1659 microversion: 2.42 time: 0.973521 Oct 11 01:35:17.204860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.208558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1839/3647] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:16 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1659 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:17.222545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.223016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.228495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2c061b6-7a54-4581-843c-3935663058ec tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f0e5820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:17.268955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7024c783-bd30-4e4f-9ae8-5cb373c7fda6 tempest-PortsAdminExtendedAttrsTestJSON-857475646 tempest-PortsAdminExtendedAttrsTestJSON-857475646-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.085501 Oct 11 01:35:17.269600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1809/3648] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 01:35:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:17.290562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:17.291200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:17.326816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.327323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.342832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.342974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.343463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.343939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.354943 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2c061b6-7a54-4581-843c-3935663058ec tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1463 microversion: 2.1 time: 0.144513 Oct 11 01:35:17.371605 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1840/3649] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:17 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:17.397191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1482ef13-0913-407b-9caa-4752864ef733 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f110160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:17.496482 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1482ef13-0913-407b-9caa-4752864ef733 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 200 len: 1463 microversion: 2.1 time: 0.111505 Oct 11 01:35:17.497328 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1841/3650] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:17 2022] GET /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 1463 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:17.514272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:17.514795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:17.532156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.532995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.535018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:17.537254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:17.538278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:17.545714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:18.493669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:18.511930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0bd5b116-141e-4f49-881d-d76f15c5fd42 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.232788 Oct 11 01:35:18.512941 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1810/3651] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:17 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:18.528686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:18.536523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:18.553288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:18.554080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:18.554726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:18.557860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:18.558573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:18.559171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:19.128925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:19.150662 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d98b31d-4369-4a50-ac72-0088db800de8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1480 microversion: 2.1 time: 1.643151 Oct 11 01:35:19.152755 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1842/3652] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:17 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1480 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:19.278216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:19.293412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:19.295323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:19.304980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4bcf83b-a578-4868-a7c5-a3206b757da1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1706 microversion: 2.42 time: 0.789453 Oct 11 01:35:19.315237 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1811/3653] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:18 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1706 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:19.538450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:19.539385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:19.549872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:19.555832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:19.556582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:19.560214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:19.562331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:19.563395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:19.969634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:19.985753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4938fa2-0614-4dcb-adfe-55f963763cd7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 0.451551 Oct 11 01:35:19.988104 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1843/3654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:19 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:20.175254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:20.175989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:20.186699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:20.189042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:20.189697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:20.190644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:20.192515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:20.193307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:20.343039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:20.344376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:20.353532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:20.356575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:20.357732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:20.360269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:20.361146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:20.365078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:20.878933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:20.895276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:20.897120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:20.898781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:20.905413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ae83001d-a134-41a3-ac3c-1e686f32b073 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1706 microversion: 2.42 time: 0.566437 Oct 11 01:35:20.928336 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e108ee08-4348-4ca5-9bd6-1f2e817ce701 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1467 microversion: 2.1 time: 0.757959 Oct 11 01:35:20.932180 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1844/3655] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:20 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1706 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:20.951649 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1812/3656] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:20 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1467 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:20.961204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e979900a-3ee2-4724-9f4e-df4c446c8a32", "name": "network-vif-plugged", "status": "completed", "tag": "b9b209f7-b400-4589-bdf5-39231a98e38f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:20.967805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4969aadd-5138-45cc-831b-5cb01a764411 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112faa08b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:20.975080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:20.976215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:20.976849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:21.020816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] Creating event network-vif-plugged:b9b209f7-b400-4589-bdf5-39231a98e38f for instance e979900a-3ee2-4724-9f4e-df4c446c8a32 on n-h2-772273-9 Oct 11 01:35:21.035941 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-455e440a-d519-4dff-8317-1e5b175505cc req-0e9bff14-96fb-411e-9d38-97b5b1cac761 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102038 Oct 11 01:35:21.036877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1845/3657] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:21.050256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.080308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:21.109081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:21.119236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:21.127135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:21.129049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:21.129802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:21.130472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:21.232168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4969aadd-5138-45cc-831b-5cb01a764411 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?changes-since=2022-10-11T01%3A32%3A28Z" status: 200 len: 1901 microversion: 2.1 time: 0.270177 Oct 11 01:35:21.235679 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1813/3658] 10.222.0.66 () {58 vars in 1199 bytes} [Tue Oct 11 01:35:20 2022] GET /compute/v2.1/images?changes-since=2022-10-11T01%3A32%3A28Z => generated 1901 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:21.247391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42c61e2d-0402-474a-b1c7-ab54abd28c68 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f85fc10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.319964 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42c61e2d-0402-474a-b1c7-ab54abd28c68 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-815544975" status: 200 len: 484 microversion: 2.1 time: 0.076280 Oct 11 01:35:21.328771 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1814/3659] 10.222.0.66 () {58 vars in 1229 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-815544975 => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:21.334964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5bc1923-281f-484a-8ee9-75a378fc6a54 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f9c85e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.506457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5bc1923-281f-484a-8ee9-75a378fc6a54 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?server=98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 956 microversion: 2.1 time: 0.175356 Oct 11 01:35:21.512452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1815/3660] 10.222.0.66 () {58 vars in 1209 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/images?server=98adc813-c919-45e7-8803-4bb1aa30864e => generated 956 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:21.525786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1e6b3e7-8411-4b6f-a136-f0380842838a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134c0e790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.622058 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1e6b3e7-8411-4b6f-a136-f0380842838a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 484 microversion: 2.1 time: 0.100474 Oct 11 01:35:21.624937 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1816/3661] 10.222.0.66 () {58 vars in 1317 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c => generated 484 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:21.641534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03c1ed57-0f8b-47e0-b721-d32074048054 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f113416f700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.745943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03c1ed57-0f8b-47e0-b721-d32074048054 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 484 microversion: 2.1 time: 0.111978 Oct 11 01:35:21.746882 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1817/3662] 10.222.0.66 () {58 vars in 1303 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c => generated 484 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:21.765521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc38f209-058c-4a42-ac40-7e39a31895a2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11387b15e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:21.990085 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cc38f209-058c-4a42-ac40-7e39a31895a2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3276 microversion: 2.1 time: 0.234164 Oct 11 01:35:21.994212 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1818/3663] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:22.007181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:22.008410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:22.047320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:22.048300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:22.049006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:22.051618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:22.053624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:22.054737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:22.718996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:22.730331 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b4ed706-b412-430b-b228-5ed881caf0e2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 1.689139 Oct 11 01:35:22.743364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1846/3664] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:22.743364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d488854-b10d-4547-a00c-7bb27f26c476 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f133550>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:22.804257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:22.828489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:22.829978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:22.831231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cd58b0c-d158-483f-8fb1-27de258050b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1753 microversion: 2.42 time: 0.831396 Oct 11 01:35:22.849973 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1819/3665] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:21 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1753 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:23.096584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-626b66a3-de86-4b53-a903-c7cdda79038e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: .version_select at 0x7f1134c0e3a0>, body: {"keypair": {"name": "tempest-keypair-488258380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsYS+QQAFKgVjW9S02DsMzwMpj1mLQQGqlrDa8s8tcq71FxORmWdfjJkdrluW2rCopufJP5KXSXKDGHMdVUFHup2HDuNiKq82NksJl87B21ZPjb3vwqDRomXfXMpb/WQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:23.147366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-626b66a3-de86-4b53-a903-c7cdda79038e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:35:23.176575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-626b66a3-de86-4b53-a903-c7cdda79038e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for user 56faf0ffbfe540a59e9c63bd23d7707a and project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:35:23.239168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-626b66a3-de86-4b53-a903-c7cdda79038e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.371026 Oct 11 01:35:23.240356 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1820/3666] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:35:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 390 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:35:23.251314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-unplugged", "status": "completed", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:23.255660 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d488854-b10d-4547-a00c-7bb27f26c476 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.512000 Oct 11 01:35:23.256333 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1847/3667] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 01:35:22 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:23.272543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a137a698-8c16-4dea-99e1-63418c454759 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f0e5b80>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:23.275841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:23.276593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:23.279929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:23.320207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] Creating event network-vif-unplugged:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:35:23.335572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d9b47e2e-20c2-4f00-b13d-c1c8c2f7fb88 req-4467be66-1860-4f71-a4c9-c3187bc3479f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093620 Oct 11 01:35:23.336185 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1821/3668] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:23.366978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a137a698-8c16-4dea-99e1-63418c454759 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.098382 Oct 11 01:35:23.368139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1848/3669] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:35:23 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:23.383632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7eb24b15-13f6-4e94-802e-78439a7ff8db tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343dfe50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:23.601077 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7eb24b15-13f6-4e94-802e-78439a7ff8db tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?changes-since=2022-10-11T01%3A32%3A23Z" status: 200 len: 6329 microversion: 2.1 time: 0.221503 Oct 11 01:35:23.601675 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1822/3670] 10.222.0.66 () {58 vars in 1220 bytes} [Tue Oct 11 01:35:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-11T01%3A32%3A23Z => generated 6329 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:23.630374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f78baac4-80b2-4db9-8dee-f01597628e4d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f12e1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:23.757320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:23.758064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:23.774366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:23.774864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:23.775304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:23.776030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:23.777050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:23.777486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:23.805441 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f78baac4-80b2-4db9-8dee-f01597628e4d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-815544975" status: 200 len: 664 microversion: 2.1 time: 0.180176 Oct 11 01:35:23.806047 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1849/3671] 10.222.0.66 () {58 vars in 1250 bytes} [Tue Oct 11 01:35:23 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-815544975 => generated 664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:23.861367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07878c7d-6155-4413-b030-c916c5a3215b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f133160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.028869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07878c7d-6155-4413-b030-c916c5a3215b tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1466 microversion: 2.1 time: 0.205548 Oct 11 01:35:24.053072 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1850/3672] 10.222.0.66 () {58 vars in 1338 bytes} [Tue Oct 11 01:35:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c => generated 1466 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:24.068782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.070064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:24.084162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:24.084943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:24.085575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:24.086480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:24.087130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:24.087811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:24.239425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:24.251664 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-554f7168-bbc0-44cc-bbbf-39b75ff048f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1315 microversion: 2.1 time: 0.498024 Oct 11 01:35:24.268231 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1823/3673] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:23 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:24.285808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5b3e782-1917-4bda-a4bd-d7e298c78208 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f85f550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.369130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5b3e782-1917-4bda-a4bd-d7e298c78208 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1466 microversion: 2.1 time: 0.098969 Oct 11 01:35:24.385893 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1824/3674] 10.222.0.66 () {58 vars in 1324 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F290745aa-d417-486a-992e-d62eae89a12c => generated 1466 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:24.397730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-edb67cf4-1c67-4c18-826d-b313e4e3543d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11343dfe50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.556199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-edb67cf4-1c67-4c18-826d-b313e4e3543d tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.168991 Oct 11 01:35:24.556816 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1825/3675] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:24.583945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1634dc27-2ac6-4da0-8573-6990901f7e0f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f85f9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.714027 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1634dc27-2ac6-4da0-8573-6990901f7e0f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.133253 Oct 11 01:35:24.714695 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1826/3676] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:24.744956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e085a25a-fb99-4ddd-b13a-de8a3c7b6422 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f9c18b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.821055 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e085a25a-fb99-4ddd-b13a-de8a3c7b6422 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74" status: 200 len: 784 microversion: 2.1 time: 0.092793 Oct 11 01:35:24.821766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1827/3677] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/images/2d331602-222c-492e-9d47-dfe2484eac74 => generated 784 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:24.845497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0fa9864-092a-4d03-890c-535009e08d14 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134255ee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.935537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0fa9864-092a-4d03-890c-535009e08d14 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.094760 Oct 11 01:35:24.937391 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1828/3678] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:24.956248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0f84f92-acfb-4a21-9c8d-dcb5ec042bb3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f9c14c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:24.964350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:24.978411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:24.981381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:24.984914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6d8b8bc-6b5e-4117-95f2-ec782018da2e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1753 microversion: 2.42 time: 0.928355 Oct 11 01:35:24.985876 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1851/3679] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:24 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1753 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:25.284244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:25.285817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:25.311225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:25.316492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:25.317292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:25.318345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:25.319009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:25.322486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:26.112399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:26.134593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ee2fb00-e296-49fe-aaca-87bad75705aa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1502 microversion: 2.1 time: 0.854163 Oct 11 01:35:26.143859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1852/3680] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:25 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1502 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:26.160225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:26.171871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:26.197170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:26.197994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:26.198731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:26.199655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:26.207505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:26.208159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:26.208278 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0f84f92-acfb-4a21-9c8d-dcb5ec042bb3 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465" status: 204 len: 0 microversion: 2.1 time: 1.256188 Oct 11 01:35:26.209246 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1829/3681] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:24 2022] DELETE /compute/v2.1/images/afea4bae-2019-4653-8d50-920a0405f465 => generated 0 bytes in 1258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:26.218464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d8b3072-ad29-4661-b5fb-6e321f86978a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f1134c0eb80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:27.191755 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d8b3072-ad29-4661-b5fb-6e321f86978a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71" status: 204 len: 0 microversion: 2.1 time: 0.977631 Oct 11 01:35:27.192882 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1830/3682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:26 2022] DELETE /compute/v2.1/images/ae8cd7ba-e780-42c2-a1b6-f902840a2f71 => generated 0 bytes in 980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:27.218086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44942572-b6f2-48d0-896b-00237ece569a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f11341ddee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:27.558847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:27.572201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:27.577039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:27.579278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f87d911e-a6c3-4cbb-a7a0-042c5a12831a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1800 microversion: 2.42 time: 1.434133 Oct 11 01:35:27.582126 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1853/3683] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:26 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1800 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:27.990646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44942572-b6f2-48d0-896b-00237ece569a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0" status: 204 len: 0 microversion: 2.1 time: 0.793733 Oct 11 01:35:27.991231 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1831/3684] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:27 2022] DELETE /compute/v2.1/images/2b7d2fac-e2fe-47b1-803c-c7df9a33bce0 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:35:27.999569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:28.000420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:28.019956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.020680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.021374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.022311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.032019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.032845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.111996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:35:28.274063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-511d3c52-cf21-44f2-a71a-b7b3138c11f8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 204 len: 0 microversion: 2.1 time: 0.278018 Oct 11 01:35:28.275825 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1854/3685] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:35:27 2022] DELETE /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:28.283874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:28.284624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:28.294359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.297095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.297810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.298708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.299420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.303818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.618634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:28.621211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:28.637265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.640763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.641526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.642759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:28.643486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:28.645113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:28.786782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:28.800013 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6850f94-188f-4384-97b7-b746150b4c74 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1474 microversion: 2.1 time: 0.520267 Oct 11 01:35:28.801546 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1832/3686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:28 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1474 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:29.192054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:29.202789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:29.205094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:29.208192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e52d04b6-5c1e-4a54-a2ab-237ce8a7ac44 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1800 microversion: 2.42 time: 0.596148 Oct 11 01:35:29.218497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6c23c08-ad92-4ab2-8d9d-fabe0687607a"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:29.222967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:29.231783 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1855/3687] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:28 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1800 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:29.248046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:29.248836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:29.249443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:29.250372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:29.252065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:29.257003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:29.787552 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6bbca8a5-b444-4d7f-8a3d-0e19d4b6e4e1 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573061 Oct 11 01:35:29.798468 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1833/3688] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:35:29 2022] POST /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:29.827585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:29.829370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:29.853230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:29.855633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:29.856783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:29.857685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:29.858279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:29.859104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:30.251431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:30.252167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:30.268393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:30.268906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:30.271967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:30.275544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:30.276156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:30.277167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:31.371272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:31.389252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81f65e4c-57a2-4188-bb95-e2c44e6c3d9f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1474 microversion: 2.1 time: 1.570245 Oct 11 01:35:31.392159 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1856/3689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:29 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1474 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:31.420818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:31.441493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:31.450258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:31.453263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6d275f7-1c59-495b-9a82-56527b51928a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1847 microversion: 2.42 time: 1.207108 Oct 11 01:35:31.458731 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1834/3690] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:30 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1847 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:32.244361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-820198191", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c83854a-4ccf-47a8-832a-9a9ff3fe1665"}], "security_groups": [{"name": "tempest-securitygroup--89852992"}], "key_name": "tempest-keypair-488258380", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:32.419893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:32.420968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:32.431499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:32.434498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:32.438447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:32.439099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:32.441433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:32.442589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:32.446572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:32.656133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:32.667122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b6bfed5-930b-494b-ac31-e1b433b45d4a tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1432 microversion: 2.1 time: 0.252554 Oct 11 01:35:32.671952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1835/3691] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:32 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1432 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:35:32.683707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:32.684512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:32.697557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:32.699459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:32.700416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:32.701331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:32.701964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:32.702554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:32.886991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] validate_networks() for [('6c83854a-4ccf-47a8-832a-9a9ff3fe1665', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:35:33.199508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:33.377316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:33.411965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:33.418195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:33.425403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd70d693-54d0-4afe-ba7a-b5f3cea375ee tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1847 microversion: 2.42 time: 0.749233 Oct 11 01:35:33.426359 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1836/3692] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:32 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1847 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:33.441472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "b510dbd3-acee-4e6e-b655-3ae36a550333"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:33.471291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:33.471858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:33.472299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:33.505100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] Creating event network-changed:b510dbd3-acee-4e6e-b655-3ae36a550333 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:33.522746 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4f4ffbd4-dcf4-4d14-b495-c3604b0f1b6d req-dcb7a230-c05b-4fc8-8725-0ec6ead71208 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093315 Oct 11 01:35:33.526646 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1837/3693] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:33.534116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290745aa-d417-486a-992e-d62eae89a12c", "name": "network-vif-deleted", "tag": "fc66c72e-d89b-4f1c-a1dc-05001344cfe4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:33.553372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:33.554050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:33.554668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:33.568854 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] Creating event network-vif-deleted:fc66c72e-d89b-4f1c-a1dc-05001344cfe4 for instance 290745aa-d417-486a-992e-d62eae89a12c on n-h2-772273-9 Oct 11 01:35:33.576199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1df0302d-f58c-4415-8f56-ccf0c46083ac req-9f5699ba-c0c6-4c91-a46a-58b9983dcc28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047514 Oct 11 01:35:33.577097 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1838/3694] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:33.699859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:33.705147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:33.744642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:33.746776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:33.748666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:33.749781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:33.751236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:33.751895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:33.868643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:33.869396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:33.870591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:33.871237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lazy-loading 'fault' on Instance uuid 290745aa-d417-486a-992e-d62eae89a12c {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:35:34.331150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:34.339779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e97ee8e9-3689-4944-a5b9-aa32fbfa481f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 200 len: 1308 microversion: 2.1 time: 0.652610 Oct 11 01:35:34.356061 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1839/3695] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:33 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:34.456322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:34.456988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:34.466029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:34.468564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:34.469271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:34.470242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:34.475104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:34.475921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:34.998101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:35:34.999366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:35:35.000245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:35:35.000883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:35:35.002292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:35:35.023236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.025287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.027387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.028530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.030429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.036263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.072099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:35:35.079155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for user 56faf0ffbfe540a59e9c63bd23d7707a and project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:35:35.098549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:35:35.103276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:35:35.111099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.128968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.130638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.132057 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab4645c5-32e3-420c-8856-9bb765426b6d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1868 microversion: 2.42 time: 0.680129 Oct 11 01:35:35.133041 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1840/3696] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:34 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1868 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:35.208217 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-688605a4-24db-4b15-86df-8ce900377719 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.968156 Oct 11 01:35:35.209708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1857/3697] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:35:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:35:35.220726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:35.221339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:35.329093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.341188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.342707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:35.352145 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fcdb72d-d133-4191-a639-88188a836070 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1280 microversion: 2.20 time: 0.134110 Oct 11 01:35:35.354307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1841/3698] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:35 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:35.377862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:35.378715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 290745aa-d417-486a-992e-d62eae89a12c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:35.386789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.387613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.388198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.389093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.389722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.390300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.406035 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] HTTP exception thrown: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Request method failure captured: Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c HTTP/1.1 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMemeF4DGlKxyhN8Hzs1P4Ot4C-Rl07WBIjztQ0YMIk_PBefXH6SgPmFN9r-hzjkihwD1IDzLxCywpl8CIJAjVkzgzCMGfow98ZcjWxOHeMTERNRVCotdfrNA5HwhlroYrT51bHfChWMNqJSdOT4o_OEm5WmaN-zTKJi8ctGeOh8ZW0 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 32895d0af242461faed7d72736e13a35 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32895d0af242461faed7d72736e13a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32895d0af242461faed7d72736e13a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32895d0af242461faed7d72736e13a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32895d0af242461faed7d72736e13a35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 32895d0af242461faed7d72736e13a35 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ListImageFiltersTestJSON-1933167946-project Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 0039fc3447f244ddb615297e0ec76fa4 Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ListImageFiltersTestJSON-1933167946-project Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '290745aa-d417-486a-992e-d62eae89a12c'} Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:35.409323 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. Oct 11 01:35:35.413623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:35:35.415175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Returning 404 to user: Instance 290745aa-d417-486a-992e-d62eae89a12c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:35:35.416226 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-afc63915-72e8-4c49-bfcc-70f2fa2f0902 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c" status: 404 len: 111 microversion: 2.1 time: 0.043005 Oct 11 01:35:35.417878 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1858/3699] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:35 2022] GET /compute/v2.1/servers/290745aa-d417-486a-992e-d62eae89a12c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:35:35.425799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:35.426524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:35.440906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.442104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.443005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.445017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.446688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.448810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.521049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:35:35.585620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:35.623139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "52d6107a-faad-4585-82b7-209fc2869a8a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:35.660798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.665677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.669227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.681237 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-085b9c12-814d-4899-ac60-3a635f5effa8 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 204 len: 0 microversion: 2.1 time: 0.259180 Oct 11 01:35:35.682404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1842/3700] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:35:35 2022] DELETE /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:35.705027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:35.705834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:35.714617 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] Creating event network-changed:52d6107a-faad-4585-82b7-209fc2869a8a for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:35.719036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.719580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.720020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.721709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:35.723969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:35.724608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:35.725291 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-26305747-654c-4ee6-931f-44def4c776e0 req-185210c8-0a58-47ff-a711-0827787fdd97 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104225 Oct 11 01:35:35.729121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1859/3701] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:36.159611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:36.160359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:36.175758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:36.176628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:36.177271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:36.178379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:36.179057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:36.179700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:36.377029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:36.390062 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cb4f4b5-4f69-4460-aa2d-3dfe7dc5aed0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1473 microversion: 2.1 time: 0.703066 Oct 11 01:35:36.404881 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1843/3702] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:35 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1473 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:36.416310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:36.417337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:36.425330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:36.426217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:36.426868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:36.427838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:36.428500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:36.429102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:36.909670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:36.926674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:36.928244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:36.929518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c6bb91e-6956-4389-97f6-43c153caf141 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1332 microversion: 2.20 time: 0.523082 Oct 11 01:35:36.930092 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1844/3703] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:36 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1332 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:37.418677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:37.419300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:37.429438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:37.429931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:37.430566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:37.431466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:37.432071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:37.435169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:37.467449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:37.500368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:37.506829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:37.508208 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15bda37f-a3ac-4405-844e-373df2967ffa tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1868 microversion: 2.42 time: 1.353138 Oct 11 01:35:37.509795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1860/3704] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:36 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1868 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:37.803577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "a001d4dc-bce3-4733-9a21-4df812b8cd37"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:37.830065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:37.831448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:37.832209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:37.847978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] Creating event network-changed:a001d4dc-bce3-4733-9a21-4df812b8cd37 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:37.857092 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-453a73b0-508f-4df7-8d1a-7bf720e97751 req-80828f0a-e265-482d-b7b4-6ae61d27efe6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060273 Oct 11 01:35:37.858100 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1861/3705] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:37.958370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:37.959276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:37.977578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:37.978338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:37.980810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:37.981748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:37.982339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:37.985856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:38.406057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:38.420046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:38.428587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:38.430132 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99767bbb-e536-49a6-9fe4-57220ceaa8e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1338 microversion: 2.20 time: 0.477979 Oct 11 01:35:38.430941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1862/3706] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:37 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1338 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:38.536030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:38.537431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:38.546803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:38.550133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:38.554180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:38.555889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:38.556610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:38.557256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:38.767276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:38.780610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03e5dca7-dc11-42e8-b500-de9ed3c195c9 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1473 microversion: 2.1 time: 1.366566 Oct 11 01:35:38.781776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1845/3707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:37 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1473 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:39.458914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:39.459740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:39.474955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:39.475686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:39.476293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:39.477156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:39.477612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:39.478253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:39.935927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:39.942662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:39.946181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:39.947698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:39.949451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e4e58c0-c1eb-4859-a7c0-a009463dd60d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1889 microversion: 2.42 time: 1.417749 Oct 11 01:35:39.960146 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1863/3708] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:38 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1889 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:39.975470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:39.976317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:39.978321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:39.984929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:39.985356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:39.985799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:39.986513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:39.986982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:39.987420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:40.077323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:40.078080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:40.078613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:40.079308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lazy-loading 'fault' on Instance uuid 98adc813-c919-45e7-8803-4bb1aa30864e {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:35:40.087490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:40.096679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:40.098118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:40.099481 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99de0f34-f704-415e-b56d-5077732af7eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.644436 Oct 11 01:35:40.112007 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1846/3709] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:39 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:40.124321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98adc813-c919-45e7-8803-4bb1aa30864e", "name": "network-vif-deleted", "tag": "141a4d35-a851-43cd-b920-80b1e5297567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:40.135784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:40.136987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:40.137571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:40.156234 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] Creating event network-vif-deleted:141a4d35-a851-43cd-b920-80b1e5297567 for instance 98adc813-c919-45e7-8803-4bb1aa30864e on n-h2-772273-9 Oct 11 01:35:40.161558 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-73d62120-2ba1-44a4-9dd5-958828880b4d req-04e2ff6d-afbd-43ae-9987-b6f0bcc31359 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048073 Oct 11 01:35:40.162685 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1847/3710] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:40.174125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0039fc3447f244ddb615297e0ec76fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32895d0af242461faed7d72736e13a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:40.205403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "d7ac2b47-05d7-4f7c-8500-83d41abe71b6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:40.207516 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aad229ea-a430-4127-a617-a5293f50c4b6 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 200 len: 1308 microversion: 2.1 time: 0.245972 Oct 11 01:35:40.210284 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1864/3711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:39 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:40.228880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:40.232320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:40.239723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:40.262249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] Creating event network-changed:d7ac2b47-05d7-4f7c-8500-83d41abe71b6 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:40.269559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-bf1ea52e-bf29-4b2e-9ab3-22569b791a59 req-14317e5c-a8fd-49c9-85c7-f543946a2c51 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104819 Oct 11 01:35:40.270344 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1848/3712] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:40.987194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:40.988547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:41.017551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.019061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.021703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.022470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.023102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.031949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.130485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:41.131192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:41.163267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.165140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.165596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.166341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.178377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.178836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.909203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.920276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.925999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.927625 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e5c2bda-34e5-4cdf-8a08-cc8c6faa0307 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.802052 Oct 11 01:35:41.928331 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1849/3713] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:41 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:41.940710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:41.941326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] [instance: 98adc813-c919-45e7-8803-4bb1aa30864e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:41.958490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.959236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.959850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.960683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:41.961274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:41.961829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:41.978253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.989425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.990016 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] HTTP exception thrown: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. Oct 11 01:35:41.991653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:41.993005 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d794ce43-2577-4705-9528-136fa72003d4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1889 microversion: 2.42 time: 1.010725 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Request method failure captured: Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e HTTP/1.1 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMemeF4DGlKxyhN8Hzs1P4Ot4C-Rl07WBIjztQ0YMIk_PBefXH6SgPmFN9r-hzjkihwD1IDzLxCywpl8CIJAjVkzgzCMGfow98ZcjWxOHeMTERNRVCotdfrNA5HwhlroYrT51bHfChWMNqJSdOT4o_OEm5WmaN-zTKJi8ctGeOh8ZW0 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 32895d0af242461faed7d72736e13a35 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32895d0af242461faed7d72736e13a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32895d0af242461faed7d72736e13a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32895d0af242461faed7d72736e13a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32895d0af242461faed7d72736e13a35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 32895d0af242461faed7d72736e13a35 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1933167946 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ListImageFiltersTestJSON-1933167946-project Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 0039fc3447f244ddb615297e0ec76fa4 Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ListImageFiltersTestJSON-1933167946-project Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '98adc813-c919-45e7-8803-4bb1aa30864e'} Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:35:41.993338 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Returning 404 to user: Instance 98adc813-c919-45e7-8803-4bb1aa30864e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-088ff8e1-3cca-46ea-82db-803575e5f4c0 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e" status: 404 len: 111 microversion: 2.1 time: 0.057892 Oct 11 01:35:41.997114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1850/3714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:41 2022] GET /compute/v2.1/servers/98adc813-c919-45e7-8803-4bb1aa30864e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:35:41.998327 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1865/3715] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:40 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1889 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:42.020654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c35b613b-5f31-4c84-bcaf-7c368d95dab2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f85f160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:42.490487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c35b613b-5f31-4c84-bcaf-7c368d95dab2 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417" status: 204 len: 0 microversion: 2.1 time: 0.487523 Oct 11 01:35:42.494020 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1851/3716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:41 2022] DELETE /compute/v2.1/images/244ab389-16ea-4f1f-9198-99b65c6fa417 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:42.501812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b39d5619-5829-4547-8905-f359d0668b4f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112f69f0d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:42.638273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "88b5f2a6-484e-422b-8d8d-041afd050a51"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:42.670040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:42.670526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:42.670961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:42.745026 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] Creating event network-changed:88b5f2a6-484e-422b-8d8d-041afd050a51 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:42.767623 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3cfef412-b28e-4b14-bfbf-177f9eed36f9 req-e7e8e9a3-56fb-48d3-a0c1-10a3ec1e6bfd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131310 Oct 11 01:35:42.769551 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1852/3717] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:42.981476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:42.985482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:43.011378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:43.013159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:43.017609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:43.018665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:43.020157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:43.022372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:43.080694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b39d5619-5829-4547-8905-f359d0668b4f tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349" status: 204 len: 0 microversion: 2.1 time: 0.583613 Oct 11 01:35:43.082042 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1866/3718] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:42 2022] DELETE /compute/v2.1/images/4edd6971-c8db-4494-b591-7ed4d66e3349 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:43.089524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:43.090355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:43.107963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:43.108950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:43.111068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:43.112046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:43.113020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:43.115102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:43.707188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.718510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.720696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.722847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.723308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60fcc850-efb8-486e-a108-475c51cb8e6a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.764165 Oct 11 01:35:43.724897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1853/3719] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:42 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:43.730005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4b007da-4b4e-4098-a3c7-4b9d7815ae88 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] Calling method '.version_select at 0x7f112fabe8b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:43.773867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.775371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:43.781677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6f507ed-90ce-475d-a113-129ded5c297e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.698463 Oct 11 01:35:43.786549 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1867/3720] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:43 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:44.170612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4b007da-4b4e-4098-a3c7-4b9d7815ae88 tempest-ListImageFiltersTestJSON-1933167946 tempest-ListImageFiltersTestJSON-1933167946-project] 10.222.0.66 "DELETE /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4" status: 204 len: 0 microversion: 2.1 time: 0.443897 Oct 11 01:35:44.175265 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1854/3721] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:43 2022] DELETE /compute/v2.1/images/4cdc5f6f-34b9-4d8f-83cf-07ef620f7ee4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:44.758795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:44.762214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:44.776497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:44.780068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:44.781156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:44.788865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:44.788865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:44.788865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:44.816724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:44.819267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:44.841412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:44.845136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:44.845813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:44.860925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:44.862384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:44.863088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:45.059763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:45.088543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:45.328950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.339678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:45.378496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.385503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.389765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.391818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.393413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b6ea384-522e-4f6d-af05-2410575b1c67 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.642936 Oct 11 01:35:45.393726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:45.409770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67aa2888-8e29-40e4-853a-8aabbcb11ee0 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.586339 Oct 11 01:35:45.409770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1855/3722] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:44 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:45.409770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:45.418516 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1868/3723] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:44 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:45.424316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:45.425460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:45.426587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:45.455709 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] Creating event network-changed:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h1-772273-9 Oct 11 01:35:45.462197 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-99ac15eb-a179-44be-89a2-18bd960da75c req-69780d0a-8913-498b-8ec2-7edcc6c59996 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062484 Oct 11 01:35:45.463245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1856/3724] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:46.436506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:46.437009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:46.437367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:46.438338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:46.447363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:46.449027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:46.449685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:46.450795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:46.451509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:46.452169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:46.455295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:46.455828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:46.456267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:46.456971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:46.458891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:46.459396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:46.925235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.930983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.958044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.961837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.963219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.966580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:46.968576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bb2e3ed-76b8-4b9d-a888-135e124830d9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.535845 Oct 11 01:35:46.969452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1857/3725] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:46 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:35:46.994760 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0a61518-238a-4eb6-b515-ca4040fc244d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.568100 Oct 11 01:35:46.998594 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1869/3726] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:46 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:47.284953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Calling method '.version_select at 0x7f112fabe9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:47.302753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:47.303586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:47.304321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:47.305409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:47.306040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:47.306623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:47.334550 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2a3d208-cba2-4ba5-8004-acf9b9eea474 tempest-AbsoluteLimitsTestJSON-726593423 tempest-AbsoluteLimitsTestJSON-726593423-project] 10.222.0.66 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.351518 Oct 11 01:35:47.348015 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1858/3727] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Oct 11 01:35:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:47.502153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "d2e62e92-5fe7-440b-9b51-94c01c3b6ff2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:47.535113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:47.535632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:47.536074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:47.574820 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] Creating event network-changed:d2e62e92-5fe7-440b-9b51-94c01c3b6ff2 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:47.592602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d8943536-84ad-4041-8b25-7e990e78ad40 req-87401988-a670-4532-9add-7509d6667217 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095779 Oct 11 01:35:47.596579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1870/3728] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:47.999377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:48.000064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:48.008394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:48.022125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:48.022773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:48.024217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:48.024834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:48.025424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:48.029731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:48.031998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:48.077289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:48.079320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:48.081410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:48.087642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:48.090841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:48.092619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:48.863638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:48.892985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:48.898913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:48.904715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d6e21ff-0232-4f42-b4ac-66949cc16119 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 0.904789 Oct 11 01:35:48.910992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1859/3729] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:47 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:48.972763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:49.003164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:49.010107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:49.013137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-165d7dd5-54dd-48a4-bcbd-c1e984fce619 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.991609 Oct 11 01:35:49.017254 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1871/3730] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:48 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:49.624825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "2384d352-10d1-4281-aa0f-caf21e0925fb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:49.641503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:49.648027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:49.648702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:49.675153 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] Creating event network-changed:2384d352-10d1-4281-aa0f-caf21e0925fb for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:35:49.685517 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9647728d-6818-4f3d-9176-8267c4274682 req-afb641a2-daf3-4a1a-af9b-97d393da1e7e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064790 Oct 11 01:35:49.686635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1860/3731] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:49.889171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:49.890408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:49.899712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:49.900633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:49.902912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:49.905203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:49.905912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:49.906675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:49.936053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:49.937245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:49.945766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:49.946743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:49.947671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:49.948997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:49.949920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:49.950590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:49.960622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:35:50.157374 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-adad5218-2ef0-47c0-ab32-f9584ee0b879 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 204 len: 0 microversion: 2.1 time: 0.274040 Oct 11 01:35:50.158358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1872/3732] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:35:49 2022] DELETE /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:35:50.163964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:50.164676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:50.179992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:50.180496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:50.180939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:50.181653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:50.182108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:50.182537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:51.019555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.028887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.030351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.031552 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e5721d2-1601-4c83-a6c6-64baf9d854e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 1.101598 Oct 11 01:35:51.032133 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1861/3733] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:49 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:51.064516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:51.069902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:51.083038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:51.083806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:51.084409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:51.085289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:51.088490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:51.089727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:51.318485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.335095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.338261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.340586 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3111d777-b090-4606-b31c-fe16fcf75837 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.181027 Oct 11 01:35:51.342043 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1873/3734] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:50 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:51.348395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "name": "network-vif-plugged", "status": "completed", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:51.362876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:51.364135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:51.364922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:51.380286 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] Creating event network-vif-plugged:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h1-772273-9 Oct 11 01:35:51.388536 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-94567a2d-4b32-4a59-b9fc-f8a77b3c959d req-90ce713b-6553-4cd9-9e93-de802f91b096 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Oct 11 01:35:51.389640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1874/3735] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:35:51.626747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:51.640423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b39750b-4a7b-42e7-994d-c805b1e37a99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1554 microversion: 2.1 time: 0.581084 Oct 11 01:35:51.659086 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1862/3736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:51 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1554 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:52.059537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:52.060819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:52.070256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:52.071135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:52.071925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:52.072862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:52.073636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:52.074281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:52.371999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:52.373172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:52.380669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:52.381507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:52.382140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:52.383824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:52.384481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:52.385259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:53.074398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.082986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.084606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.085939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50018240-a21b-4a40-8283-b0b58c57e6ae tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1404 microversion: 2.20 time: 1.032478 Oct 11 01:35:53.087009 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1875/3737] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:52 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1404 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:53.092446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:53.093269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:53.100727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:53.101569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:53.102147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:53.103117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:53.103756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:53.104329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:53.517260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.532969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.536986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.538954 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b993d977-f214-4f43-844f-659a7459a4ad tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.171485 Oct 11 01:35:53.539849 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1863/3738] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:52 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:53.692044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:53.711613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67c55365-9aab-45a3-9b0e-a55395b0d851 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1554 microversion: 2.1 time: 0.621887 Oct 11 01:35:53.711613 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1876/3739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:53 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1554 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:54.114447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:54.115069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:54.129715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:54.130212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:54.134104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:54.134894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:54.135381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:54.137483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:54.330285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e979900a-3ee2-4724-9f4e-df4c446c8a32", "name": "network-vif-deleted", "tag": "b9b209f7-b400-4589-bdf5-39231a98e38f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:35:54.350086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:54.350590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:54.351127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:54.397641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] Creating event network-vif-deleted:b9b209f7-b400-4589-bdf5-39231a98e38f for instance e979900a-3ee2-4724-9f4e-df4c446c8a32 on n-h2-772273-9 Oct 11 01:35:54.410699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0416a4ef-dd7d-4839-a311-f409a121ad36 req-7b584c22-6467-4235-aff0-08794a8f041f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086770 Oct 11 01:35:54.414173 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1877/3740] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:35:54.573424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:54.574429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:54.592749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:54.599293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:54.600661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:54.601975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:54.607621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:54.608287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:55.862944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:55.866989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:55.896381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:55.902450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:55.907826 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-641482fa-d3cc-4537-95d5-b6e120ac6408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1596 microversion: 2.20 time: 1.795066 Oct 11 01:35:55.908691 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1864/3741] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:54 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1596 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:55.920789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:55.923013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:55.940795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:55.944001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:55.944671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:55.946296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:55.948286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:55.950328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:56.527554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:56.546773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b65d5e55-356f-43e9-ac22-11cef1376d2b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1346 microversion: 2.1 time: 0.636657 Oct 11 01:35:56.600197 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1865/3742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:55 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1346 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:56.618553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:56.619052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:56.633608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:56.637718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:56.638489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:56.641299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:56.642034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:56.645222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:56.718618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:56.732507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:56.739449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:56.741325 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a726e464-9ecd-4f9e-8e9b-d894ed6272a4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 2.174016 Oct 11 01:35:56.742501 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1878/3743] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:54 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:57.049617 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc0afb3d-edc6-46f3-87ea-82b06ca04663 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.445364 Oct 11 01:35:57.050616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1866/3744] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:35:56 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-interface => generated 285 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:35:57.629917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:57.631381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:57.645821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:57.646609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:57.654391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:57.656944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:57.658919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:57.659687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:57.768699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:57.769967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:35:57.776213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:57.777477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:57.786520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:57.787290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:57.787998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:57.788935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:57.789634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:57.790776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:58.340327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:58.353745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c052a121-13e6-4b70-bc1a-94902166e88c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1346 microversion: 2.1 time: 0.729182 Oct 11 01:35:58.371582 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1879/3745] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:57 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1346 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:58.868657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:58.882629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:58.894127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:58.895416 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-559951d1-bc46-442d-95ed-32144df97610 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.127625 Oct 11 01:35:58.896008 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1867/3746] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:57 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:35:59.394263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:59.395044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:59.403024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:59.410557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:59.411175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:59.412060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:59.412652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:59.413188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:59.903679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:35:59.921333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41cfb0c3-8b3f-4f29-909e-02e7176fa2f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1346 microversion: 2.1 time: 0.530955 Oct 11 01:35:59.922388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:35:59.922837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1880/3747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:35:59 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1346 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:35:59.923016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:35:59.939012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:59.939550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:59.940003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:35:59.940739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:35:59.941202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:35:59.941638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:00.953642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:00.957979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:00.969542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:00.976515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:00.980682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:00.982745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:00.983054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:00.985227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:00.985556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:00.987114 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1d856a7-1ec0-49bf-b871-5c4df47a649e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.068703 Oct 11 01:36:00.988445 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1868/3748] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:35:59 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:00.996683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:00.997280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:01.039072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:01.146054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:01.162420 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0619e0b-da98-4834-8826-ad3069c93a21 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 200 len: 1346 microversion: 2.1 time: 0.215438 Oct 11 01:36:01.163545 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1881/3749] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:00 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:02.021168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:02.021816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:02.033683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.037044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.038679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.040839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.041514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.042862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.189204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:02.189993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:02.205384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.206872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.209343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.211422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.212657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.216587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.257928 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 HTTP/1.1 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e979900a-3ee2-4724-9f4e-df4c446c8a32'} Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:02.262525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.266358 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.270569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:36:02.271515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2be429ce-c911-4707-a94c-5d3fe59f81f6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 404 len: 111 microversion: 2.1 time: 0.086562 Oct 11 01:36:02.272436 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1882/3750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:02 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:36:02.483143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:02.485877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:02.513593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.514120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.514567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.515302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:02.515801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:02.516262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:02.561305 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32/os-volume_attachments HTTP/1.1 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': 'e979900a-3ee2-4724-9f4e-df4c446c8a32'} Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:36:02.563084 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9757b3b6-cdb7-4aa5-b0d6-147917fce7ed tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086282 Oct 11 01:36:02.570275 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1883/3751] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:36:02 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:36:02.638587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:02.656026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:02.657806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:02.659208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-016db79c-5a7b-415d-b693-411ff1552d22 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.650200 Oct 11 01:36:02.664310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1869/3752] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:02 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:02.841416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1074882281", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:02.969401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:36:03.483571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:03.490989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:03.511755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:03.518415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:03.519924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:03.571057 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] Creating event network-changed:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h1-772273-9 Oct 11 01:36:03.584363 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9a89069c-3aff-4d6d-b14b-403f2c1a53af req-4fe48bde-df20-496d-bad0-8fb7da8b6ae1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104304 Oct 11 01:36:03.588185 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1870/3753] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:03.696713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:03.697672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:03.712198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:03.715522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:03.715683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:03.716662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:03.717414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:03.717949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:04.310237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:36:04.310759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:36:04.311330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:36:04.311863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:36:04.313195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:36:04.331819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:04.332567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:04.333488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:04.335168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:04.338360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:04.339234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:04.379365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:36:04.400942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:36:04.436085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:36:04.439419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:36:04.567094 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8cefdf0d-7bfd-41f4-8663-d3f21704f944 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731378 Oct 11 01:36:04.576906 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1884/3754] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:36:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:36:04.584495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-169521d6-b0bf-43ac-8362-9fde65482b18 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:04.585549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-169521d6-b0bf-43ac-8362-9fde65482b18 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:04.733912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-169521d6-b0bf-43ac-8362-9fde65482b18 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:04.746990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-169521d6-b0bf-43ac-8362-9fde65482b18 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd" status: 200 len: 1215 microversion: 2.1 time: 0.167254 Oct 11 01:36:04.770493 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1885/3755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:04 2022] GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:04.779565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc012cba-66c6-4d06-a617-32172d10145d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:04.780489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc012cba-66c6-4d06-a617-32172d10145d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:04.840729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc012cba-66c6-4d06-a617-32172d10145d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:36:05.083839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:05.109957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:05.121616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:05.123041 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d90274b0-fc31-4655-8925-37ce4f0568c1 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.430899 Oct 11 01:36:05.127902 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1871/3756] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:03 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:05.511110 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.compute.api [None req-dc012cba-66c6-4d06-a617-32172d10145d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Instance Mapping does not exist while attempting local delete cleanup. Oct 11 01:36:05.512871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc012cba-66c6-4d06-a617-32172d10145d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd" status: 204 len: 0 microversion: 2.1 time: 0.740613 Oct 11 01:36:05.516653 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1886/3757] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:36:04 2022] DELETE /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:36:05.531260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:05.533176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:05.543626 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd HTTP/1.1 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd'} Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:05.547045 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:05.554117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:05.554117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:36:05.554117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:36:05.554117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:36:05.554117 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:05.557134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:36:05.562148 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0051b8a8-be7d-4a73-92f1-d37d9f90b131 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd" status: 404 len: 111 microversion: 2.1 time: 0.040822 Oct 11 01:36:05.568755 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1872/3758] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:05 2022] GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:36:05.657604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-696186578", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:05.765830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:36:06.157967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:06.159329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:06.170661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:06.172899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:06.173965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:06.176914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:06.177417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:06.177871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:07.463062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:07.481317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:07.482620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:07.486258 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9666297f-11a4-4b24-afd5-ce63c25d5098 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.332242 Oct 11 01:36:07.516353 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1873/3759] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:06 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:08.475736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:36:08.476760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:36:08.477456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:36:08.477941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:36:08.478429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:36:08.498425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:08.499194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:08.500272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:08.502662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:08.503414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:08.505479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:08.530917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:08.532368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:08.541636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:08.543139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:08.543891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:08.545828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:08.546564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:08.547522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:08.558243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:36:08.574960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:36:08.590770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:36:08.593459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:36:08.690083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cef112d3-a694-46b3-a84d-7a5f47510b00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.037217 Oct 11 01:36:08.691496 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1887/3760] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:36:08.711680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ddf1683d-6c6f-4ec0-93dd-907114b553f9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:08.712310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ddf1683d-6c6f-4ec0-93dd-907114b553f9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:08.886496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ddf1683d-6c6f-4ec0-93dd-907114b553f9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:08.896348 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ddf1683d-6c6f-4ec0-93dd-907114b553f9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1214 microversion: 2.1 time: 0.195475 Oct 11 01:36:08.913231 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1888/3761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:08 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:09.523690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:09.540115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:09.541808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:09.547382 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f13cc554-3afc-4680-ac1e-c6456c005953 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.021160 Oct 11 01:36:09.572672 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1874/3762] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:08 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:09.924953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:09.926248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:09.955575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:09.956725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:09.957837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:09.958808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:09.959532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:09.960180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:10.192273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:10.207651 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8466e69c-18d9-4b3d-9bd8-0b1c5076eeec tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1266 microversion: 2.1 time: 0.286538 Oct 11 01:36:10.224882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1889/3763] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:09 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:10.581830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:10.582436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:10.597281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:10.597797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:10.598244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:10.599302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:10.604078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:10.604761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:11.114476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:11.150965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:11.152621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:11.153829 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6035118-2c0a-4818-a5f6-4ee52df626c4 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.577718 Oct 11 01:36:11.154747 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1875/3764] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:10 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:11.237730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:11.238918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:11.242931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:11.249806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:11.250233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:11.250670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:11.251912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:11.252562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:11.253228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:11.412817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:11.426756 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8776d02d-2d6f-493f-8cdc-44141fbc1523 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1272 microversion: 2.1 time: 0.193881 Oct 11 01:36:11.444633 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1890/3765] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:11 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:12.181710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:12.182608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:12.204217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:12.209720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:12.212653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:12.213664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:12.214897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:12.217794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:12.453734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:12.454370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:12.493597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:12.495559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:12.508169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:12.510389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:12.518736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:12.519487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:13.430571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:13.450449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:13.452655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:13.455311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ac55007-08f1-49af-86bd-c813bfce40f2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.277515 Oct 11 01:36:13.456958 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1876/3766] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:12 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:13.722869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:13.737638 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eb95d456-7c23-44d0-829b-13bdeff3af38 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 1.287246 Oct 11 01:36:13.756613 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1891/3767] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:12 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:36:14.060670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1102477225", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "bde31a0e-a5d4-4640-9679-ae7909d33947"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:14.171544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] validate_networks() for [('bde31a0e-a5d4-4640-9679-ae7909d33947', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:36:14.484651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:14.485583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:14.502913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:14.504845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:14.506190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:14.509853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:14.510870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:14.512105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:15.295953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:15.319920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:15.322989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:15.330003 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-efd8346b-a40e-42c2-8355-07b209ec020f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.848893 Oct 11 01:36:15.347014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1892/3768] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:14 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:15.359975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:15.361970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:15.372687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:15.373421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:15.374141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:15.375241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:15.375888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:15.377446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:15.869414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:15.887877 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e3bb886-e521-4474-8cdc-0293f2ee85bc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.538132 Oct 11 01:36:15.891201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1893/3769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:15 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:16.054765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:36:16.058018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:36:16.061564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:36:16.062759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:36:16.063914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:36:16.082996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cca152c-1ae8-42b8-9697-dfe7c61b0613", "tag": "7fda48fe-0ec3-4af5-b150-8ba985b3caba"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:16.100903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.101972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.106562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.106797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.107151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.108082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.111189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.113672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.116122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.134507 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] Creating event network-changed:7fda48fe-0ec3-4af5-b150-8ba985b3caba for instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 on n-h2-772273-9 Oct 11 01:36:16.148338 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a2c96756-6862-4eb8-a889-3792d335f802 req-927d31fd-a0d4-4d38-aa90-429ade4cf807 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070641 Oct 11 01:36:16.157470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1894/3770] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:36:16.174184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Getting quotas for project 225db83e56174d019e25ddb86c61258c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:36:16.184939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Getting quotas for user d5d1ac70525c4ecb8a54e4845ea7d719 and project 225db83e56174d019e25ddb86c61258c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:36:16.277240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:36:16.288538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:36:16.360450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:16.362720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:16.381684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.382405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.382874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.385622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.396760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.399894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.552531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d814d033-07b7-4999-8dca-d54ac607d267 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.091931 Oct 11 01:36:16.555064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1877/3771] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:36:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:36:16.582352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:16.583114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:16.868410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:16.883155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:16.891373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:16.896122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f8f3bd4-d3b2-43ff-86e1-63510354c83a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1262 microversion: 2.26 time: 0.331552 Oct 11 01:36:16.898616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1878/3772] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:16 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1262 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:16.925597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:16.926235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:16.942573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.943090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.943772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:16.944500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:16.944960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:16.945392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:17.118979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:17.144596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:17.159499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:17.162678 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d7d2daa-0aea-4d76-9d4e-565f5574ff7a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.807306 Oct 11 01:36:17.166071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1895/3773] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:16 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:17.768796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:17.786397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69a4e17b-de7d-4097-89ff-514a06aa2daf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.871737 Oct 11 01:36:17.795112 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1879/3774] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:16 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:17.926508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:17.927764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:17.935712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:17.936643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:17.937288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:17.938185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:17.938875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:17.939579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:18.069468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.101157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.103963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.105897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-68378aa5-5ac7-4956-9a27-9f1dea63e5c3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1258 microversion: 2.26 time: 0.186577 Oct 11 01:36:18.107027 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1896/3775] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:17 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:18.197937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:18.199639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:18.212725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:18.213963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:18.214699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:18.215786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:18.216799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:18.217475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:18.686963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.702608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.707143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:18.709716 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2660a846-cbcc-49e6-8bce-a4eaf9afc302 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.515928 Oct 11 01:36:18.727421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1880/3776] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:18 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:18.822418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:18.823187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:18.831256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:18.834808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:18.853186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:18.855625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:18.856616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:18.857997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:18.858758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:18.894472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=18 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:19.110320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:19.121231 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0133fcbc-d6e0-48f9-8740-9925e5a0bb12 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.303235 Oct 11 01:36:19.121836 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1897/3777] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:18 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:19.142321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:19.143860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:19.152563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:19.153275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:19.154211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:19.155524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:19.156439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:19.157492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:19.267186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:19.276904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:19.280178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:19.283191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1194cf5e-9440-47c0-b1a4-9bca31a06282 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1314 microversion: 2.26 time: 0.145019 Oct 11 01:36:19.286023 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1881/3778] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:19 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:19.742323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:19.743629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:19.758710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:19.759830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:19.760483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:19.761557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:19.762236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:19.764122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:20.117773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.145168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:20.145783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:20.150493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.152566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.153774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-add99676-7b7f-4881-93dc-becf5f5510c8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.415527 Oct 11 01:36:20.157771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:20.158275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:20.158721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:20.159460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:20.159924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:20.160357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:20.163151 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1898/3779] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:19 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:20.314616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:20.315638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:20.334617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:20.336493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:20.336941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:20.337664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:20.338125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:20.338558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:20.494265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.509931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.516121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.517315 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-851fcb08-8ed5-4b83-8e9d-ba9ff25b77b3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1314 microversion: 2.26 time: 0.209333 Oct 11 01:36:20.521300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1899/3780] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:20 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:20.673243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:20.683274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8152a7ff-14a5-4803-b34b-6cd173be2fee tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.541914 Oct 11 01:36:20.683899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1882/3781] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:20 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:36:21.082978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "b510dbd3-acee-4e6e-b655-3ae36a550333"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:21.112829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:21.113346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:21.113787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:21.156168 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] Creating event network-vif-plugged:b510dbd3-acee-4e6e-b655-3ae36a550333 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:21.175371 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4b1e1e98-2800-4b6f-87f2-f8078921ff22 req-fa88ced5-b12e-49e7-8295-5798a4cae6c3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096471 Oct 11 01:36:21.179664 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1900/3782] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:36:21.185141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:21.185979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:21.197383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:21.198353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:21.199006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:21.201405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:21.205592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:21.206259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:21.545334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:21.546076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:21.563118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:21.563647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:21.564082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:21.564781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:21.565234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:21.565675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:21.978538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:21.989900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:21.992276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:21.994417 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-178c2e93-30da-4808-a36d-629e83894e8f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1320 microversion: 2.26 time: 0.453474 Oct 11 01:36:21.998023 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1901/3783] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:21 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:22.003148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:22.004292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:22.012020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:22.012813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:22.013554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:22.014686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:22.015605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:22.016228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:22.178875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:22.194822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:22.196304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:22.199833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-748e0b7b-4fcc-49ae-af65-fe6b162b3f0e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.017218 Oct 11 01:36:22.206257 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1883/3784] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:21 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:22.516355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:22.531981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-744d64c9-2b4f-4087-b853-f70c83aff775 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.532425 Oct 11 01:36:22.533084 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1902/3785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:21 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:23.027662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:23.028691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:23.051844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.052756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.053440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.054401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.055069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.056324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.233840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:23.234855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:23.251799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.253098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.253754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.263714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.264584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.265132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.567636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.584069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.588449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.594607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-643c3842-c0b8-4dfe-a3f7-b31d92b56d05 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.570678 Oct 11 01:36:23.607363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1884/3786] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:23 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:23.607363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "88b5f2a6-484e-422b-8d8d-041afd050a51"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:23.633435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.633969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.635136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.644629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:23.660116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] Creating event network-vif-plugged:88b5f2a6-484e-422b-8d8d-041afd050a51 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:23.667763 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-32ae8944-575e-4c85-87b4-59d073fd83af req-8f29b36f-173a-4648-bb5a-7e662f43db68 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068398 Oct 11 01:36:23.668381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1885/3787] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:23.682082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:23.683097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:23.698439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.701719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.702192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.702931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:23.709855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:23.710492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:23.961051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.990849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.995749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:23.998174 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b46ff30-52b3-4710-8cce-67c0ee26c27b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.769161 Oct 11 01:36:23.999843 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1903/3788] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:23 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:24.155640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:24.164547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0627f0d-a09f-4f0d-a085-f5b11e9ae177 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.492311 Oct 11 01:36:24.165145 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1886/3789] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:23 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:24.623857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:24.626168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:24.639414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:24.640189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:24.640801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:24.641672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:24.642141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:24.642564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:24.918088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:24.943136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:24.944694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:24.945905 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8453745e-d27a-44f0-9d9c-c1f218436c6e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.326200 Oct 11 01:36:24.955576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1904/3790] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:24 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:25.029827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:25.030543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:25.061436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:25.062256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:25.064213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:25.065690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:25.068325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:25.068983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:25.190745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:25.191997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:25.203625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:25.204315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:25.204913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:25.207804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:25.220321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:25.221063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:25.226142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:26.023888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.044980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.048447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.049701 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1cbb2f4-c65c-4855-838b-af30a739cb6b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.027843 Oct 11 01:36:26.055408 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1887/3791] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:25 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:26.061900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.076127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "52d6107a-faad-4585-82b7-209fc2869a8a"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "d2e62e92-5fe7-440b-9b51-94c01c3b6ff2"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "d7ac2b47-05d7-4f7c-8500-83d41abe71b6"}, {"server_uuid": "1cca152c-1ae8-42b8-9697-dfe7c61b0613", "name": "network-vif-plugged", "status": "completed", "tag": "7fda48fe-0ec3-4af5-b150-8ba985b3caba"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "a001d4dc-bce3-4733-9a21-4df812b8cd37"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:26.076516 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eccdee96-4875-48ae-9093-94ba0691d023 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.885706 Oct 11 01:36:26.085595 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1905/3792] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:25 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:26.101067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:26.101816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:26.104442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:26.107131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:26.110820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:26.129964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:26.130477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:26.130916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:26.132987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:26.133455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:26.136620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:26.145801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Creating event network-vif-plugged:52d6107a-faad-4585-82b7-209fc2869a8a for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:26.153880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Creating event network-vif-plugged:d2e62e92-5fe7-440b-9b51-94c01c3b6ff2 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:26.157558 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Creating event network-vif-plugged:d7ac2b47-05d7-4f7c-8500-83d41abe71b6 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:26.158155 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Creating event network-vif-plugged:7fda48fe-0ec3-4af5-b150-8ba985b3caba for instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 on n-h2-772273-9 Oct 11 01:36:26.158693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] Creating event network-vif-plugged:a001d4dc-bce3-4733-9a21-4df812b8cd37 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:26.195159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:26.203932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1126b160-8a1e-48f3-a908-55acb708de5d req-d665dd27-b922-45e8-96ae-ac2c2d941933 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.146839 Oct 11 01:36:26.207943 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1888/3793] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:26.228061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12ce607-dd0a-4914-8ac1-454e0dbb5409", "tag": "67a421ec-f864-4543-95ba-603db72e27d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:26.270840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:26.271880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:26.272567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:26.294866 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] Creating event network-changed:67a421ec-f864-4543-95ba-603db72e27d8 for instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 on n-h2-772273-9 Oct 11 01:36:26.301251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ee51285d-58a8-41eb-94ea-9e18562a8139 req-b71e2291-4b29-43e8-bcb1-91c04b35f6d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087449 Oct 11 01:36:26.302118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1889/3794] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:26.710972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.723016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.725809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:26.727365 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4355d56e-823c-4312-9499-f35890a22f17 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.640634 Oct 11 01:36:26.728459 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1906/3795] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:26 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:27.078518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:27.084359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:27.085081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:27.105554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:27.106304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:27.118700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.119200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.120084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.121119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.121554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:27.122272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.122724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.123146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:27.125813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:27.126824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.127489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.129368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:27.545027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:27.553523 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d7325df-d338-4c88-815c-2e2a34667cfa tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1314 microversion: 2.1 time: 0.452072 Oct 11 01:36:27.570999 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1907/3796] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:27 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:36:27.574573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:27.585801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:27.587501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:27.589414 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-955b0e9c-a9cd-488b-b53e-31f17bdefe4d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 0.511598 Oct 11 01:36:27.605807 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1890/3797] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:27 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:27.754334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:27.754898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:27.762584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.764133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.765426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:27.767140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:27.767620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:27.768927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:28.035888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:28.051588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:28.053709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:28.056601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8e4fdb1-be76-4f22-9f3c-eb828dadc15c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.306299 Oct 11 01:36:28.079851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1908/3798] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:27 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:28.240308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-plugged", "status": "completed", "tag": "2384d352-10d1-4281-aa0f-caf21e0925fb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:28.256545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:28.257035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:28.257469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:28.272847 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] Creating event network-vif-plugged:2384d352-10d1-4281-aa0f-caf21e0925fb for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:28.280450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-98d30e65-657d-4e5b-a538-9f63a7d0a5b7 req-ca66faea-51e8-4cc1-a5d1-601b9cf8f120 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043957 Oct 11 01:36:28.287294 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1891/3799] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:28.576115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:28.576801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:28.587997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:28.589605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:28.590277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:28.591081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:28.591574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:28.592011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:28.618685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:28.619821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:28.630793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:28.634472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:28.635146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:28.636175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:28.648130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:28.648966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.123329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.136565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f0849be-e983-4049-9d9e-fd45afafd99c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1500 microversion: 2.1 time: 0.564051 Oct 11 01:36:29.151792 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1909/3800] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:28 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1500 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:29.151792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:29.151792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:29.186548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.187868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.189338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.194114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.194915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.196683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.672019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.685697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.688382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.690898 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-152a778b-4bdc-491a-8bfc-19acd140dc3a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1877 microversion: 2.42 time: 1.075797 Oct 11 01:36:29.692028 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1892/3801] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:28 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1877 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:29.699030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:29.700173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:29.708490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.709714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.710379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.711330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.712011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.712631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.818217 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-950873da-5bd0-442f-a40f-4e2efa4a3cef tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613/action" status: 202 len: 0 microversion: 2.1 time: 0.124240 Oct 11 01:36:29.819956 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1893/3802] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:36:29 2022] POST /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:36:29.846364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:29.847825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:29.858784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.860188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.861396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.862420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.863084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.864116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.885448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.902261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.904760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:29.907904 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6dfe9545-c078-4c09-9371-82b115020ebe tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.761159 Oct 11 01:36:29.924370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1910/3803] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:29 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:29.937479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:29.938350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:29.946492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.950124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.950586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.951630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:29.952258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:29.952842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:29.986005 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b9c7385-001c-4a93-8f34-ae139065024c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/ips" status: 200 len: 152 microversion: 2.20 time: 0.054466 Oct 11 01:36:29.987250 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1911/3804] 10.222.0.66 () {60 vars in 1289 bytes} [Tue Oct 11 01:36:29 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:36:30.290121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:30.300371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d85691f-7080-418c-b50a-e29e62f35fe4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1505 microversion: 2.1 time: 0.468307 Oct 11 01:36:30.300981 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1894/3805] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:29 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:36:30.721457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:30.722075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:30.728240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:30.728717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:30.729156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:30.729904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:30.730360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:30.730785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:30.939004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:30.940264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:30.956251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:30.957034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:30.957740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:30.958485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:30.958948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:30.960604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.200530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.212238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.214167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.215783 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc75be1b-b541-400e-a8a8-f607bf1d1f01 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2835 microversion: 2.42 time: 0.498374 Oct 11 01:36:31.228510 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1912/3806] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:30 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2835 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:31.255608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:31.258676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:31.273811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.274354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.274810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.277753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.278785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.281356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.551671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2e5853a-c53d-4f71-9676-c61faa31e86e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.309901 Oct 11 01:36:31.552974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1913/3807] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:36:31 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776/os-interface => generated 1832 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:31.559259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:31.560178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:31.579057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.580808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.582686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.586014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.586923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.591939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.620010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.637384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.650599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.654871 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85989eae-9caa-48ba-ab52-bed8f5fbce95 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.722182 Oct 11 01:36:31.659681 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1895/3808] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:30 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:31.914120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:31.924089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbbea205-7650-4b82-983f-e391cf7b7ebe tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1485 microversion: 2.1 time: 0.369427 Oct 11 01:36:31.925695 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1914/3809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:31 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1485 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:31.948031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:31.948783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:31.956015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.956503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.957116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.957983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:31.958444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:31.958866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:31.987896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:36:32.091318 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a94f32d4-7953-4951-b2f2-ba43d988d025 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 204 len: 0 microversion: 2.1 time: 0.147591 Oct 11 01:36:32.096109 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1896/3810] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:36:31 2022] DELETE /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:36:32.105583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:32.106762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:32.117557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:32.118932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:32.120930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:32.122014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:32.123030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:32.123717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:32.315332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:32.330522 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd790a9a-e78c-4ed9-959a-d51136fa2cc6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1491 microversion: 2.1 time: 0.233718 Oct 11 01:36:32.332343 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1915/3811] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:32 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1491 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:32.687112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:32.687859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:32.700447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:32.700956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:32.701402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:32.702123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:32.702587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:32.703016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.073825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:33.090603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:33.093022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:33.094676 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce8fb119-ce0e-4fea-8237-4d213703206d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.412210 Oct 11 01:36:33.100010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1897/3812] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:32 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:33.355073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:33.356774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:33.364624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.365500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.366249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.367129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.367812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.368509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.570142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:33.570740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:33.580379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.581209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.581969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.583817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.584569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.585218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.621796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lazy-loading 'flavor' on Instance uuid 6b5c015a-c090-4722-8ef4-6340d39484ad {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:33.834541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:33.851981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-718ac2e1-45e9-4526-ad6a-56bd808f32d6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1491 microversion: 2.1 time: 0.501948 Oct 11 01:36:33.852880 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1916/3813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:33 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1491 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:33.913600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-789ee3d5-6693-4d39-9a60-862d2f7b9cfc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/action" status: 202 len: 0 microversion: 2.20 time: 0.347540 Oct 11 01:36:33.918335 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1898/3814] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:36:33 2022] POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:36:33.923537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:33.924342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:33.931523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.932309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.933536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:33.934482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:33.935152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:33.935913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:34.125988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:34.126872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:34.129044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:34.145938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:34.146549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:34.147113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:34.147940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:34.149959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:34.152655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:34.371257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.386750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.389293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.397435 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-902a5c2b-cf4b-45f9-9015-15a38399ad41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.477210 Oct 11 01:36:34.411641 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1917/3815] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:33 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:34.424464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "tag": "b510dbd3-acee-4e6e-b655-3ae36a550333"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:34.438942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:34.439800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:34.440506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:34.458654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] Creating event network-changed:b510dbd3-acee-4e6e-b655-3ae36a550333 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:36:34.481875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bcf1fa89-83a2-46a4-a9a1-70eb3dd59c72 req-2346292c-5974-4bdd-a517-eeb4a2e5dc1b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067420 Oct 11 01:36:34.489435 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1918/3816] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:34.550124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.556576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:34.562538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.564028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:34.565210 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-456ea8d3-aa41-44ad-8f3c-29526cd47f64 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.444458 Oct 11 01:36:34.565783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1899/3817] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:34 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:34.879320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:34.880597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:34.893991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:34.899114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:34.900041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:34.903472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:34.904159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:34.904803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.043008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cca152c-1ae8-42b8-9697-dfe7c61b0613", "name": "network-vif-deleted", "tag": "7fda48fe-0ec3-4af5-b150-8ba985b3caba"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:35.080713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:35.081545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.082245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.083115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.090972 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46429230-47a8-4182-899e-49bca0f2ddc2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 200 len: 1449 microversion: 2.1 time: 0.217359 Oct 11 01:36:35.091989 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1919/3818] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:34 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 1449 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:35.112078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] Creating event network-vif-deleted:7fda48fe-0ec3-4af5-b150-8ba985b3caba for instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 on n-h2-772273-9 Oct 11 01:36:35.117143 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-abc80db3-b3d5-4f09-93ad-d90b1d85c763 req-b35bc318-921e-4cd7-ae7b-1de7769fd43a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078124 Oct 11 01:36:35.129082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1900/3819] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:36:35.428077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:35.429591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:35.446206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.446206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.446206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.446521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.451235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.451938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.635069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:35.636305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:35.648686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.649182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.649811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.653851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.654558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.667142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.768612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:35.781214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:35.792497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:35.800088 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-677a8eae-9ddc-4c26-ba1b-536d66a3699f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.376498 Oct 11 01:36:35.803042 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1920/3820] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:35 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:35.819775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12ce607-dd0a-4914-8ac1-454e0dbb5409", "name": "network-vif-plugged", "status": "completed", "tag": "67a421ec-f864-4543-95ba-603db72e27d8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:35.867228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:35.869031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:35.869735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:35.927739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] Creating event network-vif-plugged:67a421ec-f864-4543-95ba-603db72e27d8 for instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 on n-h2-772273-9 Oct 11 01:36:35.938278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2a65d32e-120d-4fa9-b4da-684bbcec9561 req-a5bba2be-10af-4a5a-9495-95458cd0a6ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132543 Oct 11 01:36:35.939434 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1921/3821] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:35.983091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:36.000065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:36.002348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:36.005349 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-758b8c77-6392-47a2-a278-72080a4cede9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.395113 Oct 11 01:36:36.007256 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1901/3822] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:35 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:36.121113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:36.122154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:36.132321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:36.133247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:36.137793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:36.141387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:36.143298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:36.143967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:36.196531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 HTTP/1.1 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1cca152c-1ae8-42b8-9697-dfe7c61b0613'} Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:36.202160 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:36:36.206895 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:36:36.211213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:36:36.212529 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e1f5a4b-dd2c-4ff4-8205-91033daa5ec9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 404 len: 111 microversion: 2.1 time: 0.097970 Oct 11 01:36:36.219035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1922/3823] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:36 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:36:36.471164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1061151699", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:36.585785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:36:36.827928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:36.829507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:36.846836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:36.849542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:36.850156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:36.851204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:36.851701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:36.852135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:37.500926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:37.514915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:37.519413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:37.522768 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6df3ffa6-a51e-4fd8-9879-17d5143a82ed tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.698749 Oct 11 01:36:37.523718 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1923/3824] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:36 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:37.534226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:37.535239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:37.547101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:37.547878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:37.548513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:37.549389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:37.550014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:37.550600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:37.578461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:38.155403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:36:38.155879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:36:38.156353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:36:38.156787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:36:38.157252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:36:38.171408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:38.172409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:38.173109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:38.174111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:38.175170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:38.176434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:38.189527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.199847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.201984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.203046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:36:38.203849 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1990b4d-a68f-4c51-a9ce-f13113ecb498 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1362 microversion: 2.26 time: 0.678372 Oct 11 01:36:38.204579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1924/3825] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:37 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:38.209511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:36:38.234565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:36:38.237774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:36:38.295937 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14862c3a-b3f9-4cf0-9c03-c95fb2ca5d5b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827793 Oct 11 01:36:38.299553 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1902/3826] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:36:38.308716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ec9465c-c095-4d49-b329-831f2d80e5d0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:38.309342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ec9465c-c095-4d49-b329-831f2d80e5d0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:38.504638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ec9465c-c095-4d49-b329-831f2d80e5d0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.513027 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ec9465c-c095-4d49-b329-831f2d80e5d0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1215 microversion: 2.1 time: 0.208912 Oct 11 01:36:38.514278 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1925/3827] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:38 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:38.550851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:38.552040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:38.558994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:38.559811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:38.560478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:38.561816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:38.562486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:38.563799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:38.895326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.923360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.926746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:38.929826 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1148e554-1133-4665-b1b7-fbab6e2013fa tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.383457 Oct 11 01:36:38.932090 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1903/3828] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:38 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:39.241878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:39.242661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:39.258197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.259046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.262424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.263623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.264310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.265187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.547719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:39.549626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:39.572266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.576657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.577531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.580149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.583255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.584421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.673362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:39.683520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:39.684993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:39.686542 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46c01fef-43cb-481f-a025-c1a3e7179afa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1547 microversion: 2.26 time: 0.449883 Oct 11 01:36:39.687117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1926/3829] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:39 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1547 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:39.724772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f0b23a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:39.741949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.743133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.743706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.744855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:39.746594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:39.758832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.759460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.760086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.760281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee16002a-65af-4d8f-8747-5fbc657814a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1267 microversion: 2.1 time: 0.226174 Oct 11 01:36:39.760642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.761861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.763147 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1904/3830] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:39 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:39.782864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.865514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.866365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.866491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.903228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.904208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.904798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.950597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:39.965026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:39.965719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:39.977161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.977571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.978019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:39.987136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:39.987790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:39.988253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.019399 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48818ecb-20b7-4da5-9e14-dbeafd39246c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-2133443601" status: 201 len: 0 microversion: 2.26 time: 0.306149 Oct 11 01:36:40.020102 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1927/3831] 10.222.0.66 () {62 vars in 1380 bytes} [Tue Oct 11 01:36:39 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-2133443601 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 11 01:36:40.037261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50bb2f61-9053-4ea7-bd17-0623bbb9b8ee tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6cf1f0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.051911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50bb2f61-9053-4ea7-bd17-0623bbb9b8ee tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.052416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50bb2f61-9053-4ea7-bd17-0623bbb9b8ee tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.052861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50bb2f61-9053-4ea7-bd17-0623bbb9b8ee tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.071769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50bb2f61-9053-4ea7-bd17-0623bbb9b8ee tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-2133443601" status: 204 len: 0 microversion: 2.26 time: 0.042964 Oct 11 01:36:40.073947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1928/3832] 10.222.0.66 () {60 vars in 1361 bytes} [Tue Oct 11 01:36:40 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-2133443601 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:40.082747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f1138970430>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.104688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.105461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.106100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.106791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.115425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.116168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.116765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.117957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.118620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.119200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.158539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.159326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.160009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.179935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:40.227318 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-001ff6f6-5873-4785-acc7-62035341690c tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 204 len: 0 microversion: 2.26 time: 0.147773 Oct 11 01:36:40.229982 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1929/3833] 10.222.0.66 () {60 vars in 1295 bytes} [Tue Oct 11 01:36:40 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:36:40.246205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bab10fe6-10e7-4c50-aad7-64362ef63be1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f1138970af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.266385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bab10fe6-10e7-4c50-aad7-64362ef63be1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.266916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bab10fe6-10e7-4c50-aad7-64362ef63be1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.269518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bab10fe6-10e7-4c50-aad7-64362ef63be1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.282971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bab10fe6-10e7-4c50-aad7-64362ef63be1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 12 microversion: 2.26 time: 0.046755 Oct 11 01:36:40.283835 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1930/3834] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:36:40 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:40.297898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f072160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.323625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.329096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.330404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.332650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.344933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.347175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.349345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.350318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.351875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.352664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.409265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.411927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.412873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.429870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.430577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.431178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.477420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:40.499527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-efc18765-451a-4f69-bc12-1d53af274078 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-78751111" status: 201 len: 0 microversion: 2.26 time: 0.205407 Oct 11 01:36:40.500911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1931/3835] 10.222.0.66 () {62 vars in 1374 bytes} [Tue Oct 11 01:36:40 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-78751111 => generated 0 bytes in 207 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 11 01:36:40.517250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-219c14b6-a481-4c54-ac15-a72ef3c46dbb tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f002af0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.541789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219c14b6-a481-4c54-ac15-a72ef3c46dbb tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.543224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219c14b6-a481-4c54-ac15-a72ef3c46dbb tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.544053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-219c14b6-a481-4c54-ac15-a72ef3c46dbb tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.582792 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-219c14b6-a481-4c54-ac15-a72ef3c46dbb tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 34 microversion: 2.26 time: 0.073992 Oct 11 01:36:40.583727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1932/3836] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:36:40 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 34 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:40.614364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f002a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.637449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.638099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.638642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.639223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.646290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.646949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.647516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.648336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.649056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.650005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.687544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:40.697852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:40.699794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.700376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.700885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.708893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:40.710592 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-559b13cc-9775-4571-aaef-75351bfff2b5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.750046 Oct 11 01:36:40.711382 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1905/3837] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:39 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:40.749538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:40.769616 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b5ca0c02-0b76-415a-8596-e07c5dbff542 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-78751111" status: 204 len: 0 microversion: 2.26 time: 0.174953 Oct 11 01:36:40.770625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1933/3838] 10.222.0.66 () {60 vars in 1358 bytes} [Tue Oct 11 01:36:40 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-78751111 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:40.779841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae078a9f-e1f1-493f-880a-dcf206ea8c7f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6b0b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.790884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.794839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.795522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae078a9f-e1f1-493f-880a-dcf206ea8c7f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.796027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae078a9f-e1f1-493f-880a-dcf206ea8c7f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.802589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae078a9f-e1f1-493f-880a-dcf206ea8c7f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.811775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.814521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.817318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.819138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.819852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.820589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.835284 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae078a9f-e1f1-493f-880a-dcf206ea8c7f tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 12 microversion: 2.26 time: 0.059997 Oct 11 01:36:40.841809 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1906/3839] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:36:40 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 12 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:40.847229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6cedc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.856136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.856885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.857531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.858202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.875229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.876048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.876694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.877629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.878277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.878898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.905893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.906375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.907057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.922338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:40.942409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41707084-761b-406b-b05e-6e482a0ed25d tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 204 len: 0 microversion: 2.26 time: 0.099280 Oct 11 01:36:40.943739 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1907/3840] 10.222.0.66 () {60 vars in 1295 bytes} [Tue Oct 11 01:36:40 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:40.953893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6b5d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:40.965612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.966515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.967111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.967795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:40.975225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.976008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.976814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:40.977823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:40.978484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:40.979139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.015611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.019056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.019757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.038045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.038764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.039450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.071140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.093965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7498d02e-c39a-4d49-9226-afcfb618a375 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-4634000" status: 201 len: 0 microversion: 2.26 time: 0.144276 Oct 11 01:36:41.095063 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1908/3841] 10.222.0.66 () {62 vars in 1371 bytes} [Tue Oct 11 01:36:40 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-4634000 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 483 bytes (2 switches on core 0) Oct 11 01:36:41.106426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6b0c10>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.131371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.131865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.132313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.132805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.140015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.140515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.140958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.141686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.142229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.142676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.175648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.176160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.176611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.191035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.191577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.192023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.224543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.249450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8efd2b8-14ec-4355-9b00-25e5885b1420 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-225694882" status: 201 len: 0 microversion: 2.26 time: 0.148358 Oct 11 01:36:41.250794 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1909/3842] 10.222.0.66 () {62 vars in 1377 bytes} [Tue Oct 11 01:36:41 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-225694882 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 01:36:41.261466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f6b59d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.271750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.272306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.272927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.273638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.282793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.284275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.284729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.284997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:41.285451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.286448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.286583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.301805 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d25c6a4a-8b56-46e0-bf10-cce152d0a55a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1273 microversion: 2.1 time: 0.515851 Oct 11 01:36:41.302992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1934/3843] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:40 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1273 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:41.341201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.342068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.342522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.374535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.393089 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0910408-790a-4f31-a893-162c5020015a tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 204 len: 0 microversion: 2.26 time: 0.136460 Oct 11 01:36:41.394018 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1910/3844] 10.222.0.66 () {60 vars in 1295 bytes} [Tue Oct 11 01:36:41 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:36:41.403393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7aad1495-c6cc-4d9c-b0d1-ba6e7ba4a4e9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f020dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.405886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:41.413041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aad1495-c6cc-4d9c-b0d1-ba6e7ba4a4e9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.413767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aad1495-c6cc-4d9c-b0d1-ba6e7ba4a4e9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.414213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7aad1495-c6cc-4d9c-b0d1-ba6e7ba4a4e9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.424936 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7aad1495-c6cc-4d9c-b0d1-ba6e7ba4a4e9 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 12 microversion: 2.26 time: 0.026243 Oct 11 01:36:41.425623 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1935/3845] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:36:41 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:41.436438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f9c19d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.446328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.446858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.447391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.447946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.454539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.455179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.455805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.456628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.457191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.457717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.481988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.482596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.483273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.496003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.518120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1386545d-7d49-41e3-9dbd-a2837ed40fe7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 204 len: 0 microversion: 2.26 time: 0.085779 Oct 11 01:36:41.520661 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1911/3846] 10.222.0.66 () {60 vars in 1295 bytes} [Tue Oct 11 01:36:41 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:41.529378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f072700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.542684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.543659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.544192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.545084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.555042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.555630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.556302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.557377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.557901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.558627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.595188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.595732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.596349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.610016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.610959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.611606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.640491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.662289 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b7c8c94-2c48-467b-9aa8-8f13203c2ba1 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-123248114" status: 201 len: 0 microversion: 2.26 time: 0.137849 Oct 11 01:36:41.663911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1936/3847] 10.222.0.66 () {62 vars in 1377 bytes} [Tue Oct 11 01:36:41 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-123248114 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 01:36:41.679071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112f9c1b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.694417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.695020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.695364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.695887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.705433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.707968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.708644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.709521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.710144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.710854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.742951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:41.744185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.759464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.760082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.760595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.761414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.762133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.762855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.763940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.764608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.765217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.770587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:41.771761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:41.774979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.775925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.777311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.821504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.839598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41af367e-a239-4dd8-aa7b-845d3c89d7d7 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-680648126" status: 201 len: 0 microversion: 2.26 time: 0.168198 Oct 11 01:36:41.843407 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1912/3848] 10.222.0.66 () {62 vars in 1377 bytes} [Tue Oct 11 01:36:41 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags/tempest-tag-680648126 => generated 0 bytes in 170 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 01:36:41.852392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Action: 'update_all', calling method: .version_select at 0x7f1134151ee0>, body: {"tags": ["tempest-tag-753620411", "tempest-tag-50592110"]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:41.863846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.864588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.865218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.865866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:41.872698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.873490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.874068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.875008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.875922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.876692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.921012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:41.921671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:41.922175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:41.956840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:41.980571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-71b92778-deb0-4652-9a1b-0018ffa092fa tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 59 microversion: 2.26 time: 0.133253 Oct 11 01:36:41.986756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1913/3849] 10.222.0.66 () {62 vars in 1312 bytes} [Tue Oct 11 01:36:41 2022] PUT /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 59 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:41.994717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d78f505b-c3b4-4920-b131-0bdf0021bf43 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f11387b1dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:42.004676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d78f505b-c3b4-4920-b131-0bdf0021bf43 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.005636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d78f505b-c3b4-4920-b131-0bdf0021bf43 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.005779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d78f505b-c3b4-4920-b131-0bdf0021bf43 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.019991 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d78f505b-c3b4-4920-b131-0bdf0021bf43 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 200 len: 59 microversion: 2.26 time: 0.031179 Oct 11 01:36:42.025742 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1914/3850] 10.222.0.66 () {60 vars in 1292 bytes} [Tue Oct 11 01:36:41 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 59 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:42.038621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '.version_select at 0x7f112fa541f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:42.050364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.050981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.051505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.051996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:42.060051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.060538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.060996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.062533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.063055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.063543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.119568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.120082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.121281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.144219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lazy-loading 'flavor' on Instance uuid f12ce607-dd0a-4914-8ac1-454e0dbb5409 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:36:42.182151 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b387bea-2667-4ba5-9f52-e2c5d762dec6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags" status: 204 len: 0 microversion: 2.26 time: 0.151514 Oct 11 01:36:42.197911 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1915/3851] 10.222.0.66 () {60 vars in 1295 bytes} [Tue Oct 11 01:36:42 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:42.229691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:42.237930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:42.262147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.265250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.275958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.276457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.276625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.280017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.280208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.282815 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a55f6213-8530-4017-9532-bef3332f8c42 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.546281 Oct 11 01:36:42.284219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.285303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1937/3852] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:41 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:42.300766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.330465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:42.331200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:42.340865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.343824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.344418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.347261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.351160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.352052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.372593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:36:42.498639 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a4e0b27-5979-4d10-9604-0453db9851c6 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 204 len: 0 microversion: 2.26 time: 0.286638 Oct 11 01:36:42.501270 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1916/3853] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:36:42 2022] DELETE /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:36:42.517377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:42.518693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:42.543279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.546175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.548338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.549267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:42.549752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:42.554792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:42.589935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.600997 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a45ce17-c403-43b9-b3b5-ec9ff9c6b080 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1273 microversion: 2.1 time: 0.274101 Oct 11 01:36:42.601778 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1938/3854] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:42 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:36:42.898208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.912707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.914316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:42.915531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8cc9b925-7169-4841-b4d9-944d76868c1e tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1553 microversion: 2.26 time: 0.409126 Oct 11 01:36:42.916151 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1917/3855] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:42 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:36:43.318146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:43.319761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:43.335388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:43.336720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:43.340773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:43.342076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:43.344504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:43.346927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:43.638239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:43.638984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:43.646549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:43.647755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:43.648312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:43.649142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:43.649716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:43.650254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:44.001604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.014303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.039765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.041486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c926bc04-b13a-461d-9a3f-d04c67342e21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.727558 Oct 11 01:36:44.059400 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1939/3856] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:43 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:44.064117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:44.064733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:44.072108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:44.073092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:44.074757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:44.075701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:44.076512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:44.077501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:44.168025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.186431 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e337de7-f114-43eb-90a0-05a8d0328b47 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.560163 Oct 11 01:36:44.187720 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1918/3857] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:43 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:44.556037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.570512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.575330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:44.577016 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a4466ca9-3765-4d43-94cc-597df69aae2b tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1553 microversion: 2.26 time: 0.530736 Oct 11 01:36:44.577924 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1940/3858] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:44 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:45.068969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:45.069618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:45.079937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.080437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.080884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.081616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.085787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.086273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.212135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:45.212919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:45.223127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.234332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.240366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.241627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.242355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.243009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.778673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:45.799469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:45.801679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:45.803257 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b9338660-0a90-4bcb-bd19-b6a87d8be8d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.738401 Oct 11 01:36:45.804279 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1919/3859] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:45 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:45.815546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:45.816189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:45.834806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.835737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.836395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.837357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:45.838138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:45.838919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:45.924628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:45.939605 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72d18ea4-e26a-471c-9aae-0cb715f6838e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.731040 Oct 11 01:36:45.940413 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1941/3860] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:45 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:46.012754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:46.022017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:46.023649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5d1ac70525c4ecb8a54e4845ea7d719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225db83e56174d019e25ddb86c61258c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:46.025063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d343b0d-52c7-4d8a-bfc9-afe19bef4503 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 200 len: 1511 microversion: 2.26 time: 0.219765 Oct 11 01:36:46.035200 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1920/3861] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:45 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:46.133899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12ce607-dd0a-4914-8ac1-454e0dbb5409", "name": "network-vif-deleted", "tag": "67a421ec-f864-4543-95ba-603db72e27d8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:46.204157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:46.206249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:46.207026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:46.245986 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] Creating event network-vif-deleted:67a421ec-f864-4543-95ba-603db72e27d8 for instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 on n-h2-772273-9 Oct 11 01:36:46.256993 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-63f9ac53-1412-4b70-be39-dd4ed953661e req-b3f7a30a-2e35-4907-bf11-ef79d29fc50d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130679 Oct 11 01:36:46.258583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1942/3862] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:46.839782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:46.840398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:46.858872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:46.859680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:46.860545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:46.861445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:46.862066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:46.862656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:46.980195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:46.980917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:46.997550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:46.998059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:46.998505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:46.999232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:46.999728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:47.000159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:47.266326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:47.284987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:47.289626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:47.292372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88a929e9-7b1a-44fe-abd0-b60adcbc613c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.456567 Oct 11 01:36:47.293576 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1921/3863] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:46 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:47.301016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:47.302165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] [instance: f12ce607-dd0a-4914-8ac1-454e0dbb5409] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:47.329359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:47.330376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:47.334326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:47.337697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:47.340351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:47.341536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:47.375005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] HTTP exception thrown: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. Oct 11 01:36:47.376252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Request method failure captured: Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 HTTP/1.1 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMiMp5oSlJayOrFl_yaDewsJX6xM-Bnn2wEqv3HfRVKNurKwcEz76aVSsslFLdxR9BdxQm7gQVgpM_gAM1ktpbQ1mnnT9mvTktnd_EWquK-6IKnFAtZkO-Sw7L9RE7miCZdV8ISum8fJhf9ja__O0iwGz-q0XixCisVquZ9qJbIG6Lo Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.26 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 225db83e56174d019e25ddb86c61258c Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerTagsTestJSON-597212021 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/225db83e56174d019e25ddb86c61258c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_225db83e56174d019e25ddb86c61258c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/225db83e56174d019e25ddb86c61258c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/225db83e56174d019e25ddb86c61258c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerTagsTestJSON-597212021 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 225db83e56174d019e25ddb86c61258c Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerTagsTestJSON-597212021 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerTagsTestJSON-597212021-project Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d5d1ac70525c4ecb8a54e4845ea7d719 Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerTagsTestJSON-597212021-project Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'f12ce607-dd0a-4914-8ac1-454e0dbb5409'} Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:36:47.377677 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. Oct 11 01:36:47.381578 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:36:47.384178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] Returning 404 to user: Instance f12ce607-dd0a-4914-8ac1-454e0dbb5409 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:36:47.384771 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6180098-8b1d-4c47-bc4a-bf5002eb5f5d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.422346 Oct 11 01:36:47.385569 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f884302-afd7-4763-bbc1-58afb00edef3 tempest-ServerTagsTestJSON-597212021 tempest-ServerTagsTestJSON-597212021-project] 10.222.0.66 "GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409" status: 404 len: 111 microversion: 2.26 time: 0.089885 Oct 11 01:36:47.391068 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1922/3864] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:47 2022] GET /compute/v2.1/servers/f12ce607-dd0a-4914-8ac1-454e0dbb5409 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:36:47.403111 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1943/3865] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:46 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:48.297267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ebf720-fa16-42fb-a5ed-7a506f4cf8c9", "tag": "3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:48.306675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:48.320084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:48.336827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:48.338528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:48.339656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:48.340155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:48.340596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:48.351682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:48.356714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:48.357413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:48.358359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:48.360630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:48.361282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:48.384358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] Creating event network-changed:3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693 for instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 on n-h2-772273-9 Oct 11 01:36:48.401505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-62d4e137-42a5-4e19-8adc-9c7be580a9d1 req-11f89e01-478d-4059-be4c-22b598731c68 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108059 Oct 11 01:36:48.412002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1923/3866] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:48.419266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:48.431641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:48.452251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:48.452867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:48.453307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:48.455331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:48.455846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:48.456280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:48.512399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:49.087662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:49.103528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:49.107971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:49.109200 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-afb6066f-6777-47e8-80c0-40af864310c3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.787630 Oct 11 01:36:49.112255 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1944/3867] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:48 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:49.292870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:49.312748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cfb2c984-8101-4813-ab73-5c727af00e32 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.893528 Oct 11 01:36:49.314661 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1924/3868] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:48 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:50.141272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:50.141860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:50.155453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:50.155959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:50.156401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:50.157128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:50.157581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:50.158002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:50.341637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:50.342671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:50.359774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:50.361895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:50.375542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:50.379562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:50.380128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:50.381856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:50.955493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:50.973602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:50.976522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:50.980205 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12bd3c50-dbfc-4ac5-89d8-2a9a862c5089 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1742 microversion: 2.20 time: 0.841664 Oct 11 01:36:50.997704 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1945/3869] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:50 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1742 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:51.231156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:51.246363 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df0838ba-b87a-4999-bf57-b09edf71e967 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.909189 Oct 11 01:36:51.247655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1925/3870] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:50 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:52.015766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:52.017381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:52.040616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:52.043647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:52.046584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:52.050830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:52.053168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:52.055253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:52.277498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:52.278129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:52.304072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:52.304586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:52.308323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:52.314241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:52.316046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:52.318280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:52.381688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:36:52.964681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:52.975121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:52.977317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:52.980799 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0303709b-32e5-4f9a-8c71-04b5eb61833c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.971906 Oct 11 01:36:53.004960 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1946/3871] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:52 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:53.014459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "name": "network-vif-plugged", "status": "completed", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:53.031305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:53.033216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:53.033216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:53.057822 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] Creating event network-vif-plugged:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h1-772273-9 Oct 11 01:36:53.067591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e53f5420-706a-4d7b-a24d-305a1fa30e06 req-bba7b26a-a0eb-450c-9ad5-8dbe84c9e32f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060390 Oct 11 01:36:53.068587 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1947/3872] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:36:53.196869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:53.212411 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9a9d4a7-4569-4fe1-ba08-7d21a439c3ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.942112 Oct 11 01:36:53.219044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1926/3873] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:52 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:54.013808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:54.016417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:54.039722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:54.048898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:54.050255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:54.052022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:54.052665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:54.055985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:54.242708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:54.243663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:54.257024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:54.259729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:54.260333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:54.262409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:54.265740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:54.266800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:54.759393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:54.775159 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8aa329b5-b0bd-4cf9-b743-5b5d371497bd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.537551 Oct 11 01:36:54.780408 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1927/3874] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:54 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:54.955094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:54.966749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:54.970365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:54.971990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e74206a5-6ad1-4a00-a3f3-45a748c02660 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.964406 Oct 11 01:36:54.975877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1948/3875] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:54 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:55.804831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:55.805469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:55.820113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:55.826016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:55.830376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:55.831441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:55.835839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:55.839839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:55.857860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ebf720-fa16-42fb-a5ed-7a506f4cf8c9", "name": "network-vif-plugged", "status": "completed", "tag": "3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:36:55.884475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:55.887042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:55.887665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:55.936891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] Creating event network-vif-plugged:3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693 for instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 on n-h2-772273-9 Oct 11 01:36:55.982153 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ffbfb28f-d9e6-4ffb-94d0-5abd1a2e021d req-29075268-30fc-4858-94da-317fb3fcd460 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135370 Oct 11 01:36:55.983055 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1949/3876] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:36:56.008620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:56.013186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:56.062894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:56.063422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:56.063868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:56.064590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:56.065056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:56.065480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:57.619024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:57.659542 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3bddff89-d348-4900-a604-c2aa0487c636 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 1.858192 Oct 11 01:36:57.666147 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1928/3877] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:55 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:57.760400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:57.778986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:57.784417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:57.788398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58b4659f-e8ec-443f-a5a1-9861a5858265 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 1.784998 Oct 11 01:36:57.789378 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1950/3878] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:56 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:36:58.692805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:58.693614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:58.703410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:58.710910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:58.711541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:58.714162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:58.717001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:58.717491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:58.818628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:36:58.819248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:36:58.831915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:58.848768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:58.850935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:58.854943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:36:58.857725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:36:58.858383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:36:59.331865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:59.340112 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d800dbf-09fd-4c07-9c84-713abdcf9d74 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1315 microversion: 2.1 time: 0.651690 Oct 11 01:36:59.368370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1929/3879] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:36:58 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:36:59.512321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:59.521405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:59.522847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:36:59.540841 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8276f67-8707-4825-9af6-f3526f50b01e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.726388 Oct 11 01:36:59.548371 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1951/3880] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:36:58 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:00.368181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:00.369478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:00.387419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:00.390256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:00.390937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:00.393099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:00.394352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:00.398954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:00.575776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:00.577160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:00.598115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:00.600058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:00.601719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:00.605742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:00.610214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:00.616194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:00.983672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:01.006684 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fed357e1-924c-44e0-8f04-f2c8e1b448a4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1501 microversion: 2.1 time: 0.638503 Oct 11 01:37:01.008295 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1930/3881] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:00 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:01.039502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:01.040381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:01.056674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:01.067443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:01.068910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:01.072576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:01.074842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:01.079812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:01.080501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:01.181180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lazy-loading 'flavor' on Instance uuid 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:37:01.270689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:01.286782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:01.290662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:01.294122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.723951 Oct 11 01:37:01.298115 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1952/3882] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:00 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:02.236893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:02.238712 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002184 Oct 11 01:37:02.240699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1953/3883] 10.222.0.66 () {56 vars in 886 bytes} [Tue Oct 11 01:37:02 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 01:37:02.249313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:02.250826 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002911 Oct 11 01:37:02.251522 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1954/3884] 10.222.0.66 () {54 vars in 1035 bytes} [Tue Oct 11 01:37:02 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 11 01:37:02.258955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:02.262419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003590 Oct 11 01:37:02.263089 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1955/3885] 10.222.0.66 () {54 vars in 1041 bytes} [Tue Oct 11 01:37:02 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:37:02.271760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:02.273189 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad532205-2c74-4eef-bbe1-450abbfc71b1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001997 Oct 11 01:37:02.273775 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1956/3886] 10.222.0.66 () {56 vars in 886 bytes} [Tue Oct 11 01:37:02 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 01:37:02.329396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:02.330006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:02.340966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:02.344744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:02.345439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:02.350286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:02.351062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:02.351693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:02.766385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:02.777203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:02.779679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:02.782801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d64a8fe-a17b-4194-b211-3a81afddc351 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.457312 Oct 11 01:37:02.784072 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1957/3887] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:02 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:03.817277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:03.817944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:03.832503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:03.840123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:03.840588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:03.841338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:03.842304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:03.842832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:04.319570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:04.336178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:04.341123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:04.347002 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1693929-426a-45e2-a507-ee511e3737e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.533313 Oct 11 01:37:04.348572 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1958/3888] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:03 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:05.381324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:05.382814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:05.395052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:05.395900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:05.405832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:05.407433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:05.408247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:05.408908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:06.461735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:06.466482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:06.480803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:06.482298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:06.483564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b06c336-172a-4ed4-b71c-7802612d498a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 1.109413 Oct 11 01:37:06.495667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1959/3889] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:05 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:07.326448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34f7d120-2440-4888-bf11-19f24467e257 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Action: 'create', calling method: .version_select at 0x7f112f014670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-15022564", "metadata": {"Type": "work"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:08.185143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34f7d120-2440-4888-bf11-19f24467e257 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.481439 Oct 11 01:37:08.186705 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1960/3890] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Oct 11 01:37:06 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1484 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 11 01:37:08.202432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:08.203610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:08.219264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:08.222269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:08.224210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:08.225217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:08.227371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:08.228386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:08.525502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:08.534980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:08.536331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:08.537550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb804a39-a02d-4838-a4ae-1573d04820cf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.339825 Oct 11 01:37:08.552168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1961/3891] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:08 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:08.562448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1103c01e-fd6d-45a1-aaa0-7dc3fbf7d54d tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112f014790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:08.699437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1103c01e-fd6d-45a1-aaa0-7dc3fbf7d54d tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 200 len: 351 microversion: 2.1 time: 0.146036 Oct 11 01:37:08.700037 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1962/3892] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:08 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:09.567048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:09.567890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:09.581333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:09.585932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:09.586391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:09.587148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:09.587635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:09.595688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:10.161230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:10.183624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:10.185513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:10.186756 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d4c3607-d9a3-4286-9e31-b17d1a3477be tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.624717 Oct 11 01:37:10.203743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1963/3893] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:09 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:10.227793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a41ab91-093b-4278-adda-6815a582f89a tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112f12e820>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:10.389004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a41ab91-093b-4278-adda-6815a582f89a tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 200 len: 352 microversion: 2.1 time: 0.183702 Oct 11 01:37:10.389607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1964/3894] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:10 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:10.404121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7804a31-a76d-4dd5-a6f0-9dda239e6f4a tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f11389709d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:10.586523 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a7804a31-a76d-4dd5-a6f0-9dda239e6f4a tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 200 len: 352 microversion: 2.1 time: 0.187587 Oct 11 01:37:10.588239 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1965/3895] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:10 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:37:10.604433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-531cd932-5ae3-4424-ad96-9cd7d368e912 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112efd30d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:11.170343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:11.378493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:11.423223 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-531cd932-5ae3-4424-ad96-9cd7d368e912 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 202 len: 0 microversion: 2.1 time: 0.824852 Oct 11 01:37:11.424182 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1966/3896] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:37:10 2022] DELETE /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:37:11.432120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:11.432574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:11.439788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=48 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:11.453823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:11.466181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:11.467035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:11.468176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:11.470210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:11.475628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:11.785175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:11.802175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:11.814456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:11.818044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96b312cc-226c-48e6-a781-ed95887c612c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.390217 Oct 11 01:37:11.820934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1967/3897] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:11 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:11.831838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cb4863a1-28c4-4ae6-94f5-894bbbdee3b8 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112efd3dc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:12.047561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cb4863a1-28c4-4ae6-94f5-894bbbdee3b8 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 200 len: 351 microversion: 2.1 time: 0.225462 Oct 11 01:37:12.048873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1968/3898] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:11 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:12.852755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:12.854166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:12.866909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:12.867765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:12.869638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:12.873403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:12.874550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:12.881311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:13.183918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:13.199877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:13.204117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:13.208394 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00ce30c1-b5df-4076-8e97-5d611adc4455 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.360834 Oct 11 01:37:13.210134 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1969/3899] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:12 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:13.222572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-825f73d8-8ff7-4c46-bb35-c3e676afe5d0 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112f014c10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:13.385687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-825f73d8-8ff7-4c46-bb35-c3e676afe5d0 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 200 len: 351 microversion: 2.1 time: 0.173762 Oct 11 01:37:13.387152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1970/3900] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:13 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:14.239180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:14.240260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:14.283227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:14.285122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:14.288788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:14.303075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:14.306909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:14.308240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:16.145910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:16.160588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:16.165514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:16.167801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ac7b1bb-e58c-48f1-8d30-c4a90b5695cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 1.932759 Oct 11 01:37:16.168747 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1971/3901] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:14 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:16.173994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25223b53-a562-4996-b179-d663d91343b4 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Calling method '.version_select at 0x7f112efe70d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:16.208966 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-25223b53-a562-4996-b179-d663d91343b4 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] HTTP exception thrown: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25223b53-a562-4996-b179-d663d91343b4 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Request method failure captured: Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec HTTP/1.1 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMjCLFynXXelzz1Ip2QDY4aDgmtmQiVbzRw5Zc0cMM_uMkAlJC_-5HPy61vzLBaR7djYPHyXKCvzGMdKPV1CAH0JguhoNi9fAeQ1hELBtKWrnjSnXNHpRz0OR5olCjubPwqqGU5OfOHVEEQ_7Crd54aUZ06y6BFaz0ola8piCDlsdtM Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 895f27cc534749a497c53b14eea42e7c Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesGetTestJSON-880553378 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/895f27cc534749a497c53b14eea42e7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_895f27cc534749a497c53b14eea42e7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/895f27cc534749a497c53b14eea42e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/895f27cc534749a497c53b14eea42e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesGetTestJSON-880553378 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 895f27cc534749a497c53b14eea42e7c Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesGetTestJSON-880553378 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesGetTestJSON-880553378-project Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 020e7665175f41be83416f69d8663646 Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesGetTestJSON-880553378-project Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: exception: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'baaa58fe-557a-475b-ba37-934d9bd8e8ec'} Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. (HTTP 404) (Request-ID: req-9e2a9fab-2eaf-4979-bd50-34db25e6c327) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 01:37:16.211366 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. Oct 11 01:37:16.215892 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:37:16.222997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25223b53-a562-4996-b179-d663d91343b4 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] Returning 404 to user: Volume baaa58fe-557a-475b-ba37-934d9bd8e8ec could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:37:16.224175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25223b53-a562-4996-b179-d663d91343b4 tempest-VolumesGetTestJSON-880553378 tempest-VolumesGetTestJSON-880553378-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec" status: 404 len: 109 microversion: 2.1 time: 0.054210 Oct 11 01:37:16.228209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1972/3902] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 01:37:16 2022] GET /compute/v2.1/os-volumes/baaa58fe-557a-475b-ba37-934d9bd8e8ec => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:37:17.224014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:17.224706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:17.259625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:17.261764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:17.264440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:17.269100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:17.270771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:17.276174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:18.182449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:18.208484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:18.220819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:18.226763 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78748a52-c720-4c5e-b7fd-f1a2d422cde6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 1.021904 Oct 11 01:37:18.231581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1973/3903] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:17 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:19.259894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:19.262024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:19.273119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:19.286194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:19.290506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:19.293555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:19.294056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:19.297471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:20.110828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:20.144911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:20.152766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:20.154184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d61c83ed-bb33-4ac6-8b7a-9c02fba319d3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.901757 Oct 11 01:37:20.157857 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1974/3904] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:19 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:21.186302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:21.186931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:21.219383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:21.219921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:21.220373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:21.225424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:21.225996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:21.226451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:21.999354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:22.015470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:22.027097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:22.032818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-31a1d300-61ef-4d3d-b4f5-44103ab0f302 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.852449 Oct 11 01:37:22.032818 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1975/3905] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:21 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:23.062517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:23.063304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:23.092792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:23.098097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:23.098630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:23.108241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:23.116611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:23.117397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:24.134372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:24.152552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:24.159685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:24.161649 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd99c343-f37e-415f-a370-fba4614ef1b8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 1.103184 Oct 11 01:37:24.169904 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1976/3906] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:23 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:24.574158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20ab18c1-5578-476c-8d3d-94b071189204 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9/action" status: 202 len: 0 microversion: 2.1 time: 23.541647 Oct 11 01:37:24.583913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:24.584734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:24.587678 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1931/3907] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:37:01 2022] POST /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9/action => generated 0 bytes in 23556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:37:24.597592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:24.600248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:24.602424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:24.603596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:24.608066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:24.608778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:25.064948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:25.075980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dca453bc-bab2-4cea-a394-fb7c9c1a184a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1507 microversion: 2.1 time: 0.496054 Oct 11 01:37:25.077248 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1977/3908] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:24 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:25.194557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:25.195276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:25.205677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:25.206523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:25.207233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:25.212193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:25.213169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:25.214751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:25.847272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:25.879491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:25.884589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:25.889483 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bad2ff8b-6713-42ec-b0d5-7efd871c7565 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1737 microversion: 2.20 time: 0.701413 Oct 11 01:37:25.893368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1932/3909] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:25 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1737 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:26.105268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:26.105885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:26.137755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.138268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.138767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:26.139549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.140007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.140430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:26.648748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:26.649251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:26.671731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.672307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.672782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:26.673500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.676662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:26.678438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.678955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:26.692926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67b1dccf-36f5-4331-98ae-7a2af2b8a581 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1507 microversion: 2.1 time: 0.593198 Oct 11 01:37:26.695650 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1978/3910] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:26 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:26.924838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:26.925841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:26.938195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.942503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.943695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:26.944836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:26.945521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:26.946423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:27.169211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.181748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.183779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.185074 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cd91aac-5127-4a1d-a33c-0eb86e7c3935 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2954 microversion: 2.42 time: 0.540861 Oct 11 01:37:27.199960 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1933/3911] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:26 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2954 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:27.214987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:27.215800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:27.233469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:27.234226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:27.235024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:27.236210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:27.236827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:27.237418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:27.358345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.369176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.375365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:27.380914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-404a5995-2b0c-4499-a9af-309b38ffe414 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1719 microversion: 2.20 time: 0.461915 Oct 11 01:37:27.384219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1979/3912] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:26 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1719 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:27.478392 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a85550b-6b8e-4cae-a0e1-802779f90247 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.267688 Oct 11 01:37:27.480925 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1934/3913] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:37:27 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776/os-interface => generated 1832 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:27.720692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:27.722735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:27.734595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:27.735146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:27.738414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:27.739378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:27.739866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:27.743894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:28.413271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:28.414061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:28.427804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:28.430004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:28.430496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:28.431264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:28.435755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:28.436275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:28.775959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:28.784808 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abb3c9d9-29a7-4f13-a636-7eb9ca8e9194 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1507 microversion: 2.1 time: 1.069473 Oct 11 01:37:28.785933 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1980/3914] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:27 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1507 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:28.866491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:28.880853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:28.882310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:28.884084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e2b9e49-65f7-456c-823d-329961228bd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1719 microversion: 2.20 time: 0.475434 Oct 11 01:37:28.885146 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1935/3915] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:28 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1719 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:29.812450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:29.813080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:29.823841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:29.824805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:29.825403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:29.826381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:29.828741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:29.830707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:29.915563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:29.917406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:29.932086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:29.937031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:29.937891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:29.939387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:29.940050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:29.940863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:30.382671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:30.405631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:30.410605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:30.414738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f302ca5-9004-42d4-9482-2ec9e0590be4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1719 microversion: 2.20 time: 0.504296 Oct 11 01:37:30.418935 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1936/3916] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:29 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1719 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:30.444861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:30.461959 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-877bd285-35c1-4bc6-8a7e-5fea8deeb7cf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1507 microversion: 2.1 time: 0.656506 Oct 11 01:37:30.465245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1981/3917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:29 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:30.774815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "name": "network-vif-unplugged", "status": "completed", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:30.794738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:30.795570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:30.796237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:30.823194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] Creating event network-vif-unplugged:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h1-772273-9 Oct 11 01:37:30.839393 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a4aba092-1110-423f-a16c-46e588ca40e0 req-d19b10e9-d2c0-4d61-9b32-2109118abdd6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068550 Oct 11 01:37:30.841599 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1937/3918] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:31.451721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:31.454059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:31.474942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:31.477343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:31.479813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:31.481230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:31.484212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:31.486757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:31.495543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:31.498930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:31.520244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:31.522459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:31.523234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:31.524813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:31.527166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:31.528695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:32.083730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:32.096980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:32.099357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:32.101444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9bcae7b3-24d8-4d41-86fa-a3b98fc1415b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1662 microversion: 2.20 time: 0.655133 Oct 11 01:37:32.102043 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1982/3919] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:31 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1662 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:32.129684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:32.136164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eef96a4-0554-49f6-ada3-330c8bf28cc5"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:32.144937 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afdc377b-7d4e-46a2-943f-86fc185ed1c8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1528 microversion: 2.1 time: 0.654945 Oct 11 01:37:32.146048 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1938/3920] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:31 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1528 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:32.147789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:32.154843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:32.181218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:32.181218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:32.181218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:32.181218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:32.186430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:32.599696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:32.939177 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f48416fe-0e4d-4e4c-894b-1321063e738c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.807956 Oct 11 01:37:32.942139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1983/3921] 10.222.0.66 () {62 vars in 1364 bytes} [Tue Oct 11 01:37:32 2022] POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 188 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:37:33.170075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:33.170714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:33.179381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.179885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.184278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.199036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.199765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.205485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.211993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:33.213277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:33.225951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.227162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.227955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.228927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.236208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.241720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.394537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120493) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 01:37:33.555070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:33.563397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-deab3f1c-5724-4659-a960-34356d5c6006 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1528 microversion: 2.1 time: 0.397262 Oct 11 01:37:33.572010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1939/3922] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:33 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1528 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:33.594358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71938bcc-f5cc-4471-9d8e-358164fcd623 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/action" status: 202 len: 0 microversion: 2.20 time: 0.387948 Oct 11 01:37:33.602409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1984/3923] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:37:33 2022] POST /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:37:33.607512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:33.608201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:33.618320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.618893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.620010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.626521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:33.627265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:33.627881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:33.943869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:33.965672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:33.967199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:33.969241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b87a03f-528b-4bb2-bbb3-c01476886408 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1748 microversion: 2.20 time: 0.365533 Oct 11 01:37:33.970402 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1940/3924] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:33 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1748 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:34.592273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:34.597602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:34.612910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:34.620451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:34.621322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:34.622253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:34.622895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:34.623663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:34.997272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:34.998179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:35.014347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:35.019651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:35.020220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:35.021080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:35.021658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:35.022192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:35.880509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:35.890723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe7acf06-8a2c-4280-bfdd-2d5db62ba883 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1528 microversion: 2.1 time: 1.304360 Oct 11 01:37:35.895501 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1985/3925] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:34 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1528 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:36.062840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:36.079252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:36.082839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:36.089489 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7460fed5-ce9f-4627-ab71-3da26b9d1426 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1748 microversion: 2.20 time: 1.095369 Oct 11 01:37:36.091123 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1941/3926] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:34 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1748 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:36.922450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:36.923071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:36.941667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:36.942181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:36.946096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:36.948568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:36.952876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:36.954375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:37.117767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:37.119796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:37.136577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:37.138631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:37.139310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:37.142002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:37.143239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:37.143992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:37.647781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:37.660757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:37.674441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:37.680164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a99fe622-9772-4ea2-a8dc-e474df4068b4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1748 microversion: 2.20 time: 0.568330 Oct 11 01:37:37.686779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1942/3927] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:37 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1748 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:37.748497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:37.761528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5087a0c1-776e-418b-b3e2-16c82dee4bd6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 0.842675 Oct 11 01:37:37.764293 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1986/3928] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:36 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:38.532692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ebf720-fa16-42fb-a5ed-7a506f4cf8c9", "name": "network-vif-plugged", "status": "completed", "tag": "3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:37:38.582880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:38.583095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:38.590949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:38.653785 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] Creating event network-vif-plugged:3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693 for instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 on n-h2-772273-9 Oct 11 01:37:38.686302 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-35233fbf-b7ed-43f5-be5a-f075ab2d1ae8 req-acfc8a4f-9ff8-4fb8-b4e6-2876a3645bd1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153894 Oct 11 01:37:38.687254 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1943/3929] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:37:38.709682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:38.710916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:38.742553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:38.744156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:38.746231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:38.749251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:38.749742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:38.750181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:38.791862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:38.792811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:38.804859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:38.805740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:38.807753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:38.810550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:38.812426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:38.817266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:39.502371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:39.537779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:39.539932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:39.545168 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5bb4f9f-8c57-40ea-8971-d70823e9aee1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 0.840028 Oct 11 01:37:39.545809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:39.555704 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1987/3930] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:38 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:39.557794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-509ccff3-635c-498e-9b67-e5cbf3e1e6a5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 0.773180 Oct 11 01:37:39.559672 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1944/3931] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:38 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:40.590724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:40.591406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:40.596248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:40.598756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:40.653744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:40.654242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:40.654689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:40.656542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:40.657039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:40.657480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:40.658182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:40.664486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:40.665034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:40.665478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:40.668817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:40.673420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:42.330614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:42.345198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:42.350942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:42.358294 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02e6f0d3-27f3-431a-9ab0-26c1d2a28c13 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.778110 Oct 11 01:37:42.359695 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1988/3932] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:40 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:42.377434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:42.388062 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a826129e-2b24-495f-9f35-a31c7897ca2d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.805270 Oct 11 01:37:42.398234 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1945/3933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:40 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:43.397096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:43.397716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:43.425447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:43.426203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:43.436901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:43.459848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:43.460473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:43.460920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:43.477968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:43.481131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:43.482486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:43.512874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:43.514032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:43.514537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:43.515263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:43.517575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:43.525570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:45.064553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:45.072776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-728f4331-f117-46c2-a0ab-4def9a96c328 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.652177 Oct 11 01:37:45.091200 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1946/3934] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:43 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:45.096219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:45.105852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:45.116387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:45.117952 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5953ddf6-efab-4ca0-92b4-4986cfe4cd37 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.725360 Oct 11 01:37:45.118936 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1989/3935] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:43 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:46.098790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:46.099560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:46.114777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:46.115594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:46.116255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:46.118776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:46.123085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:46.123887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:46.147180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:46.148664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:46.179024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:46.195372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:46.202346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:46.203638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:46.207032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:46.207932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:47.128878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:47.144015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:47.158769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:47.160977 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0fe44e0a-75a9-4a8a-a775-514275fae2fb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.018101 Oct 11 01:37:47.176419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1990/3936] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:46 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:37:47.526817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:47.540824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73ee081f-d5da-49ac-af81-7ef3cbae5c62 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.446159 Oct 11 01:37:47.564949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1947/3937] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:46 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:48.193245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:48.194048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:48.209927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:48.214598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:48.215206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:48.221962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:48.222601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:48.223153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:48.572114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:48.572811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:48.583589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:48.588244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:48.588931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:48.589838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:48.592333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:48.597805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:49.496383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:49.523595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:49.535149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:49.545318 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7914acb6-6d35-4ed2-9eef-e4d656c75fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.348577 Oct 11 01:37:49.557276 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1991/3938] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:48 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:49.571404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:49.588274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dbc63e0-ac27-4941-85d7-29da1ca60c72 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.020087 Oct 11 01:37:49.605191 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1948/3939] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:48 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:50.577893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:50.579563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:50.598541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:50.600657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:50.604863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:50.606000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:50.606688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:50.607660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:50.617820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:50.619366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:50.655227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:50.656256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:50.659536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:50.660692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:50.666321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:50.672136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:51.299428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:51.305024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:51.315462 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a5bf1c5-a10f-408d-9449-8050ad3f567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 0.694948 Oct 11 01:37:51.316160 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1949/3940] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:50 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:37:51.319669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:51.323083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:51.328875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e01c166-c9d9-4160-855e-23df0ce333a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 0.758052 Oct 11 01:37:51.353797 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1992/3941] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:50 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:52.343516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:52.344219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:52.353574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:52.356995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:52.358860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:52.359904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:52.363215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:52.364275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:52.364780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:52.365400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:52.365760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:52.387101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:52.387633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:52.395804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:52.397834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:52.405161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:52.405629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:52.442189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:37:53.363956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:53.378192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:53.380711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:53.389089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:53.391541 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0f12744-6fb9-4525-ad06-b5eed80cf9a2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.031921 Oct 11 01:37:53.393049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7067e398-bef6-4882-a4e3-633adee54c46 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.054244 Oct 11 01:37:53.393409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1993/3942] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:52 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:53.427034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1950/3943] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:52 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:54.428451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:54.429182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:54.455135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:54.458040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:54.460650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:54.465834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:54.466929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:54.473614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:54.478987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:54.482013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:54.515853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:54.527971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:54.533807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:54.537936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:54.544161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:54.547530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:55.710877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:55.730212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:55.732024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:55.739750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8c5808b-cc0e-459b-bd64-628ba7624257 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1750 microversion: 2.20 time: 1.318985 Oct 11 01:37:55.740992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1994/3944] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:54 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1750 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:37:55.796988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:55.828356 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41b49ec2-b18f-4f7b-b655-a0f6c44efc19 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.379121 Oct 11 01:37:55.829473 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1951/3945] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:54 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:56.775171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:56.777090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:56.788631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:56.789406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:56.789998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:56.790877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:56.792771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:56.793384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:56.861868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:37:56.862414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:37:56.886309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:56.888050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:56.891524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:56.894744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:37:56.896295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:37:56.899641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:37:59.060714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:59.080454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7075865b-ba95-4098-a01c-770bbf825c16 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 2.223667 Oct 11 01:37:59.084549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1952/3946] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:37:56 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:37:59.171775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:59.209017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:59.211604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:37:59.213013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60b54c93-b3c4-4554-a371-b66f7ad5f388 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 2.441866 Oct 11 01:37:59.216094 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1995/3947] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:37:56 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:00.120291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:00.121522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:00.138096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:00.141768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:00.142397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:00.147671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:00.148360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:00.149347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:00.248052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:00.249172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:00.284778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:00.285278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:00.285718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:00.286427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:00.286885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:00.287302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:01.324492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:01.338957 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-551482ab-16d9-41a8-a7af-dcae33e6acc0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.222734 Oct 11 01:38:01.339652 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1953/3948] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:00 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:01.449043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:01.466736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:01.473254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:01.485715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1ebecae-89de-4b4d-ae30-4427dba09752 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.238764 Oct 11 01:38:01.492403 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1996/3949] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:00 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:02.024348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:02.059165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:02.061325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:02.061325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:02.110779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] Creating event network-changed:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h2-772273-9 Oct 11 01:38:02.122162 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-10d0a1eb-b58d-415a-8101-097f19c2b9a4 req-7c36e965-f418-42b0-8fff-37d6f537748f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106618 Oct 11 01:38:02.125806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1954/3950] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:38:02.363897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:02.365025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:02.379482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:02.391668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:02.396863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:02.399143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:02.399947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:02.406564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:02.517028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:02.522881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:02.524254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:02.589111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:02.589954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:02.590891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:02.594503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:02.597082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:02.598178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:03.260538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:03.303115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:03.312994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:03.314317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cd6d28d-3ff2-4756-be38-b7cd2f2e36e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.797501 Oct 11 01:38:03.332230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1955/3951] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:02 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:03.466380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:03.475761 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c9786af-2db4-456f-bfa1-b261ff4ee058 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.116087 Oct 11 01:38:03.497573 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1997/3952] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:02 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:04.361258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:04.361862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:04.374379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:04.384209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:04.387668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:04.395482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:04.396287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:04.400781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:04.502428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:04.503099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:04.516719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:04.518670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:04.519672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:04.522568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:04.527261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:04.530736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:05.513753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:05.530981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:05.542432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:05.543992 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-443d3fa4-36a0-49b7-aebe-91efd9eeae3d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.186918 Oct 11 01:38:05.544718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1956/3953] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:04 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:05.621894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:05.637154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5fbec7d6-70b1-42e7-873f-313d6ae31237 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.138640 Oct 11 01:38:05.642883 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1998/3954] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:04 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:06.587564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:06.589057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:06.602964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:06.604972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:06.606353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:06.607255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:06.607926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:06.608501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:06.672623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:06.673711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:06.750365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:06.761312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:06.762320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:06.769600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:06.774693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:06.777884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:07.461016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:07.475633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:07.480384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:07.492903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-141e9f2d-4d43-411b-b60e-7451200b3923 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.913339 Oct 11 01:38:07.509553 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1957/3955] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:06 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:07.745578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:07.797997 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5253afa1-343c-4769-9b38-f9204758db0c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.129068 Oct 11 01:38:07.798677 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 1999/3956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:06 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:08.533815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:08.539484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:08.564665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:08.568510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:08.569213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:08.570124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:08.575552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:08.577039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:08.826718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:08.827323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:08.850036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:08.850594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:08.854703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:08.856823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:08.860188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:08.861280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:09.998832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:10.012653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98628051-c75d-4de1-bb85-2b7b9f81bba5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1523 microversion: 2.1 time: 1.191337 Oct 11 01:38:10.014908 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2000/3957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:08 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1523 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:10.074786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:10.099732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:10.101442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:10.102818 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-154e7f64-f7b1-43e3-ac50-0c140dbcbe63 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.579315 Oct 11 01:38:10.116077 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1958/3958] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:08 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:11.044896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:11.045532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:11.064529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:11.065306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:11.065947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:11.068143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:11.069489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:11.074511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:11.148989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:11.149634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:11.186769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:11.187568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:11.188171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:11.190245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:11.196015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:11.200286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:12.596938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:12.607458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:12.608932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:12.610141 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a013c72b-cd25-4951-9e3c-46fadc44d475 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.473462 Oct 11 01:38:12.613461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1959/3959] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:11 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:12.747966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:12.769892 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b36e23b1-0478-44a2-be52-665f30f6224e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1505 microversion: 2.1 time: 1.727553 Oct 11 01:38:12.774452 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2001/3960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:11 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1505 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:13.640684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:13.641302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:13.650167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:13.650686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:13.651120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:13.651854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:13.652304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:13.653051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:13.804667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:13.805488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:13.809140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=26 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:13.840650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:13.843162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:13.844189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:13.851610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:13.853084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:13.854254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:14.444715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:14.484444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:14.486223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:14.492814 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e585cad1-a5db-483e-886f-2c4004c7cbfe tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.855834 Oct 11 01:38:14.493704 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1960/3961] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:13 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:14.776817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:14.806012 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b8dede4-0aa7-4231-a288-ec2bd3ebd928 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1505 microversion: 2.1 time: 1.004894 Oct 11 01:38:14.809213 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2002/3962] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:13 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1505 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:15.531792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:15.533787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:15.545789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:15.547214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:15.547912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:15.548645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:15.549269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:15.550384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:15.774200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:15.786859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:15.789346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:15.790833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96d2d223-e2e1-42e2-9ec9-55d80acaffe3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.271167 Oct 11 01:38:15.793014 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1961/3963] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:15 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:15.835949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:15.836980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:15.847159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:15.848377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:15.849112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:15.851873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:15.852657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:15.854426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:16.075610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ebf720-fa16-42fb-a5ed-7a506f4cf8c9", "name": "network-vif-unplugged", "status": "completed", "tag": "3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:16.088975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:16.089740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:16.090407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:16.090726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:16.101905 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b55b7035-1384-49a9-a23b-f2ea1ed0b389 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1505 microversion: 2.1 time: 0.270946 Oct 11 01:38:16.107203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] Creating event network-vif-unplugged:3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693 for instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 on n-h2-772273-9 Oct 11 01:38:16.112909 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1962/3964] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:15 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:16.118216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-abbb4e50-3434-4773-a7d1-c96d2326db38 req-f9c79068-a73b-4489-9f91-5e52e9d196f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.520420 Oct 11 01:38:16.120154 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2003/3965] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:38:16.818583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:16.819880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:16.841960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:16.842972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:16.843761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:16.855065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:16.856057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:16.858105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:17.128870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:17.131501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:17.146480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:17.149221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:17.152675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:17.154235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:17.155906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:17.157863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:17.830275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:17.880282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:17.886556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:17.889128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67c56905-ecb4-4f68-9790-35dd58759d2c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.074787 Oct 11 01:38:17.892011 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1963/3966] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:16 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:18.534906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:18.547108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf425659-84ba-4573-8864-1ea02751098f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1505 microversion: 2.1 time: 1.422952 Oct 11 01:38:18.560053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2004/3967] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:17 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1505 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:18.922612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:18.923228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:18.938633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:18.944153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:18.944927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:18.945847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:18.946552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:18.947134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:19.576527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:19.578311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:19.596515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:19.599084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:19.599838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:19.602041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:19.604282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:19.605988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:19.975463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:19.999308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:20.000879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:20.007904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd3bdc58-cab3-48d1-aa05-e3833f74bf39 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.083838 Oct 11 01:38:20.008773 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1964/3968] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:18 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:20.230596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:20.239916 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f58b2b19-7618-46b7-b7b4-413019f3f595 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 200 len: 1448 microversion: 2.1 time: 0.667867 Oct 11 01:38:20.247425 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2005/3969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:19 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 1448 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:20.286420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:20.289134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:20.305293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:20.310510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:20.311197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:20.312626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:20.316172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:20.326023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:20.395955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:38:20.419980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Working on deleting snapshot 5c298801-4a97-4dc2-91d3-bb8c8497e2b2 from shelved instance... Oct 11 01:38:21.034103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:21.035655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:21.051503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:21.053689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:21.054333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:21.056654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:21.056654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:21.057096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:21.742001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:21.755294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:21.757050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:21.763144 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21aa0f52-b072-4e42-b3be-e949743c21e4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.730607 Oct 11 01:38:21.764311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2006/3970] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:21 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:21.932742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Doing local delete in cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120494) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 01:38:21.933563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:21.934057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:21.934390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:21.934951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 01:38:21.944694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] deallocate_for_instance() {{(pid=120494) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 01:38:22.792391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:22.793013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:22.805711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:22.806231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:22.807831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:22.812488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:22.813186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:22.815146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:23.146804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:23.169551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:23.171499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:23.172909 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8a28bfb-6a39-4288-a456-4caa8f557810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.384679 Oct 11 01:38:23.173812 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2007/3971] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:22 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:23.526463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:23.546978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Updating instance_info_cache with network_info: [] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:38:23.564301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ebf720-fa16-42fb-a5ed-7a506f4cf8c9", "name": "network-vif-deleted", "tag": "3b40c97e-5d6d-4fdf-b5c9-0d92ae8e2693"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:23.607278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:23.608644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:23.609334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:23.662940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_external_events [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] Unable to find a host for instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9. Dropping event network-vif-deleted {{(pid=120493) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 01:38:23.664624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1c075265-6ba4-4157-853e-3b5aa762c0f4 req-8a04fefd-1eb3-441a-b9c8-5d045687281e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104146 Oct 11 01:38:23.668669 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2008/3972] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 109 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 01:38:24.137747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=34 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:24.202960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:24.204240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:24.225255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:24.226022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:24.226635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:24.227585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:24.233410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:24.234146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:24.393405 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9949b5d7-9d60-434e-b548-0c1cf75f0fd9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 204 len: 0 microversion: 2.1 time: 4.119474 Oct 11 01:38:24.402336 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1965/3973] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:38:20 2022] DELETE /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 0 bytes in 4122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:38:24.414022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:24.415792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:24.434856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:24.435647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:24.436122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:24.438601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:24.439128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:24.440956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:24.476862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 HTTP/1.1 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '10ebf720-fa16-42fb-a5ed-7a506f4cf8c9'} Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:38:24.481199 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:38:24.486276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:38:24.486883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b32b769-747f-4458-8014-de63b7d8fdfc tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 404 len: 111 microversion: 2.1 time: 0.079590 Oct 11 01:38:24.487159 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1966/3974] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:24 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:38:24.534931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:24.545141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:24.551831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:24.559161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca3b0ccf-a519-4635-8586-89e7d4b36aca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.361619 Oct 11 01:38:24.564420 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2009/3975] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:24 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:24.830347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1669508100", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:24.997051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:38:25.606384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:25.607072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:25.621279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:25.621775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:25.622217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:25.622942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:25.623417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:25.623845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:26.234606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:26.257290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:26.270177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:26.277439 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29169def-52de-4c80-b417-e1218b9e84ac tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.674837 Oct 11 01:38:26.278581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2010/3976] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:25 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:27.310868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:27.311516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:27.341713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:27.349484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:27.350036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:27.350824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:27.351309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:27.351769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:27.502049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:38:27.502557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:38:27.504420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:38:27.504990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:38:27.505657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:38:27.524015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:27.530359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:27.531181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:27.532297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:27.536146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:27.536922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:27.607398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:38:27.626259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:38:27.697317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:38:27.711879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:38:27.862949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:27.884907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:27.885909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bbe5ffb7-f768-44e9-bfbe-0d94971ac265 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.053754 Oct 11 01:38:27.888421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1967/3977] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:38:27.889640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:27.891263 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ad086a1-e88c-44f4-a6c2-fb6389f81cf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.584736 Oct 11 01:38:27.920110 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2011/3978] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:27 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:27.926941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c0a6edf-eaf9-442c-b13f-8ac368213d96 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:27.927880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c0a6edf-eaf9-442c-b13f-8ac368213d96 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:28.219853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c0a6edf-eaf9-442c-b13f-8ac368213d96 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:28.228575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c0a6edf-eaf9-442c-b13f-8ac368213d96 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1215 microversion: 2.1 time: 0.313590 Oct 11 01:38:28.236575 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1968/3979] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:27 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:28.921791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:28.923174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:28.971525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:28.982489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:28.985987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:29.001099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:29.001970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:29.002428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:29.266567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:29.267995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:29.297889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:29.301816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:29.302552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:29.304084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:29.313405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:29.314257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:29.483809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:29.492095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d2ac8e6-4354-4abe-ad74-83b0a9818d82 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1211 microversion: 2.1 time: 0.237500 Oct 11 01:38:29.496406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1969/3980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:29 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1211 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:29.576181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:29.594881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:29.596766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:29.602483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85d7b35d-a2f9-44c5-ae32-6c3c90198c97 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.685081 Oct 11 01:38:29.615738 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2012/3981] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:28 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:30.533430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:30.537692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:30.554366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:30.555045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:30.555654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:30.558838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:30.559835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:30.559959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:30.632956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:30.634265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:30.656712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:30.657544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:30.658218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:30.659213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:30.659959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:30.661251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:30.797418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:30.811600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5590f0c5-3978-4231-8b5f-e76ed1971ec6 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1273 microversion: 2.1 time: 0.281962 Oct 11 01:38:30.812735 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1970/3982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:30 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:31.484197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:31.501981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:31.505361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:31.508651 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ae8acfa-021d-4573-93ff-7db0ce91bb6f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.879605 Oct 11 01:38:31.539192 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2013/3983] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:30 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:38:31.846113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:31.846708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:31.856021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:31.856526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:31.856950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:31.857651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:31.858097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:31.864125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:32.060923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:32.072309 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0586ead-1da7-4ca0-8a4b-e6d98a5b822c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1273 microversion: 2.1 time: 0.233371 Oct 11 01:38:32.073150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1971/3984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:31 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:32.555285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:32.556743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:32.565561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:32.566396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:32.567037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:32.568001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:32.568658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:32.569282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:33.096306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:33.096925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:33.123765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:33.124988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:33.126247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:33.132374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:33.133516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:33.139170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:33.647535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:33.654740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:33.670344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:33.672154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:33.673604 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd3ec55c-8432-40ff-8c50-d22fd7d2f187 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.124165 Oct 11 01:38:33.674717 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2014/3985] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:32 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:34.227917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:34.237630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b91e7ef-8d9b-4d78-8821-80f599dba41a tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 1.145196 Oct 11 01:38:34.238502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1972/3986] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:33 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:34.720258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:34.726693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:34.738518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:34.739375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:34.740638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:34.741787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:34.742496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:34.743563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:35.278630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:35.280597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:35.316092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:35.316926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:35.317557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:35.318912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:35.323151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:35.323833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:35.583164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:35.602563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:35.605747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:35.608707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b5e6f21-0660-49e0-b6cc-ece7fec4ed25 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.911428 Oct 11 01:38:35.611873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2015/3987] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:34 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:36.169760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:36.182690 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3a74957-6c7d-4990-a2f4-65321fc3b0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.923249 Oct 11 01:38:36.188751 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1973/3988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:35 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:36.641891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:36.642528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:36.653357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:36.654309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:36.654865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:36.656663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:36.657215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:36.667786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:37.210800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:37.212559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:37.238727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:37.243051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:37.244622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:37.250403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:37.252056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:37.253308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:37.578153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:38.102242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:38.114369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:38.115871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:38.124569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f850da6c-d6fc-4356-9548-4f817b3ba7c8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 1.490015 Oct 11 01:38:38.126173 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2016/3989] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:36 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:38.147495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e3bc5f-5479-4e6a-83e8-59561985a0df", "tag": "9f4dffda-d50a-4b07-947f-e603ba94070f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:38.161244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:38.161899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:38.162342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:38.181119 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] Creating event network-changed:9f4dffda-d50a-4b07-947f-e603ba94070f for instance 36e3bc5f-5479-4e6a-83e8-59561985a0df on n-h2-772273-9 Oct 11 01:38:38.188401 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5b1f74e0-d467-4f34-ab33-4c256ebff175 req-a066aff7-d170-4b93-b22b-5e1e45474c30 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060716 Oct 11 01:38:38.189133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2017/3990] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:38:38.201505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:38.212704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "name": "network-vif-plugged", "status": "completed", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:38.216282 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-677d38db-ddcf-4e9c-83d7-e1959c84696b tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 1.009247 Oct 11 01:38:38.217135 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1974/3991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:37 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:38.235287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:38.235988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:38.236438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:38.271130 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] Creating event network-vif-plugged:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h2-772273-9 Oct 11 01:38:38.285117 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-da19c90c-cef3-4cf5-995e-22d3acc7c09a req-7cbc3a96-2c77-4ec8-bc0a-ead32d07d55c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092012 Oct 11 01:38:38.288970 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2018/3992] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:38:39.154585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:39.155204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:39.157814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:39.164280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:39.165039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:39.165702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:39.167192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:39.167923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:39.168574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:39.243036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:39.244589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:39.259242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:39.261504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:39.262589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:39.263645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:39.264335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:39.265332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:39.759075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:39.773317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:39.779022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:39.781166 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-297887d7-6296-474d-ad25-f04e0fe5cb47 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.630496 Oct 11 01:38:39.782371 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1975/3993] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:39 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:39.813562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:39.827401 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cb8a246c-6471-4b00-a44f-179b23457ce4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.592639 Oct 11 01:38:39.831685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2019/3994] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:39 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:40.810332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:40.811046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:40.838447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:40.843203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:40.845074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:40.846848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:40.847365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:40.847827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:40.858155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:40.858992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:40.874531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:40.875047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:40.875526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:40.879765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:40.880556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:40.886844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:41.336913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:41.349272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:41.365693 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6cd88a81-1f59-4e46-9a1c-8ea54e2fe4ea tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.513243 Oct 11 01:38:41.371361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:41.372666 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2020/3995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:40 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:41.376245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:41.380244 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-02fba55b-5319-4991-b057-6e02af2d794e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.577128 Oct 11 01:38:41.382942 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1976/3996] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:40 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:42.415727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:42.416275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:42.428207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:42.428706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:42.463088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:42.467741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:42.468241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:42.471305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:42.496077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:42.496732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:42.515200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:42.517853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:42.518514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:42.521849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:42.527513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:42.528155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:43.279000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:43.288765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:43.290538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:43.295870 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e1045f5-457c-4bb6-bfd1-b9d862b2c385 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.884737 Oct 11 01:38:43.296988 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2021/3997] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:42 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:43.322508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:43.335507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a9e6289-3726-4271-bcf1-3d12137cddb7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.856743 Oct 11 01:38:43.347896 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1977/3998] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:42 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:44.327136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:44.328016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:44.350173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=40 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:44.354023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:44.354472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:44.354923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:44.355683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:44.359640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:44.360323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:44.372803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:44.374007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:44.383193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:44.392493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:44.395359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:44.396338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:44.401557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:44.402270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:44.892469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:44.911172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:44.913256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:44.914707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2fdf53ab-aa84-42eb-ae18-365e7f2fd8a4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1806 microversion: 2.20 time: 0.591573 Oct 11 01:38:44.941417 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2022/3999] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:44 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1806 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:44.945981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:44.956305 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85274b36-7260-4a64-8c5a-337ae77b95b2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.588012 Oct 11 01:38:44.960758 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1978/4000] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:44 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:45.948834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:45.949453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:45.957471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:45.957471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:45.957752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:45.958294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:45.958761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:45.959215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:45.982807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:45.983463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:46.007281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:46.361290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:46.378943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:46.388592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:46.389545 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f546df5e-1c44-44d2-ad03-fca45354f6bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1793 microversion: 2.20 time: 0.444724 Oct 11 01:38:46.390139 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2023/4001] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:38:45 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1793 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:38:46.419860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e3bc5f-5479-4e6a-83e8-59561985a0df", "name": "network-vif-plugged", "status": "completed", "tag": "9f4dffda-d50a-4b07-947f-e603ba94070f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:46.441616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:46.443846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:UPDATE=15,nova_cell1:SELECT=81,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:46.452910 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8a681f9-ca89-49dc-98a4-d3c71fa0392e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.474616 Oct 11 01:38:46.453638 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1979/4002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:45 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:38:46.456904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:46.457410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:46.457854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:46.492332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] Creating event network-vif-plugged:9f4dffda-d50a-4b07-947f-e603ba94070f for instance 36e3bc5f-5479-4e6a-83e8-59561985a0df on n-h2-772273-9 Oct 11 01:38:46.499139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-148a41b8-f5d9-49e5-9ddd-ebaaac250fef req-461e40fd-3112-43ce-8225-a690b5dae729 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093838 Oct 11 01:38:46.504947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2024/4003] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:38:47.481192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:47.481810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:47.496799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:47.497528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:47.498192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:47.498921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:47.501789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:47.502450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:48.402444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:48.414872 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eee33531-8803-48a0-a53c-1b60a876296e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1315 microversion: 2.1 time: 0.938243 Oct 11 01:38:48.416124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1980/4004] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:47 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:49.452637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:49.456274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:49.492237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:49.503239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:49.517869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:49.519132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:49.522223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:49.526861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:50.073199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:50.088632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-23acb516-2933-4c60-a514-e08a695e4487 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1501 microversion: 2.1 time: 0.649605 Oct 11 01:38:50.105714 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2025/4005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:49 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1501 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:50.125500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:38:50.149243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:50.154412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:50.155838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:50.240150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:38:50.367508 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b419fbe-f7f7-43e9-aad7-7489677fa7d8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df/action" status: 202 len: 0 microversion: 2.1 time: 0.238495 Oct 11 01:38:50.368715 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1981/4006] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:38:50 2022] POST /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:38:50.379704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:50.380684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:50.403940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:50.405159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:50.405833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:50.412331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:50.413156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:50.413810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:50.882262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:50.891790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd8b61c9-987d-47cd-87c5-8bd6697ce504 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.518130 Oct 11 01:38:50.895787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2026/4007] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:50 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:51.919694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:51.921218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:51.940529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:51.941297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:51.941825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:51.942631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:51.943165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:51.943736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:52.518529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:52.533210 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e6178d6-19d5-4ac8-ac5b-db8b627929c4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.619027 Oct 11 01:38:52.554410 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1982/4008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:51 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:53.557936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:53.558549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:53.569928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:53.571828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:53.572596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:53.574141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:53.576018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:53.577073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:53.971575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:53.983956 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58f6d854-748f-406b-95aa-e9a3d5e7e583 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.429760 Oct 11 01:38:53.985029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2027/4009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:53 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:55.010453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:55.011703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:55.018628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:38:55.039320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:55.045767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:55.059837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:55.060674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:55.061176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:55.061682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:55.459953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:55.473113 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14cb4e5d-d063-486c-b7d3-8eeb0e922f30 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.466059 Oct 11 01:38:55.479199 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1983/4010] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:55 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:56.501713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:56.504077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:56.517800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:56.518434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:56.518748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:56.523133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:56.526291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:56.526792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:56.984332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:56.997025 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-76ebf9db-0eb8-4049-8e7e-39f4eaeb3c7e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.498968 Oct 11 01:38:57.001412 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2028/4011] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:56 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:58.031197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:58.033343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:58.049399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:58.049777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:58.050260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:58.050992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:58.065638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:58.065638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:58.425183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:58.434000 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a458b8f-bc64-4df9-8eae-0b3270ffd1ba tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.411651 Oct 11 01:38:58.435873 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1984/4012] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:58 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:38:59.463242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:38:59.463895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:38:59.474530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:59.479944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:59.483873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:59.484861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:38:59.488386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:38:59.490925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:38:59.747251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:38:59.756778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b68fb7a1-1aa0-48ee-abf6-53832288ad9c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.302552 Oct 11 01:38:59.777145 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2029/4013] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:38:59 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:00.783948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:00.785486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:00.798556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:00.799168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:00.799834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:00.800998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:00.801721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:00.802353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:01.077942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:01.091015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a58b0833-0b6a-4dce-bce5-48a499a77c11 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.312968 Oct 11 01:39:01.093321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1985/4014] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:00 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:02.121978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:02.123362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:02.140626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:02.141726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:02.142675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:02.143866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:02.144601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:02.145263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:02.520431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:02.530058 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a53f06c1-9d6f-4edb-8246-7aa0b27cac00 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.413213 Oct 11 01:39:02.538914 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2030/4015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:02 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:03.565667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:03.567222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:03.583681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:03.584517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:03.586783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:03.589118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:03.590520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:03.593760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:03.915711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:03.933001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d001b96-d9da-483d-b200-0a41b5f77c2f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.366926 Oct 11 01:39:03.936420 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1986/4016] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:03 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:04.969921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:04.971852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:05.004334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:05.004927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:05.009040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:05.010421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:05.011068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:05.015352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:05.043063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=86 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:05.374295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:05.382340 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ca3b2f9-d29e-44d3-9d8e-ac45caacdbad tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.427839 Oct 11 01:39:05.382931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2031/4017] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:04 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:06.410510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:06.411598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:06.430704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:06.432817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:06.433265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:06.433994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:06.435299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:06.436623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:06.856615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:06.870498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cc3ded0e-de05-437b-8843-c05e93fe0aa3 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.463824 Oct 11 01:39:06.871686 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1987/4018] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:06 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:07.894985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:07.896216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:07.917065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:07.917779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:07.918380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:07.919274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:07.919913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:07.920493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:08.344851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:08.355571 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39596161-0109-42e6-886b-9ad727982e61 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.462193 Oct 11 01:39:08.356958 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2032/4019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:07 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:09.389842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:09.392915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:09.412867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:09.417313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:09.418921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:09.422500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:09.424071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:09.425506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:10.717318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:10.731303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3fc3bbea-93f1-4c1f-968c-53625dd35514 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 1.352293 Oct 11 01:39:10.732718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1988/4020] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:09 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:11.763754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:11.763754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:11.770855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:11.771377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:11.771838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:11.772549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:11.773001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:11.773430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:12.483904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:12.502218 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-114efde1-28fc-4bc2-aa9d-b33a6e926069 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.745835 Oct 11 01:39:12.506939 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2033/4021] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:11 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:13.534794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:13.536235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:13.552664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:13.553157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:13.559566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:13.564359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:13.565132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:13.567417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:14.023743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:14.036228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc51bf64-c4a8-4051-99ba-5ae304f2b9ce tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.503793 Oct 11 01:39:14.047731 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1989/4022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:13 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:15.065170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:15.065855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:15.077715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=24 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:15.094226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:15.095068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:15.096789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:15.100488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:15.101099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:15.101646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:15.438660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:15.451744 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a744b5c-10ce-4d36-b7f2-9e1cd9fc567c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1511 microversion: 2.1 time: 0.390238 Oct 11 01:39:15.455270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2034/4023] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:15 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:16.482781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:16.483497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:16.500516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:16.501233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:16.501942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:16.507328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:16.508234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:16.508862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:16.824690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:16.841208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-19cb28d4-215b-4a49-bc31-7e95bfc50c45 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1488 microversion: 2.1 time: 0.361879 Oct 11 01:39:16.842618 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1990/4024] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:16 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1488 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:16.868062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:16.868757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:16.880605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:16.881282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:16.881848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:16.889497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:16.890180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:16.890847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:16.958741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:39:17.245767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af62f40a-98e4-4553-a602-3d91471ec1cd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 204 len: 0 microversion: 2.1 time: 0.378337 Oct 11 01:39:17.246745 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2035/4025] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:16 2022] DELETE /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:39:17.256188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:17.257409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:17.272224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:17.272727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:17.273173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:17.273906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:17.284952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:17.290424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:17.565840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:17.579657 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2cb16b5-e0cd-423c-84d0-7b932f77b1dd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1494 microversion: 2.1 time: 0.328701 Oct 11 01:39:17.593224 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1991/4026] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:17 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1494 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:18.605774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:18.606548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:18.621855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:18.622363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:18.627728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:18.635720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:18.636536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:18.637178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:19.309687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:19.327316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5795d52-7a65-4885-b25d-ef1ef2c3fb09 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1494 microversion: 2.1 time: 0.726172 Oct 11 01:39:19.344270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2036/4027] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:18 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1494 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:20.043179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e3bc5f-5479-4e6a-83e8-59561985a0df", "name": "network-vif-deleted", "tag": "9f4dffda-d50a-4b07-947f-e603ba94070f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:20.064291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:20.068017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:20.070952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:20.114506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:20.117014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] Creating event network-vif-deleted:9f4dffda-d50a-4b07-947f-e603ba94070f for instance 36e3bc5f-5479-4e6a-83e8-59561985a0df on n-h2-772273-9 Oct 11 01:39:20.129030 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ad7a3167-5726-4775-bbbb-a7606afc2682 req-a81b5ddf-4dae-4751-916d-a8a6db238ce6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089979 Oct 11 01:39:20.130010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1992/4028] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:20.797645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:20.798290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:20.808851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:20.809358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:20.809797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:20.811652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:20.812286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:20.812903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:20.879674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:20.880578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:20.881401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:20.882319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lazy-loading 'fault' on Instance uuid 36e3bc5f-5479-4e6a-83e8-59561985a0df {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:39:20.994462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:21.007681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63e7b546-ab0d-4bb9-8e58-c96afa81e912 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 200 len: 1305 microversion: 2.1 time: 0.658574 Oct 11 01:39:21.035859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2037/4029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:20 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 1305 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:22.043816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:22.044529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:22.067617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:22.068118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:22.068570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:22.073650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:22.074480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:22.074949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:22.157256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df HTTP/1.1 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '36e3bc5f-5479-4e6a-83e8-59561985a0df'} Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:22.163814 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:22.168184 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:22.175607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:22.176995 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a0bcd5b-eb91-4447-b596-fd7e565afccf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 404 len: 111 microversion: 2.1 time: 0.139070 Oct 11 01:39:22.185833 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1993/4030] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:22 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:39:22.433430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-956854794", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "80ff0d17-ce84-4718-b438-9e7e01531695"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:22.580742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] validate_networks() for [('80ff0d17-ce84-4718-b438-9e7e01531695', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:39:23.481148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:39:23.483558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:39:23.484242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:39:23.484817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:39:23.485929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:39:23.501842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:23.502350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:23.502802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:23.503598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:23.504073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:23.504509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:23.542621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:39:23.551987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Getting quotas for user 187ec65453c343a4a0d375e30ef9ea93 and project 4cc0e5a7fa8b49c9be1b206e047ac440. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:39:23.566928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:39:23.572784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:39:23.708762 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0739824b-0217-41c9-878b-b28b0e5ac0e5 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281090 Oct 11 01:39:23.723844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69ba34ff-4bcb-4d53-8917-353a700da919 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:23.724547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69ba34ff-4bcb-4d53-8917-353a700da919 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:23.732509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2038/4031] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:39:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:39:23.847062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69ba34ff-4bcb-4d53-8917-353a700da919 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:23.859658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69ba34ff-4bcb-4d53-8917-353a700da919 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1214 microversion: 2.1 time: 0.139820 Oct 11 01:39:23.860263 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1994/4032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:23 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:24.891101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:24.892862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:24.908878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:24.910788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:24.923134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:24.924770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:24.925498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:24.926789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:25.075615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:25.104380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-264c89da-deb1-4302-8fe7-b0c76f67478c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1210 microversion: 2.1 time: 0.222861 Oct 11 01:39:25.129376 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2039/4033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:24 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1210 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:39:26.132822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:26.135426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:26.163748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:26.184692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:26.185548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:26.202190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:26.207638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:26.208163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:26.210161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:26.411228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:26.428028 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6be7bff-8b12-4758-9b05-ca85be611d99 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1272 microversion: 2.1 time: 0.299476 Oct 11 01:39:26.430014 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1995/4034] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:26 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:27.457263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:27.458634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:27.477860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:27.484777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:27.485519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:27.486882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:27.487620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:27.492339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:27.786257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:27.799467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-604d1698-c389-4ba6-910b-b2e16acfc485 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.344675 Oct 11 01:39:27.811371 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2040/4035] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:27 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:39:28.826930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:28.828423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:28.841701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:28.842485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:28.852544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:28.855377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:28.858607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:28.859402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:29.625537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:29.639100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a75c2de-4c3f-4218-92dd-3198b69a9c5f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.816253 Oct 11 01:39:29.662236 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1996/4036] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:28 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:30.678381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:30.680165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a9313e-7f54-4ea7-b788-566054c81a13", "tag": "cd7a85d8-a0cb-4605-bb32-58c97d8d11ed"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:30.682489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:30.704493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:30.705004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:30.709551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:30.715134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:30.715994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:30.718971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:30.719730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:30.720547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:30.722547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:30.765722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] Creating event network-changed:cd7a85d8-a0cb-4605-bb32-58c97d8d11ed for instance 00a9313e-7f54-4ea7-b788-566054c81a13 on n-h1-772273-9 Oct 11 01:39:30.773118 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-73473bdd-1082-4b53-a88e-265042421e42 req-c2f4b234-b5d1-4966-a7fa-c43c9a52853d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434752 Oct 11 01:39:30.773750 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2041/4037] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:31.271326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:31.282131 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18c1b02b-7e2c-4b7b-ae13-26be772c9c73 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.620458 Oct 11 01:39:31.295789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1997/4038] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:30 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:32.313577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:32.316944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:32.379971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:32.380616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:32.381082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:32.381840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:32.382307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:32.382743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:32.873214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:32.887895 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e4b5693-96b7-41eb-8fb8-63e993033138 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.580962 Oct 11 01:39:32.892363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2042/4039] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:32 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:33.014904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:33.015459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:33.023818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.029139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.029779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:33.036232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.036733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.037182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:33.098533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:39:33.302296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bbeeee39-728b-494d-85fe-3f784c22cf41 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "DELETE /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 204 len: 0 microversion: 2.42 time: 0.814480 Oct 11 01:39:33.303470 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1998/4040] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:39:32 2022] DELETE /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:39:33.318394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:33.319195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:33.326034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.326680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.327173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:33.327925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.328384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.328953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:33.530386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:33.560123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:33.622432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:33.636812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:33.638943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:33.642421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-921b5510-b68b-43bc-b435-c3048c18d4a2 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2960 microversion: 2.42 time: 0.328652 Oct 11 01:39:33.643830 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2043/4041] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:33 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2960 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:33.919901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:33.920799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:33.936592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:33.940551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.944047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.944844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:33.947169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:33.948474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:33.951135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:34.453686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:34.470563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c9527d8-ccae-47de-8739-7df07d95f869 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.556242 Oct 11 01:39:34.471506 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1999/4042] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:33 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:34.680116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:34.684103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:34.695864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:34.697570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:34.698367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:34.700202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:34.700984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:34.704785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:35.185835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:35.188302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:35.200859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:35.202980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:35.205122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f6bad4b6-8d0d-4b17-91e1-feabf1d7034a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2960 microversion: 2.42 time: 0.532829 Oct 11 01:39:35.206554 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2044/4043] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:34 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2960 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:35.496137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:35.497536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:35.505640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:35.506476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:35.507144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:35.508222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:35.509449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:35.510254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:35.767823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:35.786744 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75d612dd-1241-45c9-8138-a046bdd9f6f2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.296022 Oct 11 01:39:35.787461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2000/4044] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:35 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:36.255047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:36.257710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:36.275905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:36.276476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:36.277144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:36.278546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:36.280453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:36.281073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:36.729302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:36.778864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:36.784556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:36.789229 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b913f27c-0f0f-472a-b791-89d381d3745e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2960 microversion: 2.42 time: 0.550755 Oct 11 01:39:36.796070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2045/4045] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:36 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2960 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:36.813222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:36.814579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:36.830238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:36.830742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:36.831190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:36.831943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:36.849320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:36.849897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:37.257161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:37.272222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81959a2c-d121-4b0e-9a0c-a15c0cbf0a08 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.462914 Oct 11 01:39:37.278646 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2001/4046] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:36 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:37.379599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a9313e-7f54-4ea7-b788-566054c81a13", "name": "network-vif-plugged", "status": "completed", "tag": "cd7a85d8-a0cb-4605-bb32-58c97d8d11ed"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:37.405202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:37.412763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:37.420010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:37.462592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] Creating event network-vif-plugged:cd7a85d8-a0cb-4605-bb32-58c97d8d11ed for instance 00a9313e-7f54-4ea7-b788-566054c81a13 on n-h1-772273-9 Oct 11 01:39:37.484368 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e0ea1e57-8cfe-4ae5-a43b-45a05bcb1c97 req-0ce2e3d8-b626-427c-b7f6-032a7b6d08cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106713 Oct 11 01:39:37.489423 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2046/4047] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:37.834456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:37.835226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:37.858053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:37.859137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:37.862966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:37.867285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:37.867927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:37.869706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:38.303049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:38.304128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:38.327125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:38.343776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:38.348970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:38.351961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:38.356900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:38.361233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:38.855405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:38.875692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:38.881775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:38.884896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ad627aa-dde7-4a87-8c5a-29e30bbc178e tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2939 microversion: 2.42 time: 1.054600 Oct 11 01:39:38.907251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:38.911481 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2002/4048] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:37 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2939 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:38.919658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6d15162-0098-49b1-b7de-40c9b272f733 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1314 microversion: 2.1 time: 0.626215 Oct 11 01:39:38.933050 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2047/4049] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:38 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:39.548230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-unplugged", "status": "completed", "tag": "b510dbd3-acee-4e6e-b655-3ae36a550333"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-unplugged", "status": "completed", "tag": "88b5f2a6-484e-422b-8d8d-041afd050a51"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:39.574315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:39.575994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:39.576609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:39.608724 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Creating event network-vif-unplugged:b510dbd3-acee-4e6e-b655-3ae36a550333 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:39.609251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] Creating event network-vif-unplugged:88b5f2a6-484e-422b-8d8d-041afd050a51 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:39.627115 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7938d8cb-1ed3-49e5-a207-a27d91dbe53e req-89247e6a-82e5-46c0-a127-0f312bf49ff9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.083797 Oct 11 01:39:39.631026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2003/4050] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:39.921527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:39.922966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:39.939557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:39.942875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:39.944137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:39.945679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:39.947800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:39.948097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:39.949337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:39.950515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:39.960575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:39.961070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:39.971211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:39.972128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:39.972627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:39.973075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:40.668511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:40.684449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:40.691466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:40.693175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2273a26d-3b3a-45fd-9057-aa5473362e15 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2939 microversion: 2.42 time: 0.778882 Oct 11 01:39:40.696809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2048/4051] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:39 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2939 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:40.723554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:40.736110 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-441eea0d-bec6-4767-86ba-db07db924adf tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1500 microversion: 2.1 time: 0.789800 Oct 11 01:39:40.738699 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2004/4052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:39 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1500 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:40.775774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:40.776548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:40.786010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:40.786728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:40.787376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:40.788265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:40.788884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:40.789478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:40.870194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lazy-loading 'flavor' on Instance uuid 00a9313e-7f54-4ea7-b788-566054c81a13 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:39:41.176180 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15c7822f-e2ba-418c-9e36-3d09d653d58f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "POST /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13/action" status: 202 len: 0 microversion: 2.1 time: 0.406581 Oct 11 01:39:41.183627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2049/4053] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:39:40 2022] POST /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:39:41.187521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:41.188145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:41.200571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:41.209398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:41.210115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:41.212544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:41.216882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:41.217599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:41.610407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:41.626287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e32f34c-9539-4fd6-97ad-ddb7d97a6af8 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1508 microversion: 2.1 time: 0.442431 Oct 11 01:39:41.628563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2005/4054] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:41 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:39:41.731739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:41.732474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:41.752571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:41.753154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:41.753616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:41.754363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:41.767145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:41.767756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:41.885107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-unplugged", "status": "completed", "tag": "d2e62e92-5fe7-440b-9b51-94c01c3b6ff2"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-unplugged", "status": "completed", "tag": "d7ac2b47-05d7-4f7c-8500-83d41abe71b6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:41.914048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:41.932521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:41.933663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:41.976327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Creating event network-vif-unplugged:d2e62e92-5fe7-440b-9b51-94c01c3b6ff2 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:41.976876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] Creating event network-vif-unplugged:d7ac2b47-05d7-4f7c-8500-83d41abe71b6 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:41.994381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-14c18d56-61c1-4481-a148-b3deaf47cc75 req-89a8d506-7379-47da-9138-10ad79df362f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.113616 Oct 11 01:39:42.001236 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2006/4055] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:42.016804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-deleted", "tag": "d2e62e92-5fe7-440b-9b51-94c01c3b6ff2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:42.044166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:42.046596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:42.048080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:42.086484 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] Creating event network-vif-deleted:d2e62e92-5fe7-440b-9b51-94c01c3b6ff2 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:42.112917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5791c640-0fcd-4590-944e-11baf9bea1b4 req-13276dad-7bc3-43a3-9f67-778b89cd29d7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106256 Oct 11 01:39:42.116321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2007/4056] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:42.147267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:42.168081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:42.169566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:42.170884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98db8a79-c77e-4236-8841-050bc9a3c5c9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2871 microversion: 2.42 time: 0.444358 Oct 11 01:39:42.171480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2050/4057] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:41 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2871 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:42.655135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:42.655793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:42.674197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:42.674710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:42.675162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:42.684186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:42.684699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:42.685149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.201765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:43.202951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:43.215827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.218898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.219387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.221649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.222128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.222616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.312067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:43.323439 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26eb4561-b382-4701-b6aa-700b5c503bc9 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1491 microversion: 2.1 time: 0.673759 Oct 11 01:39:43.326858 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2008/4058] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:42 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1491 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:43.357684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:43.359880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:43.380917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.387556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.390174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.392236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.392840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.395937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.503795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:39:43.711784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:43.787949 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b79ce50-fb85-416e-80a5-fb037102ce27 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 204 len: 0 microversion: 2.1 time: 0.434569 Oct 11 01:39:43.791687 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2009/4059] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:43 2022] DELETE /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:39:43.801752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:43.802468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:43.813843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.814340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.816412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:43.820403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:43.822381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:43.823020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:44.482035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:44.494366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80a2d075-61c7-499e-a607-d1f18a172de4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1497 microversion: 2.1 time: 0.699695 Oct 11 01:39:44.498770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2010/4060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:43 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1497 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:44.509564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-unplugged", "status": "completed", "tag": "2384d352-10d1-4281-aa0f-caf21e0925fb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:44.514940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:44.529434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:44.529581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:44.531007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:44.532133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:44.533250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:44.546701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d382564-c1dd-4809-8a5a-30128451ecab tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2710 microversion: 2.42 time: 1.348760 Oct 11 01:39:44.549167 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2051/4061] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:43 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2710 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:44.566166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-deleted", "tag": "88b5f2a6-484e-422b-8d8d-041afd050a51"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:44.578715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] Creating event network-vif-unplugged:2384d352-10d1-4281-aa0f-caf21e0925fb for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:44.589040 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b19d5660-b192-4834-9adc-5ff3f4b58ddf req-7540c297-1202-43ac-9916-6369774b070f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088511 Oct 11 01:39:44.596381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2011/4062] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:44.612106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:44.614590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:44.621473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:44.646362 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] Creating event network-vif-deleted:88b5f2a6-484e-422b-8d8d-041afd050a51 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:44.666720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2343c91b-7fa9-4427-ac7c-9a9cf5b5552c req-2e84c572-adde-424a-a579-471b73ebf156 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114702 Oct 11 01:39:44.667762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2052/4063] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:45.528844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:45.529568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:45.559253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:45.559797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:45.560248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:45.560988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:45.571909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:45.572737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:45.582794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:45.584089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:45.603402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:45.610215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:45.612703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:45.613176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:45.618689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:45.619629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:45.620097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:46.034549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:46.049520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28d90cf7-7600-4e93-bb0f-212827800517 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1497 microversion: 2.1 time: 0.532190 Oct 11 01:39:46.074900 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2012/4064] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:45 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1497 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:46.183154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:46.197987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:46.200898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:46.206494 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d690221b-1efa-4613-b5e8-38a74adb2ff5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2549 microversion: 2.42 time: 0.628890 Oct 11 01:39:46.217005 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2053/4065] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:45 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2549 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:46.684452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-deleted", "tag": "2384d352-10d1-4281-aa0f-caf21e0925fb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:46.701702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:46.704445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:46.706755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:46.741063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] Creating event network-vif-deleted:2384d352-10d1-4281-aa0f-caf21e0925fb for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:46.757452 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3d250bc3-67ef-4d6f-97e5-fd46e697fcc8 req-7b33e412-83b1-4353-9ff5-d22170c133a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076659 Oct 11 01:39:46.776731 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2013/4066] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:47.082067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:47.083525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:47.098442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:47.098938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:47.103936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:47.103936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:47.103936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:47.118605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:47.238261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:47.239320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:47.252662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:47.253514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:47.254543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:47.257844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:47.261935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:47.262495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:47.679619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187ec65453c343a4a0d375e30ef9ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc0e5a7fa8b49c9be1b206e047ac440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:47.692664 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-277a29cc-006b-4628-b3bb-95d9419b3e7c tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 200 len: 1455 microversion: 2.1 time: 0.614403 Oct 11 01:39:47.700447 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2054/4067] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:47 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 1455 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:39:47.796282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:47.828210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:47.834102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:47.836523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81e43724-f1df-495b-9ee9-08d822546ff6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 2276 microversion: 2.42 time: 0.603715 Oct 11 01:39:47.841783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2014/4068] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:47 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 2276 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:39:48.145530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a9313e-7f54-4ea7-b788-566054c81a13", "name": "network-vif-deleted", "tag": "cd7a85d8-a0cb-4605-bb32-58c97d8d11ed"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:48.176433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.177081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.177621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.221897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] Creating event network-vif-deleted:cd7a85d8-a0cb-4605-bb32-58c97d8d11ed for instance 00a9313e-7f54-4ea7-b788-566054c81a13 on n-h1-772273-9 Oct 11 01:39:48.241062 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-24045c21-06fc-4734-95e3-07966c112715 req-dd10eb04-afb6-4d24-90ba-ab09e0de2574 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.539357 Oct 11 01:39:48.247070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2055/4069] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:48.725552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:48.726552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:48.738922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.745309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.747776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.748780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.750633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.751267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.776728 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 HTTP/1.1 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '00a9313e-7f54-4ea7-b788-566054c81a13'} Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.779188 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.784495 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.786855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:48.787944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f52caf2b-998f-49b4-b340-cff04bc6af8e tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 404 len: 111 microversion: 2.1 time: 0.067687 Oct 11 01:39:48.788765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2015/4070] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:48 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:48.801543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:48.802616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:48.811021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.812472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.813088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.813995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.814614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.815254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.838066 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 HTTP/1.1 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '00a9313e-7f54-4ea7-b788-566054c81a13'} Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:48.843142 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.848456 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.853052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:48.854266 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-258d680a-aea6-4c18-8649-09bc9a751def tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 404 len: 111 microversion: 2.1 time: 0.058836 Oct 11 01:39:48.854512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-deleted", "tag": "b510dbd3-acee-4e6e-b655-3ae36a550333"}, {"server_uuid": "28aeee3e-c9db-42d0-9f35-e8b8a6f58776", "name": "network-vif-deleted", "tag": "d7ac2b47-05d7-4f7c-8500-83d41abe71b6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:39:48.859586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2056/4071] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:48 2022] DELETE /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:39:48.866401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:48.867600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 00a9313e-7f54-4ea7-b788-566054c81a13] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:48.874010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.877700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.878440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.879210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.880274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.883365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.884798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.896887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.897942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.920342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Creating event network-vif-deleted:b510dbd3-acee-4e6e-b655-3ae36a550333 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:48.929505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] Creating event network-vif-deleted:d7ac2b47-05d7-4f7c-8500-83d41abe71b6 for instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 on n-h1-772273-9 Oct 11 01:39:48.942175 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-87255390-a5e3-4998-9182-498927de96af req-fc5d11bc-dba5-48a8-8ff1-d58bbd05718a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091697 Oct 11 01:39:48.943781 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 HTTP/1.1 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '00a9313e-7f54-4ea7-b788-566054c81a13'} Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:48.947592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. Oct 11 01:39:48.952749 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:48.954893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 00a9313e-7f54-4ea7-b788-566054c81a13 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:48.955358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2016/4072] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:39:48.956386 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8721b2b-739e-431a-a797-391c9ee75ba2 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13" status: 404 len: 111 microversion: 2.1 time: 0.094621 Oct 11 01:39:48.957377 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2057/4073] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:48 2022] GET /compute/v2.1/servers/00a9313e-7f54-4ea7-b788-566054c81a13 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:48.964227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:48.970442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:48.971809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:48.972886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:48.986329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.988286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.988985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.989558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.991095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.991816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.992196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.992797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.994227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:48.994850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:48.996977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:48.999428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.047740 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df HTTP/1.1 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '36e3bc5f-5479-4e6a-83e8-59561985a0df'} Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.053733 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.059705 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.064119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.067436 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ec662aa-2ce8-48f2-b83a-d28856a70b34 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 404 len: 111 microversion: 2.1 time: 0.104330 Oct 11 01:39:49.072989 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2058/4074] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:48 2022] DELETE /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.090177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.091891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 36e3bc5f-5479-4e6a-83e8-59561985a0df] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.146084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.150972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.151927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.153902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.156737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.157323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.191332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df HTTP/1.1 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '36e3bc5f-5479-4e6a-83e8-59561985a0df'} Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.193334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. Oct 11 01:39:49.199394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.206696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 36e3bc5f-5479-4e6a-83e8-59561985a0df could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.207890 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eb4f6a21-e3e2-4059-9741-d034200dce02 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df" status: 404 len: 111 microversion: 2.1 time: 0.130463 Oct 11 01:39:49.208721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2059/4075] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:49 2022] GET /compute/v2.1/servers/36e3bc5f-5479-4e6a-83e8-59561985a0df => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.222129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.223035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.236843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.239275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.239975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.240933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.241599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.242241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.268894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:49.289176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:49.292160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:49.293427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a2876a3-40bf-44ba-a5cf-f0ba2838c5d5 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.336735 Oct 11 01:39:49.293995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2017/4076] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:48 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:49.294972 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 HTTP/1.1 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '10ebf720-fa16-42fb-a5ed-7a506f4cf8c9'} Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.296623 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.300444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7975954d-6e40-4557-9a33-8d621967a949 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 404 len: 111 microversion: 2.1 time: 0.085248 Oct 11 01:39:49.306827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2060/4077] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:49 2022] DELETE /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.320138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.325922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.342609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.345197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.346653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.349553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.350248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.353165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.409927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 HTTP/1.1 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '10ebf720-fa16-42fb-a5ed-7a506f4cf8c9'} Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.411949 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. Oct 11 01:39:49.417412 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.422144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.423645 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79acae18-f2d1-463f-a7f3-2bc2e61c9b63 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9" status: 404 len: 111 microversion: 2.1 time: 0.111035 Oct 11 01:39:49.432718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2018/4078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:49 2022] GET /compute/v2.1/servers/10ebf720-fa16-42fb-a5ed-7a506f4cf8c9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.437128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.437632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.444518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.445009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.445447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.446191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.446645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.447067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.490934 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 HTTP/1.1 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '1cca152c-1ae8-42b8-9697-dfe7c61b0613'} Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.513856 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.518409 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.519932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.522411 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f25380c7-e657-4d50-a1c1-7b058fd21ea0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 404 len: 111 microversion: 2.1 time: 0.089221 Oct 11 01:39:49.531073 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2061/4079] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:49 2022] DELETE /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.537156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.537788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 1cca152c-1ae8-42b8-9697-dfe7c61b0613] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.578791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.579227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.579727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.580451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:49.580913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:49.583016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:49.613962 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 HTTP/1.1 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1cca152c-1ae8-42b8-9697-dfe7c61b0613'} Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.617084 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. Oct 11 01:39:49.621690 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.626934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 1cca152c-1ae8-42b8-9697-dfe7c61b0613 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.628124 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a32a6cb-d27a-43a1-8b7c-d67c39e5944f tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613" status: 404 len: 111 microversion: 2.1 time: 0.096489 Oct 11 01:39:49.630266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2019/4080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:49 2022] GET /compute/v2.1/servers/1cca152c-1ae8-42b8-9697-dfe7c61b0613 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.638116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.638615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.650996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd HTTP/1.1 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd'} Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.652607 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.657879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-732aa5cf-751a-44e8-af8f-b5a6a5809ccd tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd" status: 404 len: 111 microversion: 2.1 time: 0.019820 Oct 11 01:39:49.661030 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2062/4081] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:39:49 2022] DELETE /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:39:49.663773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:49.666299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:49.677093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd HTTP/1.1 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd'} Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:39:49.681061 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:39:49.686043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:39:49.686043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:39:49.686043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:39:49.686043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. Oct 11 01:39:49.686043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:39:49.687555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:39:49.689409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1140c6d5-9be3-42d0-976c-33bbe0902ab0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd" status: 404 len: 111 microversion: 2.1 time: 0.029794 Oct 11 01:39:49.691854 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2020/4082] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:39:49 2022] GET /compute/v2.1/servers/0fed77a7-d48c-43b3-a3f5-0e81ca1cc9bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:39:50.269512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:50.270125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:50.288438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.289200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.290361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:50.292182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.292826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.296409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:50.329697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:50.330318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:50.358143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.360402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.361360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:50.363736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-270a5e16-963b-4e82-970d-be082304c91d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments/0eef96a4-0554-49f6-ada3-330c8bf28cc5" status: 200 len: 194 microversion: 2.20 time: 0.098201 Oct 11 01:39:50.366963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.367461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2063/4083] 10.222.0.66 () {60 vars in 1454 bytes} [Tue Oct 11 01:39:50 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments/0eef96a4-0554-49f6-ada3-330c8bf28cc5 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:50.367765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.371123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:50.499399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:50.517307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:50.519354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:50.520588 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69722d22-20cd-4e9c-b4ff-e99c555dbc3f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.195896 Oct 11 01:39:50.523100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2021/4084] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:50 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:39:50.711017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:50.723664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:50.746174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.747009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.747696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:50.748640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:50.749311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:50.749946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:51.211332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lazy-loading 'services' on Instance uuid 6b5c015a-c090-4722-8ef4-6340d39484ad {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:39:51.477684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-899452ff-ea6b-41b8-9b19-ba41796eccd2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments/0eef96a4-0554-49f6-ada3-330c8bf28cc5" status: 202 len: 0 microversion: 2.20 time: 0.776228 Oct 11 01:39:51.479594 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2064/4085] 10.222.0.66 () {60 vars in 1457 bytes} [Tue Oct 11 01:39:50 2022] DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments/0eef96a4-0554-49f6-ada3-330c8bf28cc5 => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:39:51.489095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:51.491563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:51.521677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:51.524297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:51.526543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:51.532524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:51.533949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:51.534721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:51.558358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:51.559205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:51.574709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:51.575859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:51.577690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:51.578672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:51.581100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:51.581682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:51.585603 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4be9665-df21-4e4d-bfcd-0e89dece9b81 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100025 Oct 11 01:39:51.595293 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2022/4086] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:51 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:51.674007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:51.691419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:51.693146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:51.694550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-22003dca-b6da-4c10-809b-3a4802ec53d8 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.143142 Oct 11 01:39:51.695671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2065/4087] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:51 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:52.599433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:52.601608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:52.625737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:52.626235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:52.626680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:52.627415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:52.640802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:52.642153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:52.722464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:52.724349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:52.731307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e67a2f05-3e38-4522-bb60-076a918c82f8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137022 Oct 11 01:39:52.732844 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2023/4088] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:52 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:52.739280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:52.742557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:52.744904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:52.746265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:52.747916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:52.749111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:52.801972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:52.923047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:52.939801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:52.945245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:52.952684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-191695f7-5873-4911-97d8-4d5950e2b30b tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.230595 Oct 11 01:39:52.954096 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2066/4089] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:52 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:53.744409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:53.747644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:53.770969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:53.775289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:53.777224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:53.778242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:53.779756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:53.782589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:53.893139 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8754a5bd-d963-42dd-a074-a2cb9afc6366 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152997 Oct 11 01:39:53.899974 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2024/4090] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:53 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:53.988431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:53.989511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:54.009882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:54.010649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:54.011944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:54.013864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:54.015718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:54.017090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:54.310269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:54.333544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:54.335333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:54.337467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee849d61-928c-41ec-9537-9f6cf48efc8a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.353184 Oct 11 01:39:54.338678 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2067/4091] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:53 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:39:54.913366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:54.916834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:54.939610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:54.942289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:54.943151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:54.945056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:54.948836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:54.949629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:55.030777 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d70feb6-ed99-4425-b52a-77453a2e6b07 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115565 Oct 11 01:39:55.040241 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2025/4092] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:54 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:55.371158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:55.372559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:55.381160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:55.381831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:55.382448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:55.383530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:55.384392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:55.385155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:55.530351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:55.540774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:55.543697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:55.545559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1db4aeb7-dac2-46c5-88ed-f46e11999120 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.179982 Oct 11 01:39:55.560219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2068/4093] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:55 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:56.051412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:56.054790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:56.075240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:56.081898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:56.082765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:56.083576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:56.084037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:56.084466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:56.157866 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-74247284-4217-4fde-be67-90fdc330055d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113815 Oct 11 01:39:56.158431 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2026/4094] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:56 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:56.574403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:56.575745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:56.594982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:56.595518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:56.595956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:56.596859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:56.597500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:56.598112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:56.810451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:56.858337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:56.862542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:56.864409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f2138a9-299c-44ca-a66b-b5b39a1b2fd6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.294974 Oct 11 01:39:56.865197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2069/4095] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:56 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:57.170981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:57.173266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:57.176196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:39:57.181545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:57.182728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:57.183403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:57.184316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:57.184997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:57.185641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:57.237666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ae64d7d-a70e-43d3-8d74-d0ac9ac10a3c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070614 Oct 11 01:39:57.238263 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2027/4096] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:57 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:39:57.896261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:57.897653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:57.905697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:57.907641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:57.908512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:57.914966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:57.918692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:57.919528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:58.073972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:58.097952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:58.102785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:58.124378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-960bb2c8-52a2-49e6-9402-f3509622b5cb tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.233902 Oct 11 01:39:58.125318 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2070/4097] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:57 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:39:58.252037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:58.254920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:58.262437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:58.263220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:58.263944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:58.264972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:58.265668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:58.266317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:58.300694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2418c72d-a361-4db4-b44f-5491f45f694d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052675 Oct 11 01:39:58.306789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2028/4098] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:58 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:39:59.153689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:59.155272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:59.170017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:59.171007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:59.171769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:59.172709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:59.173403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:59.174045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:59.279061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:59.289442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:59.291534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:39:59.294672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39ab9765-1d79-46ef-b092-d137ca183497 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.146272 Oct 11 01:39:59.295642 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2071/4099] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:39:59 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:39:59.314479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:39:59.319018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:39:59.327848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:59.328348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:59.328788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:59.330656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:39:59.331410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:39:59.331846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:39:59.366691 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cc7a290-a173-49f2-bd99-2d59b41d5513 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056196 Oct 11 01:39:59.373065 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2029/4100] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:39:59 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:40:00.325718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:00.326728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:00.339377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:00.342873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:00.343592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:00.344613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:00.348950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:00.349636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:00.380838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:00.382507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:00.400881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:00.401682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:00.402316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:00.405688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:00.410766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:00.411443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:00.432653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:00.444345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:00.446099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:00.447835 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25ef1aaf-b942-4977-b417-ba53332bc346 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.128073 Oct 11 01:40:00.449031 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2072/4101] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:00 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:00.466746 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a2687c3-0f82-4a49-aca5-657c4fd1efc9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090830 Oct 11 01:40:00.467676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2030/4102] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:40:00 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:40:01.474461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:01.475668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:01.484807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:01.488039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:01.504267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:01.505750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:01.506495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:01.508020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:01.508919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:01.509636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:01.512102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:01.512599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:01.513042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:01.513757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:01.519204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:01.519770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:01.547944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:01.601466 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5974f51-a41b-4442-95fa-7f9f7e80f34c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122078 Oct 11 01:40:01.608913 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2031/4103] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:40:01 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:40:01.630862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:01.640376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:01.642056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:01.643487 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab259118-8329-4aea-85ab-d7c66c5b484f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.173159 Oct 11 01:40:01.644775 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2073/4104] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:01 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:02.616446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:02.621507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:02.649895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:02.650433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:02.650877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:02.651621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:02.652090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:02.652516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:02.669179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:02.669791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:02.679849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:02.688004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:02.690847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:02.691926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:02.692556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:02.693176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:02.724259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6af25d6-b358-4bb1-ba1b-ea6670b348ee tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112411 Oct 11 01:40:02.731124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2032/4105] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:40:02 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:40:02.822200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:02.839815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:02.841474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:02.842876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d752be1a-7672-4820-bad5-de2745b1d925 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.177541 Oct 11 01:40:02.843486 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2074/4106] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:02 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:03.742837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:03.745283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:03.761378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:03.761840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:03.765282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:03.766073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:03.767328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:03.771397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:03.807512 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e503212b-6be0-4a8e-9a41-b5738e034205 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068620 Oct 11 01:40:03.808440 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2033/4107] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:40:03 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:40:03.871064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:03.872483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:03.880289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:03.881025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:03.881612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:03.882702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:03.883938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:03.887757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:03.977219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:03.996506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:03.998177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:03.999595 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2fecea7f-afbe-4883-a3fa-14b7510c70dd tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.133743 Oct 11 01:40:04.005649 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2075/4108] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:03 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:04.821084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:04.823307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:04.853915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:04.854700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:04.855167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:04.856164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:04.856337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:04.859290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:04.955785 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bcff9a79-c906-462f-a6fd-3b77400ae73a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.139351 Oct 11 01:40:04.957173 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2034/4109] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:40:04 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:05.036536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:05.037159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:05.047812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.048315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.048762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:05.049479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.056127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.065878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:05.223643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:05.238015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:05.239810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:05.241501 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61750b10-dc16-4248-94c1-f789603f8ff7 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.212009 Oct 11 01:40:05.263703 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2076/4110] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:05 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:05.441751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:05.442254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:05.453870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.454373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.454822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:05.455576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.456034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.456465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:05.518873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:40:05.714888 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00c0d441-f84f-49f7-b08b-2b79f4f0d06c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 204 len: 0 microversion: 2.20 time: 0.285314 Oct 11 01:40:05.716297 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2035/4111] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:40:05 2022] DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:40:05.728234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:05.729354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:05.772045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.775414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.776440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:05.778899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:05.785023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:05.796532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:06.281008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:06.281906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:06.298154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:06.298653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:06.299092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:06.305041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:06.305526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:06.305969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:06.530937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.531573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.549643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.551084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.552797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.553690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:06.557414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89afdfa5-c843-4e13-883c-53518c132cfb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 0.835652 Oct 11 01:40:06.558955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ee4a392-56b8-429a-8282-e562fde5c494 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.283909 Oct 11 01:40:06.560217 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2036/4112] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:06 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:06.561351 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2077/4113] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:05 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:07.590715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:07.591489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:07.608413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:07.609658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:07.611814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:07.613840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:07.622082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:07.622989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:07.623613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:07.628671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:07.629710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:07.631816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:07.634030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:07.637758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:07.640282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:07.645901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:08.042844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:08.063364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:08.069742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:08.075177 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05379c9a-bb92-42f1-8137-90f012095243 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.471266 Oct 11 01:40:08.077608 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2078/4114] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:07 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:09.124230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:09.125172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:09.143227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:09.145847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:09.146644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:09.147983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:09.161426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:09.162219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:09.765374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.785810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.792086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.796862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3ae9a0b-21a0-4e75-8448-a99b2b7a4ccc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1721 microversion: 2.20 time: 2.210570 Oct 11 01:40:09.800692 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2037/4115] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:07 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1721 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:09.812080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.833443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.840152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:09.841900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9f2ca19-b93d-4333-bdd3-7eb64016b771 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.721914 Oct 11 01:40:09.844224 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2079/4116] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:09 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:10.703818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c015a-c090-4722-8ef4-6340d39484ad", "name": "network-vif-deleted", "tag": "70736a29-504b-4898-a059-d6833da328dc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:10.730681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:10.732593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:10.733655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:10.773571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] Creating event network-vif-deleted:70736a29-504b-4898-a059-d6833da328dc for instance 6b5c015a-c090-4722-8ef4-6340d39484ad on n-h2-772273-9 Oct 11 01:40:10.794627 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-427899be-ffe3-4846-9f5b-fb26bf155bef req-213020a4-38ad-4120-977d-540f03ca7b38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094399 Oct 11 01:40:10.796313 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2038/4117] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:10.830899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:10.831701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:10.854412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:10.855371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:10.858862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:10.860953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:10.863370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:10.864014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:10.874293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:10.875001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:10.898378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:10.918386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:10.918956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:10.919736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:10.920215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:10.920644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:11.029994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:11.030947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:11.033077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:11.038177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lazy-loading 'fault' on Instance uuid 6b5c015a-c090-4722-8ef4-6340d39484ad {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:40:11.306212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.314187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.324156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.332857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.333611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.337584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-781e813a-3a5a-4ae9-920a-b1a59713b4eb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 200 len: 1370 microversion: 2.20 time: 0.508547 Oct 11 01:40:11.338333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:11.340491 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e690b03b-3595-4a65-baf6-d884773976ff tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.471427 Oct 11 01:40:11.341917 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2080/4118] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:10 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:11.350037 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2039/4119] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:10 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:12.395313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:12.396419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:12.397033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:12.400064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:12.420108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:12.422018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:12.422823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:12.423476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:12.424386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:12.425085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:12.425708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:12.426358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:12.427242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:12.427862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:12.433116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:12.433832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:12.476301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad HTTP/1.1 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '6b5c015a-c090-4722-8ef4-6340d39484ad'} Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:12.478915 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:40:12.483590 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:12.496255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:12.497422 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16c75834-de59-41b5-b59a-f2b2e9d35296 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 404 len: 111 microversion: 2.20 time: 0.109275 Oct 11 01:40:12.499224 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2040/4120] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:12 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:40:12.506603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e780e2cb-0b83-4e3a-a878-b8f99fccaec8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '.version_select at 0x7f112f4fbdc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:12.564633 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e780e2cb-0b83-4e3a-a878-b8f99fccaec8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488258380" status: 204 len: 0 microversion: 2.20 time: 0.061561 Oct 11 01:40:12.565629 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2041/4121] 10.222.0.66 () {60 vars in 1259 bytes} [Tue Oct 11 01:40:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488258380 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:40:12.843419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:12.872024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:12.890254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:12.891643 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92438696-6539-492e-a14b-7e71da80ec9f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.505117 Oct 11 01:40:12.897389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2081/4122] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:12 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:13.927328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:13.928142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:13.960006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:13.963748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:13.973645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:13.974506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:13.977418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:13.990544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:14.308239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:14.325408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:14.331679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:14.336902 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95520cae-5ba5-4869-a75d-cf566f3eb3fe tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.413705 Oct 11 01:40:14.339963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2042/4123] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:13 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:15.077666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11729815-c82f-4f8d-899e-908166d846f3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: .version_select at 0x7f112efc9d30>, body: {"keypair": {"name": "tempest-keypair-842059781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB1WXkPx5NvgA5rUq2f0Yj4CITW9BLVUsLOc6fP+HHspkPwk6mdJYwyDdBcpwcp77hyz/1n8Ti3dYVONiRbrs7mOu1CQ9MWW53n70dVBsOJqkw8fY5+V+1MxUX9eUhIRA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:15.135634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-11729815-c82f-4f8d-899e-908166d846f3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:40:15.156990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-11729815-c82f-4f8d-899e-908166d846f3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for user 56faf0ffbfe540a59e9c63bd23d7707a and project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:40:15.234334 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11729815-c82f-4f8d-899e-908166d846f3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.161399 Oct 11 01:40:15.235397 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2082/4124] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:40:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 11 01:40:15.370763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:15.371434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:15.385754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:15.397715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:15.398460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:15.402232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:15.408308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:15.409109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:15.800579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:15.835484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:15.845304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:15.849745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9e99856-32e4-48fb-bca9-2bc5880ab2b6 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.482645 Oct 11 01:40:15.854805 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2043/4125] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:15 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:16.889288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:16.890018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:16.901775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:16.912954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:16.915490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:16.918139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:16.930473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:16.933935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:16.939951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:16.990626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:17.945081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:17.957601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:17.958927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:17.984519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4e4fa29-c842-4751-abc4-581cfeec1f5c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 1.100339 Oct 11 01:40:18.007196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2083/4126] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:16 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:19.016856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:19.017483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:19.043844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:19.045312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:19.050730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:19.055202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:19.058878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:19.059405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:19.265178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:19.275309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:19.276802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:19.278011 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f465206-d8ba-4547-827c-bf9e25d575bf tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.267253 Oct 11 01:40:19.278631 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2044/4127] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:19 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:20.308279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:20.309509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:20.326014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:20.333013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:20.333792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:20.334764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:20.335420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:20.336617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:20.576326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:20.622330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:20.631531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:20.632894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95139ab8-434c-49a6-b1d1-4a5b17815c9c tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.328617 Oct 11 01:40:20.645053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2084/4128] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:20 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:20.842829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1701893994", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c83854a-4ccf-47a8-832a-9a9ff3fe1665"}], "security_groups": [{"name": "tempest-securitygroup--251418464"}], "key_name": "tempest-keypair-842059781", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:21.184929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] validate_networks() for [('6c83854a-4ccf-47a8-832a-9a9ff3fe1665', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:40:21.674295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:21.676218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:21.704843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:21.719480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:21.720088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:21.720875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:21.734240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:21.734717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:21.993604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:22.003220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:22.004559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:22.005794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81737a62-ff0c-4b8a-971c-2147f554365a tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.335441 Oct 11 01:40:22.006363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2085/4129] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:21 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:22.505440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:40:22.505908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:40:22.507511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:40:22.508026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:40:22.508461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:40:22.532895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:22.534776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:22.538323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:22.540068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:22.541000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:22.543398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:22.614762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:40:22.631192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Getting quotas for user 56faf0ffbfe540a59e9c63bd23d7707a and project 6da1e9e8db1c491daa6aa54bc1248e28. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:40:22.689550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:40:22.698770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:40:22.834981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dfd5877d-600a-4177-8a62-4b23cf5ac36d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.997373 Oct 11 01:40:22.852551 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2045/4130] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:40:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 01:40:23.040108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:23.040800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:23.060304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:23.064301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:23.065405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:23.066176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:23.066651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:23.067085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:23.253057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:23.254352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:23.328382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.345658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.358970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.366648 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e4cb50a-89d4-42ae-bd23-2ddfe277fd80 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.330796 Oct 11 01:40:23.376371 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2046/4131] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:23 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:23.412237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.423760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.427931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:23.429043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a022e4f-52dd-4021-a871-df976baec536 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1281 microversion: 2.20 time: 0.585402 Oct 11 01:40:23.434035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2086/4132] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:22 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1281 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:24.397453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:24.399251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:24.407386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:24.408159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:24.408840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:24.409833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:24.410526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:24.411197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:24.466581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:24.467981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:24.493207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:24.496067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:24.500014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:24.504281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:24.505084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:24.505787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:24.881710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:24.891245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:24.902566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:24.908932 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de69c5b4-8cdb-4b3d-944b-2451524388e0 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1285 microversion: 2.20 time: 0.446369 Oct 11 01:40:24.922432 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2087/4133] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:24 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1285 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:25.065989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:25.104009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:25.109659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:25.121041 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-070c97c6-b47e-43f6-b601-f486ff3f42d9 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.727738 Oct 11 01:40:25.140039 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2047/4134] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:24 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:25.953941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:25.955248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:25.965621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:25.974861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:25.976391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:25.978015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:25.980776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:25.982893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:26.156681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:26.157445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:26.170880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:26.187872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:26.192701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:26.195759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:26.196543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:26.198416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:26.427466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.442402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.446432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.459184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eaa67d32-5ecd-437d-b377-d43c2cd716bd tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1339 microversion: 2.20 time: 0.508999 Oct 11 01:40:26.459959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2088/4135] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:25 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1339 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:26.582703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.616843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.644257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:26.649262 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5256cd79-7b7f-4b00-8776-29d2b5112dec tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.493653 Oct 11 01:40:26.651103 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2048/4136] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:26 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:27.243149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.254011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.272750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.273257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.280862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.281781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.282291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.282722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.356822 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 HTTP/1.1 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e979900a-3ee2-4724-9f4e-df4c446c8a32'} Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:27.358592 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.364183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.369411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:27.372103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-781e4ac2-3500-4e68-8556-38fd29c3b78d tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 404 len: 111 microversion: 2.1 time: 0.133522 Oct 11 01:40:27.377361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2089/4137] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:40:27 2022] DELETE /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:40:27.388008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.388697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: e979900a-3ee2-4724-9f4e-df4c446c8a32] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.391895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:27.414087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.414588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.425832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.432349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.432849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.433308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.490185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.490968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.503732 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 HTTP/1.1 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e979900a-3ee2-4724-9f4e-df4c446c8a32'} Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.505262 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. Oct 11 01:40:27.511016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.511635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.511635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.511635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.515541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.516342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance e979900a-3ee2-4724-9f4e-df4c446c8a32 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:27.517441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40e97e8d-19dc-4da3-aa08-a0f9cecfa8f4 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32" status: 404 len: 111 microversion: 2.1 time: 0.136380 Oct 11 01:40:27.520540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.520967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.525694 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2049/4138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:27 2022] GET /compute/v2.1/servers/e979900a-3ee2-4724-9f4e-df4c446c8a32 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:40:27.557493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.571524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.602204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.602720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.604524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.604524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.604524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.604807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.630852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:27.686522 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 HTTP/1.1 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4e4099b2-9ca5-4e0f-9ae4-22daf5577341'} Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:27.696676 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:27.700617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:27.702794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf39db09-5906-4c1d-bb09-0478dfbaa8c0 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 404 len: 111 microversion: 2.1 time: 0.162692 Oct 11 01:40:27.703587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2050/4139] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:40:27 2022] DELETE /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:40:27.720139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.720843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.741459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.746165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.746639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.748395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.754489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.756593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.846325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:27.856153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:27.874296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:27.878823 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6810a49f-4f65-453b-9ab2-e8d27bf89457 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1339 microversion: 2.20 time: 0.391157 Oct 11 01:40:27.879475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2090/4140] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:27 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1339 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:27.888676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:27.902257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] [instance: 4e4099b2-9ca5-4e0f-9ae4-22daf5577341] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:27.929833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.936126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.944113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.951136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:27.951799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:27.952325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:27.998243 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] HTTP exception thrown: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Request method failure captured: Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 HTTP/1.1 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMgbGxPCzBg-lAd7tZj5jMEhBsmqG2qyLoOWcodUDoSJHIIyuyZ-4SPFoDND9TNk4EMUAwq1_ZlHG6VnuvpcNXJgHSa1ZYpYT0ODO2KrgEYnPMDB1lvmv2GGswYCwlm04VWQ8Lea5FD0m45plZHwIoVBO6ZA-ci4XFZd49ujIigZe9E Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cc0e5a7fa8b49c9be1b206e047ac440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4cc0e5a7fa8b49c9be1b206e047ac440 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654160031 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 187ec65453c343a4a0d375e30ef9ea93 Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-1654160031-project Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4e4099b2-9ca5-4e0f-9ae4-22daf5577341'} Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:28.020121 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. Oct 11 01:40:28.026931 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:40:28.033611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] Returning 404 to user: Instance 4e4099b2-9ca5-4e0f-9ae4-22daf5577341 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:28.034759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8736df3d-55c6-422f-a52f-d35b90c11da7 tempest-DeleteServersTestJSON-1654160031 tempest-DeleteServersTestJSON-1654160031-project] 10.222.0.66 "GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341" status: 404 len: 111 microversion: 2.1 time: 0.152800 Oct 11 01:40:28.035460 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2091/4141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:27 2022] GET /compute/v2.1/servers/4e4099b2-9ca5-4e0f-9ae4-22daf5577341 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:40:28.162557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:28.217375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:28.224196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:28.238561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a8f8f2b-3d51-4d47-aef3-bdbddd17f63f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.530319 Oct 11 01:40:28.240939 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2051/4142] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:27 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:28.912864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:28.913497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:28.932881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:28.933660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:28.934276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:28.935191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:28.939986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:28.940673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:29.272086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:29.272809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:29.288614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:29.289653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:29.290097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:29.290819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:29.295204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:29.302438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:29.369263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.377984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.379480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.380665 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd5dda10-aa13-4033-81ce-100c27b5cf0f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1339 microversion: 2.20 time: 0.480507 Oct 11 01:40:29.381263 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2092/4143] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:28 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1339 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:29.743245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.763878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.766059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:29.776938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-593e8258-2a6a-4554-85ec-215ac3bdba70 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.508883 Oct 11 01:40:29.791928 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2052/4144] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:29 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:30.425115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:30.425744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:30.448230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:30.448741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:30.449193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:30.449925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:30.450384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:30.450998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:30.806363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:30.816356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:30.834398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:30.842444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:30.843152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:30.844107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:30.848189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:30.848921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:31.652481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:31.662663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:31.670590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:31.681783 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14cb7abb-0a50-4e09-9d78-73dc013ee314 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1602 microversion: 2.42 time: 0.879262 Oct 11 01:40:31.696866 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2053/4145] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:30 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1602 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:40:32.052815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:32.061928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:32.063428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:32.072512 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7f489d8-cd4a-4f04-80d1-42077f1ed76e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 1.669090 Oct 11 01:40:32.073120 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2093/4146] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:30 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:32.710272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:32.711948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:32.716443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:32.720621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:32.728365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:32.736753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:32.739151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:32.740124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:32.740666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:32.742460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:32.837676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:32.838339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:32.838888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:32.839720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lazy-loading 'fault' on Instance uuid 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:40:33.051153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:33.070598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:33.072651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fdff778671b491ab31aebca665bb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '785964fd74584eeb95457d62851b721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:33.078418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36e4d337-1912-4e76-b836-be4bd65c481d tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 200 len: 1607 microversion: 2.42 time: 0.371913 Oct 11 01:40:33.081320 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2054/4147] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:32 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 1607 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:33.100782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:33.102011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:33.111261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:33.111839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:33.112347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:33.113108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:33.113576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:33.114012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:33.422174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:34.062656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:34.077311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:34.081475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:34.084584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c6e9181-8bba-4e56-9650-556f3fba0a27 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.987605 Oct 11 01:40:34.087109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2094/4148] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:33 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:34.111054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:34.112824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:34.143239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:34.148935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:34.154733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:34.155928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:34.156718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:34.157769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:34.188504 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] HTTP exception thrown: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Request method failure captured: Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 HTTP/1.1 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMff2E77clkkQNR1sSqfheZbu8rxhTYeXClR9or5XX23cA3iCUXWi0p6HJdK3eJJHx7r2-ZtiS0w8MyuF8HOkkmq1QfQEzmOvy2OcqS7ur2ooM5AAgT8XaJEX9udRSUvukWfNKxNam28lbxawRDa-umNNIMX1H-H9O-5jwe8Xcqr9gs Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/785964fd74584eeb95457d62851b721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_785964fd74584eeb95457d62851b721a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8fdff778671b491ab31aebca665bb3b9 Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '28aeee3e-c9db-42d0-9f35-e8b8a6f58776'} Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:34.205760 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:34.209995 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:34.213574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Returning 404 to user: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:34.214757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3537997b-59ab-4ca8-abe4-2bb7a7c51aa3 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 404 len: 111 microversion: 2.42 time: 0.110455 Oct 11 01:40:34.215957 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2055/4149] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:34 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:40:34.225664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7a6b147-097e-4f29-a0ce-67135caa5f2f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '.version_select at 0x7f112f04cf70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:34.280410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7a6b147-097e-4f29-a0ce-67135caa5f2f tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641881539" status: 204 len: 0 microversion: 2.42 time: 0.060099 Oct 11 01:40:34.281017 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2095/4150] 10.222.0.66 () {60 vars in 1259 bytes} [Tue Oct 11 01:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641881539 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:40:34.918488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:34.949254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:34.950324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:34.951483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:34.982190 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] Creating event network-changed:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:40:34.994568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9a75a8f8-2aa6-4ec6-b7ea-b9dc0cf7fe8a req-566ffa9d-af84-4267-ac54-5a6f9213117e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080276 Oct 11 01:40:34.995806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2056/4151] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:35.112373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:35.113108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:35.133733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:35.134236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:35.134680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:35.135466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:35.135903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:35.136338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:36.125503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:36.141945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:36.147132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:36.152343 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-18f9c079-5eff-4ff7-a25e-28fa61181fca tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 1.044586 Oct 11 01:40:36.155075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2096/4152] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:35 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:37.183788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:37.185557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:37.192617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:37.193979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:37.194601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:37.195568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:37.196368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:37.196967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:37.559909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:37.575240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:37.589875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:37.591616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7bea3a3e-336a-426e-bb53-4a9bccc4155f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.413295 Oct 11 01:40:37.603693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2057/4153] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:37 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:38.438211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-927046027", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "2f86bd7d-bdd5-432a-8948-99d8129d0127"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:38.528194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] validate_networks() for [('2f86bd7d-bdd5-432a-8948-99d8129d0127', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:40:38.620740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:38.621995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:38.633660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:38.646681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:38.647261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:38.649302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:38.649792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:38.650236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:39.182864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:39.197618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:39.204564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:39.213561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0ad8df2-7c2e-4967-acb4-1bd3cfdb9ec1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.595516 Oct 11 01:40:39.232249 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2058/4154] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:38 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:40.084228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:40:40.084704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:40:40.085125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:40:40.085570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:40:40.086003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:40:40.143737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:40.144353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:40.144890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:40.146899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:40.147531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:40.149990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:40.182452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Getting quotas for project a46aa1a46c954576847c8663b5ec6efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:40:40.190137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Getting quotas for user cfbedb5bdc7e40239f1e6876ae5b3072 and project a46aa1a46c954576847c8663b5ec6efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:40:40.232530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:40:40.235319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:40:40.240471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:40.242325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:40.259631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:40.261228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:40.263819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:40.265246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:40.266237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:40.267325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:40.336580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a796978b-4dd5-4bbe-96b3-e354ea4aa794 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.289683 Oct 11 01:40:40.337866 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2097/4155] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:40:40.353409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-22b055c5-6d27-4e1d-9b61-ab33001420cc tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:40.354563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-22b055c5-6d27-4e1d-9b61-ab33001420cc tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:40.485141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-22b055c5-6d27-4e1d-9b61-ab33001420cc tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:40.499996 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-22b055c5-6d27-4e1d-9b61-ab33001420cc tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1214 microversion: 2.1 time: 0.154280 Oct 11 01:40:40.500786 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2098/4156] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:40 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:40:40.944000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1404093287", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:41.052751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:40:41.224241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:41.237444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:41.240595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:41.244002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9dc33bd-c5c3-4997-ab3e-150497dfa969 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 1.009579 Oct 11 01:40:41.257879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2059/4157] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:40 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:41.472215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:40:41.473325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:40:41.473976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:40:41.474600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:40:41.475233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:40:41.487826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:41.488911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:41.489707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:41.490644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:41.491319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:41.492147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:41.514528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Getting quotas for project 3c55dc2a8350473a8f16114adc0c6ecd. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:40:41.522327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Getting quotas for user d0f52074ca934e1087203868c9915908 and project 3c55dc2a8350473a8f16114adc0c6ecd. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:40:41.522637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:41.523933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:41.539748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:40:41.542330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:40:41.545354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:41.545935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:41.546388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:41.548762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:41.549246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:41.549899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:41.647244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a24d425-4585-4464-ac5a-23fc1b17553c tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708391 Oct 11 01:40:41.662579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2099/4158] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:40:41.681025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-434b9e37-a850-4ac0-98b9-0f549364d7f1 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:41.683157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-434b9e37-a850-4ac0-98b9-0f549364d7f1 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:41.703178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:41.721614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99ee67ac-0eb5-4744-8af1-d21750910df2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1218 microversion: 2.1 time: 0.202381 Oct 11 01:40:41.724309 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2060/4159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:41 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:41.955388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-434b9e37-a850-4ac0-98b9-0f549364d7f1 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:41.978154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-434b9e37-a850-4ac0-98b9-0f549364d7f1 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1215 microversion: 2.1 time: 0.308904 Oct 11 01:40:41.985141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2100/4160] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:41 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:42.254596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-150105119", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:42.275629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:42.276600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:42.299013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:42.305446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:42.307514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:42.310905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:42.313446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:42.314525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:42.400678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] validate_networks() for None {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:40:42.810614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:42.823506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:42.825266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:42.829465 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4faa874a-3e41-48cb-b542-8a8f384277e1 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.560694 Oct 11 01:40:42.830552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2101/4161] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:42 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:42.846606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:42.852353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:42.876019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:42.876549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:42.877008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:42.877791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:42.878427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:42.878875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:42.972084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:40:42.972654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:40:42.973255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:40:42.974437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:40:42.975746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:40:42.993993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:42.994492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:42.994935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:42.995698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:43.007491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:43.009207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:43.073391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Getting quotas for project ad35f026a9de4d86a97757ee3a467f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:40:43.091844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:43.109537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Getting quotas for user 2452e9929ca64715ae9a8fb0feb81b3c and project ad35f026a9de4d86a97757ee3a467f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:40:43.109747 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2453829c-d36c-4c50-8c5f-25053cd1a554 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1284 microversion: 2.1 time: 0.274688 Oct 11 01:40:43.123449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2102/4162] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:42 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:43.130049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:43.131588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:43.156602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:40:43.157465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:43.158206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:43.158936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:40:43.159591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:43.162676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:43.165382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:43.166777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:43.297195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e605eaa5-c966-4a74-a48d-0ea5c1dc3dd0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047390 Oct 11 01:40:43.308755 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2061/4163] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:40:43.313719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a020ca0a-d0d3-4b14-98a5-19820301a873 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:43.314336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a020ca0a-d0d3-4b14-98a5-19820301a873 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:43.514025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:43.533450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75f36e92-d5a2-4ba4-a873-2adc9f1b07b5 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1219 microversion: 2.1 time: 0.420811 Oct 11 01:40:43.534076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2103/4164] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:43 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1219 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:43.547220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a020ca0a-d0d3-4b14-98a5-19820301a873 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:43.555475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a020ca0a-d0d3-4b14-98a5-19820301a873 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1213 microversion: 2.1 time: 0.245486 Oct 11 01:40:43.572422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2062/4165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:43 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1213 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:43.884990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:43.886629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:43.928076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:43.932075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:43.932713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:43.935720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:43.936472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:43.940098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:44.138839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:44.139607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:44.151512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:44.161823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:44.164487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:44.169266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:44.170341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:44.172318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:44.574236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:44.591473 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0eae8b2e-e492-45de-9a26-3d85a54f4d7e tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1272 microversion: 2.1 time: 0.457444 Oct 11 01:40:44.598538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2063/4166] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:44 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1272 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:44.606154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:44.607150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:44.615403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:44.616084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:44.616781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:44.617961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:44.619109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:44.621272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:44.956383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:44.978199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-020ecb7e-e525-4dac-91b8-33f687ea5f8f tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1273 microversion: 2.1 time: 0.376670 Oct 11 01:40:44.993530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2064/4167] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:44 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:45.009092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:45.010005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:45.018638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:45.019276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:45.019943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:45.020946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:45.022144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:45.022678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:45.595485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:45.610279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:45.617408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:45.623059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54358249-6240-4b3e-868b-fc660baabac8 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 1.766133 Oct 11 01:40:45.624327 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2104/4168] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:43 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:45.631016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:45.631971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:45.642848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:45.656920 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0fc8a33-8286-468c-800f-2a61c923867b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1209 microversion: 2.1 time: 0.657567 Oct 11 01:40:45.658296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:45.658876 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2065/4169] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:44 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1209 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:45.667699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:45.668835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:45.670578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:45.672118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:45.672680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.008605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:46.009718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:46.017810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.019959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.020573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.022318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.023693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.024331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.233780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:46.242752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9255951-9db8-4c6b-8993-f5918b01c187 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1273 microversion: 2.1 time: 0.239672 Oct 11 01:40:46.247471 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2066/4170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:46 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:46.298170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:46.298675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:46.310517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.311300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.311938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.312858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.313503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.314105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.568752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:46.578203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b7ccbb0-b909-4fed-b19d-da4aaad25fa0 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 0.951866 Oct 11 01:40:46.599546 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2105/4171] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:45 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:46.614488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "name": "network-vif-plugged", "status": "completed", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:46.629399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.634786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.635730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.678030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] Creating event network-vif-plugged:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:40:46.684453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-cd7be659-2853-4492-8625-d18100ddf793 req-d12c0630-d9b4-4119-94da-9a824d2d9513 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082760 Oct 11 01:40:46.685083 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2106/4172] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:46.691273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:46.693470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:46.706118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.712171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.712811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.713807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.714457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.714987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.768195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:46.824686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] HTTP exception thrown: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Request method failure captured: Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 HTTP/1.1 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMff2E77clkkQNR1sSqfheZbu8rxhTYeXClR9or5XX23cA3iCUXWi0p6HJdK3eJJHx7r2-ZtiS0w8MyuF8HOkkmq1QfQEzmOvy2OcqS7ur2ooM5AAgT8XaJEX9udRSUvukWfNKxNam28lbxawRDa-umNNIMX1H-H9O-5jwe8Xcqr9gs Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/785964fd74584eeb95457d62851b721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_785964fd74584eeb95457d62851b721a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8fdff778671b491ab31aebca665bb3b9 Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '28aeee3e-c9db-42d0-9f35-e8b8a6f58776'} Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:46.828976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:46.833634 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:46.835863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Returning 404 to user: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:46.836759 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-348d4fc9-f340-442e-884a-990c9e2a2460 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "DELETE /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 404 len: 111 microversion: 2.42 time: 0.543550 Oct 11 01:40:46.837337 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2067/4173] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:40:46 2022] DELETE /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 111 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:40:46.844871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:46.845497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:46.866135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.867453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.876004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:46.880503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:46.881347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:46.882169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.133142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:47.144790 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eda11046-9e03-44dc-8652-0a284b9ee2df tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1271 microversion: 2.1 time: 0.306211 Oct 11 01:40:47.163057 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2068/4174] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:46 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:47.188365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:47.192093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] [instance: 28aeee3e-c9db-42d0-9f35-e8b8a6f58776] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:47.215502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.217499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.218475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.220478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.222504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.222965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.271085 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] HTTP exception thrown: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Request method failure captured: Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 HTTP/1.1 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMff2E77clkkQNR1sSqfheZbu8rxhTYeXClR9or5XX23cA3iCUXWi0p6HJdK3eJJHx7r2-ZtiS0w8MyuF8HOkkmq1QfQEzmOvy2OcqS7ur2ooM5AAgT8XaJEX9udRSUvukWfNKxNam28lbxawRDa-umNNIMX1H-H9O-5jwe8Xcqr9gs Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/785964fd74584eeb95457d62851b721a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_785964fd74584eeb95457d62851b721a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/785964fd74584eeb95457d62851b721a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 785964fd74584eeb95457d62851b721a Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1558598980 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 8fdff778671b491ab31aebca665bb3b9 Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1558598980-project Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '28aeee3e-c9db-42d0-9f35-e8b8a6f58776'} Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:47.275223 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] Returning 404 to user: Instance 28aeee3e-c9db-42d0-9f35-e8b8a6f58776 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:40:47.280834 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30e38a98-af5a-4f93-b0ee-1c54456ae799 tempest-TaggedBootDevicesTest_v242-1558598980 tempest-TaggedBootDevicesTest_v242-1558598980-project] 10.222.0.66 "GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776" status: 404 len: 111 microversion: 2.42 time: 0.113084 Oct 11 01:40:47.282466 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2069/4175] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:47 2022] GET /compute/v2.1/servers/28aeee3e-c9db-42d0-9f35-e8b8a6f58776 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:40:47.294060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:47.296986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:47.310076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.313913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.314557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.316876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.317522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.318141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.364072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:47.377084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:47.380202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:47.384139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc99b937-187f-4143-8c65-6f142f8c6589 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.697740 Oct 11 01:40:47.387304 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2107/4176] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:46 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:47.468184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:47.477576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3171e57-befc-47f2-af7e-36ca7521ea36 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1273 microversion: 2.1 time: 0.194467 Oct 11 01:40:47.486950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2070/4177] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:47 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:47.604977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:47.609520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:47.611942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:47.627655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.628229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.628840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:47.629640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:47.630202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:47.630645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.174589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:48.176237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:48.189609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.193676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.196339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.197526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.204651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.205873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.236655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:48.464920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:48.477091 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5599f179-64c1-44c3-805c-19f51f82d575 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 0.876455 Oct 11 01:40:48.496583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2108/4178] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:47 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:48.502007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:48.502989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:48.521192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.522192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.523097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.525048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.525887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.526503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.633043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:48.649022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15001bb5-f961-422d-bde7-139b90f3ea0e tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1271 microversion: 2.1 time: 0.478863 Oct 11 01:40:48.649635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2071/4179] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:48 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1271 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:48.661744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc45531-9210-4225-b638-4ebb6fec5a9b", "tag": "fc21996f-3db8-422a-82eb-320dd85ff65d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:48.688655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.689432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.690354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.717288 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] Creating event network-changed:fc21996f-3db8-422a-82eb-320dd85ff65d for instance 9fc45531-9210-4225-b638-4ebb6fec5a9b on n-h1-772273-9 Oct 11 01:40:48.737407 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4e24f508-6c2c-49af-848d-fffe45c326e9 req-4525cbe1-2b4c-4549-ac3e-dad5e2241727 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086391 Oct 11 01:40:48.738014 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2072/4180] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:48.747478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:48.761957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:48.783321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.783883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.784329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:48.787299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:48.789644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:48.790097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:49.380504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:49.396850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:49.399615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:49.404739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93bd82bb-64c5-435e-a8f4-a0520848db28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1406 microversion: 2.20 time: 0.906687 Oct 11 01:40:49.405987 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2109/4181] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:48 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1406 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:49.503585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:49.504614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:49.536543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:49.537279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:49.538008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:49.540603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:49.543452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:49.544152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:49.837816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:49.848132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-052b54bf-3106-4a73-bf93-75fed9090346 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 1.104697 Oct 11 01:40:49.868428 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2073/4182] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:48 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:49.875153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:49.876361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:49.890970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:49.892325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:49.894152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:49.896629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:49.901093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:49.901770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:50.052217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:50.063520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a69990c-a873-4c23-94a2-982ccdd7f656 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 0.565455 Oct 11 01:40:50.065872 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2110/4183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:49 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:40:50.155755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:50.164602 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7abcb8d-c119-4d64-b083-8c9924f7a277 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1271 microversion: 2.1 time: 0.295054 Oct 11 01:40:50.165187 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2074/4184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:49 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:50.438340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:50.438984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:50.454963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:50.472926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:50.473573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:50.474507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:50.475148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:50.488168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:50.876865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:50.877460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:50.890799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:50.891328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:50.904193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:50.904898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:50.905374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:50.905817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:51.200577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:51.213532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:51.215001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:51.222945 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e62aa280-d2ff-4f8c-a008-549627d4116c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1597 microversion: 2.20 time: 0.790754 Oct 11 01:40:51.223552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2111/4185] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:40:50 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1597 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:40:51.235024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:51.236200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:51.248361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:51.248851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:51.256092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:51.263261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:51.264156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:51.265877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:51.421997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:51.430286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51f86d4a-c88d-459c-b29d-4bac2602034a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 0.557350 Oct 11 01:40:51.435466 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2075/4186] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:50 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:51.449443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:51.452068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:51.469909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:51.470408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:51.470839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:51.489212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:51.490237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:51.490237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:51.501985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:51.948996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:51.961337 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-012b4931-ab91-4cf8-9e75-d0f3d4ce494b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 0.729750 Oct 11 01:40:51.962119 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2112/4187] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:51 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:51.978021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:51.979558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:52.002829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:52.007141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:52.020555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:52.034281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:52.035085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:52.035620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:52.036076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:52.253228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:52.284891 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b978b4e0-6343-4dba-a4e1-467e1566d327 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.844961 Oct 11 01:40:52.305846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2076/4188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:51 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:52.341184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83603e04-a41c-4548-82f0-807ae046dbad tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.377984 Oct 11 01:40:52.342001 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2113/4189] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:40:51 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:40:52.461499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:52.462124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:52.476114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:52.476751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:52.477204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:52.477930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:52.478622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:52.479224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:52.987694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:52.989141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:53.001862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:53.002710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:53.003451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:53.006072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:53.008314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:53.037271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:53.047762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:53.551877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:54.156408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:54.173817 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e390f5b-e94e-42c4-81fe-21936033becc tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 1.716678 Oct 11 01:40:54.178324 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2077/4190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:52 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:54.205713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:54.211667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:54.243988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:54.247008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:54.247829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:54.251580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:54.255249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:54.260314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:55.215493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:55.229569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e12a1f74-2ba4-4c90-ac5e-861d17933463 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 2.247140 Oct 11 01:40:55.240134 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2114/4191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:52 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:55.245226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aeb7d7b-4471-4608-909c-24bb99a9f4e0", "tag": "1bf1a8f0-cedf-4eb0-b424-71480bc7ad30"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:55.293629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:55.294118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:55.294553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:55.329869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] Creating event network-changed:1bf1a8f0-cedf-4eb0-b424-71480bc7ad30 for instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 on n-h1-772273-9 Oct 11 01:40:55.345641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-47d5d5c7-ab72-43f6-bb07-9072d6870da9 req-3ccfb436-dbf7-4495-8af5-4734079cd54c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103933 Oct 11 01:40:55.346276 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2115/4192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:55.355276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:55.367504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:55.395329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:55.395873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:55.396328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:55.397068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:55.397540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:55.398076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:55.932973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:55.945277 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4b271dd-13ba-4b51-8f66-64463574aa6f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 1.764857 Oct 11 01:40:55.963892 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2078/4193] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:54 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:55.971836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc45531-9210-4225-b638-4ebb6fec5a9b", "name": "network-vif-plugged", "status": "completed", "tag": "fc21996f-3db8-422a-82eb-320dd85ff65d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:55.999203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:55.999885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:56.000499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:56.023745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] Creating event network-vif-plugged:fc21996f-3db8-422a-82eb-320dd85ff65d for instance 9fc45531-9210-4225-b638-4ebb6fec5a9b on n-h1-772273-9 Oct 11 01:40:56.029993 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-eed6bf5f-4400-4cfb-b6c3-efdf48bb6e4e req-52477f1a-ae54-4f63-8cbf-9940206cb87c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064509 Oct 11 01:40:56.037082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2079/4194] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:56.263609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:56.264192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:56.272955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:56.278598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:56.279303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:56.280306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:56.280984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:56.281781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:56.524121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:56.533777 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b60c54a-5e4f-40f1-9627-fb46ab4c07da tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 1.183223 Oct 11 01:40:56.548625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2116/4195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:55 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:56.977994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:56.979898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:57.000575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:57.002460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:57.003578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:57.004117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:57.004945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:57.006976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:57.014543 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f7839b9-1586-49d1-bb75-ec79f2da1a6c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 0.755721 Oct 11 01:40:57.019936 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2080/4196] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:56 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:40:57.021268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:57.329418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:57.348363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e1b747b-a1ca-4a9d-9188-f5554b5b946f tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.376986 Oct 11 01:40:57.356387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2117/4197] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:56 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:57.405996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b38630d-78be-4962-9d66-48c3d17e8320", "tag": "1d067b6c-78f9-4636-aa93-e8155b208025"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:40:57.443910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:57.444328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:57.444815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:57.489465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] Creating event network-changed:1d067b6c-78f9-4636-aa93-e8155b208025 for instance 4b38630d-78be-4962-9d66-48c3d17e8320 on n-h2-772273-9 Oct 11 01:40:57.512021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-edf70bd9-ce72-4d31-a051-f16488127a4f req-cbcaeb50-6969-4e05-83f7-3e02c76f352b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105925 Oct 11 01:40:57.513139 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2081/4198] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:40:57.567783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:57.570010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:57.584547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:57.586440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:57.587086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:57.588462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:57.590807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:57.591807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:58.042673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:58.043553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:58.054736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:40:58.065300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:58.066043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:58.066418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:58.067163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:58.067698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:58.068138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:58.413667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:58.436670 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a45a8d2-fce3-45b4-8481-c0e16acda8be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 0.868453 Oct 11 01:40:58.437804 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2118/4199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:57 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:58.465039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:58.467447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:58.497537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:58.513047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:58.513574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:58.515708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:58.516320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:58.516991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:59.234989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:59.246002 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f89edd6d-42c3-44f3-af89-ca4a3ce93175 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.806949 Oct 11 01:40:59.253609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2119/4200] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:58 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:59.258511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:40:59.273423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2404997b-4e37-44ef-886b-363bf26d9799 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1314 microversion: 2.1 time: 1.234771 Oct 11 01:40:59.275386 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2082/4201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:58 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:40:59.461661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:40:59.463920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:40:59.483065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:59.484445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:59.487321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:40:59.490950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:40:59.492418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:40:59.495872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:00.126638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:00.150523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:00.151184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:00.151658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:00.186161 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] Creating event network-changed:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:41:00.193031 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d3dce481-92ef-45f6-8c87-e90a25c78eb1 req-2570ba8d-d327-4609-9620-0c4bfdeb4c5e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071115 Oct 11 01:41:00.194246 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2083/4202] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:41:00.283294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:00.286069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:00.306408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:00.306408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:00.306408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:00.307846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:00.308336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:00.308834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:01.328555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:01.344596 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f41fc50-a326-41a9-bd04-3a3b785c064b tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 1.070523 Oct 11 01:41:01.363575 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2084/4203] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:00 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:01.369875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:01.370730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:01.379089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:01.379781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:01.380360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:01.380938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:01.381831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:01.382477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:01.383240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:01.399816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72d2db8f-b080-44a9-a6c6-baa6cc6838be tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 1.935596 Oct 11 01:41:01.400990 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2120/4204] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:40:59 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:01.995877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:02.004391 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f78bcd36-acf3-4992-9ba7-e4ee805c1dd2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1501 microversion: 2.1 time: 0.638837 Oct 11 01:41:02.009527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2085/4205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:01 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:02.037038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:02.037330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:02.044790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.046049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.046612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.052451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.053109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.053724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.371865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:02.373165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:02.397026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.398693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.402791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.404031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.407471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.408185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.431721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:02.441330 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-330e77fd-2a5b-44cb-a6e6-e56131309e47 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1501 microversion: 2.1 time: 0.408727 Oct 11 01:41:02.447072 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2121/4206] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:02 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1501 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:02.468618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:02.469851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:02.488184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.488429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.489027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.489789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.490261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.490702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.877755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:02.891663 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9ce418c-259e-42f0-9c26-7979d71c1ff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 0.442770 Oct 11 01:41:02.892809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2122/4207] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:02 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:02.902981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:02.909744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:02.921776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:02.928046 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c218674-3714-42ed-a177-7f6a5dc6a4cc tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.560340 Oct 11 01:41:02.930582 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2086/4208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:02 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:02.934469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.935801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.936460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.937499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:02.938398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:02.938890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:02.970274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lazy-loading 'flavor' on Instance uuid 9fc45531-9210-4225-b638-4ebb6fec5a9b {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:41:03.042790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:03.088170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c8426c21-2631-4b51-9929-c476d8fb2112 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.193223 Oct 11 01:41:03.089168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2123/4209] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:41:02 2022] POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:41:03.097043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:03.097672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:03.112920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:03.113431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:03.113881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:03.114613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:03.115090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:03.115570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:03.408354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:03.424741 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbc28ebf-a63c-4b60-88b8-cf869226e3b4 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1509 microversion: 2.1 time: 0.331636 Oct 11 01:41:03.425557 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2087/4210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:03 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1509 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:03.914990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:03.916315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:03.938397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:03.939215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:03.939863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:03.940856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:03.941497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:03.942163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:03.956615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:03.957502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:03.978344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:03.996201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:04.003999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:04.005002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:04.005669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:04.006315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:04.804872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:04.827279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4cc2611-4c22-4028-8f55-767d3d9ae60a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 0.916780 Oct 11 01:41:04.827933 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2124/4211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:03 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:04.857977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:04.858617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:04.879316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:04.880016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:04.880575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:04.881411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:04.883621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:04.884185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.156215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:05.172668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8076bd6e-1fab-4129-b08b-60e03e54bc60 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 1.219841 Oct 11 01:41:05.173329 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2088/4212] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:03 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:05.464050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:05.474537 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-144caf51-8019-4a79-ad58-2fca0a45d0ce tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1492 microversion: 2.1 time: 0.635897 Oct 11 01:41:05.478226 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2125/4213] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:04 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1492 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:05.505960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:05.506746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:05.523433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.524273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.525857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.528931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.529906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.530984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.684406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:05.707091 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0cdda917-fd33-4e99-ba8c-60758baa6766 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.205551 Oct 11 01:41:05.730757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:05.731711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:05.735600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2089/4214] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:41:05 2022] POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:41:05.747856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.749582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.754254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.757394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.758173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.759175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.857617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:05.858955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:05.876585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.877299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.878981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:05.880228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:05.881034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:05.882327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:07.711420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:07.722863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-494b248a-d9cf-42b2-8016-b642d6e80f23 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 1.871794 Oct 11 01:41:07.725464 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2090/4215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:05 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:07.735682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:07.739425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:07.756242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:07.760115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:07.760708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:07.761590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:07.763175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:07.764068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:07.837695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:07.847863 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc9c7524-0f6e-4dda-8400-2d992048aa1a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1498 microversion: 2.1 time: 2.121791 Oct 11 01:41:07.867777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2126/4216] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:05 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1498 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:07.879748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aeb7d7b-4471-4608-909c-24bb99a9f4e0", "name": "network-vif-plugged", "status": "completed", "tag": "1bf1a8f0-cedf-4eb0-b424-71480bc7ad30"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:07.899290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:07.901000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:07.901453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:07.925612 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] Creating event network-vif-plugged:1bf1a8f0-cedf-4eb0-b424-71480bc7ad30 for instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 on n-h1-772273-9 Oct 11 01:41:07.940399 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bcef3384-a16d-41cd-8029-69f292419ddb req-91575f5b-3a2c-45a0-b1f2-417a5c88648b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068029 Oct 11 01:41:07.941854 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2127/4217] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:41:08.216129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:08.224583 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8adca4a9-0950-4e22-b5f6-03e1e55ce628 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.497217 Oct 11 01:41:08.232450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2091/4218] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:07 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:08.752108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:08.753693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:08.770577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:08.771422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:08.775035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:08.775851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:08.776395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:08.776839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:08.877020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:08.878486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:08.887661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:08.888875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:08.889338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:08.890082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:08.890552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:08.891153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:09.405535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:09.419445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc65510a-52b5-41ad-93b1-d7becd55c5b4 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1315 microversion: 2.1 time: 0.674714 Oct 11 01:41:09.420673 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2128/4219] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:08 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:09.432721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:09.433417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:09.449036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:09.449439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:09.449885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:09.450603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:09.451067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:09.459482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:09.459809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:09.474876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69d795e4-3a74-4701-8693-e603c17859fe tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1498 microversion: 2.1 time: 0.602509 Oct 11 01:41:09.478267 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2092/4220] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:08 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1498 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:10.452056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:10.454100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:10.474134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:10.474710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:10.476054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:10.478323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:10.479126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:10.480046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:10.763821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:10.774043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a639ee3-fb76-4425-b7ec-88ad69cf82b7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 1.351686 Oct 11 01:41:10.777432 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2129/4221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:09 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:10.790112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:10.793627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:10.823862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:10.824366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:10.828234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:10.829020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:10.829667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:10.830123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:11.425850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:11.439859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf675d49-eba4-411a-badc-ccc49deebff9 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1464 microversion: 2.1 time: 0.993110 Oct 11 01:41:11.443756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2093/4222] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:10 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1464 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:11.459269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b38630d-78be-4962-9d66-48c3d17e8320", "name": "network-vif-plugged", "status": "completed", "tag": "1d067b6c-78f9-4636-aa93-e8155b208025"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:11.496889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:11.497401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:11.497835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:11.536761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] Creating event network-vif-plugged:1d067b6c-78f9-4636-aa93-e8155b208025 for instance 4b38630d-78be-4962-9d66-48c3d17e8320 on n-h2-772273-9 Oct 11 01:41:11.555624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1e9e81c5-db66-45cb-b2c2-19c62e88a932 req-7e4d494d-ec00-43fc-9aa8-a00a6d507235 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110080 Oct 11 01:41:11.556706 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2094/4223] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:41:11.568322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:11.568925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:11.587368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:11.588801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:11.589452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:11.590527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:11.596095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:11.596789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:11.664749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:41:11.966015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ff1cce7-3787-47d1-98a4-8528cec2fa58 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 204 len: 0 microversion: 2.1 time: 0.407654 Oct 11 01:41:11.966683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2095/4224] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:41:11 2022] DELETE /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:41:11.978921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:11.979691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:11.991137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:11.991683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:11.992131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:11.992859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:11.993324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:11.993761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:12.926681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:12.944906 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bfe9c090-bc20-486c-8061-81b9294b8a45 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1501 microversion: 2.1 time: 2.165956 Oct 11 01:41:12.959455 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2130/4225] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:10 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1501 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:12.959455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:12.959455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:12.976433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:12.978232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:12.978688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:12.980299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:12.980847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:12.981289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:13.533847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:13.543312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-550919fb-c5a3-4bc4-bd59-bcb3440a3858 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 1.575241 Oct 11 01:41:13.548727 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2096/4226] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:11 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:13.560471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:13.562413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:13.576751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:13.577256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:13.579051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:13.579965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:13.580257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:13.584933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:13.679880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lazy-loading 'flavor' on Instance uuid 9fc45531-9210-4225-b638-4ebb6fec5a9b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:41:13.811327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a98a03bb-9d7e-45e5-8b1c-f97bf27a1162 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.259944 Oct 11 01:41:13.812940 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2097/4227] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:41:13 2022] POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:41:13.845486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:13.849855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:13.868544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:13.871621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:13.872817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:13.874810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:13.877146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:13.877774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:14.005366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:14.020470 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8dee2dda-2273-4d63-b699-d5315a876002 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1470 microversion: 2.1 time: 1.073369 Oct 11 01:41:14.024777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2131/4228] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:12 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1470 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:14.568045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:14.568695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:14.586690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:14.587557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:14.589506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:14.590915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:14.596535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:14.598937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:14.771849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:14.788997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b79a439d-0aed-471a-a0e9-29afdf677141 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1509 microversion: 2.1 time: 0.961094 Oct 11 01:41:14.803722 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2098/4229] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:13 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1509 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:15.052185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:15.054469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:15.063975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:15.074330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:15.080862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:15.081348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:15.081772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ecc684d-ceef-448a-ad16-00f55fafaefb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1313 microversion: 2.1 time: 0.518666 Oct 11 01:41:15.082949 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2132/4230] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:14 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:15.096088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:15.101874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:15.102344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:15.488500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f52074ca934e1087203868c9915908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55dc2a8350473a8f16114adc0c6ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:15.501391 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f749e187-1b03-4960-9e4b-9357bb9bcc05 tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 200 len: 1470 microversion: 2.1 time: 0.457840 Oct 11 01:41:15.502769 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2099/4231] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:15 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:15.823080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:15.823744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:15.839652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:15.840167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:15.840619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:15.841361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:15.846046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:15.847069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:16.090639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aeb7d7b-4471-4608-909c-24bb99a9f4e0", "name": "network-vif-deleted", "tag": "1bf1a8f0-cedf-4eb0-b424-71480bc7ad30"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:16.117146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:16.120065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:16.120595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:16.163756 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] Creating event network-vif-deleted:1bf1a8f0-cedf-4eb0-b424-71480bc7ad30 for instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 on n-h1-772273-9 Oct 11 01:41:16.172612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c5213ef0-edba-49fa-8f0e-3b054057d4b4 req-b1ca95ab-9816-4887-81c8-3256440b02cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089247 Oct 11 01:41:16.176582 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2100/4232] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:41:16.201600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:16.204249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:16.233162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:16.233599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:16.237073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:16.240091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:16.240677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:16.241350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:16.873067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:16.901911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:16.912425 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a0563c0-1deb-49fe-b82f-22b59b2a8906 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1492 microversion: 2.1 time: 1.092515 Oct 11 01:41:16.920792 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7bf95d92-db22-4dbd-bb63-1e7aa50cb2c3 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1462 microversion: 2.1 time: 0.741063 Oct 11 01:41:16.937118 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2133/4233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:15 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1492 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:16.940223 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2101/4234] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:16 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1462 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:16.974852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:16.976663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ab9c5d-0869-49d4-92d4-c4534315d27c", "device": "/dev/sdb"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:16.983558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:16.986520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] [instance: 0aeb7d7b-4471-4608-909c-24bb99a9f4e0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:17.024929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.025549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.026573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.027316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.027996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.028590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.030173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.031056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.031722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.032321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.033841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.034690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.068174 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] HTTP exception thrown: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Request method failure captured: Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 HTTP/1.1 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMmVT4fyu-6sMfnEBO-ocGaqWwYAc6KPtiaMurRfZZts4IwVTL958hpWplme1Bqb4rVszFilZBrQDtMGM4clqDABb4sdlfKYB4M9mlYkZDUraIah8b5RTl0Hc5lBt81A2D7qmFcl45v76X7hPtdRKXoORi9VwflP2_mSjosE_hGfnEE Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 3c55dc2a8350473a8f16114adc0c6ecd Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesNegativeTest-1921938405 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3c55dc2a8350473a8f16114adc0c6ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3c55dc2a8350473a8f16114adc0c6ecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3c55dc2a8350473a8f16114adc0c6ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3c55dc2a8350473a8f16114adc0c6ecd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesNegativeTest-1921938405 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 3c55dc2a8350473a8f16114adc0c6ecd Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesNegativeTest-1921938405 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesNegativeTest-1921938405-project Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d0f52074ca934e1087203868c9915908 Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesNegativeTest-1921938405-project Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0aeb7d7b-4471-4608-909c-24bb99a9f4e0'} Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:41:17.070832 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. Oct 11 01:41:17.075525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:41:17.081441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] Returning 404 to user: Instance 0aeb7d7b-4471-4608-909c-24bb99a9f4e0 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:41:17.082673 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-933d8302-71fe-4118-a6a9-2a3ffe0f073a tempest-VolumesNegativeTest-1921938405 tempest-VolumesNegativeTest-1921938405-project] 10.222.0.66 "GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0" status: 404 len: 111 microversion: 2.1 time: 0.144069 Oct 11 01:41:17.083976 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2134/4235] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:16 2022] GET /compute/v2.1/servers/0aeb7d7b-4471-4608-909c-24bb99a9f4e0 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:41:17.101917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:17.102530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:17.128983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.131438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.135173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.136216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.138456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.139958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.312948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f8ae8fa-5101-4be1-9bfd-f723f9e48d5c tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.226722 Oct 11 01:41:17.318140 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2135/4236] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:41:17 2022] POST /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:41:17.345263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:17.346457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:17.361207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.364267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.366710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.367793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:17.369553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:17.371319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:17.867306 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b43aaba-e2ad-46c0-a5a1-ad23ef0d3fd7 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "POST /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915954 Oct 11 01:41:17.869435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2102/4237] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:41:16 2022] POST /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:41:18.005718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:18.019715 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4e20792-7678-49e5-9069-8843d8201bf7 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1498 microversion: 2.1 time: 0.698597 Oct 11 01:41:18.040557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2136/4238] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:17 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1498 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:19.047427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:19.048243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:19.064954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:19.065537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:19.066056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:19.069905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:19.070512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:19.071767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:19.105718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:19.386915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:19.396029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6071179-0c36-480f-bdd6-ff8411888402 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1498 microversion: 2.1 time: 0.353488 Oct 11 01:41:19.415830 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2103/4239] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:19 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:20.423131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:20.423865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:20.435489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=58 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:20.438238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:20.439056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:20.448014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:20.449339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:20.454171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:20.455506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:20.783320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:20.793598 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4a8165c-2a53-4fbb-b80f-24614806485b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1498 microversion: 2.1 time: 0.375301 Oct 11 01:41:20.811558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2137/4240] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:20 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1498 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:21.829627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:21.841568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:21.869953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:21.877724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:21.878335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:21.882630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:21.888818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:21.889288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:22.656555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:22.665899 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6455780-8557-42d4-a73a-bb77d14a8726 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1501 microversion: 2.1 time: 0.841373 Oct 11 01:41:22.685214 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2104/4241] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:21 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1501 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:22.701732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:22.701732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:22.721685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:22.722195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:22.722651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:22.723436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:22.723904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:22.724343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:22.832555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:41:23.044203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:23.132780 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8534f911-521f-4172-8433-59bbb27b54e2 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 204 len: 0 microversion: 2.1 time: 0.436769 Oct 11 01:41:23.134882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2138/4242] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:41:22 2022] DELETE /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:41:23.143782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:23.145623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:23.158279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:23.160550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:23.163245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:23.170412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:23.172019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:23.172473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:23.588536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:23.596453 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-927404d6-15ec-4e32-88bc-28057e318a3b tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1507 microversion: 2.1 time: 0.457309 Oct 11 01:41:23.624005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2105/4243] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:23 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:24.626035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:24.627419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:24.647326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:24.655992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:24.656511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:24.658340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:24.659874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:24.661336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:26.259122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:26.268414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a0165a3-109c-4841-abbe-e80537f65e7a tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1507 microversion: 2.1 time: 1.648715 Oct 11 01:41:26.272265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2139/4244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:24 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1507 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:41:27.304356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:27.304976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:27.322555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:27.328159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:27.336133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:27.337223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:27.338157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:27.342809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:27.648777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbedb5bdc7e40239f1e6876ae5b3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46aa1a46c954576847c8663b5ec6efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:27.659832 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca041658-ffd8-4ecd-9eec-0d2be3ada2b9 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 200 len: 1465 microversion: 2.1 time: 0.360745 Oct 11 01:41:27.661510 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2106/4245] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:27 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 1465 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:27.781945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc45531-9210-4225-b638-4ebb6fec5a9b", "name": "network-vif-deleted", "tag": "fc21996f-3db8-422a-82eb-320dd85ff65d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:27.822350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:27.834029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:27.838128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:27.908248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] Creating event network-vif-deleted:fc21996f-3db8-422a-82eb-320dd85ff65d for instance 9fc45531-9210-4225-b638-4ebb6fec5a9b on n-h1-772273-9 Oct 11 01:41:27.923465 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8dd084db-1f77-4b87-a498-aeb83d826b74 req-6324fd27-49bc-4d77-aa26-fe3ed829153f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144835 Oct 11 01:41:27.926814 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2140/4246] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:41:28.689995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:28.690618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] [instance: 9fc45531-9210-4225-b638-4ebb6fec5a9b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:28.702793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:28.706500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:28.707925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:28.708638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:28.712073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:28.713544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:28.713986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:28.754065 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] HTTP exception thrown: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Request method failure captured: Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b HTTP/1.1 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMmQPjQj1A5h_erWUAZNorDVg7Hs31KUJnzv-VrTEzfcFqzEaKzoYQ_iRHyvzKZkkzrlVAIOgFumL6U0fD6Afi-aTwuHVkgvR2AfbBo9mYWBkI-MC0WrE6UQEdrD2BoGDYjVnb8v9gEyEbKffD3scy5E4qx8oqNDDzFg9o0BxeZ7KJo Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: a46aa1a46c954576847c8663b5ec6efc Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestServerAdvancedOps-2053748759 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a46aa1a46c954576847c8663b5ec6efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a46aa1a46c954576847c8663b5ec6efc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a46aa1a46c954576847c8663b5ec6efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a46aa1a46c954576847c8663b5ec6efc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestServerAdvancedOps-2053748759 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: a46aa1a46c954576847c8663b5ec6efc Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestServerAdvancedOps-2053748759 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestServerAdvancedOps-2053748759-project Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cfbedb5bdc7e40239f1e6876ae5b3072 Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestServerAdvancedOps-2053748759-project Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '9fc45531-9210-4225-b638-4ebb6fec5a9b'} Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:41:28.758413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:41:28.763218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] Returning 404 to user: Instance 9fc45531-9210-4225-b638-4ebb6fec5a9b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:41:28.769112 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e8c6329-52b1-495e-a7d8-776cb154c867 tempest-TestServerAdvancedOps-2053748759 tempest-TestServerAdvancedOps-2053748759-project] 10.222.0.66 "GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b" status: 404 len: 111 microversion: 2.1 time: 0.080076 Oct 11 01:41:28.769112 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2107/4247] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:28 2022] GET /compute/v2.1/servers/9fc45531-9210-4225-b638-4ebb6fec5a9b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:41:48.246968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:48.247741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:48.841414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-760093847", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a65b91d9-c807-4fac-acf8-2ed527f7855c"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:49.047914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] validate_networks() for [('a65b91d9-c807-4fac-acf8-2ed527f7855c', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:41:50.237236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:41:50.237768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:41:50.238200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:41:50.238626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:41:50.239185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:41:50.277804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:50.278412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:50.281357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:50.285300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:50.286058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:50.286712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:50.382371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Getting quotas for project f97ee7a8caeb44e89e2144c65ea5d80a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:41:50.406630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Getting quotas for user 4231e976c0fd4c37a04ecf563bd54a31 and project f97ee7a8caeb44e89e2144c65ea5d80a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:41:50.458155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Going to run 2 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:41:50.463276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 59b358c7-590c-431a-a618-ea58bb3621c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:41:50.537992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=59b358c7-590c-431a-a618-ea58bb3621c6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:41:50.757621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-118bfb49-bf4f-459e-b799-438585b4a3cb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518782 Oct 11 01:41:50.763563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2141/4248] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:41:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:41:50.772138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:50.778304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:50.786450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Searching by: {'deleted': False, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:41:50.843057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:50.850925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=25 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:41:50.899173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:50.900718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:50.904485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:50.905641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:50.906645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:50.907258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:50.972814 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f366a92-5e13-4a3c-b894-1fcee139ced9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.199551 Oct 11 01:41:50.982859 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2108/4249] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:41:50 2022] GET /compute/v2.1/servers => generated 675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:41:50.988895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8e9ffc1-84b8-4dae-9a68-e59c1ff562ce tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:50.994022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8e9ffc1-84b8-4dae-9a68-e59c1ff562ce tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:51.169760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8e9ffc1-84b8-4dae-9a68-e59c1ff562ce tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:51.184876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8e9ffc1-84b8-4dae-9a68-e59c1ff562ce tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1219 microversion: 2.1 time: 0.200885 Oct 11 01:41:51.189349 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2142/4250] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:50 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:52.220054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2ccebd09-2de9-4b45-ac95-5d3883e9cb66 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:52.221603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2ccebd09-2de9-4b45-ac95-5d3883e9cb66 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:52.473809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ccebd09-2de9-4b45-ac95-5d3883e9cb66 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:52.492863 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2ccebd09-2de9-4b45-ac95-5d3883e9cb66 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1219 microversion: 2.1 time: 0.274145 Oct 11 01:41:52.499916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2109/4251] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:52 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1219 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:53.525344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:53.526144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:53.548548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:53.555173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:53.556461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:53.560998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:53.561853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:53.562538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:53.807146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:53.820449 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c06164b7-9bf1-4207-a22e-21adbde36897 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1215 microversion: 2.1 time: 0.299380 Oct 11 01:41:53.821823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2143/4252] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:53 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:54.872636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:54.874786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:54.892744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:54.895997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:54.897211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:54.898221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:54.899136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:54.900026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:55.247284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:55.264368 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ea704cf-e7cf-4fdd-b0d7-671c169adc14 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1279 microversion: 2.1 time: 0.421396 Oct 11 01:41:55.295768 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2110/4253] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:54 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1279 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:56.298278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:56.300480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:56.320576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:56.321387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:56.321843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:56.322583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:56.326909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:56.327535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:57.210034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:57.232198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c21602b-6ea0-4898-8de0-22231458f367 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1277 microversion: 2.1 time: 0.942961 Oct 11 01:41:57.238002 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2144/4254] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:56 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1277 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:58.288150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:58.294137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:58.336239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:58.337723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:58.338646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:58.340008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:58.341308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:58.341979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:58.708241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:41:58.733590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-597e224c-3edf-41f8-b03f-c210e1492e60 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1277 microversion: 2.1 time: 0.476605 Oct 11 01:41:58.737071 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2111/4255] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:58 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1277 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:41:58.779110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b358c7-590c-431a-a618-ea58bb3621c6", "tag": "13d7fb0c-340a-451c-a46e-e7ca145aebe7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:41:58.808217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:58.809280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:58.809963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:58.855653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] Creating event network-changed:13d7fb0c-340a-451c-a46e-e7ca145aebe7 for instance 59b358c7-590c-431a-a618-ea58bb3621c6 on n-h1-772273-9 Oct 11 01:41:58.867088 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7c952bc0-2749-4be2-98b0-6013949e545f req-f3eb85b5-bae1-405a-9ba4-b8e54eac7a29 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091617 Oct 11 01:41:58.869668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2145/4256] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:41:59.764440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:41:59.766058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:41:59.780439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:59.783110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:59.783832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:41:59.785064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:41:59.787157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:41:59.789037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:00.169676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:00.180860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-152408cc-e465-4a7c-921a-bec385c83d95 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.421577 Oct 11 01:42:00.199375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2112/4257] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:41:59 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:01.215228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:01.215985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:01.231414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:01.232830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:01.237492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:01.242059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:01.242782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:01.245311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:01.246075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:01.246920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:01.662692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:01.675221 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82ad775d-c2e2-440f-b925-1fa25ac52aac tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.464554 Oct 11 01:42:01.676325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2146/4258] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:01 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:02.066169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f78925-374f-4a23-8b66-ede5d6b38978", "tag": "82148eac-c2aa-4f56-ab2e-67d9ca7913ba"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:02.078645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:02.080606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:02.081093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:02.081562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:02.096483 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] Creating event network-changed:82148eac-c2aa-4f56-ab2e-67d9ca7913ba for instance 62f78925-374f-4a23-8b66-ede5d6b38978 on n-h2-772273-9 Oct 11 01:42:02.101790 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-56333fcd-33fc-48c6-be43-a154b60127b1 req-77365bcf-8d63-4713-a34d-18f0b643a928 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039468 Oct 11 01:42:02.102422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2113/4259] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:42:02.700869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:02.701476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:02.709726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:02.710420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:02.711059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:02.712000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:02.712628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:02.713251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:03.723682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:03.737500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-182b47d5-379a-4761-91e9-7aaee5035390 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 1.038823 Oct 11 01:42:03.760712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2147/4260] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:02 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:04.766684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:04.767497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:04.769761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:04.792271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:04.801595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:04.802814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:04.811951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:04.816974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:04.817649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:05.210607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:05.222301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-19861685-3364-4fc4-a1b4-083f18cde90e tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.459494 Oct 11 01:42:05.224819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2114/4261] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:04 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:05.969484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f4e73bd-2377-4cf3-838a-64afc78281d6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Action: 'create', calling method: .version_select at 0x7f112f739310>, body: {"keypair": {"name": "tempest-keypair-569893860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOc/UZvgTk/hRD3TBOBT2SIq7BG0b64EEKykbeEkYLqf6/zajOWjRyEIi4LxEg4M28Z7/UtChzgDQ0cgW06binW7vd1gs1f/KgdT0EhLns8uJn2pViZAslX5jyG1GABWA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:05.992775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f4e73bd-2377-4cf3-838a-64afc78281d6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Getting quotas for project 21b94b3661b84faea7c4fb19f659baa3. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:42:06.003520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8f4e73bd-2377-4cf3-838a-64afc78281d6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Getting quotas for user d278a65e509b4ac9ade6a8119e28e011 and project 21b94b3661b84faea7c4fb19f659baa3. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:42:06.080134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f4e73bd-2377-4cf3-838a-64afc78281d6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.119941 Oct 11 01:42:06.081130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2148/4262] 10.222.0.66 () {62 vars in 1200 bytes} [Tue Oct 11 01:42:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 01:42:06.249058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:06.250632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:06.267673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:06.271763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:06.273263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:06.275844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:06.278098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:06.280099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:07.014279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:07.029663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2111f45-aeec-48e0-8026-61db1e72cfda tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.782538 Oct 11 01:42:07.030656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2115/4263] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:06 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:07.723093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:07.723689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:07.745751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:07.746952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:07.747440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:07.748260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:07.748650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:07.749084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:07.897222 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8153f9e8-7f53-40c3-b8f8-c22e87b24477 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/ips" status: 200 len: 151 microversion: 2.20 time: 0.179306 Oct 11 01:42:07.904959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2149/4264] 10.222.0.66 () {60 vars in 1289 bytes} [Tue Oct 11 01:42:07 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/ips => generated 151 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:42:08.054195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:08.055511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:08.073773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:08.074309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:08.074776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:08.075568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:08.082820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:08.083493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:08.711936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:08.733307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c349314-6b6a-48fe-b92c-fe85500ea10f tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.684368 Oct 11 01:42:08.752754 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2116/4265] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:08 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:09.287743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b358c7-590c-431a-a618-ea58bb3621c6", "name": "network-vif-plugged", "status": "completed", "tag": "13d7fb0c-340a-451c-a46e-e7ca145aebe7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:09.313183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:09.314284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:09.316343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:09.352173 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] Creating event network-vif-plugged:13d7fb0c-340a-451c-a46e-e7ca145aebe7 for instance 59b358c7-590c-431a-a618-ea58bb3621c6 on n-h1-772273-9 Oct 11 01:42:09.367416 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-20318b13-73a0-4141-b477-447b8d888309 req-ff0fba64-c35b-4237-a91d-9be2eaaac605 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083270 Oct 11 01:42:09.369852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2150/4266] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:09.489265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-871622096", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1e776bef-a542-4baa-8903-3335f406840a"}, {"port": "813b21b2-a382-4673-a9b4-785be1665800", "tag": "port-1"}, {"port": "9126da6e-457d-4f7b-9641-851b9acb0c5c", "tag": "port-2"}, {"uuid": "c2bd1cec-e716-4f8e-8d0e-9fb0c140eb25", "tag": "net-1"}, {"uuid": "c2bd1cec-e716-4f8e-8d0e-9fb0c140eb25"}, {"uuid": "aa5cc44a-99ee-49ae-8ef4-c887299a392f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "aa5cc44a-99ee-49ae-8ef4-c887299a392f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8f031f59-6d86-47d6-aefc-4de27e99031a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "70002ebc-a97a-49eb-8958-ab17a094704d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6ccd770f-7dd3-4e10-a75e-68bde0c6b747", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1031214530"}], "key_name": "tempest-keypair-569893860", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:09.763907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:09.765373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:09.771048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] validate_networks() for [('1e776bef-a542-4baa-8903-3335f406840a', None, None, None, None, None), (None, None, '813b21b2-a382-4673-a9b4-785be1665800', None, None, None), (None, None, '9126da6e-457d-4f7b-9641-851b9acb0c5c', None, None, None), ('c2bd1cec-e716-4f8e-8d0e-9fb0c140eb25', None, None, None, None, None), ('c2bd1cec-e716-4f8e-8d0e-9fb0c140eb25', None, None, None, None, None), ('aa5cc44a-99ee-49ae-8ef4-c887299a392f', '10.2.2.100', None, None, None, None), ('aa5cc44a-99ee-49ae-8ef4-c887299a392f', '10.2.2.200', None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:42:09.778068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:09.781810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:09.782607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:09.783754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:09.785713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:09.787442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:10.522308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:10.532319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63c27c68-1988-4c42-8cc4-dd25a8c26f1a tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.773800 Oct 11 01:42:10.536039 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2151/4267] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:09 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:11.416614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:11.417172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:11.441526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:11.444393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:11.444847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:11.445581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:11.447841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:11.448284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:11.550344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lazy-loading 'flavor' on Instance uuid 77dda07b-53f5-41e8-b828-65c9e8b8d878 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:42:12.447816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c43c129-329c-45f6-b24c-ee74e06df353 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/action" status: 202 len: 0 microversion: 2.20 time: 1.033571 Oct 11 01:42:12.451230 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2152/4268] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:42:11 2022] POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:42:12.473421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:12.474111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:12.504079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:12.504587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:12.506592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:12.508769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:12.511818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:12.512273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:12.982751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:13.005976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63076a66-74f7-49a5-b12a-e3c2837adfe9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.549161 Oct 11 01:42:13.008254 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2153/4269] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:12 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:13.026421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:13.027368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:13.039184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:13.043645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:13.077473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:13.084832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:13.085216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:13.086871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:13.872680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:13.882147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:13.883607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:13.884825 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-558307b9-3c0b-406a-a4bd-6e0ea033b594 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.875370 Oct 11 01:42:13.885672 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2154/4270] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:13 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:13.891521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f78925-374f-4a23-8b66-ede5d6b38978", "name": "network-vif-plugged", "status": "completed", "tag": "82148eac-c2aa-4f56-ab2e-67d9ca7913ba"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:13.904391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:13.905181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:13.905868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:13.919735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] Creating event network-vif-plugged:82148eac-c2aa-4f56-ab2e-67d9ca7913ba for instance 62f78925-374f-4a23-8b66-ede5d6b38978 on n-h2-772273-9 Oct 11 01:42:13.926985 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c201e562-8c55-4737-9909-034698017c36 req-9fa76f58-8cd6-49a4-9c53-d09aa84b2675 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039376 Oct 11 01:42:13.928541 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2155/4271] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:14.036279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:14.038140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:14.049134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:14.053779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:14.054380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:14.055226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:14.057074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:14.058156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:14.680739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:14.689337 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2291307b-aad5-4b44-bfde-71d6053e7b89 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.658556 Oct 11 01:42:14.704133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2156/4272] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:14 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:14.914080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:14.914713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:14.926522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:14.927074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:14.927564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:14.929963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:14.930442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:14.931995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:15.270687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:15.285151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:15.286785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:15.292868 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73e0a664-4abc-418d-ae3d-7525e54db9a7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.383939 Oct 11 01:42:15.296151 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2157/4273] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:14 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:15.602574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:42:15.603468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:42:15.604388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:42:15.605021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:42:15.605707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:42:15.618532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:15.622664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:15.623622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:15.625434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:15.626159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:15.626932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:15.669948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Getting quotas for project 21b94b3661b84faea7c4fb19f659baa3. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:42:15.681990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Getting quotas for user d278a65e509b4ac9ade6a8119e28e011 and project 21b94b3661b84faea7c4fb19f659baa3. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:42:15.717552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:15.722858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:15.745308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:15.750588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:15.751533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:15.754570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:15.755790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:15.758128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:16.025246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:16.141099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:42:16.144887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8f031f59-6d86-47d6-aefc-4de27e99031a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='70002ebc-a97a-49eb-8958-ab17a094704d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ccd770f-7dd3-4e10-a75e-68bde0c6b747',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:42:16.187412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.200169 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a4cdafca-0f3e-4746-99bc-fc7f050d48ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1319 microversion: 2.1 time: 0.490038 Oct 11 01:42:16.201082 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2158/4274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:15 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:16.325495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:16.326313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:16.337710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:16.338213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:16.338658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:16.339419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:16.339890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:16.340309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:16.565966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.584837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.586486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.587775 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ec7f345-1a72-42b1-a984-654b478392e9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.266900 Oct 11 01:42:16.602012 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2159/4275] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:16 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:16.725089 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e1a2984-8335-41cc-9e3b-7047f69599e1 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.240471 Oct 11 01:42:16.727266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2117/4276] 10.222.0.66 () {62 vars in 1189 bytes} [Tue Oct 11 01:42:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 7243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:42:16.741390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:16.742301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:16.859260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.874507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.879700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:16.883970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce4153e1-564b-444b-b70f-a0a3e522fe0d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1284 microversion: 2.32 time: 0.147890 Oct 11 01:42:16.901172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2160/4277] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:16 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:17.109473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d52da0a-96d1-452b-8aac-b0fa7d2a9ab5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: .version_select at 0x7f112f5230d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1305129086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3H1foIig7GkAHoOScKS/GmrEwha4NcxoczEBmIRu2WfoDSMl6Iqgwl481TCO8CKTWGOTuBr9GGntw0WsUc6OwWjMFMLwD4K/Lfpir9TDqhKIHYoTlVYbLYM902ns0bmA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:17.143886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1d52da0a-96d1-452b-8aac-b0fa7d2a9ab5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:42:17.168205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1d52da0a-96d1-452b-8aac-b0fa7d2a9ab5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:42:17.225718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:17.226346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:17.230399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d52da0a-96d1-452b-8aac-b0fa7d2a9ab5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.456857 Oct 11 01:42:17.233902 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2118/4278] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:42:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:42:17.245623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.246350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.246989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:17.247921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.248555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.249151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:17.267840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:17.543024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:17.556727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad336750-8e69-4f90-91a6-2ed87a2a7438 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 200 len: 1508 microversion: 2.1 time: 0.333039 Oct 11 01:42:17.557697 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2161/4279] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:17 2022] GET /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:17.592407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:17.592407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 59b358c7-590c-431a-a618-ea58bb3621c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:17.607113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.607669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.609598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:17.609598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.615526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:17.616194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:17.624196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.624547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.625085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:17.637206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.637952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:17.643698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:17.648960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:17.650166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:18.330888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.337306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.345120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89972ba3-3412-4284-bfd4-3f6e0aa5b5ad tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/59b358c7-590c-431a-a618-ea58bb3621c6" status: 200 len: 1507 microversion: 2.1 time: 0.757060 Oct 11 01:42:18.348105 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2119/4280] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:17 2022] GET /compute/v2.1/servers/59b358c7-590c-431a-a618-ea58bb3621c6 => generated 1507 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:18.352310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.353114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:18.353837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:18.360570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.362697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c734dca-7968-48e1-875d-60e1101195cc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.751905 Oct 11 01:42:18.391729 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2162/4281] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:17 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:18.422730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:18.423635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 59b358c7-590c-431a-a618-ea58bb3621c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:18.429390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:18.431201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:18.431956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:18.433359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:18.433633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:18.434513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:18.435167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:18.468019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 59b358c7-590c-431a-a618-ea58bb3621c6] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:42:18.494664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.509466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.512256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:18.516353 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5417b3c-cdc4-4003-89d2-65ffbb0cc20a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1284 microversion: 2.32 time: 0.167470 Oct 11 01:42:18.517275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2120/4282] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:18 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:18.648481 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-447838b0-9d46-4d80-a648-6db3d7da6fc4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "DELETE /compute/v2.1/servers/59b358c7-590c-431a-a618-ea58bb3621c6" status: 204 len: 0 microversion: 2.1 time: 0.255435 Oct 11 01:42:18.649071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2163/4283] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:42:18 2022] DELETE /compute/v2.1/servers/59b358c7-590c-431a-a618-ea58bb3621c6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:42:18.659479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:18.660451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:18.669765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:18.670711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:18.671522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:18.672468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:18.673305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:18.673964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:18.707640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 62f78925-374f-4a23-8b66-ede5d6b38978] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:42:18.821014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e907ceaa-900e-4909-91b3-067460071bf9 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "DELETE /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978" status: 204 len: 0 microversion: 2.1 time: 0.166293 Oct 11 01:42:18.822662 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2121/4284] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:42:18 2022] DELETE /compute/v2.1/servers/62f78925-374f-4a23-8b66-ede5d6b38978 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:42:18.971900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-290186088", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a65b91d9-c807-4fac-acf8-2ed527f7855c"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:19.066120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] validate_networks() for [('a65b91d9-c807-4fac-acf8-2ed527f7855c', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:42:19.419381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:19.420116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:19.434201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:19.434690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:19.435142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:19.435887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:19.436540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:19.437148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.077606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.086534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.089072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.090844 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65206888-3a3a-4c68-85d6-dd0ee0ae13bf tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.676120 Oct 11 01:42:20.107743 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2122/4285] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:19 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:20.115773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:20.116624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:20.122784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.123540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.124186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.125790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.126420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.127016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.252408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.272971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.275233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.276680 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59ed83d8-721f-47e4-b134-ac023f02ad51 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1574 microversion: 2.32 time: 0.167415 Oct 11 01:42:20.277368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2123/4286] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:20 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:20.292417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:42:20.292897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:42:20.293314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:42:20.293729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:42:20.294749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:42:20.317028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.318148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.318596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.321820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.322334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.322777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.358219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Getting quotas for project f97ee7a8caeb44e89e2144c65ea5d80a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:42:20.366096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Getting quotas for user 4231e976c0fd4c37a04ecf563bd54a31 and project f97ee7a8caeb44e89e2144c65ea5d80a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:42:20.387056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Going to run 2 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:42:20.389845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:42:20.436412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=cd786e89-b3f2-486f-922e-5761c177827b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:42:20.506310 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f0fc4f7e-84c2-455c-bbaa-ebb85fa5bdcf tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.539280 Oct 11 01:42:20.507130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2164/4287] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:42:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 1541 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 01:42:20.526053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:20.563163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:20.566827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Searching by: {'deleted': False, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:42:20.614896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.615780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.616933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.617973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:20.618695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:20.619426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:20.718182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:42:20.792547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a2b6d4f-04a3-4563-9344-bc0623c67833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.277668 Oct 11 01:42:20.797924 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2124/4288] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 01:42:20 2022] GET /compute/v2.1/servers => generated 1333 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:20.810492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-202bdfbe-83c4-46e5-93e7-1bf5267d99bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:20.811774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-202bdfbe-83c4-46e5-93e7-1bf5267d99bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:21.124384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:21.125018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:21.134079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:21.140723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-202bdfbe-83c4-46e5-93e7-1bf5267d99bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:21.158990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-202bdfbe-83c4-46e5-93e7-1bf5267d99bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1217 microversion: 2.1 time: 0.350138 Oct 11 01:42:21.191291 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2165/4289] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:20 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1217 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:21.193424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:21.195677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:21.196940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:21.200677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:21.201424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:21.202227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:21.221321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:21.302765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:21.303602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:21.317323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:21.318784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:21.321582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:21.321582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:21.323088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:21.323997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:21.511289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:21.527979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:21.529504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:21.533976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82fbb479-0320-4128-b24e-4d26e750810d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1592 microversion: 2.32 time: 0.235581 Oct 11 01:42:21.534589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2166/4290] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:21 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1592 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:22.186166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:22.186826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:22.194134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.194916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.195632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.196579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.197293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.198614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.384713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.407014 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc9ed2a3-1585-4be4-99a7-58a57e603c38 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1221 microversion: 2.1 time: 0.222502 Oct 11 01:42:22.409561 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2167/4291] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:22 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:22.442165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b358c7-590c-431a-a618-ea58bb3621c6", "name": "network-vif-deleted", "tag": "13d7fb0c-340a-451c-a46e-e7ca145aebe7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:22.479747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.480244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.480691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.551038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] Creating event network-vif-deleted:13d7fb0c-340a-451c-a46e-e7ca145aebe7 for instance 59b358c7-590c-431a-a618-ea58bb3621c6 on n-h1-772273-9 Oct 11 01:42:22.561610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-db449dc3-f98e-4007-859b-69cfc91cfc77 req-008ce004-c53e-4d34-b9fc-3f6e9383bec3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146233 Oct 11 01:42:22.566887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.585992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2168/4292] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:22.595248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.598359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.600652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-86e9abaf-a9e6-4421-80c8-3be49d4a6ecc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 1.481385 Oct 11 01:42:22.602048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:22.627515 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2125/4293] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:21 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:22.647562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.666591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.854501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.876219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.878264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:22.881604 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-450d81cc-f798-4093-93ea-8892f2490834 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1592 microversion: 2.32 time: 0.293810 Oct 11 01:42:22.883170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2169/4294] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:22 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1592 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:22.940398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f78925-374f-4a23-8b66-ede5d6b38978", "name": "network-vif-deleted", "tag": "82148eac-c2aa-4f56-ab2e-67d9ca7913ba"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:22.967183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:22.967747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:22.975908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:22.997561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] Creating event network-vif-deleted:82148eac-c2aa-4f56-ab2e-67d9ca7913ba for instance 62f78925-374f-4a23-8b66-ede5d6b38978 on n-h2-772273-9 Oct 11 01:42:23.017020 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-bcba8343-1b78-499a-9b59-846896a71b0c req-922be4ea-fc9e-48b0-a961-3202668dc8a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080188 Oct 11 01:42:23.017667 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2126/4295] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:23.435026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:23.436812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:23.449293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.450119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.452208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:23.453237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.454284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.457250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:23.616905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:23.632982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:23.633709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:23.640559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abf8ba44-9058-40ab-9b0a-9ef46f4ef833 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1277 microversion: 2.1 time: 0.209879 Oct 11 01:42:23.657536 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2170/4296] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:23 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:23.661145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.676079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.677161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:23.678841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.682680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.684708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:23.910875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:23.912174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:23.930382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.933375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.933857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:23.935981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:23.940068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:23.943999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:24.140722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.154591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.157161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.158857 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcf463bf-02b9-446f-807b-296ba6fcbbfa tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1592 microversion: 2.32 time: 0.252764 Oct 11 01:42:24.160152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2171/4297] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:23 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1592 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:24.596595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.613022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.614537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.615951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6fab6538-2376-425a-bd9a-f0ea56885aa4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.989394 Oct 11 01:42:24.622604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2127/4298] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:23 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:24.667733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:24.669145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:24.682279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:24.683398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:24.683968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:24.686689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:24.687464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:24.688731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:24.826768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:24.844431 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-601325ff-0ef3-4806-aed6-14e09cb0ceab tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1275 microversion: 2.1 time: 0.178287 Oct 11 01:42:24.846294 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2172/4299] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:24 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:25.189138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:25.190490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:25.207922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.212247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.214609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:25.215719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.217024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.221194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:25.562098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:25.579773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:25.586531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:25.588371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6009294-bde9-4823-9eeb-b639f7f0cb53 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1660 microversion: 2.32 time: 0.403302 Oct 11 01:42:25.593487 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2128/4300] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:25 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1660 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:25.653488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:25.654680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:25.667679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.668582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.671218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:25.672277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.674797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.676659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:25.874139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:25.874936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:25.883515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.887074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.887699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:25.888548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:25.890696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:25.891250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:26.319792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:26.334216 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7ff6538-3eaf-41f3-9f7f-879cf1c6a9eb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1275 microversion: 2.1 time: 0.464380 Oct 11 01:42:26.339292 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2129/4301] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:25 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1275 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:26.509312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:26.528241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:26.531747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:26.537488 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cc89a01-d79d-41da-aee6-1e959504a755 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1743 microversion: 2.20 time: 0.886210 Oct 11 01:42:26.538449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2173/4302] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:25 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1743 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:26.619151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:26.619857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:26.635798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:26.637999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:26.641147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:26.644007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:26.648530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:26.655615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "name": "network-vif-plugged", "status": "completed", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:26.664967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:26.686757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:26.687872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:26.688580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:26.714637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] Creating event network-vif-plugged:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:42:26.733447 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-67f9a634-fc2d-4e2e-b6aa-45b0155df611 req-86b0ed74-b3d1-4537-b23a-49680674fd16 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082594 Oct 11 01:42:26.734859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2174/4303] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:42:27.131413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:27.145992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:27.151694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:27.153308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75a3ead3-c328-4e86-ab8a-c73600a0eff5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1660 microversion: 2.32 time: 0.539047 Oct 11 01:42:27.153905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2130/4304] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:26 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1660 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:27.370239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:27.371020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:27.378258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:27.379168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:27.380444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:27.381405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:27.382099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:27.384230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:27.578808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:27.579975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:27.597985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:27.598477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:27.599506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:27.600237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:27.608115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:27.608938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:28.103757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.116502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-516b1c9b-404c-4bcc-a689-210dc09fb49c tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 0.751653 Oct 11 01:42:28.117134 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2175/4305] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:27 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:28.184675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:28.186105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:28.195103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:28.196263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:28.197023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:28.200300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:28.201397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:28.202516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:28.502025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:28.591585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.611812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.613370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.619536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50147dbd-881a-4886-8c68-a75df4660520 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1743 microversion: 2.20 time: 1.045106 Oct 11 01:42:28.620929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2131/4306] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:27 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1743 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:28.890026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.907774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.909181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:28.910366 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a1f47bc-d3ab-49f0-8391-ee685a75aba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1707 microversion: 2.32 time: 0.732392 Oct 11 01:42:28.911557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2176/4307] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:28 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1707 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:29.140358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:29.141189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:29.153403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:29.153913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:29.158264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:29.160034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:29.160737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:29.162634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:29.650363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:29.651133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:29.659585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:29.660014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:29.660777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:29.662429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:29.663098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:29.663816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:30.104543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:30.152188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05c35757-cbd8-4767-9921-c9587d53c439 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 1.016410 Oct 11 01:42:30.153170 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2132/4308] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:29 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:30.189911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd786e89-b3f2-486f-922e-5761c177827b", "tag": "5dbb0f7f-96b3-4785-8536-9ea65dd723c2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:30.226294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:30.227326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:30.228015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:30.253926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] Creating event network-changed:5dbb0f7f-96b3-4785-8536-9ea65dd723c2 for instance cd786e89-b3f2-486f-922e-5761c177827b on n-h2-772273-9 Oct 11 01:42:30.260018 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3be678c3-d057-455e-b1ae-d7dc55b6de16 req-c650db05-2dc7-4095-b960-befb775bcbf8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088338 Oct 11 01:42:30.260640 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2133/4309] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:30.267816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:30.268887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:30.276606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:30.278883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:30.279612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:30.280988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:30.281971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:30.282806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:30.348563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:30.661610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:31.146416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:31.644173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:31.662829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:31.665894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:31.677718 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f92e8a8-c999-41d3-bce3-1a640b43d10d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 2.030322 Oct 11 01:42:31.680200 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2177/4310] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:29 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:31.699196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9857fab6-3ca7-40f0-815c-6735795401cc", "tag": "462bf6bf-bf85-4a79-83b2-ccbfb28603d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:31.742073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:31.742573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:31.743013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:31.784151 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] Creating event network-changed:462bf6bf-bf85-4a79-83b2-ccbfb28603d7 for instance 9857fab6-3ca7-40f0-815c-6735795401cc on n-h1-772273-9 Oct 11 01:42:31.802389 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9822adea-5405-4d56-8922-3be36dcd5907 req-86440443-6bef-438b-a75f-d61775473b24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114053 Oct 11 01:42:31.803023 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2178/4311] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:31.825055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:31.825658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:31.848837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:31.852185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:31.852923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:31.853944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:31.857199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:31.858610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:32.470489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:32.485162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:32.492292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:32.494104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75f3c08e-b1d9-40e7-8d52-8808048b734c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1754 microversion: 2.32 time: 2.231837 Oct 11 01:42:32.504199 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2134/4312] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:30 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1754 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:32.708458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:32.709503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:32.726435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:32.727371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:32.728159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:32.729203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:32.729917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:32.730584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:33.553421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:33.579633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c92af78-d726-493e-bb2b-28fb103a3ee5 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 1.757453 Oct 11 01:42:33.583767 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2179/4313] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:31 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:33.591687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:33.592391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:33.629300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:33.630736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:33.631186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:33.631961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:33.632425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:33.632849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:33.649564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:33.846874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:33.871114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:33.875550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:33.882672 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce4873d0-7ff2-4e75-a06e-e8a71cf0477c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 1.178602 Oct 11 01:42:33.891383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2135/4314] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:32 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:34.319013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:34.331999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:34.337664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:34.341074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba3da501-3518-4df3-9f74-8d50b7ba739a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1754 microversion: 2.32 time: 0.756124 Oct 11 01:42:34.345682 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2180/4315] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:33 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1754 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:34.613289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:34.614629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:34.626896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:34.635621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:34.637391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:34.638446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:34.642018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:34.645583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:34.917211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:34.917969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:34.947229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:34.947732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:34.948310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:34.948900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:34.949359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:34.953267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:35.871127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:35.889109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:35.893979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:35.898222 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-820d77fe-7c0b-4700-9fee-23806ff9f6cb tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.985739 Oct 11 01:42:35.901327 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2181/4316] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:34 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:35.913501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:35.914460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:35.934236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:35.936836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:35.937710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:35.940327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:35.941803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:35.944031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:35.944814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:35.950815 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-636cddd0-a62c-4e0b-972d-2b3d5b3806bc tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 1.341587 Oct 11 01:42:35.955403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2136/4317] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:34 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:36.925438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:36.927625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:36.946575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:36.947166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:36.947537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:36.948315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:36.948806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:36.950950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:38.557361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:38.584184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:38.595874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:38.602911 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7870edfc-0655-4f1f-b241-fadeb8c31623 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1801 microversion: 2.32 time: 2.697038 Oct 11 01:42:38.627931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2182/4318] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:35 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1801 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:38.637208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:38.638645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:38.649571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:38.650505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:38.651361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:38.652591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:38.653617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:38.654340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:39.081997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:39.096813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:39.100546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:39.104095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a7e56b0a-038e-4088-8b5c-4aa0b3269c50 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 2.183148 Oct 11 01:42:39.105891 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2137/4319] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:36 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:39.635020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:39.635781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:39.652716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:39.653527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:39.662222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:39.663408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:39.672707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:39.673440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:39.823646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:39.858728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58a7618d-4f82-451c-ae6d-3215b5dd4c15 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 1.226145 Oct 11 01:42:39.871457 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2183/4320] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:38 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:39.954370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-209392042", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "7e1a1613-a5d3-4551-8181-d59f66a9f300"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1305129086", "security_groups": [{"name": "tempest-secgroup-smoke-1228468228"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:40.776593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] validate_networks() for [('7e1a1613-a5d3-4551-8181-d59f66a9f300', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:42:40.821368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:40.852561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:40.858023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:40.861824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ab755bd-d9ca-4a41-8f9f-b2cfb4becf6e tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1848 microversion: 2.32 time: 1.232014 Oct 11 01:42:40.869329 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2138/4321] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:39 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1848 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:40.893198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:40.894224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:40.909530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:40.910549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:40.913842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:40.915508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:40.923861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:40.924702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:42.016043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:42.047044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:42.053509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:42.055628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5062def3-3c11-45bb-b6ef-8a7acef344ce tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 1.183566 Oct 11 01:42:42.064695 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2139/4322] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:40 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:42.078470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:42.082238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:42.105944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:42.106815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:42.109307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:42.113068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:42.115620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:42.116359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:42.782261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:42.795751 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd640688-1c98-4ae7-941c-7e9be97b83d4 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 0.727329 Oct 11 01:42:42.800182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2140/4323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:42 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:42.810385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd786e89-b3f2-486f-922e-5761c177827b", "name": "network-vif-plugged", "status": "completed", "tag": "5dbb0f7f-96b3-4785-8536-9ea65dd723c2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:42.844319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:42.853054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:42.853898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:42.912881 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] Creating event network-vif-plugged:5dbb0f7f-96b3-4785-8536-9ea65dd723c2 for instance cd786e89-b3f2-486f-922e-5761c177827b on n-h2-772273-9 Oct 11 01:42:42.942249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f9417ab2-5365-483c-9590-93442ae7621c req-f46f4763-6f42-400d-9cf4-c61c1e8c2cbe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131846 Oct 11 01:42:42.943298 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2141/4324] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:42.989140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:42.997532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:43.022117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:43.023380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:43.048796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:43.050108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:43.050227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:43.050670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:43.954817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:42:43.956008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:42:43.956693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:42:43.957358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:42:43.959310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:42:43.985115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:43.987735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:43.988429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:43.989537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:43.993606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:43.994909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:44.055069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.074310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.084942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.086560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e97edf4f-ca06-47be-a213-4da4bc610b1c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1848 microversion: 2.32 time: 1.121727 Oct 11 01:42:44.087430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2142/4325] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:42 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1848 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:44.106176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:44.112923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:44.119360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:42:44.127078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:44.128864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:44.130169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:44.131165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:44.132645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:44.133380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:44.140408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:42:44.194149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:42:44.200493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:42:44.366378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f27cecf8-b89f-4fc7-8c87-03acb02c94e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.416047 Oct 11 01:42:44.370199 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2184/4326] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:42:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 4421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:42:44.389021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:44.401790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:44.445284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:44.480267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:44.486005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:44.486803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:44.487283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:44.495208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:44.886159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.888990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:44.919664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.924787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:44.926081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a017822-2c6f-4865-a880-46b8665145bc tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.832110 Oct 11 01:42:44.935659 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2143/4327] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:44 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:44.982391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "0f6aba64-69f5-4923-9198-0e1cc8d773be"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:45.037199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:45.042345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:45.042913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:45.081738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] Creating event network-changed:0f6aba64-69f5-4923-9198-0e1cc8d773be for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:42:45.149700 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-59e418d8-546e-4c6f-9ae3-dbb8172423ad req-127a13c1-46ff-4605-8170-f0234125520d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212749 Oct 11 01:42:45.158971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2144/4328] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:45.177267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b7b431b-7c94-4b0c-9cd7-933dc039b692 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:45.183946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b7b431b-7c94-4b0c-9cd7-933dc039b692 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:45.330427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:45.345555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3f172c6-17f0-46d4-8590-f760d242cdfb tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 0.972134 Oct 11 01:42:45.347741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2185/4329] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:44 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:45.358943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9857fab6-3ca7-40f0-815c-6735795401cc", "name": "network-vif-plugged", "status": "completed", "tag": "462bf6bf-bf85-4a79-83b2-ccbfb28603d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:45.393785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:45.396437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:45.398465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:45.440094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b7b431b-7c94-4b0c-9cd7-933dc039b692 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:45.446986 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] Creating event network-vif-plugged:462bf6bf-bf85-4a79-83b2-ccbfb28603d7 for instance 9857fab6-3ca7-40f0-815c-6735795401cc on n-h1-772273-9 Oct 11 01:42:45.453544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b7b431b-7c94-4b0c-9cd7-933dc039b692 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1266 microversion: 2.1 time: 0.290849 Oct 11 01:42:45.457995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2145/4330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:45 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:45.474036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:45.475059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:45.478984 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-79000b6d-16f0-4af2-9d70-1fe886ab57b4 req-ab89d8a6-4837-4e6e-b400-53cf490b7079 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123966 Oct 11 01:42:45.492236 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2186/4331] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:45.500173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:45.501291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:45.505492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:45.506832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:45.509846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:45.511759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:45.965591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:45.967453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:45.999203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:46.002661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:46.005845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:46.007016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:46.011058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:46.013641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:47.046733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.079854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.081949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.084570 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e690a94b-51d1-49fd-b557-5d5568e93fe5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1848 microversion: 2.32 time: 1.624692 Oct 11 01:42:47.098730 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2146/4332] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:45 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1848 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:47.121872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:47.122533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:47.146450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:47.148826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:47.149291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:47.153951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:47.156593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:47.157304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:47.233244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.245437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.263191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.273680 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0932d10-f736-4017-abe3-56b9365dfbd9 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 1.314833 Oct 11 01:42:47.277321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2187/4333] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:45 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:47.295734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:47.302707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:47.344024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:47.347278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:47.350489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:47.358121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:47.358829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:47.368495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:47.794268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:47.808206 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-440b268b-e26d-458d-ace7-edc97d742f8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1326 microversion: 2.1 time: 0.519950 Oct 11 01:42:47.826756 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2188/4334] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:47 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1326 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:48.066224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:48.083547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e127c170-d20c-4696-a68d-62d3e3d4b489 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1317 microversion: 2.1 time: 0.982630 Oct 11 01:42:48.113558 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2147/4335] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:47 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:48.115786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:48.116418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:48.130784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:48.143790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:48.144245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:48.145065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:48.145550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:48.145985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:48.222724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "813b21b2-a382-4673-a9b4-785be1665800"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:48.250868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:48.251372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:48.251822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:48.290073 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] Creating event network-changed:813b21b2-a382-4673-a9b4-785be1665800 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:42:48.313243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f3c1d09a-2cca-45f1-9920-01069b69deda req-d9589bac-a1a7-4c82-9416-6dcd9ecaaa95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099927 Oct 11 01:42:48.322961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2148/4336] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:42:48.329180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:48.329898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:48.357977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:48.358489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:48.358974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:48.360778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:48.361250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:48.361685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:49.650896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.680122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.689344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.697322 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd7d6012-b8dc-4e12-9937-f152973863f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1869 microversion: 2.32 time: 1.582588 Oct 11 01:42:49.699534 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2189/4337] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:48 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1869 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:49.725633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:49.726490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:49.734091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:49.754366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:49.756518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:49.757173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:49.761153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:49.764080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:49.764783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:49.824136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.833839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.855856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.861682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6c15fc0-387b-4361-be82-fc9d6bf86a5f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 1.537371 Oct 11 01:42:49.876417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2149/4338] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:48 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:49.892896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:49.893576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:49.896158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:49.913171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:49.913424 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbeeabc9-1467-46d2-9c10-a1e0dedc4ecf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1324 microversion: 2.1 time: 0.212222 Oct 11 01:42:49.913906 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2190/4339] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:49 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:49.915281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:49.918092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:49.919375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:49.921440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:49.922778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:50.555316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:50.567447 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9bbb1d5b-79b8-4bbd-a26a-745e58ab3368 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 200 len: 1505 microversion: 2.1 time: 0.689668 Oct 11 01:42:50.568229 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2150/4340] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:49 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 1505 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:50.600689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:50.601602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:50.614112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:50.614980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:50.617567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:50.618527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:50.620901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:50.621578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:50.726232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:50.726863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:50.739669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:50.740385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:50.741479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:50.742387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:50.743032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:50.743686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:52.171054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:52.185091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:52.193720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:52.199996 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9a6cb90-7967-409f-81a8-cc534db8480a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1890 microversion: 2.32 time: 1.478236 Oct 11 01:42:52.201142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2151/4341] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:50 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1890 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:52.206225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:52.218417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:52.230489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=56 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:52.232163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:52.234223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:52.236967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:52.237857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:52.240168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:52.240910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:52.441341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:52.458405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66fb5f67-67ad-412c-87b1-29581fb92773 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 200 len: 1505 microversion: 2.1 time: 1.865418 Oct 11 01:42:52.458973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2191/4342] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:50 2022] GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 1505 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:52.480563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:52.481194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:52.494415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:52.495816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:52.496699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:52.497974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:52.498457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:52.507007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.002926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:53.017429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:53.030933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:53.035517 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d915533-7ceb-4192-afda-376b4b077810 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.833046 Oct 11 01:42:53.036242 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2152/4343] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:52 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:53.042786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "9126da6e-457d-4f7b-9641-851b9acb0c5c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:53.078462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.079077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.085381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.103092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:53.105048 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] Creating event network-changed:9126da6e-457d-4f7b-9641-851b9acb0c5c for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:42:53.112901 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a222e39d-f756-4b90-91d1-b5476210a0d5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.644456 Oct 11 01:42:53.115401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9e08bae2-5724-49b2-82c5-4569fbdb47d2 req-8c790d4c-acca-408c-bf4b-11df7134cf11 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077791 Oct 11 01:42:53.119573 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2153/4344] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:53.132393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:53.134210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:53.139609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2192/4345] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:52 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:53.152332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.153083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.154607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.156169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.159998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.160778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.217459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:42:53.229082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:53.229706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:53.240842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.241270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.242059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.242493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.242924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.243377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.444370 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8c075b5-7d54-4194-8711-811df0ed14c7 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 204 len: 0 microversion: 2.1 time: 0.322369 Oct 11 01:42:53.444977 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2154/4346] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:42:53 2022] DELETE /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:42:53.461393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:53.462004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:53.493069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.493656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.494427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.502845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.503894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.504712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.567793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:42:53.809900 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2048daa2-c09b-4839-a4f8-160f374f0778 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 204 len: 0 microversion: 2.1 time: 0.359878 Oct 11 01:42:53.811034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2155/4347] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:42:53 2022] DELETE /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:42:53.825180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:53.826255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:53.839096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.841872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.842933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:53.844939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:53.845832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:53.847654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:54.038147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:54.163721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:54.169606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.186014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.195146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.196678 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf85973e-62ef-4a90-89df-39e934b89cee tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1890 microversion: 2.32 time: 0.971492 Oct 11 01:42:54.221649 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2193/4348] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:53 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1890 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:54.234790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:54.235746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:54.252445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:54.254910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:54.255603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:54.258014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:54.259708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:54.263884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:54.572014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.580992 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af62ce31-aa3b-41da-8f5e-a075b55f5973 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 200 len: 1511 microversion: 2.1 time: 0.760654 Oct 11 01:42:54.584933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2156/4349] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:53 2022] GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 1511 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:42:54.593700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:54.596718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:54.628522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:54.630652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:54.631871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:54.633865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:54.636946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:54.640032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:54.853837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.862986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.873879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:54.880414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f668f71-5fb8-44a6-99cc-80b8c037b22b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.652236 Oct 11 01:42:54.914499 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2194/4350] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:54 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:55.226706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:55.227326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:55.244383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:55.253236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:55.254769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:55.256402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:55.258415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:55.259062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:55.446680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:55.625138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:55.635088 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43480604-d317-4ba7-9ff9-19b2b1a55bde tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 1.048780 Oct 11 01:42:55.639124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2157/4351] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:54 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:55.664130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "030790c4-e198-4a11-b958-d37338f63628"}, {"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "b2ee6173-8c78-49ac-ba73-2d42280ef2d6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:55.691175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:55.691880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:55.692451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:55.716689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Creating event network-changed:030790c4-e198-4a11-b958-d37338f63628 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:42:55.717332 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] Creating event network-changed:b2ee6173-8c78-49ac-ba73-2d42280ef2d6 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:42:55.725428 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cae31933-ed31-4e32-98e9-fa83ff47abdb req-2557c25f-893b-429c-bfeb-01f068e7a5c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084929 Oct 11 01:42:55.726429 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2158/4352] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:55.744069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:55.745266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:55.752803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:55.753583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:55.754312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:55.755868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:55.756987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:55.757802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:56.795664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:56.831279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:56.842065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:56.855707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3bf65000-6f22-43cf-9e52-19581b1e3b35 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1890 microversion: 2.32 time: 1.628497 Oct 11 01:42:56.883593 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2195/4353] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:55 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1890 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:42:56.893530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:56.894219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:56.912668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:56.924811 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18aef0fc-660f-4f4b-8509-5d7d959906ff tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 200 len: 1511 microversion: 2.1 time: 1.196838 Oct 11 01:42:56.925421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2159/4354] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:55 2022] GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 1511 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:56.932089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:56.934049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:56.938910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:56.939435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:56.940191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:56.940657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:56.942600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:56.943272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:56.987211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:56.987969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:56.988762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:56.989686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:56.990319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:56.990950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:57.557772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:57.567903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:57.569593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:57.571246 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d240423-9487-4654-a517-508fb105557f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.686658 Oct 11 01:42:57.572245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2196/4355] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:56 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:57.597368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd786e89-b3f2-486f-922e-5761c177827b", "name": "network-vif-deleted", "tag": "5dbb0f7f-96b3-4785-8536-9ea65dd723c2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:57.642753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:57.649027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:57.663462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:57.664026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:57.664615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:57.664875 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d377d834-2478-4ffb-9831-fbf952269650 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.735760 Oct 11 01:42:57.667663 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2160/4356] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:56 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:57.710205 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] Creating event network-vif-deleted:5dbb0f7f-96b3-4785-8536-9ea65dd723c2 for instance cd786e89-b3f2-486f-922e-5761c177827b on n-h2-772273-9 Oct 11 01:42:57.731728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-71475fce-5afa-49b5-b721-5877faf6976b req-8fdd28d9-8a1f-444d-9205-a4622933dc0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145439 Oct 11 01:42:57.733312 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2197/4357] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:57.891809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:57.892435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:57.922318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:57.925884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:57.926362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:57.927134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:57.930761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:57.931226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:57.953051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:57.956074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:57.986014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:57.986528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:57.990286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:57.991092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:57.991615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:57.992066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.079712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.080595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.081264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.082000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lazy-loading 'fault' on Instance uuid cd786e89-b3f2-486f-922e-5761c177827b {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:42:58.088559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:42:58.280236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4231e976c0fd4c37a04ecf563bd54a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97ee7a8caeb44e89e2144c65ea5d80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:58.298090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de2935ed-6ed4-4d6f-9704-ebd0e90b3c08 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 200 len: 1307 microversion: 2.1 time: 0.348754 Oct 11 01:42:58.299024 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2198/4358] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:57 2022] GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:58.321290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9857fab6-3ca7-40f0-815c-6735795401cc", "name": "network-vif-deleted", "tag": "462bf6bf-bf85-4a79-83b2-ccbfb28603d7"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:58.357836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.358902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.361513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.399320 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] Creating event network-vif-deleted:462bf6bf-bf85-4a79-83b2-ccbfb28603d7 for instance 9857fab6-3ca7-40f0-815c-6735795401cc on n-h1-772273-9 Oct 11 01:42:58.412583 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-be37f04b-2398-4e48-9f08-02bb349568c0 req-e6ed96c4-eabf-485b-a26b-a1b8c8c9da2f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110051 Oct 11 01:42:58.419042 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2199/4359] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:58.599717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:58.600543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:58.627404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.629684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.630156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.637910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.640046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.640856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.681163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:58.700661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:58.702221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:58.703500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83ed722f-2769-4281-a155-4d0ae425fada tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.816174 Oct 11 01:42:58.715274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2161/4360] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:57 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:58.720269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:58.720901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:58.731050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.731806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.732481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:58.733405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:58.744080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:58.744844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.646551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:59.664713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:59.666770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:59.668254 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c51a8990-8ffb-43dc-90df-dd2f50f10b9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 1.074712 Oct 11 01:42:59.691075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2200/4361] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:58 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:42:59.696675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:59.697297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: cd786e89-b3f2-486f-922e-5761c177827b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:59.700520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:42:59.716761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d834f897-626a-4f7b-b17c-017ebcd7b066 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 1.000190 Oct 11 01:42:59.718021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2162/4362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:58 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:42:59.722104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.722609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.723118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.723863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.724329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.724764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.736177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:59.737189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:59.748933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.752942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.753676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.755042 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] HTTP exception thrown: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. Oct 11 01:42:59.756036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Request method failure captured: Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b HTTP/1.1 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMnbhKk0JSpwVox5vpjJ1PnhD04mPqLZw-j3navj7dbfGHL7aY8TKcwH72mv6s1RJdfgzzIgGU55yx3-sU115yHYzyoCPsNvhSq6PJaUCNG7wd5rF1BOBT8XX3jHAGtOM4CUjJy8P-DsI99PrFu7Rq62Dm0-Huaj5wRT8ET9OHWWJ0s Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f97ee7a8caeb44e89e2144c65ea5d80a Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f97ee7a8caeb44e89e2144c65ea5d80a Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MultipleCreateTestJSON-1107912804-project Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4231e976c0fd4c37a04ecf563bd54a31 Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MultipleCreateTestJSON-1107912804-project Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'cd786e89-b3f2-486f-922e-5761c177827b'} Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:42:59.756970 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.762249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Returning 404 to user: Instance cd786e89-b3f2-486f-922e-5761c177827b could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:42:59.764263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.766274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.766775 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4913b138-28fa-4c4a-ada1-51ec490da02b tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b" status: 404 len: 111 microversion: 2.1 time: 0.073835 Oct 11 01:42:59.767678 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2201/4363] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:59 2022] GET /compute/v2.1/servers/cd786e89-b3f2-486f-922e-5761c177827b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:42:59.774965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:42:59.798453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.798949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.799402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.826054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] Creating event network-changed:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h2-772273-9 Oct 11 01:42:59.839558 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7991f602-662f-4da8-89c0-7b403b208ee6 req-adc86856-7bcd-4399-9792-39d31ecf8d42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070532 Oct 11 01:42:59.840476 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2202/4364] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:42:59.846695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:42:59.848257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] [instance: 9857fab6-3ca7-40f0-815c-6735795401cc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:42:59.858195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.858872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.859783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.860790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:42:59.861426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:42:59.862030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:42:59.895513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] HTTP exception thrown: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Request method failure captured: Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc HTTP/1.1 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMnbhKk0JSpwVox5vpjJ1PnhD04mPqLZw-j3navj7dbfGHL7aY8TKcwH72mv6s1RJdfgzzIgGU55yx3-sU115yHYzyoCPsNvhSq6PJaUCNG7wd5rF1BOBT8XX3jHAGtOM4CUjJy8P-DsI99PrFu7Rq62Dm0-Huaj5wRT8ET9OHWWJ0s Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f97ee7a8caeb44e89e2144c65ea5d80a Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f97ee7a8caeb44e89e2144c65ea5d80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f97ee7a8caeb44e89e2144c65ea5d80a Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1107912804 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-MultipleCreateTestJSON-1107912804-project Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 4231e976c0fd4c37a04ecf563bd54a31 Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-MultipleCreateTestJSON-1107912804-project Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9857fab6-3ca7-40f0-815c-6735795401cc'} Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:42:59.897303 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] Returning 404 to user: Instance 9857fab6-3ca7-40f0-815c-6735795401cc could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8629604-09f1-484f-9699-cb8bd152b354 tempest-MultipleCreateTestJSON-1107912804 tempest-MultipleCreateTestJSON-1107912804-project] 10.222.0.66 "GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc" status: 404 len: 111 microversion: 2.1 time: 0.057312 Oct 11 01:42:59.902102 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2203/4365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:42:59 2022] GET /compute/v2.1/servers/9857fab6-3ca7-40f0-815c-6735795401cc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:43:00.147743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:00.162793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:00.164957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:00.166443 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb434377-009c-4893-86f6-777fb71a2cc2 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.436438 Oct 11 01:43:00.169138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2163/4366] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:42:59 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:00.521067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "65f84465-5b86-4a1e-91e4-96dd76f16b15"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:00.546978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:00.547512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:00.547956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:00.579569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] Creating event network-changed:65f84465-5b86-4a1e-91e4-96dd76f16b15 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:00.586567 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-729b40f8-6734-4427-a4af-0342fa93c3ff req-66487f04-78c1-4cb8-a2a9-b1ac18e9f760 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072820 Oct 11 01:43:00.587566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2204/4367] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:00.700608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:00.701879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:00.718434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:00.718947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:00.719435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:00.720155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:00.720675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:00.721113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:00.745268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:00.745977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:00.759109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:00.760081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:00.761006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:00.762338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:00.765201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:00.765862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:01.213767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.225639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.229861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.231804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.234610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56b87ebb-cb2e-47a2-b465-f00a87035f3e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.539407 Oct 11 01:43:01.240101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55f404ca-0c0c-41a8-b4db-f79b5a8e4312 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.499893 Oct 11 01:43:01.242298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2205/4368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:00 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:01.249968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:01.256701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:01.263318 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2164/4369] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:00 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:01.273503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:01.274124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:01.279963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:01.280892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:01.281368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:01.282435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:01.643469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.656601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.659032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:01.660708 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-56a8afff-a6bb-4660-941c-1e5df1ea3cde tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.416987 Oct 11 01:43:01.668110 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2206/4370] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:01 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:02.269392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:02.272443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:02.273069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:02.274357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:02.289217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:02.289724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:02.290173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:02.297242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:02.297844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:02.298168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:02.298298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:02.298916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:02.301200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:02.302107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:02.303288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:02.304948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:02.851808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:02.880275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65ac423f-5ec1-419f-b3b9-1cd21f6aa18b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.613504 Oct 11 01:43:02.895905 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2207/4371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:02 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:02.904435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "49f164c6-2aa6-4850-8dc7-900e317b521b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:02.925490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:02.927391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:02.928070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:02.956831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] Creating event network-changed:49f164c6-2aa6-4850-8dc7-900e317b521b for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:02.978215 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-73c47a4b-f40f-4e28-b4ad-a665aeb199fb req-f174cff4-ab1e-4217-b0ed-41deb1e6efbc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089851 Oct 11 01:43:02.979197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2208/4372] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:02.990013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:03.007316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:03.022312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:03.023091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:03.023815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:03.031771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:03.032574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:03.034496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:03.151643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:03.183318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:03.194559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:03.195726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-241f252e-808c-4ee9-baea-b75770deca19 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1738 microversion: 2.20 time: 0.934599 Oct 11 01:43:03.196851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2165/4373] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:02 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1738 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:03.906459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:03.908128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:03.919601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:03.923506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:03.924276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:03.927030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:03.927800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:03.928666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:04.082161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:04.101736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:04.108422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:04.109793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-612dd98e-f71a-4c94-bb59-8403e880fc96 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 1.125081 Oct 11 01:43:04.123632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2209/4374] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:02 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:04.225033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:04.226073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:04.233546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:04.234554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:04.235235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:04.236111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:04.236679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:04.237219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:05.229271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.245968 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ed1a059-b709-4a92-8a11-bd1671d75fc0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 1.343633 Oct 11 01:43:05.247050 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2166/4375] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:03 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:43:05.251939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:05.252778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:05.263053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:05.267104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:05.270349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:05.271302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:05.271990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:05.275687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:05.516619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.545132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.548119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.551539 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-003c300f-ce0f-4b35-8b20-643f389e751e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1720 microversion: 2.20 time: 1.329680 Oct 11 01:43:05.552843 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2210/4376] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:04 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1720 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:05.765069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.783485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.785593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:05.787360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7b3999e-f59a-4aaf-9765-160850b30ec3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.539160 Oct 11 01:43:05.788822 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2167/4377] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:05 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:06.270517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:06.271136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:06.281077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.283888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.284103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:06.292613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.293129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.293585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:06.581665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:06.582909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:06.602223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.603034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.605589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:06.606444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.609577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.611212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:06.794865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:06.809648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2468f13-cb59-455f-a0e3-e383fe057467 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.544065 Oct 11 01:43:06.810542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2211/4378] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:06 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:06.832891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:06.833829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:06.852865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.853599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.864235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:06.865211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:06.865848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:06.866455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:07.454827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.476543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.477814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.478441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.479863 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1b48b37-f554-41a4-bc58-036be894f2f6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.668173 Oct 11 01:43:07.480753 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2212/4379] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:06 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:07.485748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:07.505676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.505961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:07.506394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:07.507044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:07.507304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:07.511241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8caa5d1f-ee66-487f-825c-a525a55a859f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1720 microversion: 2.20 time: 0.931412 Oct 11 01:43:07.515648 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2168/4380] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:06 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1720 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:07.520912 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] Creating event network-vif-plugged:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h2-772273-9 Oct 11 01:43:07.528958 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b6ef3658-427a-48e5-957a-47e79f126652 req-44abda1e-9d86-4f65-8e4c-ae4ed1b26c12 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046659 Oct 11 01:43:07.530117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2213/4381] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:07.838170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:07.839616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:07.862490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:07.863525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:07.864652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:07.865579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:07.870302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:07.870975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.149454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.169708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7f6615f-3f3d-4075-b04c-0d7c12184381 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1392 microversion: 2.1 time: 0.335157 Oct 11 01:43:08.170330 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2169/4382] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:07 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:08.509101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:08.510117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:08.521822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.524291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.525821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.526894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.528347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.529102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.546918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:08.547963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:08.554777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.555752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.556435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.557616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.558332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.559059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.896061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.909680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.912118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.916036 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6449e31a-b451-4e46-b126-9fdb7bf4a497 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1663 microversion: 2.20 time: 0.373308 Oct 11 01:43:08.923245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2170/4383] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:08 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1663 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:08.925124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.936148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.948450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3450a0f9-e8e0-47cf-a7ca-40d268f6e874"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:08.951094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:08.951562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:08.952907 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f452fad-13db-429b-b361-460a6529bdd3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.450681 Oct 11 01:43:08.953502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2214/4384] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:08 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:08.958883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.959701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.960393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:08.961330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:08.962035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:08.962691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.196547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:09.197179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:09.210922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.211743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.213153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.218592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.219633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.220449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.474558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:09.483485 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa49f1af-2901-4fee-9022-1b9a34146c5b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1564 microversion: 2.1 time: 0.294370 Oct 11 01:43:09.487400 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2215/4385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:09 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1564 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:43:09.516825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:09.518122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:09.528628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.529126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.532593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.536965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.538682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.539882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.548780 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cc51020-3745-46f0-8d94-5e7bd435de68 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.604232 Oct 11 01:43:09.551378 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2171/4386] 10.222.0.66 () {62 vars in 1364 bytes} [Tue Oct 11 01:43:08 2022] POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments => generated 188 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:43:09.570291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "name": "network-vif-unplugged", "status": "completed", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:09.591033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.594769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.595490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.630194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.server_external_events [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] Unable to find a host for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878. Dropping event network-vif-unplugged {{(pid=120494) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 01:43:09.631127 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e0494880-cb84-4743-9ef4-4796b1f5e205 req-8b0e43cf-05e0-4976-8532-38154bff8d25 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.071105 Oct 11 01:43:09.631782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2172/4387] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 01:43:09.862252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-970033043", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:09.882504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:09.893604 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-205f9903-ee03-4d6c-b1a3-4a508f8bb2ac tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1564 microversion: 2.1 time: 0.382142 Oct 11 01:43:09.911063 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2216/4388] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:09 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1564 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:43:09.930767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:09.932938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:09.949316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.951875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.952341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.953267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.953936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.956153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.963112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:43:09.964685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:43:09.967549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:43:09.968240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:43:09.968863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:43:09.985035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.985933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.987331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:09.988483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:09.989220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:09.989851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:10.023104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Getting quotas for project 859700e9b4dd4a7bb2024db70a4fb381. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:43:10.050643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Getting quotas for user 5b330ea644c640bc8fde7736f0a283b8 and project 859700e9b4dd4a7bb2024db70a4fb381. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:43:10.066207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:43:10.069490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:43:10.158128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ffcac59-c8df-4659-9ca6-13f6bcd2e270 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.519568 Oct 11 01:43:10.163719 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2173/4389] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:43:10.179534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:10.181154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:10.196290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:10.197058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:10.197692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:10.199110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:10.199783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:10.200584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:10.462544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:10.494805 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d6ff0ccb-5487-483c-a6f7-9eb20cd31007 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments/3450a0f9-e8e0-47cf-a7ca-40d268f6e874" status: 202 len: 0 microversion: 2.20 time: 0.575815 Oct 11 01:43:10.495845 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2217/4390] 10.222.0.66 () {60 vars in 1457 bytes} [Tue Oct 11 01:43:09 2022] DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments/3450a0f9-e8e0-47cf-a7ca-40d268f6e874 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:43:10.505847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:10.512235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:11.087607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.096331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.100552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.105179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ba86d73-d0f7-4734-85ce-73858ed43ea2 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04" status: 200 len: 1277 microversion: 2.47 time: 0.604661 Oct 11 01:43:11.108063 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2218/4391] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:10 2022] GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 => generated 1277 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:11.114319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:11.115382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:11.121729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.122517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.123190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.124175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.125001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.125668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.159656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120493) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 01:43:11.310226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.330671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.337597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:11.338883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35c62260-d764-4d61-925f-9e83e21fff00 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 1.173864 Oct 11 01:43:11.352717 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2174/4392] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:10 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:11.352843 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-687b7161-51e9-4de5-9e73-59b37218e180 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/action" status: 202 len: 0 microversion: 2.20 time: 0.237162 Oct 11 01:43:11.352843 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2219/4393] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:43:11 2022] POST /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:43:11.373927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:11.376951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:11.386820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.387701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.388298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.388893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-453798932", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:11.389465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.390093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.390845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.519995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:43:11.520691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:43:11.525088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:43:11.525934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:43:11.526888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:43:11.563741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.564255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.564834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.565766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:11.566950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:11.567425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:11.624633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Getting quotas for project 859700e9b4dd4a7bb2024db70a4fb381. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:43:11.634263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Getting quotas for user 5b330ea644c640bc8fde7736f0a283b8 and project 859700e9b4dd4a7bb2024db70a4fb381. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:43:11.649899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:43:11.652845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:43:11.736514 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43c7ff0e-7216-4841-b984-1876c4751785 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.385927 Oct 11 01:43:11.737846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2175/4394] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 01:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 01:43:11.750652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf1893e1-d575-4ddb-b6d0-a7770b16cbb7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:11.755300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf1893e1-d575-4ddb-b6d0-a7770b16cbb7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:11.829403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf1893e1-d575-4ddb-b6d0-a7770b16cbb7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "PUT /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 991 microversion: 2.47 time: 0.083909 Oct 11 01:43:11.831175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2176/4395] 10.222.0.66 () {62 vars in 1297 bytes} [Tue Oct 11 01:43:11 2022] PUT /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:43:11.860008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:11.860876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:12.029333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.043280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.048092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.052991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32ba2baf-e307-4463-b47d-6373e811cc2f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1671 microversion: 2.20 time: 0.699599 Oct 11 01:43:12.054381 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2220/4396] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:11 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1671 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:12.127493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.138390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.142997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:12.145017 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69fe7ad9-654d-4a95-b04f-8e4bdba61cb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1277 microversion: 2.47 time: 0.293233 Oct 11 01:43:12.160595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2177/4397] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:11 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1277 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:12.375050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:12.376725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:12.391376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:12.392147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:12.393795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:12.395902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:12.396904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:12.400050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:13.062075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.076688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.078922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.080285 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0be0d51c-a2c9-484b-872c-5c13306c4637 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.715578 Oct 11 01:43:13.081472 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2221/4398] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:12 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:13.084590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:13.085856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:13.098094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:13.116848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:13.118334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:13.119866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:13.122780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:13.124643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:13.126129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:13.174362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:13.175264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:13.192715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:13.194123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:13.201263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:13.202525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:13.203834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:13.205485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:13.325764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.343824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.348377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.352874 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65744025-fd42-40cb-9b29-95af51a4d75a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1329 microversion: 2.47 time: 0.182380 Oct 11 01:43:13.356653 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2222/4399] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:13 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1329 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:13.496457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.499094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:13.515852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.517516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:13.518794 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55572bca-f430-4c84-acaa-47863c9d0731 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1671 microversion: 2.20 time: 0.439723 Oct 11 01:43:13.521839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2178/4400] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:13 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1671 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:14.113204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:14.114023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:14.123401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.123856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.124487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.128404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.129897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.130567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.383960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:14.385737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:14.419731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.421756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.423149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.425034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.427198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.430958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.621789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.640842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.650667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.655754 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e26ec64c-92fe-496d-b2c0-d890a4be4842 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1335 microversion: 2.47 time: 0.277223 Oct 11 01:43:14.657333 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2179/4401] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:14 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1335 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:14.667593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:14.669554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:14.680190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.681130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.682393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.684121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:14.685835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:14.686975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:14.726179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.741546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.743289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:14.744584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdb62814-0bb9-4489-8871-593a3324d3c6 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.637212 Oct 11 01:43:14.747549 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2223/4402] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:14 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:15.323593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.336352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.341740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.342833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01ae2d56-ff6f-46b4-a856-9cc4488ba4d4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.682633 Oct 11 01:43:15.343407 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2180/4403] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:14 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:15.691817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:15.691817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:15.698681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.699182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.699695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:15.700397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.700859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.701290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:15.772093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:15.772622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:15.785002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.787331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.788092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:15.789172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.789895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.790871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:15.823214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.845243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.848341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:15.850214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c1842bb-0393-4528-9dc8-0916e0940d1b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1335 microversion: 2.47 time: 0.166879 Oct 11 01:43:15.851581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2224/4404] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:15 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1335 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:15.949830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:15.950475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:15.958741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.959193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.959668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:15.960403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:15.960866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:15.961299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:16.182304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.202024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.203581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.206042 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4366b67a-e4ae-4daa-abbf-ad12e715fc7f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.437592 Oct 11 01:43:16.207510 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2181/4405] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:15 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:16.219813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:16.241917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:16.242693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:16.243392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:16.260490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] Creating event network-changed:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h2-772273-9 Oct 11 01:43:16.269937 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6a79a40c-f0d4-4dec-846f-d97f1c2f5e5c req-93d79ac6-6b68-4478-af95-674f33952991 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058092 Oct 11 01:43:16.280892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.293803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2182/4406] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:16.296544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ece281ab-6b57-44d5-b7bc-1cbe887f3781 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1564 microversion: 2.1 time: 0.351964 Oct 11 01:43:16.308168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2225/4407] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:15 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1564 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:43:16.372676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:16.373786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:16.383585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:16.384378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:16.385434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:16.386542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:16.387212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:16.387679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:16.740448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.749872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.752465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:16.792391 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8de3747-d710-40c9-a37b-0169c4eeb43d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.388127 Oct 11 01:43:16.792391 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2183/4408] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:16 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:16.877461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:16.878103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:16.892301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:16.892940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:16.896420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:16.898423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:16.899077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:16.900036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.028362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.043300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.047539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.048839 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98ffb97e-fb09-47dc-95c5-2e1739691907 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1335 microversion: 2.47 time: 0.175943 Oct 11 01:43:17.049394 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2226/4409] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:16 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:17.237486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:17.238676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:17.255419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.255949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.256567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.257330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.257929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.258413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.480284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.497293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.500647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:17.502148 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a86cce00-3809-4653-985c-296c2b18441d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.270134 Oct 11 01:43:17.504073 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2184/4410] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:17 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:17.783480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:17.784321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:17.826296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.826837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.827283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.828031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.828489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.828923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.872179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:17.873644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:17.884672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.885181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.887210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:17.890127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:17.890615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:17.891067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.079123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lazy-loading 'services' on Instance uuid 4b38630d-78be-4962-9d66-48c3d17e8320 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:43:18.199112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.210812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.214038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.215281 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5236c8da-057c-496f-8d64-f261e1d874d2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.436044 Oct 11 01:43:18.215884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2227/4411] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:17 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:18.221046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:18.221660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:18.228233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.228862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.229404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.230149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.230705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.231200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.238874 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3702d544-3536-4510-9c05-668849e6a8c8 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320/os-volume_attachments/e6ab9c5d-0869-49d4-92d4-c4534315d27c" status: 202 len: 0 microversion: 2.1 time: 0.371794 Oct 11 01:43:18.240063 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2185/4412] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:43:17 2022] DELETE /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320/os-volume_attachments/e6ab9c5d-0869-49d4-92d4-c4534315d27c => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:43:18.310850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.319609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.321123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.322405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-52e9a305-e47a-43f7-88ab-90dc3fbfefa7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1356 microversion: 2.47 time: 0.105435 Oct 11 01:43:18.323041 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2228/4413] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:18 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:18.351026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:18.353915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:18.360371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.360862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.361297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.361992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.362442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.363499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.451796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:43:18.452226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:43:18.452730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:43:18.453110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:43:18.453705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:43:18.529487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:18.530109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:18.539819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.540323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.543767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:18.544604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.545518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.546252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.546826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.551569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.552071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.553078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.554139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.554891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.555330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.595689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-844c6f0d-0a05-4e54-be47-8ff640d612e3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "POST /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8/action" status: 202 len: 1078 microversion: 2.47 time: 0.250387 Oct 11 01:43:18.610231 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2186/4414] 10.222.0.66 () {62 vars in 1319 bytes} [Tue Oct 11 01:43:18 2022] POST /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8/action => generated 1078 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 01:43:18.617962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:18.618739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:18.625030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.625811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.626481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.627397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:18.628044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:18.629075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:18.774563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.786261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.787790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.789007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbc4bc95-e185-4669-8fcd-f15ddb4eae7f tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.174997 Oct 11 01:43:18.789575 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2187/4415] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:18 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:18.822182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.831818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.833280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:18.834466 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e42a37f3-4cdb-4e91-9040-36cdd916b7a9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.308941 Oct 11 01:43:18.850641 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2229/4416] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:18 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:19.242009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:19.242697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:19.250603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.251563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.252342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.253211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.254410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.255042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.451566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.462094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.463871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.468804 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dede09cd-9443-4c32-8485-bf9bb097bde3 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.231230 Oct 11 01:43:19.469827 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2188/4417] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:19 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:19.821151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:19.822577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:19.830884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.831850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.832584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.833442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.833973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.834506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.863403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:19.864087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:19.883477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.884948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.885867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.887114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:19.887956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:19.888572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:19.936318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.947146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.949283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:19.951559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3491e497-db1e-4e04-ba6b-f8a16bc77bb0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.134519 Oct 11 01:43:19.965405 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2230/4418] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:19 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:20.221677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.232745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.239770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.241421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-645891df-217e-46c6-93ba-15a873665561 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.384026 Oct 11 01:43:20.250863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2189/4419] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:19 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:20.500315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:20.501046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:20.506046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:20.515451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:20.516749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:20.518659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:20.520075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:20.520735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:20.521589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:20.761773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.770595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.772136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:20.773394 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1b901e9-1ef6-484a-bff0-8e02ce954af7 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.278830 Oct 11 01:43:20.773973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2231/4420] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:20 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:20.981684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:20.983180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:20.993905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:20.994085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:20.994396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:20.995197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:20.995762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:20.996370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:21.095132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.109621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.111256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.112576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5dfda4b8-c826-494a-b1dc-2d568c530bbf tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.136552 Oct 11 01:43:21.114039 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2190/4421] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:20 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:21.267750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:21.269544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:21.272219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:21.277748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:21.278328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:21.278951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:21.279876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:21.280511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:21.281114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:21.627961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.639302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.640786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:21.641984 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d4f430c-f93d-4f41-b7f4-b48d98418bcc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.378240 Oct 11 01:43:21.647414 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2232/4422] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:21 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:21.816385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:21.822977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:21.825750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:21.832914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:21.833592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:21.834176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:21.835212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:21.835839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:21.836414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:22.030443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.042191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.044552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.046100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f421a3c2-2d66-4338-8ef3-2efcec6f2f05 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.235809 Oct 11 01:43:22.060454 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2191/4423] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:21 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:22.139426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:22.140288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:22.146358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:22.147085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:22.147751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:22.148600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:22.149227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:22.149820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:22.252082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.261534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.263010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.264225 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e3ff0e5-fb5d-4166-a5dd-edc84fb138b5 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.128796 Oct 11 01:43:22.265350 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2233/4424] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:22 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:22.670729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:22.676180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:22.680080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:22.685995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:22.687271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:22.688187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:22.689428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:22.690222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:22.690735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:22.969392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.988208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.990074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:22.991317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2802f87d-25ce-4649-ba69-cf5020821483 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.325940 Oct 11 01:43:22.991904 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2192/4425] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:22 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:23.077081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:23.077878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:23.102394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:23.102908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:23.103520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:23.104308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:23.104771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:23.105309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:23.108434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:23.291258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:23.292210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:23.303921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:23.304417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:23.304880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:23.305588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:23.306045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:23.306503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:23.313150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.323124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.329127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.333095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5913761e-8e7f-4fb7-abe4-a7780530518e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.261564 Oct 11 01:43:23.348870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:23.350773 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2234/4426] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:23 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:23.411009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.424411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.427125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:23.429980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b9eae12-05da-44af-8fe7-e2ff4a7117be tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.142659 Oct 11 01:43:23.431888 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2193/4427] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:23 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:24.022608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:24.023665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:24.039090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.039815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.040398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.041282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.041874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.042449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.276251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.287184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.288941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.290318 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a767287-97ad-4203-827a-bd149cd94d44 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.272439 Oct 11 01:43:24.301313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2235/4428] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:24 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:24.364946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:24.365513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:24.377134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.377640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.378087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.378850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.379310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.379941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.458787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:24.459753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:24.472701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.473448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.474215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.476899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:24.477615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:24.478340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:24.635075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.644741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.656350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.658012 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1da4da64-b39a-44d9-ad54-a57e179e9d49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.203770 Oct 11 01:43:24.658597 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2236/4429] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:24 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:24.682156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.704278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.708253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:24.714278 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b286df2-1e67-406f-a3d1-53617df3a82d tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.355109 Oct 11 01:43:24.715192 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2194/4430] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:24 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:25.317150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:25.317876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:25.325850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.326341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.326782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.327523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.327997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.328424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.578893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.600124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.602034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.604132 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e010d182-3862-49b5-bf92-f92eefbb9f87 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.291001 Oct 11 01:43:25.605552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2237/4431] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:25 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:25.684440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:25.685933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:25.693796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.694301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.694805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.695882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.696492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.697090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.744436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:25.748960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:25.758907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.762426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.763178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.764185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:25.771552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:25.772099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:25.801905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.811122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.819906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:25.821219 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8de80d7e-d541-4c92-b63d-35a6825ae061 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.141021 Oct 11 01:43:25.824456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2195/4432] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:25 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:25.994097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.006468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.008335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.009880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f26c7cf5-a07c-451a-943f-eb6c2be5b4c4 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.269277 Oct 11 01:43:26.010659 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2238/4433] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:25 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:26.633106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:26.633722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:26.639960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:26.640454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:26.640897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:26.641601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:26.642106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:26.642623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:26.851618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:26.854692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:26.874441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:26.875332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:26.877191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:26.878884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:26.880321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:26.880993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:26.934280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.945545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.952086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:26.953565 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3014f318-bb6b-4514-a8eb-388f2805e96d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.324450 Oct 11 01:43:26.954696 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2196/4434] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:26 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:27.036248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:27.037461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:27.044446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:27.045091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:27.045535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:27.046261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:27.046724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:27.047148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:27.278449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.287464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.288851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.290046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95ff376e-1480-4269-86e3-cf4d54f1a6e0 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.443118 Oct 11 01:43:27.290625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2239/4435] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:26 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:27.377571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.386196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.387686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:27.388923 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98004613-3124-4884-b7cd-5a43bf2569b2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.357278 Oct 11 01:43:27.389487 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2197/4436] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:27 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:27.982527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:27.983896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:27.991474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:27.992040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:27.992652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:27.993507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:27.994124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:27.994560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:28.229849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.247576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.249686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.251356 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e51c7cb-425c-4c0c-b987-1960692887b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.274814 Oct 11 01:43:28.267553 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2240/4437] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:27 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:28.316279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:28.316906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:28.335383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:28.335888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:28.336336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:28.337062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:28.337528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:28.337971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:28.414413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:28.417074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:28.422032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.430079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:28.430595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:28.431042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:28.434112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:28.435004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:28.435004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:28.447894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.449842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.451263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b20128c2-ed9d-4c5f-808d-fbed0fef1679 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.139690 Oct 11 01:43:28.452274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2198/4438] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:28 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:28.583068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.591913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.593516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:28.595017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97e27080-df9f-44d5-a873-56475bb5f341 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.184922 Oct 11 01:43:28.595741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2241/4439] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:28 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:29.281476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:29.282064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:29.291576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.292072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.292509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.293219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.293667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.294391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.478308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:29.479442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:29.487817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.488427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.488994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.489952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.490493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.491123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.512695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.524482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.526385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.527608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0b4421c-6e3a-487e-a8a2-3653c68cd1b5 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.250348 Oct 11 01:43:29.531383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2199/4440] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:29 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:29.574965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.584601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.586090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.587364 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-933565e9-a57a-4a25-846d-bf540823b3ff tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.113803 Oct 11 01:43:29.587927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2242/4441] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:29 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:29.622276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:29.622837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:29.628870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.629348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.629782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.630468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:29.630947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:29.631388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:29.770388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.778871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.780535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:29.781755 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11738bc3-2b44-49ce-93cb-959663d6a42e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.163718 Oct 11 01:43:29.782479 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2200/4442] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:29 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:30.554847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:30.555524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:30.563056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.563590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.564037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.564801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.565270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.565979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.618747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:30.620347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:30.630795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.631603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.632303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.634320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.634988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.635916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.766942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.797715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.803701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.805205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8a842d0-41e0-425b-8e7d-e649ca42378d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.195073 Oct 11 01:43:30.827365 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2201/4443] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:30 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:30.833407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:30.834236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:30.852940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.853699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.855027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.855996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:30.856679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:30.857259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:30.885562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.896442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.905175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:30.907581 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d3254228-b0b4-4da3-a63d-5a5ca7dea8fd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.356295 Oct 11 01:43:30.908346 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2243/4444] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:30 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:31.024739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.037579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.039225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.040994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcdd09c4-e95c-4d06-a217-390ee94f9c21 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.211921 Oct 11 01:43:31.051968 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2202/4445] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:30 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:31.838398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:31.840028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:31.849986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:31.850780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:31.852036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:31.853428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:31.854119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:31.854740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:31.933605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:31.934874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:31.945522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:31.949364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:31.949991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:31.950908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:31.951553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:31.952434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:31.969253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.980146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.982360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:31.984792 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b63465c9-9a1e-4696-a202-708726e86d80 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.152175 Oct 11 01:43:31.986685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2244/4446] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:31 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:32.075221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:32.075859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:32.083034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:32.083764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:32.084359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:32.085218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:32.085816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:32.086382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:32.222056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.232661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.234680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.236223 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59bc177f-40a8-4bd0-9a31-ddd404863e8d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.306609 Oct 11 01:43:32.251909 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2203/4447] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:31 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:32.261252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.270743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.273085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:32.274452 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9bc85afe-cfa9-4a85-bd00-ec47b9567275 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.209651 Oct 11 01:43:32.290947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2245/4448] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:32 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:33.020867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:33.021501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:33.036149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.036655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.037103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.037820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.038284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.038717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.119705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.129167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.130646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.131887 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44c18e42-494b-41d8-a0bb-b9ea95c83b2a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.123320 Oct 11 01:43:33.132464 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2204/4449] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:33 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:33.266692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:33.267957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:33.278359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.279099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.279600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.281159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.281772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.282371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.302444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:33.306355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:33.313744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.314406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.314645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.315326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:33.315813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:33.316359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:33.577362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.591499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.599442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.601149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.601388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.602793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-874e2995-ee26-4735-b447-6a34c81383bd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.342601 Oct 11 01:43:33.603134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:33.604423 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-573ba553-4b3a-48fc-a5e6-ea33a96d0c75 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.306092 Oct 11 01:43:33.605061 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2205/4450] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:33 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:33.615589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2246/4451] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:33 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:34.161463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:34.162726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:34.174416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.175875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.176577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.177789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.178595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.179391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.283902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.294107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.295890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.297234 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f850cb31-1482-4d0b-b634-e0905f5af1d1 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.143026 Oct 11 01:43:34.301031 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2206/4452] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:34 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:34.630002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:34.631499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:34.642536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.644833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.645285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.646005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.646466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.646894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.706905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "9126da6e-457d-4f7b-9641-851b9acb0c5c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:34.722745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.724237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.728502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.741823 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] Creating event network-vif-plugged:9126da6e-457d-4f7b-9641-851b9acb0c5c for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:34.748580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-505d8b84-d58d-4a19-b4ec-f6d50258667b req-1141efa8-0332-4568-af0f-c182e12a471a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190411 Oct 11 01:43:34.749627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2247/4453] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:34.756079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:34.757109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:34.764509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.765114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.765656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.766465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:34.767037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:34.768202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:34.977752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.993071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.997926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:34.999493 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b54aa7a-114c-44f0-b0d4-68b5a0f4758a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.373810 Oct 11 01:43:35.017220 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2207/4454] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:34 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:35.031256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.040766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.042248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.043512 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2075c4b-f3a1-4622-903c-475c369afb00 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.292675 Oct 11 01:43:35.044092 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2248/4455] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:34 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:35.324323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:35.325046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:35.348030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:35.348751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:35.349367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:35.350833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:35.351588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:35.352232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:35.432571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.442478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.444408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:35.445883 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2059d78-f170-414e-8c05-6939de85ceae tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.125932 Oct 11 01:43:35.446620 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2208/4456] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:35 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:36.036975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:36.038440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:36.046817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.048689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.049535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.050697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.051389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.052019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.084772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:36.090050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:36.104513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.105003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.105443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.106157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.111368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.115369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.387001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.398703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.403183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.404833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.406136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e01df1a0-5317-46e2-a6bc-de6b7fd6fd2d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.373380 Oct 11 01:43:36.407296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2249/4457] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:36 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:36.419292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.427731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.428999 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab14008b-b2fb-4b86-a4d5-82a82f42ba9c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.364764 Oct 11 01:43:36.438972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2209/4458] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:36 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:36.473339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:36.475061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:36.481883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.482504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.483142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.484087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.485028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.485522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.555087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.564614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.566468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.567986 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4af7dc9-069b-4304-8a49-506c9067e1f3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.099847 Oct 11 01:43:36.568590 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2250/4459] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:36 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:36.641660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:36.642163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:36.648377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.648771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.649390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.650453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.651117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.651797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.676382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:36.681421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:43:36.777138 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66a73dba-06b7-4174-89d5-eeb6fccbc3d6 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 204 len: 0 microversion: 2.1 time: 0.138973 Oct 11 01:43:36.778461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2210/4460] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:43:36 2022] DELETE /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:43:36.787625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:36.788477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:36.795071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.796919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.797558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.798451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.798919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.799371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.815107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:36.943915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:36.952296 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04e423ab-cf2d-40c4-827e-f0007d02febb tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1468 microversion: 2.1 time: 0.169671 Oct 11 01:43:36.953005 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2251/4461] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:36 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:36.970774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "0f6aba64-69f5-4923-9198-0e1cc8d773be"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "813b21b2-a382-4673-a9b4-785be1665800"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "49f164c6-2aa6-4850-8dc7-900e317b521b"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "030790c4-e198-4a11-b958-d37338f63628"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "b2ee6173-8c78-49ac-ba73-2d42280ef2d6"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-plugged", "status": "completed", "tag": "65f84465-5b86-4a1e-91e4-96dd76f16b15"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:36.985151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:36.985746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:36.986272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:36.998771 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:0f6aba64-69f5-4923-9198-0e1cc8d773be for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:36.999698 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:813b21b2-a382-4673-a9b4-785be1665800 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:37.000467 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:49f164c6-2aa6-4850-8dc7-900e317b521b for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:37.001180 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:030790c4-e198-4a11-b958-d37338f63628 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:37.001890 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:b2ee6173-8c78-49ac-ba73-2d42280ef2d6 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:37.002488 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] Creating event network-vif-plugged:65f84465-5b86-4a1e-91e4-96dd76f16b15 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:37.008689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6cdb9cd1-308a-4460-b7e8-4f43d503dcd3 req-0be3f314-079b-4334-a238-653e3af1f8b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.045943 Oct 11 01:43:37.010076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2211/4462] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:37.449716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:37.450500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:37.457898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.458594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.459181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.460051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.460645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.461213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.463706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:37.464700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:37.473956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.475096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.476006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.476919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.477574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.478223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.731919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.735857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.742533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.744121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.745079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.745494 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9e61432-2813-45c0-9369-589200e3577d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1878 microversion: 2.32 time: 0.299783 Oct 11 01:43:37.746158 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2252/4463] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:37 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1878 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:37.746543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.750777 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a59356d7-5519-4f2c-b3d2-99d4f304270a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.292529 Oct 11 01:43:37.753969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:37.754906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:37.761838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.762652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.763305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.764532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.765042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2212/4464] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:37 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:37.765320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.765887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.847938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.856194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.857669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:37.858842 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96155065-ae69-44f0-bec2-df05052c8bda tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.111292 Oct 11 01:43:37.870109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2253/4465] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:37 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:37.977675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:37.978441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:37.985526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.985948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.986384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:37.987075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:37.988073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:37.988515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:38.147268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:38.155273 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c06e16d-c4c3-4c8c-a220-539b124202d0 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1468 microversion: 2.1 time: 0.182811 Oct 11 01:43:38.155896 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2213/4466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:37 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1468 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:38.772445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:38.773140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:38.778435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:38.778892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:38.783233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:38.783810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:38.784452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:38.785178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:38.785643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:38.785858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:38.786150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:38.786344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:38.786781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:38.787566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:38.788018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:38.788601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.032770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.041594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.043327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.044678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7442bdb0-0d6d-4120-b8a8-c4e008e52542 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.270450 Oct 11 01:43:39.045355 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2214/4467] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:38 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:39.050206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.050646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:39.051699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:39.058064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.058876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.059536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.060439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.062182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.062814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.062926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.064440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.067045 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3df76455-1621-4786-9ff4-af6e91ee7c3a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2833 microversion: 2.32 time: 0.299133 Oct 11 01:43:39.067809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2254/4468] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:38 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2833 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:39.073586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "name": "network-vif-plugged", "status": "completed", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:39.086387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.087273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.088009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.100885 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] Creating event network-vif-plugged:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:43:39.106114 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-201ab836-849f-4f11-95a5-733480ab806e req-e2569435-c29d-46f4-8cf0-28594dca15ca service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036931 Oct 11 01:43:39.107278 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2255/4469] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:39.114084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:39.114847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:39.122702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.123365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.123924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.124740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.125328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.125863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.148513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.160760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.162217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.164041 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11f132e7-a30c-4036-bd40-94e7bdb472d7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.116965 Oct 11 01:43:39.164041 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2215/4470] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:39 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:39.186136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:39.186920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:39.195129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.196097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.196701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.200140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.200669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.201117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.343560 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-807c97bc-5a34-41a1-868f-0c1620901ff9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.235041 Oct 11 01:43:39.346054 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2256/4471] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:43:39 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc/os-interface => generated 1833 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:39.421816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b38630d-78be-4962-9d66-48c3d17e8320", "name": "network-vif-deleted", "tag": "1d067b6c-78f9-4636-aa93-e8155b208025"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:39.453102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:39.454013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:39.454661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:39.471285 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] Creating event network-vif-deleted:1d067b6c-78f9-4636-aa93-e8155b208025 for instance 4b38630d-78be-4962-9d66-48c3d17e8320 on n-h2-772273-9 Oct 11 01:43:39.476630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-db092337-bff2-41c9-a901-64f0dc275a21 req-4a0d5913-863f-443f-b2d3-1996733a0909 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059619 Oct 11 01:43:39.477318 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2257/4472] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:39.695039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:39.703703 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d240975-9c22-4021-8a25-577a04f1c771 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1468 microversion: 2.1 time: 0.526242 Oct 11 01:43:39.706916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2216/4473] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:39 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1468 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:40.070576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:40.071284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:40.078179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.078603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.079044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.079771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.080399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.080829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.191330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:40.192151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:40.209158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.209664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.210111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.210825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.211571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.212185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.308075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.317707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.319496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.320936 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-401368f1-0210-413d-8650-3754968f2cc9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.134428 Oct 11 01:43:40.321591 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2217/4474] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:40 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:40.336353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.346183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.347997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.349513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41479b2e-b8a8-4676-aeb4-f634aa392760 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.283230 Oct 11 01:43:40.364019 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2258/4475] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:40 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:40.633652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "tag": "0f6aba64-69f5-4923-9198-0e1cc8d773be"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:40.643874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.644367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.644818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.659478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] Creating event network-changed:0f6aba64-69f5-4923-9198-0e1cc8d773be for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:43:40.665172 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2bcdfd45-10d5-475c-a408-460becf9fe84 req-79b46a4e-fb0c-4602-877e-c17dfc2f2802 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035175 Oct 11 01:43:40.665881 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2218/4476] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:43:40.726221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:40.726853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:40.733967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.734958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.735956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.736856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.737456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.738745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.825585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:40.826094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:40.827029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:40.827787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lazy-loading 'fault' on Instance uuid 4b38630d-78be-4962-9d66-48c3d17e8320 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:43:40.890628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2452e9929ca64715ae9a8fb0feb81b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad35f026a9de4d86a97757ee3a467f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:40.899816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be56cfec-92be-4abf-9705-5dabee480307 tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 200 len: 1303 microversion: 2.1 time: 0.177457 Oct 11 01:43:40.917550 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2259/4477] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:40 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:43:41.348068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:41.348807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:41.372696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.373217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.376902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.377859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.378527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.379116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.385595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:41.386243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:41.418196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.418196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.418196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.418196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.418603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.421346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.538544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.560488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.582034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.586988 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0094d644-3447-4293-9df5-1a9543c4cf0e tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.244083 Oct 11 01:43:41.591512 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2219/4478] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:41 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:41.700283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.715247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.716776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:41.718242 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c177f4e5-7908-4a83-a84c-3d9a3ceeb54c tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1729 microversion: 2.20 time: 0.345046 Oct 11 01:43:41.731824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2260/4479] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:41 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1729 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:41.926935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:41.927850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] [instance: 4b38630d-78be-4962-9d66-48c3d17e8320] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:41.934539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.935259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.935733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.936458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:41.936920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:41.937513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:41.952570 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] HTTP exception thrown: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Request method failure captured: Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 HTTP/1.1 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMmWLTQw59I1TJEAxMF6GEurvaHH9xM9vejSk0mTQl_CXJe6ygQSRdxzaMUAbVk58c8ujzQG1IKIHPfOLAbj4tE0Xss5XHBLvEq1f-SDMlzkO_TxL_M7DQIDMAcuZZr7isMVDi14M7Q_7uh7vcx8XN85t0vO5ajx3d6H6RIxMqnT9gc Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ad35f026a9de4d86a97757ee3a467f0d Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesBackupsTest-139112635 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ad35f026a9de4d86a97757ee3a467f0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ad35f026a9de4d86a97757ee3a467f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad35f026a9de4d86a97757ee3a467f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad35f026a9de4d86a97757ee3a467f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesBackupsTest-139112635 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ad35f026a9de4d86a97757ee3a467f0d Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesBackupsTest-139112635 Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesBackupsTest-139112635-project Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 2452e9929ca64715ae9a8fb0feb81b3c Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesBackupsTest-139112635-project Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4b38630d-78be-4962-9d66-48c3d17e8320'} Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:43:41.954326 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] Returning 404 to user: Instance 4b38630d-78be-4962-9d66-48c3d17e8320 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:43:41.958363 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d791c4a9-a3a4-4c03-9e27-37fcc53ea30a tempest-VolumesBackupsTest-139112635 tempest-VolumesBackupsTest-139112635-project] 10.222.0.66 "GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320" status: 404 len: 111 microversion: 2.1 time: 0.034479 Oct 11 01:43:41.959587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2220/4480] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:43:41 2022] GET /compute/v2.1/servers/4b38630d-78be-4962-9d66-48c3d17e8320 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:43:42.616331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:42.617086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:42.624183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:42.624676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:42.625119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:42.625827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:42.626286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:42.626719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:42.691522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.700493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.702143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.703475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51e5e431-97e4-4e1f-afc2-3b71bcbb6f7a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.091777 Oct 11 01:43:42.704143 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2261/4481] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:42 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:42.745571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:42.747566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:42.755825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:42.756468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:42.758000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:42.758864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:42.759507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:42.760131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:42.915508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.925614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.927136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:42.928951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cee8c0e-c165-428d-a832-578ad4f2ef41 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1716 microversion: 2.20 time: 0.187635 Oct 11 01:43:42.943933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2221/4482] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:42 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1716 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:43.730244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:43.731238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:43.739715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:43.740237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:43.740785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:43.741632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:43.742362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:43.742897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:43.809710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:43.819120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:43.820738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:43.822162 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6427cd8b-2cb2-4efa-ad45-ce140dada26b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.095974 Oct 11 01:43:43.822736 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2262/4483] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:43 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:44.848737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:44.849895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:44.854317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:44.859144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:44.860085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:44.860708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:44.861574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:44.862183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:44.862826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:44.938166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:44.947858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:44.949577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:44.950901 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf93acdd-2149-4363-b05a-25045327e763 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.106891 Oct 11 01:43:44.951594 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2222/4484] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:44 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:45.980227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:45.980851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:45.997108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:45.998273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:45.998723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:45.999475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:46.000265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:46.000842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:46.088790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:46.104811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:46.106321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:46.107588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c3f13aa1-257c-457b-85a5-c6724ab88799 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.131374 Oct 11 01:43:46.108581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2263/4485] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:45 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:47.134358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:47.135672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:47.143625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:47.144320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:47.144853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:47.145574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:47.146139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:47.146447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:47.281956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:47.293567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:47.295557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:47.296803 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4dcd4f3c-48e7-41ed-9d5c-69a6e654fa4b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.166387 Oct 11 01:43:47.297477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2223/4486] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:47 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:48.325169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:48.326880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:48.341015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:48.343933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:48.344583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:48.346030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:48.347427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:48.348023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:48.469816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:48.483416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:48.485762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:48.494200 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7011bb30-1c09-4307-a01a-0d8061d3ff9d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1365 microversion: 2.47 time: 0.173221 Oct 11 01:43:48.494992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2264/4487] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:48 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:48.917096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:43:48.919228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:48.928696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:48.929326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:48.929913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:48.930758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:48.931393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:48.932237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:48.988317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82c606c2-d200-40d7-8181-026a327f96e5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action" status: 200 len: 24556 microversion: 2.1 time: 0.074360 Oct 11 01:43:48.989160 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2224/4488] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:43:48 2022] POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action => generated 24556 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:43:49.523829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:49.524593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:49.544883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:49.545711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:49.546314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:49.547380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:49.548045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:49.548625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:49.662038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:49.681148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:49.683907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:49.685892 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a8b4d99-cac8-4f3f-98a4-8b7cd86309e9 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1371 microversion: 2.47 time: 0.167498 Oct 11 01:43:49.687974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2265/4489] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:49 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:50.717249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:50.717967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:50.727063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:50.728356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:50.728963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:50.729866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:50.730479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:50.731061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:50.846127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:50.863879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:50.873858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:50.875639 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f84c7269-2ef2-4435-add6-12dcac147107 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1371 microversion: 2.47 time: 0.165101 Oct 11 01:43:50.886510 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2225/4490] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:50 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:51.914225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:51.914994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:51.921436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=72 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:51.923423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:51.924075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:51.924665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:51.925697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:51.926315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:51.926746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:51.998975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:52.008311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:52.012128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:52.014249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73352c2a-8db3-4944-b23c-ea93056c3966 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1371 microversion: 2.47 time: 0.106205 Oct 11 01:43:52.014848 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2266/4491] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:51 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:53.041861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:53.043140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:53.050868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.051387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.051825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.052938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.053132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.053722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.145754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.158520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.160570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.161959 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-701d6892-699c-43f6-af6e-34bc662e7c49 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1356 microversion: 2.47 time: 0.124348 Oct 11 01:43:53.162767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2226/4492] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:53 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1356 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:53.192644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:53.199300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.200525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Searching by: {'deleted': False, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381'} {{(pid=120493) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 01:43:53.209788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.210594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.211288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.212325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.213053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.213693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.345537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.multi_cell_list [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 01:43:53.439701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.449180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.449915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.450536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.464115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.466625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.508110 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9592148b-0c54-47fe-b43f-4f153899efb3 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.321016 Oct 11 01:43:53.509476 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2267/4493] 10.222.0.66 () {60 vars in 1187 bytes} [Tue Oct 11 01:43:53 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:53.541069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:53.542209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:53.554267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.555029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.555804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.556564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.557026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.557456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.576855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:53.593405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:43:53.704568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1eafe40-2554-47ea-bea6-b5c63f96a91d tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 204 len: 0 microversion: 2.47 time: 0.167090 Oct 11 01:43:53.705838 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2227/4494] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:43:53 2022] DELETE /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:43:53.719069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:53.720179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:53.732150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.732647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.733087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.733838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:53.734297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:53.734981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:53.850846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.854903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:43:53.866008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.868878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:53.870591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03e0899d-0c95-4dd3-9180-8105b7730efd tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1362 microversion: 2.47 time: 0.160364 Oct 11 01:43:53.884693 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2268/4495] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:53 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:43:54.901106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:54.902597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:54.911701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:54.912459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:54.913044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:54.913913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:54.914513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:54.915360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:55.052803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:55.068044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:55.070013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:55.071745 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1c280f0-01f0-47a5-a867-2adc6b330804 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1362 microversion: 2.47 time: 0.176424 Oct 11 01:43:55.073076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2228/4496] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:54 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:56.103837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:56.106017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:56.114428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:56.115651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:56.117493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:56.118395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:56.119028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:56.119647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:56.229109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:56.233923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:56.235069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:56.236918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lazy-loading 'fault' on Instance uuid 0a54e438-de84-488c-9e91-50e5666d52e8 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:43:56.433498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:56.453237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:56.455887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:56.457385 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1a55fa5-888f-4d74-bd25-5a322fe965f7 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 200 len: 1367 microversion: 2.47 time: 0.357948 Oct 11 01:43:56.474497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2269/4497] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:56 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:57.498674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:57.499302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 0a54e438-de84-488c-9e91-50e5666d52e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:57.542281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.544220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.546211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.548619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.549795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.551456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.574051 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] HTTP exception thrown: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Request method failure captured: Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 HTTP/1.1 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMot3dAm1pgpdPD-W1qzNPyBR8yLwtrX8RQtGWu8CDAjIEG0OPDQ0ipnD79IXzv1vcX2qX46bE7p6IU3OVjDjTlVxxctImoulfMNsenChqWrjs-Lf-jJowGObV7nhGCv994IqhaVuOn-X86Q-i9DPIS49HYzmGXIl0d6_6_i_7tVULE Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 859700e9b4dd4a7bb2024db70a4fb381 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerShowV247Test-262047574 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerShowV247Test-262047574 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 859700e9b4dd4a7bb2024db70a4fb381 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerShowV247Test-262047574 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerShowV247Test-262047574-project Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5b330ea644c640bc8fde7736f0a283b8 Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerShowV247Test-262047574-project Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0a54e438-de84-488c-9e91-50e5666d52e8'} Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:43:57.575946 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. Oct 11 01:43:57.579660 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:43:57.585866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Returning 404 to user: Instance 0a54e438-de84-488c-9e91-50e5666d52e8 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:43:57.585866 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ad04ac6-bace-4a4c-ab36-a9c26c9c1a45 tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8" status: 404 len: 111 microversion: 2.47 time: 0.097491 Oct 11 01:43:57.585866 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2229/4498] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:57 2022] GET /compute/v2.1/servers/0a54e438-de84-488c-9e91-50e5666d52e8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:43:57.601179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:57.601738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:57.619207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.619739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.620191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.621183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.621898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.622325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.660437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:43:57.786157 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b623035-43f0-4e5f-bbfb-1848d298df3a tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04" status: 204 len: 0 microversion: 2.47 time: 0.199036 Oct 11 01:43:57.787766 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2270/4499] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:43:57 2022] DELETE /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:43:57.797886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:57.798849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:57.810664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.811422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.811798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.816975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:57.825614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:57.827161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:57.979210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:57.990831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:57.992998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:57.994270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ea456a7c-9487-4c7f-94fb-30f073a7253b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04" status: 200 len: 1362 microversion: 2.47 time: 0.202577 Oct 11 01:43:57.995054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2230/4500] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:57 2022] GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:43:59.033870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:43:59.035775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:43:59.043737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:59.044583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:59.045360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:59.046241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:43:59.046969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:43:59.047432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:43:59.170485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:59.180683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:59.182682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b330ea644c640bc8fde7736f0a283b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859700e9b4dd4a7bb2024db70a4fb381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:43:59.184186 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e0bf6a58-660d-4b91-a5c8-ff909993951b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04" status: 200 len: 1362 microversion: 2.47 time: 0.164860 Oct 11 01:43:59.198734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2271/4501] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:43:59 2022] GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:44:00.214683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:00.215896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] [instance: 5b1ef83a-976a-446b-b575-38ed1fb55b04] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:00.224592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:00.225249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:00.225872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:00.226914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:00.227814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:00.228255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:00.243480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] HTTP exception thrown: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Request method failure captured: Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 HTTP/1.1 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMot3dAm1pgpdPD-W1qzNPyBR8yLwtrX8RQtGWu8CDAjIEG0OPDQ0ipnD79IXzv1vcX2qX46bE7p6IU3OVjDjTlVxxctImoulfMNsenChqWrjs-Lf-jJowGObV7nhGCv994IqhaVuOn-X86Q-i9DPIS49HYzmGXIl0d6_6_i_7tVULE Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 859700e9b4dd4a7bb2024db70a4fb381 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerShowV247Test-262047574 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/859700e9b4dd4a7bb2024db70a4fb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerShowV247Test-262047574 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 859700e9b4dd4a7bb2024db70a4fb381 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerShowV247Test-262047574 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerShowV247Test-262047574-project Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 5b330ea644c640bc8fde7736f0a283b8 Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerShowV247Test-262047574-project Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5b1ef83a-976a-446b-b575-38ed1fb55b04'} Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:00.245435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. Oct 11 01:44:00.248757 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:00.250587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] Returning 404 to user: Instance 5b1ef83a-976a-446b-b575-38ed1fb55b04 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:00.251671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca3d9597-1acf-47ff-a212-32d22f1bf59b tempest-ServerShowV247Test-262047574 tempest-ServerShowV247Test-262047574-project] 10.222.0.66 "GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04" status: 404 len: 111 microversion: 2.47 time: 0.043568 Oct 11 01:44:00.252425 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2231/4502] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:00 2022] GET /compute/v2.1/servers/5b1ef83a-976a-446b-b575-38ed1fb55b04 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:09.139839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:09.141160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:09.142035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:09.185979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:09.331061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1686937179", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:09.395978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] validate_networks() for [('58fc1996-ca6b-4497-bb24-7e66d869745e', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:44:09.825896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:44:09.826325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:44:09.826815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:44:09.827238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:44:09.827979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:44:09.839387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:09.840100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:09.841938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:09.842874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:09.843523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:09.844132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:09.863961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Getting quotas for project 7f36b40f22614f41815b064d15eefa0c. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:44:09.872746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Getting quotas for user b84e5d52223d4e619215f19c344340b1 and project 7f36b40f22614f41815b064d15eefa0c. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:44:09.887596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:44:09.889943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:44:09.943554 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9ffd0ce-c066-4eac-8cbb-a6dd3a407a38 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809706 Oct 11 01:44:09.944445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2272/4503] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:44:09.960757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4fa01a6-6aac-44c4-9e9c-3af4fa58e4fb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:09.962052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4fa01a6-6aac-44c4-9e9c-3af4fa58e4fb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:10.052043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4fa01a6-6aac-44c4-9e9c-3af4fa58e4fb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:10.063389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4fa01a6-6aac-44c4-9e9c-3af4fa58e4fb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1217 microversion: 2.1 time: 0.111490 Oct 11 01:44:10.066392 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2232/4504] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:09 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:11.091223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:11.092847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:11.100830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:11.101333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:11.101777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:11.104451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:11.105910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:11.106487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:11.187394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:11.197154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-844e585a-d2a6-4597-8a78-3af077625ab1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1269 microversion: 2.1 time: 0.110925 Oct 11 01:44:11.197841 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2273/4505] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:11 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:12.228913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:12.229576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:12.243055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:12.252760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:12.253302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:12.253746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:12.256340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:12.261452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:12.262125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:12.753146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:12.767093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7320d45c-8055-4c83-a943-0e32378785d7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.548850 Oct 11 01:44:12.781210 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2233/4506] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:12 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:13.801589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:13.802997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:13.818202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:13.819795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:13.820431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:13.826186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:13.826867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:13.831931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:13.951172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:13.974081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:13.974597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:13.975051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:14.010749 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] Creating event network-changed:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h2-772273-9 Oct 11 01:44:14.041940 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9135b798-1455-454b-b9f1-c85d453a0a81 req-20c5e949-e79d-4024-a546-a999daad19c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094713 Oct 11 01:44:14.042934 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2234/4507] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:14.750800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:14.759044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c56edaff-aeac-49b3-9b8c-18495d026da6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.962192 Oct 11 01:44:14.759690 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2274/4508] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:13 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:15.788618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:15.789378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:15.794570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:15.802756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:15.803734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:15.804387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:15.806320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:15.806991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:15.807692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:15.993725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:16.008193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49d16d73-4c8c-4b3f-bce7-2132cca49bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.229635 Oct 11 01:44:16.020339 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2235/4509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:17.033987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:17.035191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:17.042905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:17.043660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:17.044256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:17.045174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:17.045640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:17.046147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:17.208538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:17.218498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8aace1e-799b-49f5-9fb9-73e31e5546eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.188218 Oct 11 01:44:17.219227 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2275/4510] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:18.243429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:18.245381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:18.272481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:18.273257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:18.273910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:18.274830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:18.275910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:18.276685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:18.468848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:18.480092 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7682ee5-1f85-48cd-ab77-7a588aba5d20 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.240727 Oct 11 01:44:18.481026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2236/4511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:18 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:19.505031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:19.507035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:19.522373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:19.522953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:19.523602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:19.524507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:19.524962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:19.525401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:19.728184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:19.737525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93baa86e-3e0f-4a3b-8b81-21bb45dbe87b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.237404 Oct 11 01:44:19.738650 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2276/4512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:19 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:20.762072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:20.762685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:20.765452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:20.775494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:20.775984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:20.776419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:20.777112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:20.777579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:20.777990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:20.917433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:20.925582 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcde8b27-d838-49d6-ad65-9c6d89d1fe1d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.167423 Oct 11 01:44:20.926172 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2237/4513] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:20 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:21.313874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "name": "network-vif-plugged", "status": "completed", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:21.322093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:21.323080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:21.328636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:21.329884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:21.330564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:21.344500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] Creating event network-vif-plugged:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h2-772273-9 Oct 11 01:44:21.350171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ddbb0f82-a520-4e63-92e1-179e4d25b479 req-7ed2c368-f896-467d-8556-0adc367ca91f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040839 Oct 11 01:44:21.351423 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2277/4514] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:21.948169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:21.948783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:21.956188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:21.956717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:21.957153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:21.957858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:21.958305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:21.958728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:22.105730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:22.115265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4812320-00cf-44d1-b8f9-b74e91c5c607 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1317 microversion: 2.1 time: 0.170843 Oct 11 01:44:22.116061 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2238/4515] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:21 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:23.140507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:23.151832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:23.169343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:23.170034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:23.170529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:23.171344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:23.172064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:23.172438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:23.359638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:23.369634 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71329674-26b8-4b35-9fec-5f9e79e4ae63 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.234325 Oct 11 01:44:23.370392 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2278/4516] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:23 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:23.443952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1249278521", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:23.504318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] validate_networks() for [('58fc1996-ca6b-4497-bb24-7e66d869745e', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:44:23.942262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:44:23.942692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:44:23.943170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:44:23.944317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:44:23.944747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:44:23.954418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:23.955192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:23.955674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:23.957161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:23.957635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:23.958064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:23.976267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Getting quotas for project 7f36b40f22614f41815b064d15eefa0c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:44:23.981594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Getting quotas for user b84e5d52223d4e619215f19c344340b1 and project 7f36b40f22614f41815b064d15eefa0c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:44:23.994682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:44:23.997143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:44:24.046001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cc2ccc2-16dd-4a6a-a28d-69e002543c40 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605846 Oct 11 01:44:24.053475 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2239/4517] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:44:24.058754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13de2c9b-9079-4879-a22e-5c2a19de1222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:24.059415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13de2c9b-9079-4879-a22e-5c2a19de1222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:24.121551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13de2c9b-9079-4879-a22e-5c2a19de1222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:24.131063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13de2c9b-9079-4879-a22e-5c2a19de1222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1217 microversion: 2.1 time: 0.076813 Oct 11 01:44:24.132121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2279/4518] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:24 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:25.154947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:25.155596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:25.165351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:25.166363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:25.166964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:25.167901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:25.168502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:25.169207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:25.253937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:25.263643 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-520f628f-b55a-4e8e-9f96-17d63d8ab4d1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1277 microversion: 2.1 time: 0.113419 Oct 11 01:44:25.264707 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2240/4519] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:25 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:25.750722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:25.751957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:25.761774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:25.762646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:25.763246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:25.764144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:25.764788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:25.765232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:26.035417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:26.045167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:26.046936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:26.048448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ee5cb80-cd32-42af-94de-c29c033e749b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2952 microversion: 2.32 time: 0.301712 Oct 11 01:44:26.049567 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2280/4520] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:25 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2952 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:44:26.077650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:26.078450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:26.085868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:26.086631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:26.087546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:26.088432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:26.089089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:26.089696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:26.217993 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e7e051e-e6bf-4f7e-b4d6-f28692c925f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.144255 Oct 11 01:44:26.224181 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2241/4521] 10.222.0.66 () {60 vars in 1316 bytes} [Tue Oct 11 01:44:26 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc/os-interface => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:44:26.292156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:26.292778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:26.318714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:26.319232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:26.322753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:26.323540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:26.324007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:26.324435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:26.550594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:26.562582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-daa9acab-440d-41df-847e-e1bd786d1ed0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.274693 Oct 11 01:44:26.564833 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2281/4522] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:26 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:27.259598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226a7aaf-0c49-441a-bf3d-b936db3db16d", "tag": "8fbca86a-1e57-40bc-b3eb-587d28cc09c3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:27.285362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:27.286183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:27.286744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:27.309275 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] Creating event network-changed:8fbca86a-1e57-40bc-b3eb-587d28cc09c3 for instance 226a7aaf-0c49-441a-bf3d-b936db3db16d on n-h1-772273-9 Oct 11 01:44:27.328456 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1f2db8c4-26e9-4dca-9ec5-9c912181c1a8 req-e463ea67-cb62-415e-bc6d-8c83ae1bd3ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073353 Oct 11 01:44:27.330617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2242/4523] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:27.590272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:27.591627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:27.599510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:27.600457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:27.601113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:27.602292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:27.602969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:27.603666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:27.747672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:27.748526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:27.758704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:27.759660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:27.760505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:27.761679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:27.762226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:27.762872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:27.764352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:27.784717 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d6565c9-9e5b-4d20-bc4e-9072f6de4a08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.198623 Oct 11 01:44:27.787300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2282/4524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:27 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:28.063692 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f77a0a1e-b0b1-4148-8076-45e7b0b60f4b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1834 microversion: 2.1 time: 0.318230 Oct 11 01:44:28.064317 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2243/4525] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:27 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1834 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:28.086803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:28.087444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:28.093572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.094058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.094485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.095383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.095816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.096240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.242428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:28.250879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00c2150d-b59e-4c63-ae49-26386d92dd71 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1683 microversion: 2.1 time: 0.167856 Oct 11 01:44:28.251550 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2283/4526] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:28 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:28.353594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:28.356454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:28.366092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.366915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.367425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.368178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.368638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.369117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.426344 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-558afc21-c9d9-4cce-9442-82c97f3a9437 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action" status: 200 len: 32633 microversion: 2.1 time: 0.076634 Oct 11 01:44:28.437025 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2244/4527] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:28 2022] POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action => generated 32633 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:44:28.578627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:28.579889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:28.590886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.591452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.594690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.596357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.597809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.599231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.690390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8355f5d348e4b92a051c81205bf4a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bc930ddc94730986342fcefcc54df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:28.691107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] flavor_id is None. Assuming migration. {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 01:44:28.691725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:44:28.812725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:28.814012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:28.840201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.840870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.841705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:28.842955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:28.844499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:28.845102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:29.078453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:29.094432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1699e123-c76f-45e0-8626-8c57e6cee895 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.285844 Oct 11 01:44:29.097659 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2245/4528] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:28 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:29.105460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61eb389e-ad31-4319-a86d-079ba658bf25 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.532306 Oct 11 01:44:29.107481 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2284/4529] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:28 2022] POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:44:29.115406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:29.116152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:29.123474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:29.123992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:29.124445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:29.125175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:29.125701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:29.126361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:29.428016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:29.437733 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2becfcb-25b1-43c2-989d-ff0d960af0c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1692 microversion: 2.1 time: 0.326631 Oct 11 01:44:29.438605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2246/4530] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:29 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1692 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:30.119602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:30.120825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:30.143108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:30.144598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:30.145318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:30.146472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:30.149092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:30.150775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:30.338732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:30.348871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-031d74b4-a9b1-4765-8068-cebc596870bb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.234915 Oct 11 01:44:30.349580 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2285/4531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:30 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:30.464437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:30.465220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:30.488481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:30.489672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:30.490288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:30.491384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:30.492036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:30.492577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:30.687828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:30.696986 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-adf2dd14-235d-4637-8f6b-40169e671302 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1692 microversion: 2.1 time: 0.237394 Oct 11 01:44:30.709832 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2247/4532] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:30 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:31.375256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:31.375967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:31.389993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:31.390489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:31.390937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:31.392172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:31.392638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:31.393068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:31.635597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:31.645593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af52db20-63c7-4ec8-9efa-e7bc9be52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.274758 Oct 11 01:44:31.645958 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2286/4533] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:31 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:31.722707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:31.723714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:31.736182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:31.738110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:31.738807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:31.739782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:31.740481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:31.741277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:31.922343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:31.930893 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2afb701c-57e3-446e-8146-54683e9cc609 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1692 microversion: 2.1 time: 0.212667 Oct 11 01:44:31.931527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2248/4534] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:31 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1692 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:32.668463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:32.669192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:32.676971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:32.677973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:32.678679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:32.679781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:32.681655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:32.682276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:32.768281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a7aaf-0c49-441a-bf3d-b936db3db16d", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca86a-1e57-40bc-b3eb-587d28cc09c3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:32.785066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:32.786219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:32.786806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:32.826467 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] Creating event network-vif-plugged:8fbca86a-1e57-40bc-b3eb-587d28cc09c3 for instance 226a7aaf-0c49-441a-bf3d-b936db3db16d on n-h1-772273-9 Oct 11 01:44:32.843380 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-25c0de17-5e1b-48b1-85a8-964d40f1e561 req-ef246ed9-43e0-4f49-b877-204245f1e2d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079256 Oct 11 01:44:32.844533 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2249/4535] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:32.860602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:32.872304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-904c7743-ebb0-4253-892f-4dd91c14ecd0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.207639 Oct 11 01:44:32.873806 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2287/4536] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:32 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:32.956348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:32.957314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:32.963746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:32.964397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:32.964994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:32.965906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:32.966506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:32.967082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:33.146563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:33.155510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9c5eafc-68b3-4612-bc78-6926a94e3b56 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.203335 Oct 11 01:44:33.156097 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2250/4537] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:32 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:33.899048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:33.899801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:33.906969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:33.907507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:33.907951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:33.908827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:33.909293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:33.910345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:34.073167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:34.082907 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d35954a6-2591-4ee2-9e4c-1612408abbe9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1317 microversion: 2.1 time: 0.188633 Oct 11 01:44:34.088155 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2288/4538] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:33 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:34.177649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:34.178576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:34.183328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:34.184269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:34.203142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:34.203954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:34.204732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:34.205929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:34.207115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:34.207767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:34.351286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:34.360097 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5ee4dba-8aa2-43d8-bf2e-533cf5a27dbd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.184318 Oct 11 01:44:34.361262 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2251/4539] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:34 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:35.110898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:35.111559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:35.113733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:35.120250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.120804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.121245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.122018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.122474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.122898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.127437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:35.259050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:35.267772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aa392d72-fb68-447e-b142-12318ea7d96a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1506 microversion: 2.1 time: 0.165497 Oct 11 01:44:35.268440 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2289/4540] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:35 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:35.290422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:35.290903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:35.297778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.298260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.298697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.299411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.299868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.300849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.330136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:44:35.333174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:35.384838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:35.385672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:35.393126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.394651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.395510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.396524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.397289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.397906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.425659 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b94149ca-83fe-493c-bec0-11b4d606edf6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 204 len: 0 microversion: 2.1 time: 0.138672 Oct 11 01:44:35.429895 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2252/4541] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:44:35 2022] DELETE /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:44:35.435315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:35.436079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:35.442197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.442973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.443593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.444446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:35.445046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:35.445617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:35.630166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:35.643806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ac19de8-0f4c-4cd6-9dbe-f7bc4c06df8c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.263398 Oct 11 01:44:35.655426 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2290/4542] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:35 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:35.655734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:35.661770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8285961-661f-465e-89c0-626225ca7203 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1512 microversion: 2.1 time: 0.227032 Oct 11 01:44:35.661770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2253/4543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:35 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:36.669588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:36.670202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:36.681784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:36.683178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:36.694445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:36.694862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:36.695307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:36.695518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:36.696115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:36.696240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:36.697123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:36.697737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:36.698324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:36.699373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:36.702125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:36.706989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:36.916904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:36.928207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-caab1167-e3a3-4e2d-b6e0-9f55227bfbd6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.262497 Oct 11 01:44:36.929150 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2291/4544] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:36 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:36.984157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:36.994049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dacb3937-488a-4ad8-b198-19919c90d2de tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 200 len: 1512 microversion: 2.1 time: 0.316719 Oct 11 01:44:36.994826 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2254/4545] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:36 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:37.508841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a7aaf-0c49-441a-bf3d-b936db3db16d", "name": "network-vif-deleted", "tag": "8fbca86a-1e57-40bc-b3eb-587d28cc09c3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:37.526181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:37.526970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:37.532318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:37.545490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] Creating event network-vif-deleted:8fbca86a-1e57-40bc-b3eb-587d28cc09c3 for instance 226a7aaf-0c49-441a-bf3d-b936db3db16d on n-h1-772273-9 Oct 11 01:44:37.555790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0897cc96-df14-41cc-b22b-429c2dd8f31b req-c1db7314-25dc-4743-9bee-c40ab76ff03e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205875 Oct 11 01:44:37.557105 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2292/4546] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:37.953965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:37.955266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:37.964271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:37.964914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:37.965361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:37.966326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:37.966837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:37.967492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.020831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:38.021623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:38.035831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.044204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.044898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.045863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.046315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.047295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.086546 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d HTTP/1.1 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '226a7aaf-0c49-441a-bf3d-b936db3db16d'} Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:38.089751 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:38.093525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.098066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:38.099193 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ecc47030-a417-487f-be11-f5097c114f84 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 404 len: 111 microversion: 2.1 time: 0.083944 Oct 11 01:44:38.100330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2293/4547] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:38 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:38.109060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:38.109960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:38.118529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.119104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.119597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.120597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.121044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.121474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.152992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:38.162446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a546d586-1062-4aa6-9dd1-98f6d0298ce6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.213206 Oct 11 01:44:38.163688 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2255/4548] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:37 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:38.290016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:38.297939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05d1f857-8719-4df9-b18f-15dc37f346eb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.193348 Oct 11 01:44:38.298583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2294/4549] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:38 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:38.362238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db9a2728-730e-470c-a72e-867d69f66ed2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db9a2728-730e-470c-a72e-867d69f66ed2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 163 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": 12345, "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 12345 Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:38.366700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db9a2728-730e-470c-a72e-867d69f66ed2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:38.370505 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db9a2728-730e-470c-a72e-867d69f66ed2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009958 Oct 11 01:44:38.372296 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2256/4550] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:38 2022] POST /compute/v2.1/servers => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:38.377422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:38.378958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:38.385045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.385643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.386151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.386916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.387506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.388795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.523949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:38.532136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4af38708-73c7-4718-a1cf-c5fde2f2d754 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.158617 Oct 11 01:44:38.532729 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2295/4551] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:38 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:38.555296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:38.555938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:38.562721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.563218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.563685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.564380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:38.564837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:38.565477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:38.703240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:38.711330 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-787d9a36-92a3-4595-b8ab-745adccf04d3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.159843 Oct 11 01:44:38.712105 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2257/4552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:38 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:39.189976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:39.191735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:39.198482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:39.200074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:39.200933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:39.201648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:39.226647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:39.227151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:39.227636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:39.425262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:39.436179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea10da69-732b-44b9-8bbd-9ea97c02e83e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.249846 Oct 11 01:44:39.452577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2296/4553] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:39 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:40.285070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adb9c9c7-da32-45cd-99bf-bc969a49d7f6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2001517865", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f7d2296f-9365-4756-941b-337b524b1905", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:40.353010 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-adb9c9c7-da32-45cd-99bf-bc969a49d7f6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adb9c9c7-da32-45cd-99bf-bc969a49d7f6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 358 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2001517865", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f7d2296f-9365-4756-941b-337b524b1905", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: exception: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2001517865', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f7d2296f-9365-4756-941b-337b524b1905'}], 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:40.357937 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. Oct 11 01:44:40.362064 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:40.364205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adb9c9c7-da32-45cd-99bf-bc969a49d7f6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Block Device f7d2296f-9365-4756-941b-337b524b1905 is not bootable. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:40.365214 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-adb9c9c7-da32-45cd-99bf-bc969a49d7f6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.084664 Oct 11 01:44:40.365934 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2258/4554] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:40.374338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:40.375080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:40.382480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.382967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.383459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.384228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.384857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.385452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.462259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:40.463184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:40.472012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.472743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.473407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.474339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.475010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.475694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.533721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:40.542427 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcf21f8f-752d-41b5-be69-051207078836 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.172202 Oct 11 01:44:40.555375 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2297/4555] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:40 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:40.566552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:40.567166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:40.573746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.574447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.575071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.576574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:40.577248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:40.577882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:40.723767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:40.735110 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84c9339f-ccc5-473e-bc3b-d1b67d6f29d0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.278650 Oct 11 01:44:40.738131 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2259/4556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:40 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:40.754411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:40.762298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a9d292a-5fd8-42a0-bfe6-12c5a713322a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.200141 Oct 11 01:44:40.763254 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2298/4557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:40 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:41.761247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:41.762024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:41.770765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:41.771653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:41.772297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:41.773211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:41.773881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:41.775137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:41.979760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:41.991458 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a214db63-01c8-4c7a-a707-4cc7de6a2e46 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.234125 Oct 11 01:44:41.995205 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2260/4558] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:41 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:42.215154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b06caa1-9444-4ba0-aff9-f242ebbaa0b5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113489029", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2d331602-222c-492e-9d47-dfe2484eac74", "destination_type": "local"}, {"source_type": "volume", "uuid": "4be22da1-5018-463d-a512-471635a4ff9f", "destination_type": "invalid"}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b06caa1-9444-4ba0-aff9-f242ebbaa0b5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 495 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113489029", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2d331602-222c-492e-9d47-dfe2484eac74", "destination_type": "local"}, {"source_type": "volume", "uuid": "4be22da1-5018-463d-a512-471635a4ff9f", "destination_type": "invalid"}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1113489029', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '2d331602-222c-492e-9d47-dfe2484eac74', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '4be22da1-5018-463d-a512-471635a4ff9f', 'destination_type': 'invalid'}], 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:42.219526 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b06caa1-9444-4ba0-aff9-f242ebbaa0b5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b06caa1-9444-4ba0-aff9-f242ebbaa0b5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009687 Oct 11 01:44:42.223296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2299/4559] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:42 2022] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:42.232042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:42.232659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:42.239331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.239865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.240306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.241009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.241467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.241897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.387622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:42.398887 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2793c4cd-6e38-4eae-a779-510ae755d23f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.170555 Oct 11 01:44:42.399885 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2261/4560] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:42 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:42.424150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:42.424772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:42.432238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.432607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.433050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.433768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.434229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.434661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.579411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:42.588108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1b838e4-62d7-47f7-9360-857bd2b68c2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.168858 Oct 11 01:44:42.588762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2300/4561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:42 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:42.649760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76edaa6a-86ae-4799-82b0-7083fb7697e2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-303374190", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76edaa6a-86ae-4799-82b0-7083fb7697e2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 491 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-303374190", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-303374190', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.653848 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76edaa6a-86ae-4799-82b0-7083fb7697e2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:42.657171 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76edaa6a-86ae-4799-82b0-7083fb7697e2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009307 Oct 11 01:44:42.660930 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2262/4562] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:42 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:42.666719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:42.667467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:42.674151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.674713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.675244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.676070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.676634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.677129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.808454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:42.817129 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1707e26e-9730-472a-b607-1a53e77367c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.154194 Oct 11 01:44:42.817965 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2301/4563] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:42 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:42.840680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:42.841232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:42.848976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.849462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.849899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.850766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:42.851407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:42.851983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:42.989219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.003186 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7d9f8f6-b2af-4307-8aaa-8eb7b0c92cb6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.161897 Oct 11 01:44:43.003186 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2263/4564] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:42 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:43.034393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:43.035706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:43.042780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.043426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.043994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.044800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.045366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.045903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.069111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2aa788dc-9178-439d-9d86-933f7619b8b0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2aa788dc-9178-439d-9d86-933f7619b8b0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 416 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.073432 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:44:43.076642 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.079184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2aa788dc-9178-439d-9d86-933f7619b8b0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:43.080747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2aa788dc-9178-439d-9d86-933f7619b8b0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016500 Oct 11 01:44:43.082209 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2264/4565] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:43 2022] POST /compute/v2.1/servers => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:43.095480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:43.096000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:43.104015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.104503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.104988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.105696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.106198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.107392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.254221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.264068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6389e84c-5348-446a-a83c-3f219c586fd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1697 microversion: 2.1 time: 0.241772 Oct 11 01:44:43.265294 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2302/4566] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:43 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1697 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:43.289154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.297021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-127182ac-b841-4f8b-ae2b-e9c5092dbfc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.210114 Oct 11 01:44:43.297593 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2265/4567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:43 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:43.320496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:43.321106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:43.327071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.327673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.328106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.328785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.329231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.329648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.471188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.479646 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-018be0d7-84fd-403e-882e-c14436b6b305 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.162793 Oct 11 01:44:43.480734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2303/4568] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:43 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:43.549491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12e8c106-8d28-4e84-9c54-04506f33415d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-940248811", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": -1, "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:43.561766 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-12e8c106-8d28-4e84-9c54-04506f33415d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Flavor -1 could not be found. Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12e8c106-8d28-4e84-9c54-04506f33415d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 205 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-940248811", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": -1, "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: exception: Flavor -1 could not be found. Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-940248811', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': -1, 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:43.564711 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 11 01:44:43.569296 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:43.571711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12e8c106-8d28-4e84-9c54-04506f33415d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:43.573415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12e8c106-8d28-4e84-9c54-04506f33415d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027915 Oct 11 01:44:43.574299 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2266/4569] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:43 2022] POST /compute/v2.1/servers => generated 73 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 01:44:43.583731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:43.584350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:43.590363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.590855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.591302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.592063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.593113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.593648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.747908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.756890 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac5cb177-d286-41a0-8f4f-c230eeabad5d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.178291 Oct 11 01:44:43.782504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:43.783975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:43.788048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2304/4570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:43 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:43.792789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.793505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.794534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.795496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:43.796172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:43.796813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:43.958358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:43.967540 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-048e55a4-118b-41be-bb2a-b40bfeb8e192 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.190650 Oct 11 01:44:43.971539 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2267/4571] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:43 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:44.061596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9b73b9e-a588-4e20-83d5-19baf3995df2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136091111", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9b73b9e-a588-4e20-83d5-19baf3995df2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 173 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136091111", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1136091111', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi -1 Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:44.066587 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9b73b9e-a588-4e20-83d5-19baf3995df2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9b73b9e-a588-4e20-83d5-19baf3995df2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010325 Oct 11 01:44:44.070958 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2305/4572] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:44 2022] POST /compute/v2.1/servers => generated 145 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:44.077846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:44.078633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:44.086227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.087045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.087765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.088709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.089561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.090226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.246739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:44.255307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82418d38-ac11-4ce9-bfc6-f179172a5212 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.181840 Oct 11 01:44:44.265245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2268/4573] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:44 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:44.289531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:44.290288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:44.291987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:44.292212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:44.301526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.302212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.302827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.302961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.303816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.304515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.305084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.305557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.306050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.306846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.307311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.318018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.529742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:44.541472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-556a2f57-057b-4fee-aadd-f0756bd7df1e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1696 microversion: 2.1 time: 0.256786 Oct 11 01:44:44.542277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2269/4574] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:44 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1696 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:44.601694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:44.611317 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61fb45a1-cd65-416d-ada8-a2d997ad86f9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.332607 Oct 11 01:44:44.612169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2306/4575] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:44 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:44.626077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "name": "network-vif-unplugged", "status": "completed", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:44.631089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.635893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.635893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.671193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Creating event network-vif-unplugged:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h1-772273-9 Oct 11 01:44:44.679103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93068f7e-f76a-4e42-bb0a-d117620c45f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1199989204", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:44.684437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-93068f7e-f76a-4e42-bb0a-d117620c45f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 01:44:44.685151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] Instance 68d1c589-4898-48a0-b69f-154a27947e2c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93068f7e-f76a-4e42-bb0a-d117620c45f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 216 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1199989204", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1199989204', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.686511 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93068f7e-f76a-4e42-bb0a-d117620c45f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93068f7e-f76a-4e42-bb0a-d117620c45f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.013855 Oct 11 01:44:44.689885 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2307/4576] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:44 2022] POST /compute/v2.1/servers => generated 123 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:44:44.696432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:44.697228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:44.704781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.705293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.705926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.706781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fb9ce06f-79d5-42c7-8705-f7672ff56e71 req-84b278da-ff45-4ad2-b7d2-e4c648a06318 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095700 Oct 11 01:44:44.707519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.707764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2270/4577] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:44.708297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.708733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.862010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:44.870968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83956652-8dd1-469f-b07d-c6274b017dac tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.178293 Oct 11 01:44:44.872245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2308/4578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:44 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:44.897975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:44.898688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:44.905816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.906313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.906755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:44.907497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:44.907958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:44.908389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.080757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:45.091191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-345842d9-b7cc-4c54-bc2b-b32d8411b82f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.197905 Oct 11 01:44:45.110828 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2271/4579] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:44 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:45.158245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-733518084", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-key-1552447309", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:45.218249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] validate_networks() for [('58fc1996-ca6b-4497-bb24-7e66d869745e', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:44:45.444725 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Invalid key_name provided. Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 246 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-733518084", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-key-1552447309", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid key_name provided. Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-733518084', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'key_name': 'tempest-key-1552447309', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1552447309 not found for user b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:45.447454 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 11 01:44:45.451771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:45.454797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid key_name provided. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:45.456630 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-feb34b95-f962-4f7b-ad02-71ab029eb65f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.303637 Oct 11 01:44:45.461433 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2309/4580] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:45 2022] POST /compute/v2.1/servers => generated 70 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 01:44:45.466951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:45.467562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:45.479021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.479568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.480017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.480738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.481203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.481634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.571139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:45.571982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:45.581723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.587583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.588288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.589061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.589526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.590118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.729045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:45.737384 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50fcba57-5c22-4a4f-8749-769bc581101e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.274697 Oct 11 01:44:45.738182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2272/4581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:45 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:45.766177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:45.772517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:45.786678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.787545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.788164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.789034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:45.789641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:45.790368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:45.814191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:45.842056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:45.851073 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dfca153f-5d28-4b55-8a1f-f17da501cdae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1696 microversion: 2.1 time: 0.284694 Oct 11 01:44:45.879593 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2310/4582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:45 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1696 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:45.983130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:45.992202 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cf1a3a4-08f4-4fb4-a950-e983ce1a3b89 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.230282 Oct 11 01:44:45.992790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2273/4583] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:45 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:46.061790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83115746", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:46.184199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.security_group_api [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Neutron security group does_not_exist not found {{(pid=120493) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 11 01:44:46.184932 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 256 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83115746", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-83115746', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 11 01:44:46.205198 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.211067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:46.217816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7b6f20b7-e6a9-485c-a776-1b82212c99f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.151093 Oct 11 01:44:46.217816 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2311/4584] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:46 2022] POST /compute/v2.1/servers => generated 106 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:46.222857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.224307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.227192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:46.231816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.232489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.232970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.233911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.234452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.236196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.392108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:46.400180 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7379736-b382-4357-bbfd-32e58c71ca46 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.183507 Oct 11 01:44:46.400767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2274/4585] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:46 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:46.422698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.423584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.431028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.431558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.432158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.432849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.433304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.433729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.437638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:46.580383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:46.589054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed836ac4-3bfd-4d0f-b33b-6ea2c0f448e5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.170186 Oct 11 01:44:46.590155 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2312/4586] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:46 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:46.611019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.611548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: b7f7bda5-b8b5-4697-bc8c-f4354c01f65f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.617615 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/b7f7bda5-b8b5-4697-bc8c-f4354c01f65f HTTP/1.1 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b7f7bda5-b8b5-4697-bc8c-f4354c01f65f'} Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.619232 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance b7f7bda5-b8b5-4697-bc8c-f4354c01f65f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:46.622942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c21f021-1160-4d85-97e2-4effc1286936 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b7f7bda5-b8b5-4697-bc8c-f4354c01f65f" status: 404 len: 111 microversion: 2.1 time: 0.014009 Oct 11 01:44:46.624369 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2275/4587] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:44:46 2022] DELETE /compute/v2.1/servers/b7f7bda5-b8b5-4697-bc8c-f4354c01f65f => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:46.629845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.630460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.636391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.636886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.637322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.638008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.638461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.638879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.750560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:46.763876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.764642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.765367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.776219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:46.784136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05f91e24-0927-429d-ab4f-fe780bef3a1b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.158556 Oct 11 01:44:46.786149 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2313/4588] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:46 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:46.798904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Creating event network-changed:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h1-772273-9 Oct 11 01:44:46.806826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] Instance 68d1c589-4898-48a0-b69f-154a27947e2c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:44:46.807986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.808858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.815014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.816433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.817100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.818107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.818777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.819453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.820365 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b1a9136d-fd8b-44fb-929b-ec2e359c2a98 req-b565d443-22d5-4174-9b12-50c42e7b5eac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074458 Oct 11 01:44:46.821693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2276/4589] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:46.893339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:46.894304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:46.902772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.904067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.904627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:46.906308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:46.907070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:46.907749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:47.357971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:47.379204 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b8c80ab-04c1-49d5-bca6-efee6bf7b919 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.570341 Oct 11 01:44:47.382481 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2314/4590] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:46 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:47.403412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:47.403903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:44:47.404611 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9223372036854775808 could not be found. Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9223372036854775808'} Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:47.407054 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:47.411120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce65041b-bc63-4ce1-a82a-3f8a31654205 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009581 Oct 11 01:44:47.413838 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2315/4591] 10.222.0.66 () {58 vars in 1188 bytes} [Tue Oct 11 01:44:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 01:44:47.419787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:47.420839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:47.428776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:47.429588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:47.430256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:47.431214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:47.431879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:47.432496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:47.487823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:47.497144 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25eca93b-f91b-4b88-b1de-6806999c8d31 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1694 microversion: 2.1 time: 0.609312 Oct 11 01:44:47.504548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2277/4592] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:46 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1694 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:47.830315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:47.841490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-df9df9f9-92b3-4476-a8b4-afab9e650cc3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.426377 Oct 11 01:44:47.846970 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2316/4593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:47 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:47.870124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:47.871141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:47.878876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:47.880436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:47.881111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:47.882135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:47.883053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:47.883756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.225489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:48.238908 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0bc7eb3-7930-4a17-9b9d-22c8c74169ab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.372567 Oct 11 01:44:48.240754 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2278/4594] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:47 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:48.261331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.261969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Failed to fetch instance by id -1 {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 01:44:48.262492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance -1 could not be found. Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance -1 could not be found. Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '-1'} Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:48.263996 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:48.268804 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f586eea4-f5f6-4897-8a3b-bef17bd1c4ad tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.007850 Oct 11 01:44:48.273779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.274387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.279130 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2317/4595] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 01:44:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:44:48.281348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.281846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.282287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.282993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.283495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.283931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.429412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:48.437605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efbfaa44-2280-4f78-bb33-f64d21977dab tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.167562 Oct 11 01:44:48.438187 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2279/4596] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:48 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:48.462934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.463410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.471816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.472872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.473317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.474231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.474493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.475108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.528849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.529460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.536569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.537265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.537902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.538780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.539422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.540012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.709864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:48.720669 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c034623-5372-4b15-8d41-6c383bc88b95 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.261523 Oct 11 01:44:48.737131 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2318/4597] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:48 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:48.745974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:48.747711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: c0ec336a-f721-440c-b7b4-7a520f0e97bf] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.750114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:48.754677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. Oct 11 01:44:48.761840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05c31971-3e13-4dbc-a8eb-0cb2658f6c80 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1691 microversion: 2.1 time: 0.237262 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/c0ec336a-f721-440c-b7b4-7a520f0e97bf/action HTTP/1.1 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 19 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: {"forceDelete": {}} Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c0ec336a-f721-440c-b7b4-7a520f0e97bf', 'body': {'forceDelete': {}}} Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:48.768879 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:48.772917 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:48.772917 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:48.772917 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. Oct 11 01:44:48.772917 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:48.774466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance c0ec336a-f721-440c-b7b4-7a520f0e97bf could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:48.775543 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a20df4d-78f3-4789-a6cb-61d0f454cb34 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/c0ec336a-f721-440c-b7b4-7a520f0e97bf/action" status: 404 len: 111 microversion: 2.1 time: 0.034215 Oct 11 01:44:48.776332 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2319/4599] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:48 2022] POST /compute/v2.1/servers/c0ec336a-f721-440c-b7b4-7a520f0e97bf/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:44:48.776437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2280/4599] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:48 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:48.793055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.794426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.797628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:48.798170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.802343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.803409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.804555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.805760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.806421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.807049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.808479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.808997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.809415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.810126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.810584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.811016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.928858 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e074ab3-a398-4f51-a733-fd12225fda3f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action" status: 204 len: 0 microversion: 2.1 time: 0.143092 Oct 11 01:44:48.929977 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2281/4600] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:48 2022] POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:44:48.939131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:48.940105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:48.947941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.948761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.949576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.950361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:48.950831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:48.951261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:48.987317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:49.001549 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a52d3fe-df5a-4bf0-b2b4-14906fc4d762 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.213009 Oct 11 01:44:49.005871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2320/4601] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:48 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:49.030148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:49.033351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:49.042091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.042700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.043319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.044164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.044831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.046231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.339153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:49.352593 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5a99c10-71bf-4f57-8ecc-f273c8950cf2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1691 microversion: 2.1 time: 0.417695 Oct 11 01:44:49.357716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2282/4602] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:48 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1691 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:49.430383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:49.441620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdc483de-63c1-4470-8fd0-8559220c7a13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.413128 Oct 11 01:44:49.442403 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2321/4603] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:49 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:49.464536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:49.477681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: bfc86f28-5378-477c-9ffa-3ed63582251b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:49.490724 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/bfc86f28-5378-477c-9ffa-3ed63582251b/action HTTP/1.1 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 39 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: {"os-getConsoleOutput": {"length": 10}} Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'bfc86f28-5378-477c-9ffa-3ed63582251b', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:49.502343 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance bfc86f28-5378-477c-9ffa-3ed63582251b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f0dd0ff-5b3c-42f7-bd4d-c8e81ea6b95d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/bfc86f28-5378-477c-9ffa-3ed63582251b/action" status: 404 len: 111 microversion: 2.1 time: 0.043689 Oct 11 01:44:49.509700 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2283/4604] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:49 2022] POST /compute/v2.1/servers/bfc86f28-5378-477c-9ffa-3ed63582251b/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:49.512870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:49.513496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:49.520975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.521468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.521906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.522600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.523056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.523509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.791766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:49.800283 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48834f9b-8495-4521-9e5a-9fd08351aa13 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.291174 Oct 11 01:44:49.801877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2322/4605] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:49 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:49.828354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:49.829520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:49.837834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.838497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.839085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.839977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.840582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.841178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.940931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:49.943437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:49.949805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.950191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.950607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:49.951308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:49.953290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:49.953290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.016117 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-407a25df-8b50-4251-8026-ed60ffc5d09b tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079221 Oct 11 01:44:50.019851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2323/4606] 10.222.0.66 () {60 vars in 1343 bytes} [Tue Oct 11 01:44:49 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:50.077526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.105312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6354b8b-9873-44bb-9d64-36fcc667afd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.279984 Oct 11 01:44:50.111811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.112639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.120149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.120849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.121505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.122383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.122992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.123624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.127509 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2284/4607] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:49 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:50.140464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.141321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 43b11a6a-9107-42c2-b62a-c6f36ed8233b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.156939 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. Oct 11 01:44:50.164237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/43b11a6a-9107-42c2-b62a-c6f36ed8233b HTTP/1.1 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '43b11a6a-9107-42c2-b62a-c6f36ed8233b'} Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:50.171442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:50.175838 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:50.175838 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:50.175838 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:50.175838 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. Oct 11 01:44:50.175838 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:50.181299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 43b11a6a-9107-42c2-b62a-c6f36ed8233b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:50.182437 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25129bd6-3e3d-4d08-8336-1fdfc6f603a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/43b11a6a-9107-42c2-b62a-c6f36ed8233b" status: 404 len: 111 microversion: 2.1 time: 0.048905 Oct 11 01:44:50.183516 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2285/4608] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:50 2022] GET /compute/v2.1/servers/43b11a6a-9107-42c2-b62a-c6f36ed8233b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:44:50.200892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.201795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.213035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.216984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.217615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.218501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.219799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.221012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.339279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c57cdad-ac72-4360-bf45-0294e8996787 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 204 len: 0 microversion: 2.20 time: 0.231334 Oct 11 01:44:50.343027 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2324/4609] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:44:50 2022] DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 01:44:50.358280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.358992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.368042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.368594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.369796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.370591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.371063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.373176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.580855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.587755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.597449 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98957525-2d2b-40cc-b654-c56407f56fa9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.409847 Oct 11 01:44:50.598192 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2286/4610] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:50 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:50.604320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.605122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.606340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.607810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.610624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60548bc5-f913-417d-8aa6-cdb5ad1de70a tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.256551 Oct 11 01:44:50.613381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.614127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.614759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.615712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.616338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.617193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.642737 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2325/4611] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:50 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:44:50.650987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:50.651827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:50.658235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.659062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.659719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.660565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.661164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.662528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.908233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.920287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-435e3ba3-22b9-48c4-9770-c8dd155ccfe6 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1691 microversion: 2.1 time: 0.318224 Oct 11 01:44:50.922635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2287/4612] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:50 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1691 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:50.926278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:50.932499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:50.936158 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75546ae5-2563-4db7-830c-2b2b67615e97 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.290307 Oct 11 01:44:50.945863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:50.946383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:50.946811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:50.952615 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2326/4613] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:50 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:50.973782 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Creating event network-vif-plugged:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h1-772273-9 Oct 11 01:44:50.990785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] Instance 68d1c589-4898-48a0-b69f-154a27947e2c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:44:51.013720 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5f08cb88-1224-473d-be49-c356c49c3dae req-c2f339a1-1b38-492f-b449-137c5b0ebcd6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089813 Oct 11 01:44:51.016982 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2288/4614] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:51.058659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32a7b17d-db07-4743-8a19-a3efb22fe735 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-535706355", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32a7b17d-db07-4743-8a19-a3efb22fe735 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 237 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-535706355", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-535706355', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.075903 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32a7b17d-db07-4743-8a19-a3efb22fe735 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32a7b17d-db07-4743-8a19-a3efb22fe735 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022921 Oct 11 01:44:51.080726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2327/4615] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:44:51.087073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.087741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.094157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.094659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.095104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.095842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.096473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.097448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.235250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.243821 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6044b266-631c-46a9-b1bb-26ef48a4ac1c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.161021 Oct 11 01:44:51.244381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2289/4616] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:51.266653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.267266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.274871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.275410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.275850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.276545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.277014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.277424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.428356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.436660 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e375c5c-95cd-4564-90a9-c3e02b979718 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.173769 Oct 11 01:44:51.439709 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2328/4617] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:51.520715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe181ba0-72cd-441e-a0d7-0a934b7d2966 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262967696", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe181ba0-72cd-441e-a0d7-0a934b7d2966 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 234 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262967696", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-262967696', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.526715 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe181ba0-72cd-441e-a0d7-0a934b7d2966 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe181ba0-72cd-441e-a0d7-0a934b7d2966 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.012763 Oct 11 01:44:51.533101 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2290/4618] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:44:51 2022] POST /compute/v2.1/servers => generated 133 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:44:51.538741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.543392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.550166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.550905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.551318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.552122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.552635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.552997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.646643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.647597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.656859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.657184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.657622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.658514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.659056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.659543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.736006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.744486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbb9c684-4c02-4470-8d1e-f05877f7de08 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.210433 Oct 11 01:44:51.745053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2329/4619] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:51.771555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.772360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.779505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.780194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.780877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.781937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.782196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.782638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.880621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.895680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.898785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.900411 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e728b0f9-8cb5-47ed-b2a3-dbd0f888e266 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.258950 Oct 11 01:44:51.920542 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2291/4620] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:44:51.954916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:51.957514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:51.967574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.968104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.969622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.970322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:51.970789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:51.971230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:51.976210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:51.986486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-550e805e-198b-4b76-8c57-2594072ae1cd tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.220225 Oct 11 01:44:52.000757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2330/4621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:52.010419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:52.010963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: e7da91c1-6e32-4414-9761-beddbccd9431] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.018534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/e7da91c1-6e32-4414-9761-beddbccd9431/action HTTP/1.1 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 13 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: {"pause": {}} Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e7da91c1-6e32-4414-9761-beddbccd9431', 'body': {'pause': {}}} Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:52.027999 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance e7da91c1-6e32-4414-9761-beddbccd9431 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:52.032375 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e322e3e3-c1bb-4c8a-96f2-5524751191aa tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/e7da91c1-6e32-4414-9761-beddbccd9431/action" status: 404 len: 111 microversion: 2.1 time: 0.023090 Oct 11 01:44:52.034122 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2331/4622] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:52 2022] POST /compute/v2.1/servers/e7da91c1-6e32-4414-9761-beddbccd9431/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:44:52.040684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:52.041433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.050597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.051240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.051811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.052615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.053443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.054248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.059047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:52.309703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:52.325319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-170614ef-655a-4e0f-a1db-b300b62a6847 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1691 microversion: 2.1 time: 0.378202 Oct 11 01:44:52.326928 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2292/4623] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:51 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1691 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:52.367070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:52.376658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d0168d62-da21-41eb-8b94-b76e886249e1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.339486 Oct 11 01:44:52.377710 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2332/4624] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:52 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:52.398492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:52.399377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.406265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.406937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.407417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.408303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.408923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.410049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.426545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:52.702141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:52.710538 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdadc34f-51f7-4708-b62b-49cc6800aceb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.316732 Oct 11 01:44:52.711354 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2293/4625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:52 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:52.733968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:52.734846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.744221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.746506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.747887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.748769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.749385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.749965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.852637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ad75b7a-5c20-41be-9c6e-a0bd58cdbdee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.122848 Oct 11 01:44:52.853934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2333/4626] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:52 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:44:52.873069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:52.876317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.884559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.885229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.885669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.911963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.912780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.915084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.928919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:52.930037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:52.943099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.943679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.944278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:52.945045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:52.946417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:52.947364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:53.304916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:53.308180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:53.317184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:53.317609 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11b29552-c31c-4a94-b0f9-8c7508180062 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1511 microversion: 2.1 time: 0.455633 Oct 11 01:44:53.319033 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2294/4627] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:52 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:53.332082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56faf0ffbfe540a59e9c63bd23d7707a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1e9e8db1c491daa6aa54bc1248e28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:53.333450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb8f8109-1585-4211-ad3b-bd3919ebdd28 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 200 len: 1722 microversion: 2.20 time: 0.410393 Oct 11 01:44:53.334025 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2334/4628] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:52 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:44:53.351152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:53.358660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:53.370167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:53.370684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:53.371141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:53.372071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:53.373220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:53.373664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:53.635783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:53.658835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4bc5d14-63cf-44e9-978a-fd813c5f0bbc tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1683 microversion: 2.1 time: 0.310061 Oct 11 01:44:53.660323 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2295/4629] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:53 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1683 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:53.766316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dda07b-53f5-41e8-b828-65c9e8b8d878", "name": "network-vif-deleted", "tag": "2af90e1d-173e-4d0b-a177-de010f03875d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:53.776336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:53.777031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:53.777607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:53.792210 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] Creating event network-vif-deleted:2af90e1d-173e-4d0b-a177-de010f03875d for instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 on n-h2-772273-9 Oct 11 01:44:53.797394 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-54daff17-55f6-439b-8806-1e16d44ee915 req-60b3e572-8498-4ad4-b5bc-95751ab2bede service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132233 Oct 11 01:44:53.802635 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2335/4630] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:44:54.355668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:54.356878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:54.363647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:54.364599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:54.365026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.365668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.366251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.367109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.367735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.368305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.376941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.377579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.378161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.378992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.379823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.380368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.397246 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 HTTP/1.1 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '77dda07b-53f5-41e8-b828-65c9e8b8d878'} Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.399106 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:54.403403 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.407038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:54.408073 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-707e23d8-4446-4288-8542-5d9291addaf5 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 404 len: 111 microversion: 2.20 time: 0.050560 Oct 11 01:44:54.412946 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2336/4631] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:54 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:44:54.435166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96a133d1-5001-40c9-890b-103a3dc622c2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '.version_select at 0x7f113893ac10>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:54.483661 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96a133d1-5001-40c9-890b-103a3dc622c2 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842059781" status: 204 len: 0 microversion: 2.20 time: 0.066960 Oct 11 01:44:54.484454 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2337/4632] 10.222.0.66 () {60 vars in 1259 bytes} [Tue Oct 11 01:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842059781 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:44:54.552109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:54.562051 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1485234-d741-4343-9dfe-ed2386bbbdf7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1491 microversion: 2.1 time: 0.210174 Oct 11 01:44:54.563299 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2296/4633] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:54 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1491 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:54.587194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:54.588111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:54.598572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.599360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.602634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.603647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.604413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.605083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.642776 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'pause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state paused Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 13 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: {"pause": {}} Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'pause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state paused Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'pause': {}}} Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state paused. Cannot pause while the instance is in this state. Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state paused Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:54.645178 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:54.649667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:54.649667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:54.649667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:54.649667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state paused Oct 11 01:44:54.649667 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:54.650157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'pause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state paused {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:54.651139 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33f8e684-8508-40fc-9d53-e3d50d2b8c05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 143 microversion: 2.1 time: 0.068410 Oct 11 01:44:54.656046 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2338/4634] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:54 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 143 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:44:54.663210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:54.663778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:54.681802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.682235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.682657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.683563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.684021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.684448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.793595 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c4b2ebe-c580-4727-ab3e-8a79dc69cd2b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.136251 Oct 11 01:44:54.798433 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2297/4635] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:54 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:44:54.804796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:54.806247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:54.821557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.823361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.824697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:54.826063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:54.827963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:54.829085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:55.179602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:55.204175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33e94dbd-4143-4219-b5a5-691574fd47a9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1498 microversion: 2.1 time: 0.403999 Oct 11 01:44:55.205105 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2339/4636] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:54 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1498 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:56.232092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:56.233683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:56.241313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.242128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.242774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.243922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.244609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.245305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.417544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:56.426875 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07910788-f66e-42e5-a5a8-c70ba995085d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.200036 Oct 11 01:44:56.427807 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2298/4637] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:56 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:56.452645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:56.453292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:56.461244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.471684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.472358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.473158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.473693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.474196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.664750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:56.673313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34ed9928-408c-4285-8cce-c6294817be05 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.224766 Oct 11 01:44:56.687362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2340/4638] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:56 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:56.698165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:56.700811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:56.707221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.707973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.708610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.709518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.710190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.710814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.724345 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action HTTP/1.1 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 28 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: {"reboot": {"type": "SOFT"}} Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '226a7aaf-0c49-441a-bf3d-b936db3db16d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:56.726272 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:56.729724 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:56.731608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:56.732640 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3558c8af-d7b1-4dd2-893d-baf482fa7f8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action" status: 404 len: 111 microversion: 2.1 time: 0.038594 Oct 11 01:44:56.742284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:56.743159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:56.747412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2299/4639] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:56 2022] POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:56.749695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.750397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.751057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.751981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.752635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.753907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.923823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:56.938885 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e968b4f2-2de5-40f7-b392-b0709bf6db8d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.200311 Oct 11 01:44:56.940144 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2341/4640] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:56 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:56.961957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:56.962808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:56.972637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.973176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.973551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:56.974243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:56.974696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:56.975121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.128114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:57.136222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b1396ca5-c653-46c5-b3f7-df5a8fad12ca tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.178046 Oct 11 01:44:57.137093 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2300/4641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:56 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:57.158796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:57.161836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 8aef51b7-f91f-451d-a11e-c6ad52b17624] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.167642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/8aef51b7-f91f-451d-a11e-c6ad52b17624/action HTTP/1.1 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 28 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: {"reboot": {"type": "SOFT"}} Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '8aef51b7-f91f-451d-a11e-c6ad52b17624', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. Oct 11 01:44:57.169472 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.173847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 8aef51b7-f91f-451d-a11e-c6ad52b17624 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:57.174565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1a82c1b-1789-421c-9f5f-5f73437bd604 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/8aef51b7-f91f-451d-a11e-c6ad52b17624/action" status: 404 len: 111 microversion: 2.1 time: 0.018798 Oct 11 01:44:57.176061 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2342/4642] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:57 2022] POST /compute/v2.1/servers/8aef51b7-f91f-451d-a11e-c6ad52b17624/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:44:57.183688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:57.184309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.191876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.192367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.192806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.193502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.193957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.194385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.342709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:57.352663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1e700080-bc00-434e-8a36-03c6e85844a6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.171417 Oct 11 01:44:57.353485 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2301/4643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:57 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:57.390590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:57.392253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.402846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.403489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.403933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.404640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.405111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.405529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.566054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:57.574310 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e733e9b0-8808-44b8-ae0f-0c77a48c040b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.194286 Oct 11 01:44:57.574873 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2343/4644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:57 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:57.597350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:57.600672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.607036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.607762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.608767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.609656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.610299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.611158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.627386 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action HTTP/1.1 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 65 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '226a7aaf-0c49-441a-bf3d-b936db3db16d', 'body': {'rebuild': {'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74'}}} Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 01:44:57.630205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:44:57.633767 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:57.637113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:57.638222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-709c7b59-6dea-4a55-9605-178bb769cbb4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action" status: 404 len: 111 microversion: 2.1 time: 0.045248 Oct 11 01:44:57.648488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:57.649716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.652194 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2302/4645] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:57 2022] POST /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:57.659477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.660042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.660550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.661458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.662589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.663232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.819841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:57.829486 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c4ad44a-3dec-4736-9f23-7dc71569480e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.185782 Oct 11 01:44:57.830086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2344/4646] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:57 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:57.869041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:57.870035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:57.881958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.895966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.896531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:57.898048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:57.898969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:57.899667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.475932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:58.490175 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47c6aef3-19b9-40a8-a782-15db47451747 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.625450 Oct 11 01:44:58.491619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2303/4647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:57 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:58.513798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:58.516534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 60d5f366-f054-4b75-8c02-b9820dedaa21] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.523628 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/60d5f366-f054-4b75-8c02-b9820dedaa21/action HTTP/1.1 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 65 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '60d5f366-f054-4b75-8c02-b9820dedaa21', 'body': {'rebuild': {'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74'}}} Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 01:44:58.525220 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 60d5f366-f054-4b75-8c02-b9820dedaa21 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:58.528861 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32d776c3-f498-432d-a04b-4aa934aa0811 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/60d5f366-f054-4b75-8c02-b9820dedaa21/action" status: 404 len: 111 microversion: 2.1 time: 0.016786 Oct 11 01:44:58.535156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:58.535797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.538778 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2345/4648] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:58 2022] POST /compute/v2.1/servers/60d5f366-f054-4b75-8c02-b9820dedaa21/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:58.542553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.543048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.543529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.544242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.544697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.545161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.697450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:58.705942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8af6f128-38d1-4195-9566-76a6eca7a98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.174635 Oct 11 01:44:58.716115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2304/4649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:58 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:58.731608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:58.732749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.740474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.741131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.741730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.742581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.743201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.743822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.881888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:58.897467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1669d1a-cef6-42c2-87cc-bcfe6081b98b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.169549 Oct 11 01:44:58.900201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2346/4650] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:58 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:58.926272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:58.927073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 43602214-1565-4703-9ecb-fa0e739135e1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.933170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/43602214-1565-4703-9ecb-fa0e739135e1/action HTTP/1.1 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 15 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: {"restore": {}} Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '43602214-1565-4703-9ecb-fa0e739135e1', 'body': {'restore': {}}} Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:58.934906 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:58.938692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:58.938692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:58.938692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. Oct 11 01:44:58.938692 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:58.941462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 43602214-1565-4703-9ecb-fa0e739135e1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:58.942514 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6152c30-67f5-400c-bdb3-9f01c59fe038 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/43602214-1565-4703-9ecb-fa0e739135e1/action" status: 404 len: 111 microversion: 2.1 time: 0.020432 Oct 11 01:44:58.943437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2305/4651] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:58 2022] POST /compute/v2.1/servers/43602214-1565-4703-9ecb-fa0e739135e1/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:44:58.952073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:58.952995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.962914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:44:58.964816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.965408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.966193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.967148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.967941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.968571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.979792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:58.980292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:58.988180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.988570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.989018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:58.989833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:58.990300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:58.990738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.024190 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 HTTP/1.1 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '77dda07b-53f5-41e8-b828-65c9e8b8d878'} Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:59.028668 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55e77b71-6c3f-44cd-984a-86e18b9ad23e tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 404 len: 111 microversion: 2.20 time: 0.051386 Oct 11 01:44:59.032696 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2306/4652] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:44:58 2022] DELETE /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:44:59.036800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:59.037422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 77dda07b-53f5-41e8-b828-65c9e8b8d878] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:59.056313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.056822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.057269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.058166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.058784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.059404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.109080 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 HTTP/1.1 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '77dda07b-53f5-41e8-b828-65c9e8b8d878'} Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.112868 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.117152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 77dda07b-53f5-41e8-b828-65c9e8b8d878 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:59.122875 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a52fdbe3-eee0-4b3e-abad-12f6ca7ac11f tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878" status: 404 len: 111 microversion: 2.20 time: 0.090337 Oct 11 01:44:59.123906 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2307/4653] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:44:59 2022] GET /compute/v2.1/servers/77dda07b-53f5-41e8-b828-65c9e8b8d878 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:44:59.196843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:59.206068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d7e99e9-9266-4ac4-b6c7-1466b7773d72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.258646 Oct 11 01:44:59.219387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2347/4654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:58 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:59.237617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:59.238071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:59.246749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.247664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.249074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.251961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.252539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.255236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.484712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:59.504630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7aed3d0b-2bf5-4b50-9828-dcc0d4863dcc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.271318 Oct 11 01:44:59.517822 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2308/4655] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:59 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:59.530018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:59.530755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:59.538319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.540411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.541002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.541879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.542467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.543020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.589424 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'restore' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 15 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: {"restore": {}} Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'restore' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'restore': {}}} Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state active. Cannot restore while the instance is in this state. Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:44:59.591222 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'restore' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:44:59.595689 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-248f4a49-db48-40ae-afe7-f9c228ffde2e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 145 microversion: 2.1 time: 0.069345 Oct 11 01:44:59.597938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2348/4656] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:59 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:44:59.603187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:59.604087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:59.611748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.613005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.613652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.614554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.615212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.615896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.767944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:59.776621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07d85abb-1c45-42c6-b4fd-764cfba0c075 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.177590 Oct 11 01:44:59.778337 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2309/4657] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:59 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:44:59.803173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:44:59.804470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:44:59.810716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.811460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.812719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.813611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:44:59.814334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:44:59.814957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:44:59.964683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:44:59.973484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6cb0a88-cf6a-404b-8097-019d68443e2c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.175380 Oct 11 01:44:59.983656 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2349/4658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:44:59 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:44:59.997778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:44:59.998638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: faebbb43-da5f-4113-8b5a-12875e0f12c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.005287 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/faebbb43-da5f-4113-8b5a-12875e0f12c6/action HTTP/1.1 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 14 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: {"resume": {}} Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'faebbb43-da5f-4113-8b5a-12875e0f12c6', 'body': {'resume': {}}} Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:00.017435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance faebbb43-da5f-4113-8b5a-12875e0f12c6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:00.021119 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-13dd6ccc-f0c7-4551-a838-eeb1b708d0fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/faebbb43-da5f-4113-8b5a-12875e0f12c6/action" status: 404 len: 111 microversion: 2.1 time: 0.027341 Oct 11 01:45:00.025547 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2310/4659] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:44:59 2022] POST /compute/v2.1/servers/faebbb43-da5f-4113-8b5a-12875e0f12c6/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:45:00.030804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:00.031721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.039059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.039879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.040528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.041423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.042075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.042716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.223823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:00.238141 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0832b918-602e-4731-8174-850057e78963 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.211104 Oct 11 01:45:00.250731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2350/4660] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:00 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:00.261405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:00.262016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.279115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.280002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.280667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.281989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.282674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.283326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.463631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:00.478119 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c170ed7e-de9a-4dba-95c9-c98ae61479bc tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.219996 Oct 11 01:45:00.478764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2311/4661] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:00 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:00.502013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:00.502676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.511063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.511667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.512167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.512968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.513503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.513993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.541102 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'resume' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 14 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: {"resume": {}} Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: exception: Cannot 'resume' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'resume': {}}} Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state active. Cannot resume while the instance is in this state. Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:00.543117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:45:00.546863 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:00.548702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'resume' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:00.549748 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fabfdd9-c3d5-4d6c-b46f-f487a38ee636 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 144 microversion: 2.1 time: 0.051890 Oct 11 01:45:00.554689 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2351/4662] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:00 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 144 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:45:00.559104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:00.559747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.566579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.567272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.567932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.568806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.569439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.570040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.738006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:00.746532 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5430de5a-9732-4a6c-8ac3-aed143d705c1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.191336 Oct 11 01:45:00.747214 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2312/4663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:00 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:00.772100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:00.772928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:00.779401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.780464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.781066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.781918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:00.782540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:00.783122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:00.920738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:00.931380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db5a83f9-5365-4ee5-be59-cdaed4a52713 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.164204 Oct 11 01:45:00.932813 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2352/4664] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:00 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:00.999300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f426d7bc-12ec-4e7f-9950-3606d02b4bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f426d7bc-12ec-4e7f-9950-3606d02b4bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 160 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "58fc1996-ca6b-4497-bb24-7e66d869745e"}]}} Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'body': {'server': {'name': '', 'imageRef': '2d331602-222c-492e-9d47-dfe2484eac74', 'flavorRef': '452', 'networks': [{'uuid': '58fc1996-ca6b-4497-bb24-7e66d869745e'}]}}} Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '' Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:45:01.005219 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f426d7bc-12ec-4e7f-9950-3606d02b4bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:01.011839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f426d7bc-12ec-4e7f-9950-3606d02b4bb2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.011250 Oct 11 01:45:01.022257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:01.022867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.037879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2313/4665] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:45:00 2022] POST /compute/v2.1/servers => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:45:01.039538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.040034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.040491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.041407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.041870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.042278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.064961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:01.203553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:01.211610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83139356-2ae0-4a15-81e5-8ba9007c1008 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.193158 Oct 11 01:45:01.230938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2353/4666] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:01 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:01.236921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:01.238085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.262491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.262914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.263363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.273999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.275927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.276461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.476674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:01.479841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:01.488770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c34c5f3a-a64f-41b8-bf73-1dfc0a16c464 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.255023 Oct 11 01:45:01.489854 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2314/4667] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:01 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:01.511125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:01.511909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: e039d833-e508-4f40-8fd1-f9148bba69e3] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.517671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/e039d833-e508-4f40-8fd1-f9148bba69e3/action HTTP/1.1 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 14 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: {"shelve": {}} Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e039d833-e508-4f40-8fd1-f9148bba69e3', 'body': {'shelve': {}}} Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:01.521627 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:01.525906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:01.525906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:01.525906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. Oct 11 01:45:01.525906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:01.526909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance e039d833-e508-4f40-8fd1-f9148bba69e3 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:01.527987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c7ba948-28c3-4d1b-827b-9338f434e955 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/e039d833-e508-4f40-8fd1-f9148bba69e3/action" status: 404 len: 111 microversion: 2.1 time: 0.020765 Oct 11 01:45:01.537399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:01.538215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.543543 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2354/4668] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:01 2022] POST /compute/v2.1/servers/e039d833-e508-4f40-8fd1-f9148bba69e3/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:45:01.546707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.547364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.547969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.548823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.549425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.550598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.703805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:01.713205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20d2df5c-caf9-4f53-b7af-e07c486e62be tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.180149 Oct 11 01:45:01.727559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2315/4669] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:01 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:01.750053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:01.750683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.760524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.761025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.761465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.762181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.762636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.763059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.913867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:01.922845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2581679-9dba-4e3a-930e-03c1869aa750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.177739 Oct 11 01:45:01.932850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2355/4670] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:01 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:01.947218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:01.948049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:01.954504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.955245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.955935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.957367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:01.958021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:01.958645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:01.992783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lazy-loading 'flavor' on Instance uuid 2f68f7f4-9338-42bb-a996-015687c5a202 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:45:02.268056 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05b5623b-22f2-4ff0-b3f3-454eaf627cc9 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.322138 Oct 11 01:45:02.270396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2316/4671] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:01 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:45:02.278349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:02.279387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:02.292477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:02.293207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:02.293830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:02.294712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:02.295186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:02.295623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:02.469820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:02.478632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d106b7ca-14cb-4880-927c-da0e6d584487 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.204367 Oct 11 01:45:02.508208 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2356/4672] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:02 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:03.520750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:03.521446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:03.528076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.528912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.529599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.530529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.531198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.531886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.579516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:03.580965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:03.594757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.595635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.596316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.597292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.597975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.602546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.646547 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad HTTP/1.1 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6b5c015a-c090-4722-8ef4-6340d39484ad'} Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:45:03.648596 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.652022 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.653909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:03.654967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15e8e2d4-e543-4eb6-b571-a2a08ca15091 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 404 len: 111 microversion: 2.20 time: 0.079322 Oct 11 01:45:03.655768 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2357/4673] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:45:03 2022] DELETE /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:45:03.664534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:03.670849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] [instance: 6b5c015a-c090-4722-8ef4-6340d39484ad] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:03.682529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.685231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.685902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.691313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:03.692070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:03.692574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:03.710767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] HTTP exception thrown: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Request method failure captured: Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad HTTP/1.1 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMhaYcEQNH0Jw1IbvuF8oMI8EqIol2e2P3hUBZo__76kfwdkzJ6OcpwWgkJ5NYV3TywNKPR339R12BwIpRAWNRRmaBZqqCjAoeJyMwP2__HZD4n32kotlAXm2nOkW3aMlAvG56DWbVnPXgTa3pb5Fc-pJhlheWoQCrWdgxg7lwhH6cs Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6da1e9e8db1c491daa6aa54bc1248e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6da1e9e8db1c491daa6aa54bc1248e28 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1634032823 Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 56faf0ffbfe540a59e9c63bd23d7707a Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1634032823-project Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6b5c015a-c090-4722-8ef4-6340d39484ad'} Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.713172 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] Returning 404 to user: Instance 6b5c015a-c090-4722-8ef4-6340d39484ad could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45cba819-c896-4041-9209-d9ad018cafe6 tempest-AttachVolumeShelveTestJSON-1634032823 tempest-AttachVolumeShelveTestJSON-1634032823-project] 10.222.0.66 "GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad" status: 404 len: 111 microversion: 2.20 time: 0.055130 Oct 11 01:45:03.718006 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2358/4674] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:45:03 2022] GET /compute/v2.1/servers/6b5c015a-c090-4722-8ef4-6340d39484ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:45:03.792104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:03.801573 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dfc43382-b0db-4eff-b13b-925de73a6586 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.286703 Oct 11 01:45:03.821068 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2317/4675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:03 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:04.832858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:04.835585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:04.848272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:04.851097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:04.852202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:04.853812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:04.856171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:04.857529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:05.105429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:05.117995 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9eb2201-a758-4485-b81a-b81eac3a15c5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.289133 Oct 11 01:45:05.119741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2359/4676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:04 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:06.141937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:06.142702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:06.154578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:06.156982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:06.157512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:06.159599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:06.162139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:06.162595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:06.385384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:06.394610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb90d80c-b040-46ab-b441-0cfd88a13869 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.256709 Oct 11 01:45:06.408077 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2318/4677] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:06 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:07.419203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:07.420000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:07.431362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:07.433135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:07.437788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:07.443184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:07.444590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:07.445251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:07.804866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:07.814176 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9b94976c-d63b-4d8c-ac99-038880754332 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.399909 Oct 11 01:45:07.823667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2360/4678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:07 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:08.839700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:08.840933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:08.850356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:08.851039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:08.852020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:08.853073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:08.853689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:08.854606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:09.048414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:09.057867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d13724c-e863-4e53-8c15-b062c2289428 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1533 microversion: 2.1 time: 0.223769 Oct 11 01:45:09.075638 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2319/4679] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:08 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1533 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:10.083753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:10.085072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:10.094537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:10.095326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:10.096020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:10.096952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:10.098142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:10.098791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:10.374368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:10.383760 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-303013b0-4910-4f3d-bd13-f0499f3dd882 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1533 microversion: 2.1 time: 0.305421 Oct 11 01:45:10.386830 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2361/4680] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:10 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1533 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:11.410439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:11.411054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:11.421750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:11.422236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:11.422676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:11.433718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:11.434203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:11.434641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:11.566594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "name": "network-vif-plugged", "status": "completed", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:11.617526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:11.624119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:11.624702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:11.651907 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] Creating event network-vif-plugged:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h2-772273-9 Oct 11 01:45:11.666022 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4a0919dc-53a0-45ad-924f-0917d5673896 req-7e0d9a02-514c-4247-ada5-86a9d5b69295 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101033 Oct 11 01:45:11.667317 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2362/4681] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:45:11.773574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:11.782805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17339957-8ccd-4af9-8524-acc7bada6d7c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1533 microversion: 2.1 time: 0.376580 Oct 11 01:45:11.796378 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2320/4682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:11 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1533 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:12.814871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:12.816182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:12.836131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:12.836854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:12.837456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:12.838342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:12.838955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:12.839592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:13.421861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:13.447503 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2f84cec-43b7-4667-a6b3-59260daf70c6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.637023 Oct 11 01:45:13.449056 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2363/4683] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:12 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:13.965502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:13.970285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:13.989849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:13.991665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:13.992776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:13.996725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:13.999446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:14.000115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:14.116905 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4a274b3-ccbf-4bb6-b525-059569a3f241 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action" status: 200 len: 24577 microversion: 2.1 time: 0.151457 Oct 11 01:45:14.122006 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2321/4684] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:13 2022] POST /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c/action => generated 24577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:45:14.481795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:14.482349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:14.503655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:14.510067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:14.511541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:14.512312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:14.512908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:14.513425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:15.010391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:15.034770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fabca0b4-0dd8-436c-98f1-cd7fdcb9fa79 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.566276 Oct 11 01:45:15.035921 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2364/4685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:14 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:16.062516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:16.063625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:16.083624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:16.084109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:16.084553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:16.085335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:16.085795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:16.086280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:16.522208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:16.532663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c18645b4-f7da-41fc-9a88-0ce9bb4bf8e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.474240 Oct 11 01:45:16.533805 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2322/4686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:16 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:16.937271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dfbae06b-7eb1-4f17-960b-61241dc5c1ed tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: .version_select at 0x7f11388d0f70>, body: {"keypair": {"name": "tempest-keypair-1896116298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyA5qyVCV5sxNnFtIRVX8ISSjOKFpP9Vy3FWhIyBiSPFVmpEVdB3HQer8pAvx3J9j8C7yGIHvv+86eG/vOcXW1QJtC3O2eStNJCfQbLj4Py+fjAWCXdYJfXulG3+ARgZA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:16.984136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-dfbae06b-7eb1-4f17-960b-61241dc5c1ed tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:45:16.995290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-dfbae06b-7eb1-4f17-960b-61241dc5c1ed tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:45:17.064597 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dfbae06b-7eb1-4f17-960b-61241dc5c1ed tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.382262 Oct 11 01:45:17.066059 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2365/4687] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:45:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:17.559776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:17.560378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:17.563765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=94 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:17.584851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:17.586455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:17.587845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:17.589902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:17.591946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:17.592589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:17.885481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:17.893559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b13cd73f-a87b-4912-bd45-dc9d357510f0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.338263 Oct 11 01:45:17.898196 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2323/4688] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:18.922343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:18.923720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:18.936331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:18.938092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:18.941403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:18.942471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:18.943176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:18.943878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:19.338068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:19.360006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eaeaa8e6-cccd-469d-bceb-70ea549ec528 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.437006 Oct 11 01:45:19.375479 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2366/4689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:18 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:20.171576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1881704635", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e93cb-284f-427c-82a6-2e0f725420b8"}], "security_groups": [{"name": "tempest-securitygroup--667813196"}], "key_name": "tempest-keypair-1896116298", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:20.317753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] validate_networks() for [('859e93cb-284f-427c-82a6-2e0f725420b8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:45:20.340096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:20.340807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:20.356580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:20.357344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:20.357972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:20.359304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:20.361284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:20.362210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:20.599278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-692d9c9a-da5b-4ece-a694-be55b4f78575 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1834 microversion: 2.1 time: 0.263020 Oct 11 01:45:20.602504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2367/4690] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:20 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1834 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:20.613239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:20.615259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:20.637499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:20.637808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:20.640468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:20.645823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:20.646776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:20.648078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:21.093486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:21.107453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-442773ec-aa10-47d2-a887-7b8d23e2c2fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.503056 Oct 11 01:45:21.126137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2368/4691] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:20 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:22.099540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:45:22.100955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:45:22.101594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:45:22.102236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:45:22.116840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:45:22.131634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.132531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.133188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.134752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.135488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.136365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.150783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:22.156216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:22.177425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:45:22.197811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.198324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.198776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.199530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.199990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.200417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.211025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:45:22.264817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:45:22.267369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:45:22.373501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bfbac15-2124-40fb-b996-0af35d3b99ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.207397 Oct 11 01:45:22.375316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2324/4692] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:45:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:45:22.386401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f17028ac-eda9-4343-97f2-ced133240c1a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:22.388065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f17028ac-eda9-4343-97f2-ced133240c1a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:22.494507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f17028ac-eda9-4343-97f2-ced133240c1a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:22.504917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f17028ac-eda9-4343-97f2-ced133240c1a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1242 microversion: 2.1 time: 0.122864 Oct 11 01:45:22.509415 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2325/4693] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:22 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:22.532287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:22.545972 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c4ea287-46ee-44d8-80f9-475ccb52d884 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.405506 Oct 11 01:45:22.546583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2369/4694] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:22 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:22.746591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:22.747583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:22.756963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.767162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.767800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.770774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.771452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.772064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.779537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:22.805016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:45:22.810357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:22.810859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:22.811290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:22.875632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] Creating event network-changed:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h1-772273-9 Oct 11 01:45:22.894837 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-581167be-0d0d-47f1-baa0-679bc8fc60ba req-68f65aeb-0710-4503-8289-17e1433a22c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119551 Oct 11 01:45:22.899248 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2370/4695] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:23.002136 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42807119-889d-4409-a46f-6b5e45f5cf14 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 204 len: 0 microversion: 2.1 time: 0.259801 Oct 11 01:45:23.004125 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2326/4696] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:45:22 2022] DELETE /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:45:23.043036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:23.047224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:23.064077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:23.064669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:23.064999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:23.085909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:23.087617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:23.088045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:23.478123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:23.489490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b43d704-bfc7-4420-a164-db881ed4e28b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1689 microversion: 2.1 time: 0.458529 Oct 11 01:45:23.510307 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2371/4697] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:23 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1689 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:23.529181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe68a163-4b0d-4d36-8e3e-fb2b01a34b94 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:23.530204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe68a163-4b0d-4d36-8e3e-fb2b01a34b94 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:23.571219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:23.573249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:23.583254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:23.587132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:23.587908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:23.589015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:23.589730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:23.590400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:23.689861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe68a163-4b0d-4d36-8e3e-fb2b01a34b94 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:23.700853 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe68a163-4b0d-4d36-8e3e-fb2b01a34b94 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1242 microversion: 2.1 time: 0.175851 Oct 11 01:45:23.703471 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2327/4698] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:23 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1242 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:24.015014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:24.031851 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14d1c82f-fc78-4431-931e-a1438bef1e59 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.464148 Oct 11 01:45:24.033235 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2372/4699] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:23 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:24.529867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:24.531102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:24.546004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:24.546752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:24.547567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:24.548455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:24.550943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:24.553294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:24.726670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:24.739578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:24.746457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:24.770084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:24.770769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:24.771699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:24.774413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:24.775439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:24.887404 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 01:45:24.887404 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 01:45:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c (ip 10.222.0.66) !!! Oct 11 01:45:25.053250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:25.066671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-754994a4-6135-413c-a01c-44a4b1f5ce9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1294 microversion: 2.1 time: 0.345299 Oct 11 01:45:25.086570 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2373/4700] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:24 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1294 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:25.109028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:25.109652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:25.122786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:25.123293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:25.123763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:25.124481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:25.124939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:25.125402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:25.200055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:25.930632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:25.953052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5b45270-bb52-48be-b877-99bfee217f64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1689 microversion: 2.1 time: 1.438494 Oct 11 01:45:25.955928 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2328/4701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:24 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1689 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:26.057081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:26.074355 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a9f9eda-d934-410d-b30b-7b9b96171750 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.986589 Oct 11 01:45:26.075499 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2374/4702] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:25 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:26.098806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:26.099734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:26.115642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:26.116350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:26.116903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:26.117741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:26.118533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:26.119183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:26.275807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:26.305212 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98789e93-b7e2-4851-a080-1082e5b34d31 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1300 microversion: 2.1 time: 0.197324 Oct 11 01:45:26.306075 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2329/4703] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:26 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:26.722991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d1c589-4898-48a0-b69f-154a27947e2c", "name": "network-vif-deleted", "tag": "1f6c5663-e535-4fde-89e2-b94ba94abdfb"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:26.767912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:26.768664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:26.773509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:26.816708 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] Creating event network-vif-deleted:1f6c5663-e535-4fde-89e2-b94ba94abdfb for instance 68d1c589-4898-48a0-b69f-154a27947e2c on n-h1-772273-9 Oct 11 01:45:26.834234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b49c7421-4d54-4cf0-af3b-59dc94341c84 req-7914793c-ce9d-4943-a9f5-c8787a365b4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118747 Oct 11 01:45:26.875223 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2375/4704] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:26.982704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:26.983319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:27.006149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.009436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.011068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.013073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.016235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.016686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.093742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.094485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.095102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.095748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lazy-loading 'fault' on Instance uuid 68d1c589-4898-48a0-b69f-154a27947e2c {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:45:27.099389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:27.101374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:27.105009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:27.105870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:27.121509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.122073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.123920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.125705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.131143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.131956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.198663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:27.210194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d586331c-d58c-4898-806d-c656ab33ab22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 200 len: 1356 microversion: 2.1 time: 0.231901 Oct 11 01:45:27.216706 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2330/4705] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:26 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:27.349389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:27.352484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:27.376864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.378567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.382249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.383102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:27.383598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:27.384031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:27.544703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:27.553580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-099b00ed-7551-4c5c-89fe-59501ea95b71 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.455061 Oct 11 01:45:27.563508 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2376/4706] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:27 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:27.583328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:27.605435 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f796aba-0111-4c23-aa62-875809e12f6c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1300 microversion: 2.1 time: 0.275620 Oct 11 01:45:27.616191 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2331/4707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:27 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:28.248346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:28.249363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 68d1c589-4898-48a0-b69f-154a27947e2c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:28.275758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.282017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.282764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:28.283733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.284411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.285022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:28.319688 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] HTTP exception thrown: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Request method failure captured: Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c HTTP/1.1 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMn3D9UHXOzpoEETJuHkb0QZUhhN94qVB3YbtTqVU9y6aLSCHC2Msq2z039wPrmpCbXOiUJtC7zEV9geYJvdTi8H2HiH97eDc1TlOUK3pxqVpkdISfS5blTLYGAKVbT7sNuhRJMixvZ6uppuSZ8YTk4UsQsYfAuwtgOb2jqJk46PPks Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b6965eb3a6a74e62a184ea493c8fcb76 Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '68d1c589-4898-48a0-b69f-154a27947e2c'} Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:28.321660 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. Oct 11 01:45:28.325842 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:45:28.327383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Returning 404 to user: Instance 68d1c589-4898-48a0-b69f-154a27947e2c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:28.328497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98c6d365-48bb-40da-97e7-40f25db75b6b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c" status: 404 len: 111 microversion: 2.1 time: 0.086207 Oct 11 01:45:28.330384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2377/4708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:28 2022] GET /compute/v2.1/servers/68d1c589-4898-48a0-b69f-154a27947e2c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:45:28.584110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:28.585407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:28.609640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.610321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.611224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:28.612200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.613364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.613981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:28.653756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:28.654536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:28.670558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.671607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.672154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:28.677869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:28.678567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:28.682384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:29.205874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:29.214043 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5fb7b6d-7d39-4ac9-b33d-1a5517a69f3c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.634330 Oct 11 01:45:29.219381 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2332/4709] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:28 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:29.225769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:29.240725 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00a36a28-aaea-4d3b-99da-ce8c73104a43 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.603685 Oct 11 01:45:29.241328 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2378/4710] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:28 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:30.243018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:30.244317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:30.259839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:30.261258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:30.268215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:30.269440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:30.271306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:30.272453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:30.277878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:30.281000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:30.281658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:30.282560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:30.283205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:30.283845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:30.285696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:30.286303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:30.286878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:30.731445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:30.743151 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43339914-cff3-4d12-9c8a-48666a74fa76 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.503923 Oct 11 01:45:30.745880 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2333/4711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:30 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:30.753041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5886fe0d-cbdb-4ff6-a253-b7564c291e8c", "tag": "2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:30.770566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:30.771468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:30.772131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:30.789299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] Creating event network-changed:2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c for instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c on n-h2-772273-9 Oct 11 01:45:30.795089 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cda6701d-bae5-4a0f-a42b-b297df39b347 req-ce0f2f94-372a-4deb-a4ba-71cd27326160 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047840 Oct 11 01:45:30.795978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2334/4712] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:30.856779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:30.901450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7964b3ef-f1d6-482c-a049-b5115f7b215b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.629586 Oct 11 01:45:30.902715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2379/4713] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:30 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:31.775717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:31.777218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:31.786730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:31.787699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:31.788444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:31.789384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:31.790553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:31.791218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:31.932296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:31.934601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:31.945075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:31.946266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:31.947071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:31.948091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:31.948920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:31.949656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:32.150641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:32.345105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:32.364319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b54df40c-2748-475e-b91b-1ebfbd55ef08 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.440074 Oct 11 01:45:32.379915 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2380/4714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:31 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:32.413524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:32.422486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62eb42c1-7251-4215-a30c-48114749ec22 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.651509 Oct 11 01:45:32.423672 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2335/4715] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:31 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:33.391226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:33.391886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:33.402005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:33.402499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:33.402935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:33.403672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:33.404125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:33.404548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:33.446523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:33.447138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:33.456881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:33.457377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:33.457822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:33.458539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:33.458997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:33.459446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:33.694713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:34.230980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:34.241926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5bfbfce8-6993-47b5-a8ea-5681d9de2268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.855660 Oct 11 01:45:34.242515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2381/4716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:33 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:34.320910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:34.344787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-edc50dba-4efc-4427-a9e9-6526daed99f3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.899648 Oct 11 01:45:34.346952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2336/4717] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:33 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:35.270002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:35.270627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:35.296507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:35.298959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:35.299440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:35.305053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:35.305659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:35.306113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:35.374034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:35.375577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:35.394337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:35.395447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:35.398126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:35.399064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:35.401487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:35.402524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:35.944439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:35.953573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-710addb3-b9b1-4d6c-8aab-25cb06656d4a tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.689477 Oct 11 01:45:35.959136 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2382/4718] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:35 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:36.085322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:36.119498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53a52c0f-3d3d-4830-8894-e4739baca90b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.749038 Oct 11 01:45:36.120117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2337/4719] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:35 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:36.271452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f55e363-cbd2-4e6c-b485-a505190447a5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '.version_select at 0x7f112fbcb040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:36.306387 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f55e363-cbd2-4e6c-b485-a505190447a5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1305129086" status: 202 len: 0 microversion: 2.1 time: 0.041671 Oct 11 01:45:36.307315 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2383/4720] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 01:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1305129086 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:45:36.442580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06c48d15-4fdf-48df-bd8c-119f630b8d47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: .version_select at 0x7f112fa3f4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-929528035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6/ebgYBMJNJKzzDve8CzlyWjt2G/XYoDjdvO1j6uUS/dHwEfTfYqxplRHLU2mAzzn8x4Yff7WLWhEfkyl7MtUUmOYOupJozeP5IPsxi/1P6GKb5js2vzopiB9jGJ+zbQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:36.448336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-06c48d15-4fdf-48df-bd8c-119f630b8d47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:45:36.465895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-06c48d15-4fdf-48df-bd8c-119f630b8d47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:45:36.524956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06c48d15-4fdf-48df-bd8c-119f630b8d47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.126440 Oct 11 01:45:36.526945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2338/4721] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:45:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:36.983044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:36.984442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:37.008222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:37.008881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:37.010520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:37.013290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:37.014283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:37.015542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:37.163230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:37.166451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:37.178796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:37.181641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:37.187551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:37.188640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:37.189696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:37.190289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:37.721563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:37.731853 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-308950f7-24c9-4a2e-ac17-4b0675f561f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.753202 Oct 11 01:45:37.751671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2384/4722] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:36 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:37.762276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886fe0d-cbdb-4ff6-a253-b7564c291e8c", "name": "network-vif-plugged", "status": "completed", "tag": "2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:37.783630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:37.789096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:37.789982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:37.821942 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] Creating event network-vif-plugged:2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c for instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c on n-h2-772273-9 Oct 11 01:45:37.829777 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d5bfacb9-d56a-4c2f-95a7-c227d5eca06f req-927caab5-0679-4add-adf4-585b2cdd3764 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075220 Oct 11 01:45:37.836564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2385/4723] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:37.894508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:37.902781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be296676-b065-4756-8221-8b4ae65ac0da tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1528 microversion: 2.1 time: 0.760240 Oct 11 01:45:37.903387 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2339/4724] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:37 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1528 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:38.760301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:38.761618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:38.768290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:38.769013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:38.769630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:38.770542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:38.771170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:38.771799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:38.923145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:38.932691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:38.934575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:38.948687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8c93aec9-00ec-4180-a878-150000a03f9d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1367 microversion: 2.1 time: 0.193450 Oct 11 01:45:38.951121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2386/4725] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:38 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:38.952567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:38.953224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:38.953808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:38.954764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:38.955450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:38.956058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:39.170069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:39.178096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f612fda1-bf5f-458a-9992-79215e7cabfb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1510 microversion: 2.1 time: 0.251379 Oct 11 01:45:39.191608 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2340/4726] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:38 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:39.977565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:39.978912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:39.991076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:39.996124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:39.996706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:39.998530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:40.000286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:40.001826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:40.201420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:40.202266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:40.212112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:40.213176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:40.213811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:40.214739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:40.215438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:40.216061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:40.364656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:40.374767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83a1355a-ed6b-4150-b7e5-6377131e92c7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1556 microversion: 2.1 time: 0.403878 Oct 11 01:45:40.376047 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2387/4727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:39 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1556 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:40.411205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:40.412052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:40.418380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:40.426018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:40.426580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:40.427006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:40.427951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:40.428246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:40.428449 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43575f52-70b9-4e5c-8feb-e83204732a0a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1510 microversion: 2.1 time: 0.229392 Oct 11 01:45:40.429268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:40.429392 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2341/4728] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:40 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:40.528675 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95dff99c-deda-4912-bfb7-2e4b4ee74b69 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133845 Oct 11 01:45:40.535986 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2388/4729] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:45:40 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:45:41.457601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:41.458801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:41.491455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:41.492135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:41.493108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:41.494383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:41.495108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:41.495848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:41.726162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "name": "network-vif-unplugged", "status": "completed", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:41.751746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:41.752256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:41.755885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:41.786740 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] Creating event network-vif-unplugged:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h2-772273-9 Oct 11 01:45:41.806750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b25fab92-cef6-4673-b539-0d07baf581ef req-5a4e0871-3de6-4953-b7c4-d9c703da3c96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082569 Oct 11 01:45:41.811243 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2389/4730] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:45:41.877840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:41.889529 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa7e9218-090f-4138-8ca7-2405fc010cc6 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1510 microversion: 2.1 time: 0.440707 Oct 11 01:45:41.891102 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2342/4731] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:41 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:42.295319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5886fe0d-cbdb-4ff6-a253-b7564c291e8c", "tag": "2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:42.332189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:42.332983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:42.335526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:42.372397 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] Creating event network-changed:2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c for instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c on n-h2-772273-9 Oct 11 01:45:42.383807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8766b412-c271-4694-be9a-b884ad60b1de req-b04d55b3-e357-49bc-8f08-d0dbf0152b33 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094517 Oct 11 01:45:42.388689 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2390/4732] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:45:42.922833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:42.938060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:42.953477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:42.953982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:42.954430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:42.958778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:42.959268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:42.966193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:43.363957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:43.376487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e124487-9ed2-4d25-9c3c-67726596fb0c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1453 microversion: 2.1 time: 0.466650 Oct 11 01:45:43.379650 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2343/4733] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:42 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1453 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:43.411937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:43.411937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:43.424937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:43.425436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:43.425874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:43.426595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:43.427045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:43.427498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:43.822294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:43.844464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f699a98-27a0-4a1c-9647-2576c7aaea5f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1453 microversion: 2.1 time: 0.447057 Oct 11 01:45:43.859756 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2391/4734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:43 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1453 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:43.927255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:43.928858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:43.936539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:43.938074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:43.939575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:43.941168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:43.941819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:43.942589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:43.973037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lazy-loading 'flavor' on Instance uuid 2f68f7f4-9338-42bb-a996-015687c5a202 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:45:43.986581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'shelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state shelved_offloaded Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 14 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: {"shelve": {}} Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'shelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state shelved_offloaded Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'shelve': {}}} Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:45:43.989539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state shelved_offloaded Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state shelved_offloaded Oct 11 01:45:43.993656 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:45:43.995827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'shelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state shelved_offloaded {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:45:43.996880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ffd9006-54c8-4492-bf40-410a4e2b7dbb tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 155 microversion: 2.1 time: 0.088364 Oct 11 01:45:43.998003 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2344/4735] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:43 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 155 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:45:44.008429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:44.009675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:44.016680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:44.017867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:44.018670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:44.020479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:44.021173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:44.021614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:44.062234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120493) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 01:45:44.151801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b4dcedf-278e-4ffc-a66a-945df9690fb0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.149055 Oct 11 01:45:44.153020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2392/4736] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:45:44 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:45:44.163055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:44.163715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:44.171539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:44.172010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:44.172671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:44.173575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:44.174193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:44.176066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:44.409748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:44.420652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46a9d60c-de2c-4c46-83c5-885e1838f34e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1461 microversion: 2.1 time: 0.263221 Oct 11 01:45:44.423106 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2345/4737] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:44 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1461 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:45.451034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:45.452483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:45.464756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:45.466079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:45.466680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:45.468717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:45.470143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:45.470657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:45.798738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:45.809645 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-929e2563-2b77-4c3c-9d7d-d845992dbf77 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1461 microversion: 2.1 time: 0.362488 Oct 11 01:45:45.815739 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2393/4738] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:45 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1461 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:46.836249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:46.837082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:46.856884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-896043332", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "a042dbb9-0ded-421c-82b4-699ba939e7c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-929528035", "security_groups": [{"name": "tempest-secgroup-smoke-776505283"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:46.860973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:46.867205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:46.869427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:46.871892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:46.873296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:46.873924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:46.874511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:47.104319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] validate_networks() for [('a042dbb9-0ded-421c-82b4-699ba939e7c2', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:45:47.382779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:47.390900 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c3a5b75-2646-4870-9a03-a24722edfc4b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.560106 Oct 11 01:45:47.391518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2346/4739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:46 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:48.082752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:45:48.094203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:45:48.094716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:45:48.095287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:45:48.097095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:45:48.097779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:45:48.100965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:48.102782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:48.103262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:48.103886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:48.113736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:48.121977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:48.123025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:48.123803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:48.124452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:48.125136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:48.132654 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] Creating event network-changed:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h1-772273-9 Oct 11 01:45:48.151383 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3a31b03c-e8c6-4544-9502-1a9e586d4f5e req-7a54873a-253b-4ee3-997d-c4904c4e8591 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072863 Oct 11 01:45:48.152478 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2347/4740] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:45:48.177100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:45:48.190220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:45:48.218590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:45:48.221911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:45:48.312194 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-caef8e90-4dd0-46ae-b23e-9f60ee99566f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.459268 Oct 11 01:45:48.319076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2394/4741] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:45:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:45:48.326581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-996b3cba-dc6a-4db5-81cb-0f4f08514f68 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:48.327524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-996b3cba-dc6a-4db5-81cb-0f4f08514f68 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:48.418281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:48.419139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:48.438087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:48.438986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:48.443853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:48.444867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:48.445529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:48.446482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:48.477423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:48.661725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-996b3cba-dc6a-4db5-81cb-0f4f08514f68 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:48.671555 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-996b3cba-dc6a-4db5-81cb-0f4f08514f68 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1265 microversion: 2.1 time: 0.350001 Oct 11 01:45:48.688890 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2348/4742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:48 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:49.522705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:49.536720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67ad78ae-69fe-4095-89f7-ae0b4d1fda91 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 1.124478 Oct 11 01:45:49.537506 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2395/4743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:48 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:49.699536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:49.701962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:49.728129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:49.730845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:49.731331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:49.732121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:49.732604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:49.735257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:49.926931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:49.940627 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e122bd7-f668-4b70-8f34-9a0802eb720a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1317 microversion: 2.1 time: 0.247975 Oct 11 01:45:49.941681 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2349/4744] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:49 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:50.565085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:50.566319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:50.578183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:50.578696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:50.579135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:50.580005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:50.580475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:50.581028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:50.967160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:50.967815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:50.985948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:50.992271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:50.992785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:50.997516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:51.000005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:51.001836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:51.082460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:51.367079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:51.383016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:51.388624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0b1a95b-e5f9-4ff6-9c10-84248c4f9141 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1323 microversion: 2.1 time: 0.424821 Oct 11 01:45:51.389668 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2350/4745] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:50 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:51.393987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2df6868f-8632-46fe-83bc-13693cfb08fe tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.832294 Oct 11 01:45:51.425182 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2396/4746] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:50 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:52.418758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:52.420070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:52.432428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:52.433085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:52.439082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:52.443848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:52.444337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:52.444771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:52.445469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:52.445920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:52.446338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:52.447818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:52.449301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:52.458569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:52.459068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:52.459554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:52.769455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:52.783903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ce9c9ff-c2c5-4689-8506-eb05823faab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.369323 Oct 11 01:45:52.785354 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2351/4747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:52 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:52.844757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:52.866967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b88c13ac-40c4-4534-a772-3ea80264d8c4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.430837 Oct 11 01:45:52.883607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2397/4748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:52 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:53.809105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:53.809852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:53.817035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:53.817518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:53.817956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:53.818655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:53.819108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:53.819567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:53.890051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:53.890643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:53.920738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:53.923703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:53.925540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:53.928879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:53.930446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:53.930995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:54.137489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:54.148218 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2225c06c-8a01-4b25-beef-088f95c1cdb1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.340900 Oct 11 01:45:54.149637 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2352/4749] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:53 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:54.169634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:54.184071 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61aaaf2a-efb6-450d-8c40-8a3f4c442001 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.297726 Oct 11 01:45:54.185228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2398/4750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:53 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:55.301085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:55.306053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:55.626581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:55.630535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:55.637993 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11f3a88f-d106-4c80-ad6c-2ec977c81631 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.467341 Oct 11 01:45:55.639714 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2353/4751] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:55 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:55.667004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e9e5bc4-084a-4858-a855-adbf30e4a00e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.462416 Oct 11 01:45:55.667968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2399/4752] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:55 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:56.664825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:56.666043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:56.676391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:56.677496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:56.678575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:56.679686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:56.680565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:56.681223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:56.702233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:56.702840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:56.725882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:56.730211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:56.730989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:56.733604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:56.737498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:56.739517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:57.047898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:57.062726 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2fb97cc-b701-498b-ba30-e39f003d43ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.401733 Oct 11 01:45:57.064122 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2354/4753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:56 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:57.134428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:57.142437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eed7019e-c0b2-4621-a685-c502cf04f106 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.444247 Oct 11 01:45:57.143024 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2400/4754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:56 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:58.088873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:58.089484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:58.109121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:58.109742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:58.110255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:58.111048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:58.111877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:58.112914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:58.165951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:58.167246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:58.190048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:58.192340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:58.192923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:58.195319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:58.195319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:58.196161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:58.196857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:58.206661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:58.363023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:58.372380 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-137837a1-1bca-4373-a0e6-63406e721aab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.287281 Oct 11 01:45:58.375139 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2355/4755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:58 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:58.481350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:58.495421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbd93844-dca4-49d8-a7ae-961dad34fb45 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.329242 Oct 11 01:45:58.528468 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2401/4756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:58 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:45:59.403711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:59.404336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:59.408010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:45:59.413400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:59.413944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:59.414393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:59.415111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:59.415608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:59.416037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:59.546227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:45:59.554464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:45:59.576842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:59.577384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:59.578136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:59.578863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:45:59.578973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:59.579324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:45:59.579779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:45:59.590973 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-949ee0e6-90a8-4f89-8222-bd49064403f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.191261 Oct 11 01:45:59.605929 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2356/4757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:59 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:45:59.738710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:45:59.747159 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-34bc6355-b511-4da0-88cc-6a7ec9732b60 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.209418 Oct 11 01:45:59.747934 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2402/4758] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:45:59 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:00.515611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:00.526451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:00.527034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:00.528445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:00.540749 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] Creating event network-changed:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:46:00.545957 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f3905c00-2a55-46ee-9a23-e71b8e7451af req-05edee6b-f48e-40d7-bd5f-66b348763b4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Oct 11 01:46:00.547142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2357/4759] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:00.615469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:00.616080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:00.618872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:00.624164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:00.624768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:00.625193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:00.626563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:00.627478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:00.628130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:00.775023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:00.775618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:00.776710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:00.782388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:00.782897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:00.783589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:00.785499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:00.786137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:00.786265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07825081-71f0-412d-9352-07434268698d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.175516 Oct 11 01:46:00.786865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:00.787102 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2403/4760] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:00 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:00.937714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:00.946064 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb5db083-0682-407e-9b22-5522ad2e65b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.176132 Oct 11 01:46:00.947132 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2358/4761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:00 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:01.810499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:01.811843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:01.820043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:01.820537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:01.820980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:01.821690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:01.822147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:01.822572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:01.970258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:01.971973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:01.979081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:01.985259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:01.986105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:01.987738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:01.989042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:01.989652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:01.990331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:01.994893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a90a65cc-13ce-489c-86a4-683aeb40d939 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.188134 Oct 11 01:46:01.995764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2404/4762] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:01 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:02.211292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:02.220710 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3184aab2-ada5-4554-96a5-69220c6722e3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.254497 Oct 11 01:46:02.221482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2359/4763] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:01 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:03.022917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:03.023564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:03.031265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:03.031798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:03.032442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:03.033935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:03.034681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:03.035198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:03.246473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:03.249103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:03.259227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:03.259894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:03.260427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:03.261385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:03.261538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:03.262035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:03.262560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:03.269570 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f8aa31c-4d60-40b6-aadf-bc0c4e5a7396 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.251415 Oct 11 01:46:03.270162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2405/4764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:03 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:03.469319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:03.478737 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-da18260f-0c83-4bc6-a0e2-83524198feee tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.236761 Oct 11 01:46:03.479643 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2360/4765] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:03 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:04.295973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:04.296816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:04.304044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:04.304611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:04.305242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:04.305950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:04.306507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:04.307134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:04.468991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:04.480677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9fc3c6d4-53b2-4a7a-ab71-6437b72f0f22 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.188451 Oct 11 01:46:04.484312 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2406/4766] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:04 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:04.507153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:04.507836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:04.515744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:04.516445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:04.516878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:04.517584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:04.518125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:04.519205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:04.670589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:04.688655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8b965d8-74db-4573-81ec-2c4b81488989 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.188839 Oct 11 01:46:04.689269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2361/4767] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:04 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:05.455332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "name": "network-vif-plugged", "status": "completed", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:05.472892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:05.473730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:05.474435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:05.493037 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] Creating event network-vif-plugged:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h1-772273-9 Oct 11 01:46:05.500826 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3d45d1af-3e8b-4c6c-9150-7d8257f501a0 req-68455b5a-50dc-4068-b4e9-26010d0170f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049744 Oct 11 01:46:05.525853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:05.526786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:05.531680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2407/4768] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:05.536353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:05.537267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:05.539082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:05.539741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:05.540603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:05.541127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:05.727156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:05.728503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:05.738754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:05.739442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:05.740055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:05.741156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:05.741766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:05.742345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:05.760669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:05.775642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa237236-1e5d-438b-80a6-1d92ced0f575 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.269507 Oct 11 01:46:05.787378 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2362/4769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:05 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:05.929853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:05.938390 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-293c10d8-a772-4616-82c0-4c77a60cb79c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.217010 Oct 11 01:46:05.938997 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2408/4770] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:05 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:06.803931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:06.804563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:06.827554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:06.828249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:06.828788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:06.829613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:06.830180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:06.830712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:06.965958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:06.966568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:06.978288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:06.982035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:06.983924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:06.984547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:06.985460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:06.986080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:06.986957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:07.003697 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18f8697c-4626-4ec6-a389-072400f6586a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.194058 Oct 11 01:46:07.004356 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2363/4771] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:06 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:07.181528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:07.191968 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-74ea6ce9-0e6b-4c4a-9299-61dfed15eae0 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1519 microversion: 2.1 time: 0.231592 Oct 11 01:46:07.193857 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2409/4772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:06 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:07.532054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-plugged", "status": "completed", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:07.545072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:07.545569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:07.546010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:07.561588 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] Creating event network-vif-plugged:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:46:07.568314 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0dc66bc6-f567-4f92-b169-b70e7f343c07 req-3a74e45f-73c1-4798-bfea-13f468d0f366 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040355 Oct 11 01:46:07.569495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2364/4773] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:46:08.027961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:08.029406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:08.049138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.049688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.050656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.051394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.051854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.052282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.286451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:08.286451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f246b58c-7cb1-4ce6-a78d-3d340b65c993 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1390 microversion: 2.1 time: 0.222370 Oct 11 01:46:08.286451 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2410/4774] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:08 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.375410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.491148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:08.499210 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d90b0ae8-1529-4a1c-8ba9-52f19590df99 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.286314 Oct 11 01:46:08.499837 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2365/4775] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:08 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:08.524797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:08.526117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:08.534270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.535001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.535620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.536356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.536916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.537413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.688681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:08.698103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3db6bb58-ab89-4a71-a013-de43d139d59a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.179147 Oct 11 01:46:08.699239 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2411/4776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:08 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:08.735169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:08.735814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:08.743970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.744737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.745346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.746242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:08.746699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:08.747117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:08.930790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:08.938537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c59e14ee-8668-4e0e-b6e6-413dd7d46881 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.213144 Oct 11 01:46:08.939442 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2366/4777] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:08 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:08.961764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f640e0a8-0b2f-416d-8faf-87f22f2612f2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:08.967576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f640e0a8-0b2f-416d-8faf-87f22f2612f2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f640e0a8-0b2f-416d-8faf-87f22f2612f2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/a39b5aba-4689-4339-88a6-25538acfc200/action HTTP/1.1 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 15 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: {"os-stop": {}} Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'a39b5aba-4689-4339-88a6-25538acfc200', 'body': {'os-stop': {}}} Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:08.984443 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. Oct 11 01:46:08.990126 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:08.991925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f640e0a8-0b2f-416d-8faf-87f22f2612f2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance a39b5aba-4689-4339-88a6-25538acfc200 has no mapping to a cell. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:08.992828 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f640e0a8-0b2f-416d-8faf-87f22f2612f2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/a39b5aba-4689-4339-88a6-25538acfc200/action" status: 404 len: 117 microversion: 2.1 time: 0.035089 Oct 11 01:46:08.993417 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2412/4778] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:08 2022] POST /compute/v2.1/servers/a39b5aba-4689-4339-88a6-25538acfc200/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:09.001786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.002510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.014322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.015054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.015566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.016271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.016725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.017319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.171602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.181189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c03e4a72-a1d3-468d-bee3-a58198535a1e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.183336 Oct 11 01:46:09.181783 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2367/4779] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:08 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:09.203865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.204487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.213508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.214005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.214616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.215346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.215887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.216314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.273235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.274028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.281821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.282574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.283511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.285295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.286029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.286668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.306418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:09.445716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.449658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:09.454876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b0f85a6e-9f81-43b2-b924-267eea27971f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.254779 Oct 11 01:46:09.456595 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2413/4780] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:09 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:09.479264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.481365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:09.481914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2230c9a6-a83d-4fc0-970d-3d2a87b519c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.489470 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. Oct 11 01:46:09.489689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-445b7d77-908c-40c1-9ac1-211804eda20c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1562 microversion: 2.1 time: 0.222042 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/2230c9a6-a83d-4fc0-970d-3d2a87b519c1/action HTTP/1.1 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 15 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: {"suspend": {}} Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2230c9a6-a83d-4fc0-970d-3d2a87b519c1', 'body': {'suspend': {}}} Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:09.491658 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 2230c9a6-a83d-4fc0-970d-3d2a87b519c1 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4d1dcad-a165-45f6-b921-6084405a6d44 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2230c9a6-a83d-4fc0-970d-3d2a87b519c1/action" status: 404 len: 111 microversion: 2.1 time: 0.016116 Oct 11 01:46:09.499083 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2414/4781] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:09 2022] POST /compute/v2.1/servers/2230c9a6-a83d-4fc0-970d-3d2a87b519c1/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:09.499555 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2368/4782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:09 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:09.502640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.503898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.511490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.511994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.512438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.513153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.513611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.514037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.515488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.516063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.524118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.524890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.525328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.526049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.526499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.526928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.745725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.754384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.759582 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-297e1f86-cf64-41a2-9246-4c5a9a732b78 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1562 microversion: 2.1 time: 0.248305 Oct 11 01:46:09.760721 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2369/4783] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:09 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:09.763267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0bbc381a-6df7-48b6-9f34-b23ce86c585d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.264508 Oct 11 01:46:09.764064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2415/4784] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:09 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:09.794474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:09.795447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:09.803391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.803897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.804380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.805253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:09.805638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:09.806535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:09.973159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:09.981341 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-573f063d-31b1-43af-a254-08f3164f3833 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.192633 Oct 11 01:46:09.981949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2370/4785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:09 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:10.006441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:10.007073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:10.013660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:10.014159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:10.014599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:10.015307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:10.015797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:10.016404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:10.041297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lazy-loading 'flavor' on Instance uuid 2f68f7f4-9338-42bb-a996-015687c5a202 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:46:10.138831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c91d95ba-637f-40e9-becf-7960ed95ac75 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.137869 Oct 11 01:46:10.142575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2416/4786] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:09 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:46:10.148363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:10.148882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:10.157942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:10.158608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:10.159077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:10.160032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:10.160696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:10.161764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:10.334615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:10.359240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-919038ac-65bf-4ca6-84b6-5a3ab5292c4c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1514 microversion: 2.1 time: 0.214939 Oct 11 01:46:10.380363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2371/4787] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:10 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:11.389298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:11.390732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:11.397697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.398561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.399189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.400142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.400826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.401503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.578747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:11.588794 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50184dc6-20c3-49dc-a9c3-e6b14901d6b1 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1497 microversion: 2.1 time: 0.204119 Oct 11 01:46:11.589907 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2417/4788] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:11 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:11.612686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:11.615886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:11.631736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.632228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.632834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.633686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.634125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.634549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.665139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lazy-loading 'flavor' on Instance uuid 2f68f7f4-9338-42bb-a996-015687c5a202 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:46:11.680243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'suspend' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state suspended Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 15 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: {"suspend": {}} Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'suspend' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state suspended Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'suspend': {}}} Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 11 01:46:11.682138 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state suspended Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state suspended Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'suspend' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state suspended {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e95b6cc1-a3c5-4ef1-ad20-863cbe8ec8c8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 148 microversion: 2.1 time: 0.075349 Oct 11 01:46:11.689938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2372/4789] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:11 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 148 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:46:11.692727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:11.693266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:11.699326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.699867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.700306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.701010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.701479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.701894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.791184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7fa83358-c5cf-4ee3-b24b-784cee1bc61c tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 202 len: 0 microversion: 2.1 time: 0.102128 Oct 11 01:46:11.792095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2418/4790] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:11 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:46:11.806305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:11.807208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:11.814336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.815054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.816247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:11.825312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:11.825755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:11.826240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:12.038798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:12.039889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:12.049354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:12.053577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:12.054071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:12.054809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:12.055275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:12.056439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:12.056721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:12.066597 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3590066-a26b-4979-902b-df22ca996c9a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1503 microversion: 2.1 time: 0.266265 Oct 11 01:46:12.068018 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2373/4791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:11 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:12.086172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:12.108694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:12.109618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:12.113168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:12.155101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] Creating event network-changed:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:46:12.164670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a8def99c-5008-49fa-ac1c-ea2f699705de req-6a0b623d-6761-4d6a-9acd-a82969581ec9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089099 Oct 11 01:46:12.164670 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2374/4792] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:12.342720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:12.352978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2fbea768-f956-49de-973b-6d4bb6804cd9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1562 microversion: 2.1 time: 0.318268 Oct 11 01:46:12.358183 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2419/4793] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:12 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1562 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:13.092574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:13.093294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:13.111206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:13.112010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:13.112531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:13.113264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:13.113735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:13.114171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:13.567560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:13.590882 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7999345-291a-4ddf-bfec-4e62d5546874 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1503 microversion: 2.1 time: 0.502480 Oct 11 01:46:13.600343 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2375/4794] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:13 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:14.625997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:14.627154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:14.645912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:14.647598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:14.648660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:14.650706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:14.651200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:14.651712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:14.849713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:14.857720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba1152fb-0342-49ab-94a0-7b36564d1a8b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.235638 Oct 11 01:46:14.858847 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2420/4795] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:14 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:14.882042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:14.882653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:14.889748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:14.890468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:14.890910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:14.891649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:14.892104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:14.892713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.047641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:15.056942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b35e5589-d4ab-4775-8ddd-ea2bbdb0327b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.179528 Oct 11 01:46:15.057523 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2376/4796] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:14 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:15.080114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:15.080653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 9262441b-e3bf-407c-9eec-16e65a13527e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.086766 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/9262441b-e3bf-407c-9eec-16e65a13527e/action HTTP/1.1 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 15 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: {"unpause": {}} Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9262441b-e3bf-407c-9eec-16e65a13527e', 'body': {'unpause': {}}} Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.088495 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 9262441b-e3bf-407c-9eec-16e65a13527e could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ccb7402e-c84c-400e-8e35-2923d9133da8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/9262441b-e3bf-407c-9eec-16e65a13527e/action" status: 404 len: 111 microversion: 2.1 time: 0.014371 Oct 11 01:46:15.097414 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2421/4797] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:15 2022] POST /compute/v2.1/servers/9262441b-e3bf-407c-9eec-16e65a13527e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:15.101985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:15.102653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.109371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.109865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.110311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.111005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.111750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.112726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.260206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:15.270626 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbdb3473-ad4d-4756-ad50-70b7827c7687 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.172940 Oct 11 01:46:15.271442 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2377/4798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:15.294761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:15.295439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.303398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.303908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.304554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.305268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.305711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.306290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.457655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:15.467004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e66ae98-79e9-4025-a052-3566d7fe282e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.176740 Oct 11 01:46:15.471374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2422/4799] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:15.490735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:15.491563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.498032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.498696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.499288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.500534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.501150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.501755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.534598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'unpause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 15 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: {"unpause": {}} Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'unpause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'unpause': {}}} Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state active. Cannot unpause while the instance is in this state. Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.536782 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'unpause' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca768e81-1557-40bf-a87a-1df59343883e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 145 microversion: 2.1 time: 0.051829 Oct 11 01:46:15.546628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2378/4800] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:15 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:46:15.550059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:15.550782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.557142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.557677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.558097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.558802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.559273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.559743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.720017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:15.728990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a965d4f2-9ff7-43be-9a3d-8a373ac122c3 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.183903 Oct 11 01:46:15.748482 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2423/4801] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:15.756846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:15.757596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.764573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.765141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.765651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.766424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.767135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.767668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.930479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:15.939776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c1b4fb9-9576-4c0a-9474-2c07ca1d8594 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.187539 Oct 11 01:46:15.940919 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2379/4802] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:15.962241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:15.963134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.969072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd/action HTTP/1.1 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 18 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: {"unshelve": null} Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd', 'body': {'unshelve': None}} Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.971068 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a10c909a-78d2-449d-a9ad-c83de08a5b43 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd/action" status: 404 len: 111 microversion: 2.1 time: 0.015017 Oct 11 01:46:15.976234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2424/4803] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:15 2022] POST /compute/v2.1/servers/b12d9b70-32ee-4cb3-8cca-50fae0ecdbfd/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:15.982405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:15.983017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:15.990007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.990498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.990934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:15.991679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:15.992132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:15.992562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.151945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:16.160440 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d58110d0-af47-4645-abd2-a01a63256166 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.181732 Oct 11 01:46:16.161953 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2380/4804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:15 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:16.187121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:16.187620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.195758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.196255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.196694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.197406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.197857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.198280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.338813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:16.347845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b61d4c47-9496-4939-9e25-751439b3e5f8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.164814 Oct 11 01:46:16.351484 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2425/4805] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:16 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:16.373867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:16.374662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.381150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.381844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.382440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.383305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.383992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.384565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.476869 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Cannot 'unshelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action HTTP/1.1 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 18 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: {"unshelve": null} Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: exception: Cannot 'unshelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'unshelve': None}} Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 in vm_state active. Cannot unshelve while the instance is in this state. Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 01:46:16.479431 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 409 to user: Cannot 'unshelve' instance 2f68f7f4-9338-42bb-a996-015687c5a202 while it is in vm_state active {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:16.484087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22cc783d-1849-4d6a-951c-4f11e02b5b5a tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action" status: 409 len: 146 microversion: 2.1 time: 0.111153 Oct 11 01:46:16.485963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2381/4806] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:16 2022] POST /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202/action => generated 146 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:46:16.492310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:16.493064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.499894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.500370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.501022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.501888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.502433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.503615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.657846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:16.666453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-253838f7-abc5-40ea-96f5-0dfbd4982a72 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.177992 Oct 11 01:46:16.667028 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2426/4807] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:16 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:16.690396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:16.691020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.704408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.704921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.705362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.706893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.707557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.708147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.869629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:16.878455 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6fa4cc9c-36b9-48f0-800c-9546ee4eb3b8 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.192756 Oct 11 01:46:16.879225 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2382/4808] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:16 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:16.902807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-379550631_updated"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:16.905368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 45f11e01-a313-4206-819e-9ea9cc069ea8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.911672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/servers/45f11e01-a313-4206-819e-9ea9cc069ea8 HTTP/1.1 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 80 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-379550631_updated"}} Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '45f11e01-a313-4206-819e-9ea9cc069ea8', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-379550631_updated'}}} Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 01:46:16.913254 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 45f11e01-a313-4206-819e-9ea9cc069ea8 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:16.917785 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7289360-6ba7-45fe-a2a3-9860d0c18bef tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "PUT /compute/v2.1/servers/45f11e01-a313-4206-819e-9ea9cc069ea8" status: 404 len: 111 microversion: 2.1 time: 0.016146 Oct 11 01:46:16.919640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2427/4809] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:46:16 2022] PUT /compute/v2.1/servers/45f11e01-a313-4206-819e-9ea9cc069ea8 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:16.923722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:16.924349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:16.932012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.932664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.932932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:16.933878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:16.934338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:16.935285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.093088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:17.101913 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab3538af-2cb3-443e-9b6b-ef3e7cda84c7 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.182162 Oct 11 01:46:17.102717 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2383/4810] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:16 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:17.126054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:17.127646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:17.137911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.138422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.139309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.140041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.140671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.141261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.279785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:17.288284 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de362fcc-92f0-41b3-9fe6-cf5ac42eb4d4 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.165999 Oct 11 01:46:17.288863 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2428/4811] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:17.311816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44256912-e465-427a-b5ba-a9d654b97ab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44256912-e465-427a-b5ba-a9d654b97ab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: request: PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 HTTP/1.1 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 280 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.316824 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44256912-e465-427a-b5ba-a9d654b97ab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44256912-e465-427a-b5ba-a9d654b97ab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 400 len: 619 microversion: 2.1 time: 0.011007 Oct 11 01:46:17.320610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2384/4812] 10.222.0.66 () {60 vars in 1257 bytes} [Tue Oct 11 01:46:17 2022] PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:46:17.328083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:17.328781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:17.335020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.335555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.336005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.336719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.337176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.337606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.471068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:17.479488 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c3e77124-77a1-4d6d-8e95-ec1ed02c94b2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.155330 Oct 11 01:46:17.480240 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2429/4813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:17.502298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:17.502948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:17.509762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.510262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.510717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.511451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.511912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.512343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.657401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:17.666344 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e29f8b9-d443-4213-88c1-aeaab703720e tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.167839 Oct 11 01:46:17.666930 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2385/4814] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:17.688831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d49e2d0-524b-47a4-8d30-20b53d43efd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d49e2d0-524b-47a4-8d30-20b53d43efd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: request: PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 HTTP/1.1 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 24 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: {"server": {"name": ""}} Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202', 'body': {'server': {'name': ''}}} Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '' Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 01:46:17.692691 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 01:46:17.696567 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:17.698951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d49e2d0-524b-47a4-8d30-20b53d43efd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:17.699910 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d49e2d0-524b-47a4-8d30-20b53d43efd5 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 400 len: 108 microversion: 2.1 time: 0.015110 Oct 11 01:46:17.700506 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2430/4815] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:46:17 2022] PUT /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:46:17.709346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:17.710126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:17.716379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.716871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.717451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.718005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:17.718458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:17.719111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:17.867220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:17.878510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6241df7d-84db-4270-958d-d154b7c71749 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1506 microversion: 2.1 time: 0.172528 Oct 11 01:46:17.878863 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2386/4816] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:17 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:23.633091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:23.633925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:23.642210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.642841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.643527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.645048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.645518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.645953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.661088 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d HTTP/1.1 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '226a7aaf-0c49-441a-bf3d-b936db3db16d'} Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:23.662882 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-130b3ba5-cf55-434e-bf9e-8858d74ee294 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 404 len: 111 microversion: 2.1 time: 0.037519 Oct 11 01:46:23.670396 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2431/4817] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:46:23 2022] DELETE /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:23.673802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:23.674427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 226a7aaf-0c49-441a-bf3d-b936db3db16d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:23.680396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=80 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:23.685444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.685950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.686452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.687203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.688027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.688643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.706001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d HTTP/1.1 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '226a7aaf-0c49-441a-bf3d-b936db3db16d'} Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:23.707539 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 226a7aaf-0c49-441a-bf3d-b936db3db16d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa937c92-9f05-4736-81f6-f61f96e3368d tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d" status: 404 len: 111 microversion: 2.1 time: 0.040391 Oct 11 01:46:23.714601 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2387/4818] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:23 2022] GET /compute/v2.1/servers/226a7aaf-0c49-441a-bf3d-b936db3db16d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:23.720987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:23.721540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:23.729382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.729865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.730293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.730980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.731499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.731922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.759809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:46:23.790178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:23.862684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58a25e26-41a6-4b3b-b893-e129517b663b tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 204 len: 0 microversion: 2.1 time: 0.144501 Oct 11 01:46:23.863287 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2432/4819] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:46:23 2022] DELETE /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:46:23.872681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:23.874688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:23.881437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.882073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.892671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.893451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:23.894421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:23.895114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:23.904127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:24.076533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:24.085761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-293cbaf0-374f-4edd-97a7-c62b9b76494f tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.217720 Oct 11 01:46:24.087089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2388/4820] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:23 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:25.110652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:25.111374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:25.119506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:25.119998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:25.120462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:25.121154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:25.121783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:25.122209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:25.281873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:25.291722 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-491f9cf2-ad59-44ca-987b-724dcdabb890 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1512 microversion: 2.1 time: 0.185225 Oct 11 01:46:25.299067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2433/4821] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:25 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:26.315745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:26.316270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:26.323444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:26.324220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:26.325139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:26.326105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:26.326857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:26.327498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:26.404331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84e5d52223d4e619215f19c344340b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b40f22614f41815b064d15eefa0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:26.419598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8118312-1cf3-4ea0-827f-1ee8a1d5dab2 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 200 len: 1470 microversion: 2.1 time: 0.107846 Oct 11 01:46:26.432228 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2389/4822] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:26 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 1470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:26.529230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f68f7f4-9338-42bb-a996-015687c5a202", "name": "network-vif-deleted", "tag": "358ef171-71bf-4ee2-b4f3-c35257a5f19f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:26.545339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:26.546322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:26.546962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:26.563652 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] Creating event network-vif-deleted:358ef171-71bf-4ee2-b4f3-c35257a5f19f for instance 2f68f7f4-9338-42bb-a996-015687c5a202 on n-h1-772273-9 Oct 11 01:46:26.570501 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-46d84a6a-0dd9-4f7d-b988-c3eb0b100eb3 req-4b079cc5-59bb-45ee-a384-cb1a68355293 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Oct 11 01:46:26.571671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2434/4823] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:27.444578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:27.445263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] [instance: 2f68f7f4-9338-42bb-a996-015687c5a202] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:27.452889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:27.453388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:27.453830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:27.454542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:27.455369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:27.455815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:27.469876 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] HTTP exception thrown: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Request method failure captured: Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 HTTP/1.1 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpoIJfw5N96HgNBl10HQlTPkCxEUNcq321bzzOpZ-_Ke9qiur_7oaqDQwa0BAhi2f49RDT3GiUOYxsqN5HIYZIvL5s-LzNvvG5uS4wf2V6qGgj2EPvrgplqnWF8wENn27ZgPUt9W5L8M-FEu1S5CUHEobxmTmtFHdSecQwJ2tqFQo0 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7f36b40f22614f41815b064d15eefa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7f36b40f22614f41815b064d15eefa0c Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2071864409 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b84e5d52223d4e619215f19c344340b1 Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-2071864409-project Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '2f68f7f4-9338-42bb-a996-015687c5a202'} Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:46:27.471460 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] Returning 404 to user: Instance 2f68f7f4-9338-42bb-a996-015687c5a202 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:46:27.475867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-546b64b9-e195-4ab7-8153-7ace00e4b222 tempest-ServersNegativeTestJSON-2071864409 tempest-ServersNegativeTestJSON-2071864409-project] 10.222.0.66 "GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202" status: 404 len: 111 microversion: 2.1 time: 0.032788 Oct 11 01:46:27.476978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2390/4824] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:27 2022] GET /compute/v2.1/servers/2f68f7f4-9338-42bb-a996-015687c5a202 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:46:29.321914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3947381-8a5c-4abd-92ad-d73274cd0af3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Action: 'create', calling method: .version_select at 0x7f1138970280>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1965077558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNJi4HfKAny1kuKDYC7kQggazI0TxCmtCx2jxASSnTIVVpejtfxTctjqZgcNS8Aq3+yFkzrQ9tbeRlqJaYotoqGclcAGpjMyBnEu5KbcwV2GhpNkQUqA13eY+sYorQrrQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:29.341921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f3947381-8a5c-4abd-92ad-d73274cd0af3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Getting quotas for project dd1077476ea1424b8d7cb1183da19c20. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:46:29.350035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f3947381-8a5c-4abd-92ad-d73274cd0af3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Getting quotas for user 122cfc7febc2449b9c58eb84c9c1ecfa and project dd1077476ea1424b8d7cb1183da19c20. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:46:29.383224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3947381-8a5c-4abd-92ad-d73274cd0af3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067631 Oct 11 01:46:29.389874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2435/4825] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:46:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:30.746748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1611110230", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1e086aee-afdf-4069-a6ab-ff426a4413bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1965077558", "security_groups": [{"name": "tempest-secgroup-smoke-2109551379"}], "networks": [{"uuid": "4d3596a1-96ad-4d59-97b9-bb61a49c19eb"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:30.958237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] validate_networks() for [('4d3596a1-96ad-4d59-97b9-bb61a49c19eb', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:46:31.507055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:46:31.507850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:46:31.509558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:46:31.509558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:46:31.510014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:46:31.521820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:31.522541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:31.523214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:31.524329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:31.525003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:31.525647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:31.547287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Getting quotas for project dd1077476ea1424b8d7cb1183da19c20. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:46:31.558929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Getting quotas for user 122cfc7febc2449b9c58eb84c9c1ecfa and project dd1077476ea1424b8d7cb1183da19c20. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:46:31.648730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:46:31.650906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e086aee-afdf-4069-a6ab-ff426a4413bf',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:46:31.803274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3195565-ffe7-4c53-8bd9-c04b4b0a57fd tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.060648 Oct 11 01:46:31.805080 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2391/4826] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:46:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:46:31.816708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c51d0323-0d37-43f7-99fc-ff2b69be8876 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:31.818055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c51d0323-0d37-43f7-99fc-ff2b69be8876 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:31.821180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:31.912916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c51d0323-0d37-43f7-99fc-ff2b69be8876 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:31.931151 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c51d0323-0d37-43f7-99fc-ff2b69be8876 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1099 microversion: 2.1 time: 0.118853 Oct 11 01:46:31.946732 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2436/4827] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:31 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1099 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:32.954416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:32.955784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:32.975542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:32.976478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:32.977611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:32.979758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:32.980742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:32.982108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:33.081791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:33.081791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:33.091236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:33.092002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:33.092465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:33.093177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:33.096448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:33.098455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:33.133750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:46:33.142691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:33.153764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ff5bdec-78c7-4b48-aab2-6ae43b6c2219 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1205 microversion: 2.1 time: 0.203411 Oct 11 01:46:33.154831 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2437/4828] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:32 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1205 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:33.261319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01f1301a-b083-4221-99e1-0d4a649ce698 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 204 len: 0 microversion: 2.32 time: 0.534862 Oct 11 01:46:33.263475 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2392/4829] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:46:32 2022] DELETE /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:46:33.273137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:33.276524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:33.290260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:33.290780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:33.292461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:33.293215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:33.293687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:33.294120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:33.839014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:33.859534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:33.865318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:33.867864 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1fb3d2a0-c468-456b-900e-8fbcdf0511cc tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2958 microversion: 2.32 time: 0.599781 Oct 11 01:46:33.868802 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2438/4830] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:33 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2958 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:34.178199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:34.179106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:34.195014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:34.195542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:34.195983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:34.196755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:34.197207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:34.198615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:34.788688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:34.802280 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-802ab00d-4a51-4dec-bbc7-d6bc03fd2c78 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1283 microversion: 2.1 time: 0.627860 Oct 11 01:46:34.804957 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2393/4831] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:34 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1283 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:34.898907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:34.904779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:34.912712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:34.913208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:34.913855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:34.914731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:34.915421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:34.916218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:35.320335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:35.334452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:35.335986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:35.337413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8c47030-696b-4d16-ae3c-cc074defea6a tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2958 microversion: 2.32 time: 0.442711 Oct 11 01:46:35.338369 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2439/4832] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:34 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2958 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:35.836051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:35.838437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:35.848467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:35.849423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:35.850088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:35.851153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:35.851890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:35.853177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:36.228040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:36.248620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:36.252392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:36.255761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:36.256408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:36.263296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb221eca-8423-4397-97da-11925ee1297b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1283 microversion: 2.1 time: 0.436879 Oct 11 01:46:36.265766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2394/4833] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:35 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1283 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:36.282832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] Creating event network-changed:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:46:36.288382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-eabb6dca-57b1-4b8c-b05a-59a1095035c9 req-6e49cee0-debc-41fc-877e-a9e399c145c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067310 Oct 11 01:46:36.289607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2440/4834] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:36.369445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:36.370071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:36.380643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:36.381674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:36.382199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:36.382929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:36.383426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:36.384066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:36.930884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:36.937080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:36.955261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:36.956468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:36.957057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:36.957932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:36.958497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:36.959028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:37.039974 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a43f83ee-c99f-4c2e-90e1-bf76b324c6c1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action" status: 200 len: 24572 microversion: 2.1 time: 0.114518 Oct 11 01:46:37.047307 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2441/4835] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:36 2022] POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action => generated 24572 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:46:37.289373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:37.291020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:37.319133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:37.319133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:37.319133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:37.319133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:37.319133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:37.319708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:37.320154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:37.333836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:37.339143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:37.340695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c581fb9-6a8f-4226-8c9b-4b63aadd0dda tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2958 microversion: 2.32 time: 0.975234 Oct 11 01:46:37.348277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2395/4836] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:36 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2958 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:38.013465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:38.022369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5cf4e997-6eee-4f7d-80be-35932d2f78a3 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1283 microversion: 2.1 time: 0.738569 Oct 11 01:46:38.024113 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2442/4837] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:37 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1283 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:46:38.376338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:38.377498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:38.385165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:38.385858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:38.386565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:38.387466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:38.388081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:38.388664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:38.892043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:38.904662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:38.906651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:38.908160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bdb75c9e-16a7-490f-a75e-2e6a260289b0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2958 microversion: 2.32 time: 0.535730 Oct 11 01:46:38.909053 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2396/4838] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:38 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2958 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:39.046273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:39.046987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:39.060131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:39.060887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:39.061791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:39.062901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:39.063713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:39.064413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:39.772523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:39.782793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a58b45db-ef46-4bd7-b28e-7cee6d9e1199 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1283 microversion: 2.1 time: 0.740319 Oct 11 01:46:39.783451 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2443/4839] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:39 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1283 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:39.937817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:39.939357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:39.947987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:39.948805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:39.949506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:39.950432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:39.951103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:39.951778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:40.312836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:40.323714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:40.334887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:40.336413 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96a9b8a1-4f04-43d0-ae8e-4596f42d4909 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2937 microversion: 2.32 time: 0.403659 Oct 11 01:46:40.337005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2397/4840] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:39 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2937 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:40.822362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:40.823000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:40.832877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:40.834533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:40.835213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:40.836020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:40.836895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:40.838697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:40.914632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-deleted", "tag": "030790c4-e198-4a11-b958-d37338f63628"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:40.941147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:40.942448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:40.943275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:40.958985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] Creating event network-vif-deleted:030790c4-e198-4a11-b958-d37338f63628 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:40.967787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-48ee852b-6dc3-45df-909c-1feb7a578ee9 req-6f9ac941-addf-4507-bb89-a77239f30b24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059923 Oct 11 01:46:40.969138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2398/4841] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:41.324185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:41.347979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72eccead-44a3-40c3-8913-3eb712687c25 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.529274 Oct 11 01:46:41.348678 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2444/4842] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:40 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:41.369762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:41.370726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:41.382380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:41.384547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:41.385176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:41.387058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:41.389490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:41.390111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:41.537909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:41.568615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:41.676222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-unplugged", "status": "completed", "tag": "0f6aba64-69f5-4923-9198-0e1cc8d773be"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:41.713019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:41.714892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:41.716812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:41.778202 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] Creating event network-vif-unplugged:0f6aba64-69f5-4923-9198-0e1cc8d773be for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:41.781048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:41.792941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:41.793148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ae22de7f-dc75-4df8-a29f-0cbae10373a6 req-9654b624-0676-43b6-8ec7-f01570e96c2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120984 Oct 11 01:46:41.793998 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2445/4843] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:41.796822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:41.799123 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-487d501b-0c4d-45be-8439-cf7086f99fb7 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2755 microversion: 2.32 time: 0.433577 Oct 11 01:46:41.806017 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2399/4844] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:41 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2755 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:42.371281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:42.379898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:42.380866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:42.388079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:42.389127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:42.389847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:42.391452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:42.392107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:42.392688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:42.713319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:42.730119 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-473ed2ff-d9ec-4238-98e3-e9a981acfeed tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.360866 Oct 11 01:46:42.744193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2446/4845] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:42 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:42.835353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:42.835996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:42.848934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:42.849752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:42.851174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:42.852102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:42.853752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:42.855356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:43.098047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-deleted", "tag": "49f164c6-2aa6-4850-8dc7-900e317b521b"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-deleted", "tag": "65f84465-5b86-4a1e-91e4-96dd76f16b15"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:43.114473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:43.115475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:43.116085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:43.130361 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Creating event network-vif-deleted:49f164c6-2aa6-4850-8dc7-900e317b521b for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:43.131308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Creating event network-vif-deleted:65f84465-5b86-4a1e-91e4-96dd76f16b15 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:43.137547 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046965 Oct 11 01:46:43.138393 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2447/4846] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:43.278711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:43.280142 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b7cecf7e-4190-400a-a1d8-c1f7beb94752 req-2cc60b7c-5eac-4376-bcec-2715868062e2 service nova] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001700 Oct 11 01:46:43.280680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2448/4847] 10.222.0.66 () {56 vars in 886 bytes} [Tue Oct 11 01:46:43 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 01:46:43.362490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:43.375148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:43.381054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:43.382373 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b80effe1-610a-4e16-9abe-ae58dd978e6d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2661 microversion: 2.32 time: 0.553990 Oct 11 01:46:43.382950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2400/4848] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:42 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2661 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:43.774798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:43.777015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:43.789453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:43.790193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:43.790955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:43.792527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:43.793964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:43.794561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:43.870524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-unplugged", "status": "completed", "tag": "b2ee6173-8c78-49ac-ba73-2d42280ef2d6"}, {"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-unplugged", "status": "completed", "tag": "65f84465-5b86-4a1e-91e4-96dd76f16b15"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:43.895796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:43.896552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:43.897171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:43.914421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Creating event network-vif-unplugged:b2ee6173-8c78-49ac-ba73-2d42280ef2d6 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:43.915371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] Creating event network-vif-unplugged:65f84465-5b86-4a1e-91e4-96dd76f16b15 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:43.921646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b65bee9b-e632-471a-b062-08d035cd7a8d req-7290e210-92ee-44ee-886e-f4f5f7f8c926 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.054772 Oct 11 01:46:43.922986 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2401/4849] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:46:44.089666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:44.101685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ffa2ed0d-cb12-449b-bd36-b5f90052d5be tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.332109 Oct 11 01:46:44.105502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2449/4850] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:43 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:44.415080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:44.415982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:44.426724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:44.430029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:44.430592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:44.432233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:44.432714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:44.433155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:44.751286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:44.767064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:44.772367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:44.776005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c1f6d1a-cd9e-4de6-be6e-ef927518f154 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 2342 microversion: 2.32 time: 0.365288 Oct 11 01:46:44.777897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2402/4851] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:44 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 2342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:45.132714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:45.140067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:45.174423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-deleted", "tag": "b2ee6173-8c78-49ac-ba73-2d42280ef2d6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:45.176351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:45.177647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:45.181903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:45.184064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:45.188391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:45.188938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:45.193563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:45.194642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:45.195256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:45.235963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] Creating event network-vif-deleted:b2ee6173-8c78-49ac-ba73-2d42280ef2d6 for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:45.266584 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e2b621eb-8709-4b8b-8a0e-ef706df7814e req-c05ddd51-f3d8-49dc-8f41-cefbe2810dfa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074363 Oct 11 01:46:45.268882 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2403/4852] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:45.680648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:45.690733 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-059b7d30-7ea5-4573-9e1e-a2568fc6b3db tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.563918 Oct 11 01:46:45.709154 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2450/4853] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:45 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:45.808996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:45.810454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:45.826396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:45.827124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:45.829792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:45.834230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:45.834961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:45.837470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:45.997929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:46.015938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:46.017461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:46.021227 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f69f10b5-83f1-4c28-af84-e3642162c8f9 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.217022 Oct 11 01:46:46.024016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2404/4854] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:45 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:46.713455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:46.714733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:46.728275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:46.729079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:46.729748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:46.730668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:46.731322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:46.733050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:47.055236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:47.055862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:47.069839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:47.073192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:47.073932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:47.074901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:47.078474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:47.079188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:47.458791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:47.478988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:47.481451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:47.482981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b939418-394c-47fb-b81c-859705a6092d tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.431748 Oct 11 01:46:47.483922 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2405/4855] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:47 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:46:47.489137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b003c73-0ddb-4bbe-b36b-342ed3d6eefc", "name": "network-vif-deleted", "tag": "0f6aba64-69f5-4923-9198-0e1cc8d773be"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:47.499578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:47.500654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:47.501437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:47.516027 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] Creating event network-vif-deleted:0f6aba64-69f5-4923-9198-0e1cc8d773be for instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc on n-h1-772273-9 Oct 11 01:46:47.523311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c05876e5-16ca-45db-9218-7550d146256b req-ea0612b4-d8ad-4c93-b5e9-e3831fc25220 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037785 Oct 11 01:46:47.524176 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2406/4856] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:47.609611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:47.621850 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e53f1d31-d33c-40e0-9335-a6296d7f73eb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.912238 Oct 11 01:46:47.637214 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2451/4857] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:46 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:48.044378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:48.045081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:48.056875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.059162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.059671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.061135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.061770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.062372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.076247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:48.364021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c1c1d5d-7ef2-41b6-a06b-05350f44532b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1831 microversion: 2.1 time: 0.323625 Oct 11 01:46:48.370106 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2407/4858] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:48 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1831 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:48.391267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:48.391911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:48.410337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.410842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.411282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.412033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.412483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.413099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.509826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:48.511357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:48.518054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.518900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.519586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.520520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.521194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.521860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.618985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:48.636256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:48.638118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:48.642866 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cdf76eb1-176c-42bb-8b0b-5f78b129dba0 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.136246 Oct 11 01:46:48.644416 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2408/4859] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:48 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:46:48.651815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:48.654662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:48.675196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:48.684075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.684995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.687312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.688403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.691978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.692672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.694611 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59982425-478c-49c3-849d-46f00bb2e497 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1680 microversion: 2.1 time: 0.307768 Oct 11 01:46:48.701506 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2452/4860] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:48 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1680 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:48.917131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:48.920262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:48.935473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.937994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.939366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.940982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:48.942977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:48.944561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:48.955627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:48.969417 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6b24a4a-a389-4437-84d1-c60d48c302c6 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.322556 Oct 11 01:46:48.970155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2409/4861] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:48 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:49.079893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cbe89637-e472-4665-91f9-084e2fca79f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action" status: 200 len: 32643 microversion: 2.1 time: 0.167020 Oct 11 01:46:49.081159 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2453/4862] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:48 2022] POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action => generated 32643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:46:49.223986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:49.224464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:49.233380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.234221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.235834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.240343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.241976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.243556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.313075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8355f5d348e4b92a051c81205bf4a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bc930ddc94730986342fcefcc54df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:49.314426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] flavor_id is None. Assuming migration. {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 01:46:49.315538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 01:46:49.662706 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50cf2378-f652-4d54-9c05-f34539504055 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action" status: 202 len: 0 microversion: 2.1 time: 0.436672 Oct 11 01:46:49.664843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2410/4863] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:46:49 2022] POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:46:49.675545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:49.676484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:49.690098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.690599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.691041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.692310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.692943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.693384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.696741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:49.697378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:49.717173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.717677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.718118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.718836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:49.719301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:49.719759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:49.966608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:49.982670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:49.986330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:50.015628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-524e81d1-f486-4e10-9399-1989e70f8a9b tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.311012 Oct 11 01:46:50.018748 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2411/4864] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:49 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:50.037639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:50.038901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:50.060675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:50.061634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:50.062393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:50.063634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:50.064664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:50.066003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:50.190603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:50.206941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:50.215161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-248ae050-6fe3-4413-b3b8-1a7d2ca19e2c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1689 microversion: 2.1 time: 0.544879 Oct 11 01:46:50.216557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2454/4865] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:49 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1689 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:50.226525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "name": "network-vif-plugged", "status": "completed", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:50.258469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:50.259412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:50.261461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:50.292698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] Creating event network-vif-plugged:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:46:50.304068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-dbe15f62-4002-4217-9122-86ed1327b461 req-0498a80f-6d7d-4aa2-8340-32cf29eecad4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085863 Oct 11 01:46:50.305441 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2455/4866] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:50.384031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:50.393308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c99e202-446b-48cd-8584-9b5a2079dd1c tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.373224 Oct 11 01:46:50.396820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2412/4867] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:50 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:50.715462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-472cd05c-69e2-4717-8c2f-a4affad78508 tempest-ExtensionsTest-2046111205 tempest-ExtensionsTest-2046111205-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:50.717203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-472cd05c-69e2-4717-8c2f-a4affad78508 tempest-ExtensionsTest-2046111205 tempest-ExtensionsTest-2046111205-project] 10.222.0.66 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.152515 Oct 11 01:46:50.717744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2456/4868] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 01:46:50 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:46:50.729503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e210bf79-7c89-4419-a577-3449b1cd110b tempest-ExtensionsTest-2046111205 tempest-ExtensionsTest-2046111205-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:50.731770 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e210bf79-7c89-4419-a577-3449b1cd110b tempest-ExtensionsTest-2046111205 tempest-ExtensionsTest-2046111205-project] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006404 Oct 11 01:46:50.732306 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2413/4869] 10.222.0.66 () {58 vars in 1134 bytes} [Tue Oct 11 01:46:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:46:51.044791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:51.045527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:51.052194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.052855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.053475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.054328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.054932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.055555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.129306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:51.144115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:51.145744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:51.147171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1300ef6-076a-4373-89bb-f4bc3c2d713c tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.106722 Oct 11 01:46:51.147774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2457/4870] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:51 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:51.244349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:51.245473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:51.254336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.254948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.255499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.256308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.256843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.257351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.420600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:51.421275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:51.429781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.430507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.431130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.432122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:51.432741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:51.433990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:51.475007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:51.489523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00076871-5db6-4ec7-964e-71887da230c4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1689 microversion: 2.1 time: 0.251553 Oct 11 01:46:51.494569 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2414/4871] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:51 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:51.609713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:51.621654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82c63b07-eb83-4e70-ba21-08e1cc21902b tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1271 microversion: 2.1 time: 0.204213 Oct 11 01:46:51.623011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2458/4872] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:51 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:52.174142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:52.175943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:52.194835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.195387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.196018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.196885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.197369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.197787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.331855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:52.356170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:52.358692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:52.360226 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c67647a4-0513-4392-9d40-82cc61b0a572 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.190816 Oct 11 01:46:52.361396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2415/4873] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:52 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:52.518522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:52.519225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:52.527643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.528149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.528604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.529326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.529795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.530221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.652643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:52.654143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:52.672439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.672949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.673397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.674135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:52.674633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:52.675067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:52.839661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:52.851106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-69055d7d-c715-48eb-b57a-e35cfcff6032 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1689 microversion: 2.1 time: 0.337400 Oct 11 01:46:52.855070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2459/4874] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:52 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1689 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:53.009289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:53.023681 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e90481fd-c254-4bf1-a5c7-8996b1028ae7 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1461 microversion: 2.1 time: 0.372271 Oct 11 01:46:53.036605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2416/4875] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:52 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1461 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:53.050346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:53.051040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:53.057864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.058459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.058928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:53.059682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.060227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.060662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:53.394120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:53.394745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:53.404456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.404958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.405407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:53.410744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.411232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.411707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:53.448322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:53.459425 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a284807-811c-401e-b952-d965c6cfe1fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1461 microversion: 2.1 time: 0.413587 Oct 11 01:46:53.461165 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2460/4876] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:53 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1461 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:53.584870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:53.606345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:53.608447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:53.615421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e480b887-ff1f-414e-8608-96504bb06b84 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.224936 Oct 11 01:46:53.619862 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2417/4877] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:53 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:53.878053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:53.878994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:53.897490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.898086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.898770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:53.899731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:53.901199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:53.901581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:54.329025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:54.341180 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-945c4ea6-31c9-44ef-9a28-ff250563c868 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 0.466380 Oct 11 01:46:54.341945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2461/4878] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:53 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:54.646324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:54.646951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:54.665420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:46:54.666979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:54.667525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:54.667968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:54.668691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:54.669341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:54.669967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:54.868978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:54.888178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:54.889980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:54.898746 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06c90a87-20cc-4cce-8dd9-d2a86ec5f471 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.256290 Oct 11 01:46:54.920841 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2418/4879] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:54 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:55.370083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:55.370694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:55.383899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:55.384393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:55.384832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:55.385541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:55.385991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:55.386414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:55.874207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:55.890858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-060b1927-056e-40d6-b9f7-f69c9f116f81 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 0.524368 Oct 11 01:46:55.892627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2462/4880] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:55 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:55.929267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:55.930406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:55.948596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:55.949376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:55.949995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:55.951152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:55.951792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:55.952377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:56.209146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:56.219142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:56.221752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:56.223303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d669c31-878d-4ecc-9529-8aa207f82423 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.299147 Oct 11 01:46:56.224567 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2419/4881] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:55 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:46:56.627701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:56.640864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:56.654166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:56.654665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:56.655104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:56.661503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:56.671493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:56.672342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:56.753667 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19d5726e-c9fc-413e-9fa8-65f791bceaa6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/ips" status: 200 len: 149 microversion: 2.1 time: 0.129806 Oct 11 01:46:56.764227 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2463/4882] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:46:56 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/ips => generated 149 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:56.916163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:56.918585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:56.935292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:56.937309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:56.939028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:56.940398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:56.940907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:56.946434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:57.108678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:57.140924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:57.141413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:57.141850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:57.178352 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] Creating event network-changed:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:46:57.195707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3fc1ff8f-a2c7-4d65-807e-cd69a30c50cf req-0162ea83-a367-46fd-a12c-b31d7a275143 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090953 Oct 11 01:46:57.200262 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2464/4883] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:46:57.262467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:57.264031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:57.279704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:57.281766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:57.283932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:57.285220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:57.286876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:57.288892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:57.914193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:57.923796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:57.925289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:57.926483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e80b69f-a514-40ce-8736-9a07bafa76dd tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.675864 Oct 11 01:46:57.941020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2465/4884] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:57 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:58.649135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:58.679571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-436dfb35-1334-407d-90d7-c17acba9c48f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 1.767631 Oct 11 01:46:58.682987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2420/4885] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:56 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:46:58.969346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:58.969965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:58.986015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:58.986520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:58.996416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:58.998980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:58.999545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.001877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:59.420325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:59.442036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:59.443807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:46:59.445230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cc16a0a-e641-4c1e-88aa-7774eb01915f tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.479870 Oct 11 01:46:59.446446 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2466/4886] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:46:58 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:46:59.494675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:59.511807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:59.512734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.516078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:59.538598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] Creating event network-changed:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:46:59.545498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fec6ad18-c983-4451-b556-68170a24af7c req-6334b4be-52dd-45e4-8d06-a7e61d57de73 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057825 Oct 11 01:46:59.546489 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2421/4887] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:46:59.707000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:46:59.708048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:59.718069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:59.719891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.720774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:59.722964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:59.724651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.725357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:59.834145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd531724-efe7-477e-8934-58b0688ee31e"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:46:59.838162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:46:59.850186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:59.855135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.855734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:46:59.857681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:46:59.861428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:46:59.862466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:00.170754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:00.190989 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a6f5b9d-5c1f-446c-ab04-609d00752b77 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 0.486784 Oct 11 01:47:00.193917 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2467/4888] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:46:59 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:00.404260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:00.471893 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0016a94e-a033-4c6a-9a50-272f9026fb00 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.639765 Oct 11 01:47:00.483412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2422/4889] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:46:59 2022] POST /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:00.491522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:00.492173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:00.507141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:00.508013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:00.508634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:00.509759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:00.510559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:00.517468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:00.744499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:00.755084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:00.771777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:00.773239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62e22bdf-682f-4567-86d1-5823fe5284c8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.302510 Oct 11 01:47:00.778220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2468/4890] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:00 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:47:01.221057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:01.222528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:01.246626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:01.253516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:01.254268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:01.255446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:01.256161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:01.256837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:01.566880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:01.586972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:01.589101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:01.589791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:02.126869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] Creating event network-changed:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:47:02.135483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-26990228-776e-47cb-9c45-28384968a957 req-9c7c7a2b-552a-4fbc-8988-6917cc86144f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572118 Oct 11 01:47:02.136800 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2469/4891] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:02.145884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:02.146910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:02.154115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=66 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:02.156370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:02.157650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:02.157993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:02.159605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:02.160430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:02.161061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:02.231468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:02.249474 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ae2f1e8-f0ad-4f7f-8f36-8f53a7c1b65a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 1.026804 Oct 11 01:47:02.250150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2423/4892] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:01 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:02.370450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:02.397141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:02.398596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:02.399833 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-499f8d9a-9bf8-4329-9f83-d4b7852f7a12 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.261564 Oct 11 01:47:02.403933 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2470/4893] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:02 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:47:03.278310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:03.279808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:03.290014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:03.292651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:03.293120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:03.300048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:03.300628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:03.301088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:03.430491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:03.431950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:03.439606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:03.441054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:03.442111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:03.443070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:03.443774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:03.446133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:03.749781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:03.759165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6473adb-2bf0-4750-9eab-b739c48edf23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 0.484974 Oct 11 01:47:03.765299 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2424/4894] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:03 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:03.767694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:03.785217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:03.789517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:03.793162 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2335d70-5884-484a-a658-941158f7cbeb tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.366119 Oct 11 01:47:03.807463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2471/4895] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:03 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:47:04.005213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2ecd583-53ba-469d-aa43-e6c63086b40e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: .version_select at 0x7f112f49a1f0>, body: {"keypair": {"name": "tempest-keypair-2012509503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKW+etvWsEyECBrtW51rIthORyh4eeZyVKCBG+Q+PDx9Yc8rhAeneRlb9+zZodMsSbnD7vK2/KTlWd0dOKrAzihtygf5YASvdVu9sCm/q8KzdVrsNYKjQlwTIvSNhPYRQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:04.022647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a2ecd583-53ba-469d-aa43-e6c63086b40e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:47:04.032875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a2ecd583-53ba-469d-aa43-e6c63086b40e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for user f15178e558aa48bcadc6ac21c55d1119 and project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:47:04.064240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2ecd583-53ba-469d-aa43-e6c63086b40e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296856 Oct 11 01:47:04.065803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2425/4896] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:47:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:04.790870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:04.791582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:04.801131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:04.806257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:04.806783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:04.807552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:04.808152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:04.808584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:04.824795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:04.825423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:04.837985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:04.838968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:04.839644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:04.840669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:04.842015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:04.842617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:05.111250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:05.135556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:05.137448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:05.138689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dbc73a6-c93c-4696-8a3b-6c5700655bf3 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1603 microversion: 2.32 time: 0.318083 Oct 11 01:47:05.139386 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2426/4897] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:04 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1603 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 01:47:05.256555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:05.265674 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d4818ed-bd3b-4097-b2c3-c5869277e1b2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1694 microversion: 2.1 time: 0.479123 Oct 11 01:47:05.266902 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2472/4898] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:04 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1694 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:06.142619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1831600768", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e960fff-dd8a-429f-b90d-73cc19a9145f"}], "security_groups": [{"name": "tempest-securitygroup--119683593"}], "key_name": "tempest-keypair-2012509503", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:06.165009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:06.165736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:06.180460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:06.184542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:06.185229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:06.192902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:06.197478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:06.199308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:06.302692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:06.303756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:06.304444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:06.305270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lazy-loading 'fault' on Instance uuid 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:47:06.496894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:06.542073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:06.546513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd278a65e509b4ac9ade6a8119e28e011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b94b3661b84faea7c4fb19f659baa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:06.551534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d83ea5fb-6755-4ec8-ade2-eb6d69c4c042 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 200 len: 1608 microversion: 2.32 time: 0.390467 Oct 11 01:47:06.554658 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2473/4899] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:06 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 1608 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 01:47:06.566549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:06.567670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:06.600401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] validate_networks() for [('4e960fff-dd8a-429f-b90d-73cc19a9145f', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:47:06.631388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:06.632342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:06.633873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:06.638753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:06.640504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:06.641054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:06.697024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:07.147273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:07.160719 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28cea54c-fca1-40ce-896c-a7637b631589 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1693 microversion: 2.1 time: 0.598527 Oct 11 01:47:07.171628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2474/4900] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:06 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1693 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:07.241976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-unplugged", "status": "completed", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:07.262083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:07.262585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:07.266089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:07.304350 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Creating event network-vif-unplugged:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h2-772273-9 Oct 11 01:47:07.323170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:47:07.353937 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9a5b942a-d3b9-4142-bf2b-b973338901f6 req-ec85df68-ded2-4486-b087-d466b4701a15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117348 Oct 11 01:47:07.354579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2475/4901] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:07.587376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:07.588057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:07.601873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:07.604345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:07.604816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:07.605560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:07.606023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:07.606464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:07.650929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] HTTP exception thrown: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Request method failure captured: Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc HTTP/1.1 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMmpa-ZVLMNPKa8xMLWhYQW2lV22k0Zr8J9fXlSPvx1kJJJ7XKbfqv3hU8VnF88a8m9UrP_bPO1USWM3q3QkQ0mSDpOtQW9dQV8FUmhbR75U9wpifR2IM77Jc2c3lHWprQpkx2kf_nO0Ml2PvbMbda7YOSg9wkjlJ0Z2NXx-C0zhpDo Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d278a65e509b4ac9ade6a8119e28e011 Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '5b003c73-0ddb-4bbe-b36b-342ed3d6eefc'} Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:47:07.657514 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:07.662395 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:47:07.663656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Returning 404 to user: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:47:07.664646 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5fd93367-6f6e-4033-a1ed-c242c897c1a8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 404 len: 111 microversion: 2.32 time: 0.082381 Oct 11 01:47:07.668576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2476/4902] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:07 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:47:07.673699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e827bb0a-0bca-4903-92fa-e82f668a6780 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '.version_select at 0x7f11388b8f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:07.703122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e827bb0a-0bca-4903-92fa-e82f668a6780 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569893860" status: 204 len: 0 microversion: 2.32 time: 0.032559 Oct 11 01:47:07.704563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2477/4903] 10.222.0.66 () {60 vars in 1259 bytes} [Tue Oct 11 01:47:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569893860 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 01:47:07.939811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:47:07.941639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:47:07.942969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:47:07.943906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:47:07.944521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:47:07.961880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:07.962700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:07.964085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:07.965150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:07.966506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:07.966967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:07.994346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:47:08.003211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for user f15178e558aa48bcadc6ac21c55d1119 and project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:47:08.050121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:47:08.055872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:47:08.123982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6450f24d-ff2d-4d4a-9032-36d2cd30db26 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.985621 Oct 11 01:47:08.125408 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2427/4904] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:47:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:47:08.136922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-874b30ac-e2ab-470f-a9d8-e411c3caf771 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:08.137920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-874b30ac-e2ab-470f-a9d8-e411c3caf771 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:08.202595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:08.203219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:08.216167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:08.216630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:08.217065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:08.217818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:08.218276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:08.219914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:08.295196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-874b30ac-e2ab-470f-a9d8-e411c3caf771 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:08.313948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-874b30ac-e2ab-470f-a9d8-e411c3caf771 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1238 microversion: 2.1 time: 0.181545 Oct 11 01:47:08.327925 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2478/4905] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:08 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1238 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:08.522047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:08.541510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a1be175-d7cc-40db-aeaa-f0b4463f419e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1693 microversion: 2.1 time: 0.343837 Oct 11 01:47:08.544517 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2428/4906] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:08 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1693 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:09.338326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:09.340403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:09.351967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:09.354162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:09.355940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:09.356853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:09.358320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:09.360038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:09.408228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:09.432115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:09.433776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:09.434389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:09.464732 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Creating event network-changed:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h2-772273-9 Oct 11 01:47:09.490356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:47:09.520684 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-90daf781-7463-4ee9-ad8b-f2f13dda28da req-93b828a3-5736-4863-970b-25fe8f31252d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118022 Oct 11 01:47:09.522623 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2429/4907] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:09.573235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:09.574219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:09.606676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:09.613376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:09.613978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:09.614869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:09.615800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:09.616338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:09.727062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:09.742158 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d898fd51-ce65-40f1-8040-22015bd1759b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1290 microversion: 2.1 time: 0.407825 Oct 11 01:47:09.756515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2479/4908] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:09 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1290 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:10.589619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:10.602729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c158c1e8-96d6-42d2-bee7-2f65900d8a23 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1693 microversion: 2.1 time: 1.038265 Oct 11 01:47:10.605529 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2430/4909] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:09 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1693 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:10.769763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:10.770517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:10.781510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:10.783696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:10.786978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:10.791362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:10.795439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:10.796525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:10.926228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:10.940573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c5a15a9-3f03-4fbf-8065-dec6523edc83 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1296 microversion: 2.1 time: 0.174472 Oct 11 01:47:10.942500 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2480/4910] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:10 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:11.634294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:11.636904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:11.645539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:11.647058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:11.648494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:11.649450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:11.650276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:11.650933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:11.865140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:11.875373 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4efb393-815e-4b5f-9c03-2036c6834807 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1691 microversion: 2.1 time: 0.245577 Oct 11 01:47:11.876571 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2431/4911] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:11 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:11.965437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:11.966048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:11.973610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:11.974106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:11.974541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:11.975259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:11.975737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:11.976160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:12.347672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:12.418546 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-421649b8-b7a6-4184-8cac-a3030c9b8c5d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.456753 Oct 11 01:47:12.420863 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2481/4912] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:11 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:12.901170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:12.902491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:12.922387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:12.923273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:12.923975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:12.925790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:12.929017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:12.930652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:13.267865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:13.277884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9651557b-cc10-42f6-b8c4-94deb79492ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1691 microversion: 2.1 time: 0.382100 Oct 11 01:47:13.281795 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2432/4913] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:12 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1691 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:13.446807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:13.447602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:13.462351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:13.464690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:13.466586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:13.468776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:13.469910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:13.470426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:13.564979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193e8756-59a7-4efd-9b1a-0da421763394", "tag": "fb70815a-c158-4ed5-8f1b-05ced35df48d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:13.610824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:13.612251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:13.612855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:13.638174 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] Creating event network-changed:fb70815a-c158-4ed5-8f1b-05ced35df48d for instance 193e8756-59a7-4efd-9b1a-0da421763394 on n-h1-772273-9 Oct 11 01:47:13.646509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a719af85-ee02-44e8-91f2-59d9d875bd6a req-82844e93-e953-410b-bab6-5addf7902ae1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085684 Oct 11 01:47:13.647803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2433/4914] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:13.767084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:13.776950 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-52964e8d-6dbc-464f-8f5a-24ffd0aa8b76 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.335586 Oct 11 01:47:13.778191 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2482/4915] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:13 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:14.272424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:14.273699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.286915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.288191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.293249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.296868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.297529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.301994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.306223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:14.307067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.318815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.320166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.323745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.324671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.325313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.325790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.332738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] HTTP exception thrown: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Request method failure captured: Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc HTTP/1.1 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMmpa-ZVLMNPKa8xMLWhYQW2lV22k0Zr8J9fXlSPvx1kJJJ7XKbfqv3hU8VnF88a8m9UrP_bPO1USWM3q3QkQ0mSDpOtQW9dQV8FUmhbR75U9wpifR2IM77Jc2c3lHWprQpkx2kf_nO0Ml2PvbMbda7YOSg9wkjlJ0Z2NXx-C0zhpDo Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d278a65e509b4ac9ade6a8119e28e011 Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5b003c73-0ddb-4bbe-b36b-342ed3d6eefc'} Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:47:14.334964 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.339832 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.342742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Returning 404 to user: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:47:14.343855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4df190e5-21b8-4239-a93f-caf8169dcd57 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 404 len: 111 microversion: 2.32 time: 0.077026 Oct 11 01:47:14.348812 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2434/4916] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 01:47:14 2022] DELETE /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:47:14.356648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:14.357446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] [instance: 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.369016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.369699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.370305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.371256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.371979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.373254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.394955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] HTTP exception thrown: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Request method failure captured: Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc HTTP/1.1 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMmpa-ZVLMNPKa8xMLWhYQW2lV22k0Zr8J9fXlSPvx1kJJJ7XKbfqv3hU8VnF88a8m9UrP_bPO1USWM3q3QkQ0mSDpOtQW9dQV8FUmhbR75U9wpifR2IM77Jc2c3lHWprQpkx2kf_nO0Ml2PvbMbda7YOSg9wkjlJ0Z2NXx-C0zhpDo Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21b94b3661b84faea7c4fb19f659baa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 21b94b3661b84faea7c4fb19f659baa3 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1372251848 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d278a65e509b4ac9ade6a8119e28e011 Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TaggedBootDevicesTest-1372251848-project Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5b003c73-0ddb-4bbe-b36b-342ed3d6eefc'} Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.397134 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. Oct 11 01:47:14.401761 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:14.404442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] Returning 404 to user: Instance 5b003c73-0ddb-4bbe-b36b-342ed3d6eefc could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:47:14.405590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a8171d9-47a9-4749-8fba-02abfb88b8f8 tempest-TaggedBootDevicesTest-1372251848 tempest-TaggedBootDevicesTest-1372251848-project] 10.222.0.66 "GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc" status: 404 len: 111 microversion: 2.32 time: 0.055588 Oct 11 01:47:14.406173 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2435/4917] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 01:47:14 2022] GET /compute/v2.1/servers/5b003c73-0ddb-4bbe-b36b-342ed3d6eefc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:47:14.596920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:14.605818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0717953d-5fd6-401a-9324-90347e231801 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1688 microversion: 2.1 time: 0.305125 Oct 11 01:47:14.606471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2483/4918] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:14 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1688 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:14.639011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:14.639700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.653937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.655060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.655719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.656738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.657215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.657819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.802861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:14.803516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.814917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.815671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.816123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.816983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.817599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.832085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.848448 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f584badb-677e-4909-8230-f5864e9cbbd3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action" status: 202 len: 0 microversion: 2.1 time: 0.216693 Oct 11 01:47:14.849971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2436/4919] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:47:14 2022] POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:47:14.860416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:14.861422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:14.869084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.869883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.870519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:14.871442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:14.872057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:14.872692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:15.363720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:15.373679 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57778dc6-aa45-4ee3-909b-7ac65f281d66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.517925 Oct 11 01:47:15.396494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:15.400903 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2437/4920] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:14 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:15.406251 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fcbbee3-9bb0-424c-bb7d-68aedbe0e1b5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.607577 Oct 11 01:47:15.417777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2484/4921] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:14 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:16.257989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-plugged", "status": "completed", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:16.277362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:16.277857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:16.278299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:16.291900 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Creating event network-vif-plugged:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h2-772273-9 Oct 11 01:47:16.317679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:47:16.333452 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-75a13ebe-a0a1-46c6-be92-57b55da901a1 req-b932623f-fc3b-4f0a-8609-039abc983f24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080936 Oct 11 01:47:16.335312 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2438/4922] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:16.402440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:16.403058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:16.410601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:16.411370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:16.411840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:16.412548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:16.413192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:16.413783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:16.434821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:16.436380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:16.445830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:16.446477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:16.447173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:16.448411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:16.449018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:16.449645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:16.679188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:16.685139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:16.697931 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3041516b-7d54-438d-a8db-661918189660 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.269911 Oct 11 01:47:16.698184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1dafdc64-5a97-46fd-822a-acf3f45eb759 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.299651 Oct 11 01:47:16.698853 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2485/4923] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:16 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:16.699307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2439/4924] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:16 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:17.732572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:17.733961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:17.741883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:17.742710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:17.743394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:17.744332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:17.745000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:17.746005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:17.974062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:17.975313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:17.979420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:17.984876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:17.995584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:17.995902 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aff53d71-8b23-40a5-96dd-17c8c684ebdf tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.266936 Oct 11 01:47:17.999087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:17.999779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:18.001367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:18.002042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:18.003204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:18.045288 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2440/4925] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:17 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:18.225928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:18.235716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b3913c6-fd40-4482-b150-422c83e60a64 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.514456 Oct 11 01:47:18.236553 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2486/4926] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:17 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:19.037568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:19.038719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:19.051224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:19.060380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.060893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.061360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.062064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.066041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.066966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.113304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:19.262754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:19.264306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:19.269811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:19.276801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.277903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.279095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.280292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.280970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.281651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.320370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:19.330487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b7b5c14-e6ed-460c-b5da-32ed0e336a2b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.307431 Oct 11 01:47:19.331664 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2441/4927] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:19 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:19.433488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-unplugged", "status": "completed", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:19.453628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.457705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.458184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.482412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:19.492462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7fca7b46-e0d3-448f-aa6e-b27c344c8350 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.234354 Oct 11 01:47:19.500188 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2487/4928] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:19 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:19.511514 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Creating event network-vif-unplugged:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:47:19.520619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:47:19.543160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-175ee485-cedf-4c9d-a2a6-7aecae8e27a1 req-e9577624-19f3-401d-84da-2585fb855637 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112570 Oct 11 01:47:19.544362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2442/4929] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:19.659378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5091e56a-6824-4bb2-a59a-6ae9365004b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: .version_select at 0x7f1138845280>, body: {"keypair": {"name": "tempest-keypair-2140206830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8p0XTQDsiT9S4hXt3sEf9zqWrAV0/oCd3idTKtL6fWLq3Hzp3R+XW3WJIuVe+IcUyq8aX4vXI/vrw49SCPBJVPRv5jyFrmEIRvqpCENXKnAgfxgTAFl2TsWDrgr1UCQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:19.686808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5091e56a-6824-4bb2-a59a-6ae9365004b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:47:19.693697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-5091e56a-6824-4bb2-a59a-6ae9365004b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:47:19.725676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5091e56a-6824-4bb2-a59a-6ae9365004b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071702 Oct 11 01:47:19.726731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2488/4930] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:47:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:19.886970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193e8756-59a7-4efd-9b1a-0da421763394", "name": "network-vif-plugged", "status": "completed", "tag": "fb70815a-c158-4ed5-8f1b-05ced35df48d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:19.910553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:19.911293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:19.911950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:19.939193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] Creating event network-vif-plugged:fb70815a-c158-4ed5-8f1b-05ced35df48d for instance 193e8756-59a7-4efd-9b1a-0da421763394 on n-h1-772273-9 Oct 11 01:47:19.956293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-19a5047e-fd97-4c0e-afc2-66fc25732802 req-b56bfb56-ad2a-499a-a0af-7e99ae133376 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069917 Oct 11 01:47:19.958578 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2443/4931] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:20.355716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:20.356392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:20.364675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:20.365195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:20.365618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:20.366321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:20.366772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:20.367395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:20.518298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:20.519713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:20.520906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:20.528868 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cc6cbdf-3141-4081-9adb-37fc36175bca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1363 microversion: 2.1 time: 0.177676 Oct 11 01:47:20.529059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:20.529524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:20.529964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:20.531523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:20.532158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:20.532760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:20.538112 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2489/4932] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:20 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:20.716109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:20.725853 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38911023-2031-47ee-bfd7-93719203a56d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.212657 Oct 11 01:47:20.745703 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2444/4933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:20 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:21.554764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:21.556062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:21.566923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.567734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.568380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.569271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.569895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.571386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.626021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:21.643261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.643721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.644154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.666347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Creating event network-changed:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:47:21.688756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 01:47:21.714924 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c3e64585-b961-4970-bb26-724a9a3f6424 req-a1302d8d-7c3b-459a-95b9-781b02561c13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082245 Oct 11 01:47:21.714924 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2445/4934] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:21.754831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:21.755696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:21.762653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.763167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.763637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.764371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.764835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.765269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.809588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:21.818062 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85f9eca7-6cf1-4fa9-8c8e-c36f8cc00ef4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1550 microversion: 2.1 time: 0.269484 Oct 11 01:47:21.820765 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2490/4935] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:21 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:21.849763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:21.850501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:21.863410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.864207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.868066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:21.869015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:21.869711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:21.870324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:22.061234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:22.070273 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59c0714c-994a-4979-9d48-3878803f4d57 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 0.322888 Oct 11 01:47:22.074491 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2446/4936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:21 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:22.091740 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-389ccc9f-c3cd-44ca-a224-e6d48ed4a8ea tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247166 Oct 11 01:47:22.092752 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2491/4937] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:47:21 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:22.356652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-280928931", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e93cb-284f-427c-82a6-2e0f725420b8"}], "security_groups": [{"name": "tempest-securitygroup--517519202"}], "key_name": "tempest-keypair-2140206830", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:22.673867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] validate_networks() for [('859e93cb-284f-427c-82a6-2e0f725420b8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:47:23.101067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:23.103197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:23.116278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:23.117027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:23.118456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:23.120230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:23.122108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:23.122716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:24.187015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:24.196539 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8004c382-329d-4372-be52-aa4b2c1cbf00 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1687 microversion: 2.1 time: 1.100570 Oct 11 01:47:24.203389 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2492/4938] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:23 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1687 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:24.425072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:47:24.425597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:47:24.426453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:47:24.427012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:47:24.427658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:47:24.443846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:24.445102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:24.447229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:24.448969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:24.451584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:24.452624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:24.496170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:47:24.513670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:47:24.538600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:24.541170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:47:24.544621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:47:24.630232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f4dc3b8-77b7-4885-b861-a638209c8dec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.278987 Oct 11 01:47:24.631180 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2447/4939] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:47:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:47:24.643823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57ef9b2b-680d-461d-a35a-164c23bca92c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:24.644744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-57ef9b2b-680d-461d-a35a-164c23bca92c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:24.815144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-57ef9b2b-680d-461d-a35a-164c23bca92c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:24.832411 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57ef9b2b-680d-461d-a35a-164c23bca92c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1241 microversion: 2.1 time: 0.192229 Oct 11 01:47:24.848711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2493/4940] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:24 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1241 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:25.066052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193e8756-59a7-4efd-9b1a-0da421763394", "tag": "fb70815a-c158-4ed5-8f1b-05ced35df48d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:25.081235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:25.081872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:25.082264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:25.096478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] Creating event network-changed:fb70815a-c158-4ed5-8f1b-05ced35df48d for instance 193e8756-59a7-4efd-9b1a-0da421763394 on n-h1-772273-9 Oct 11 01:47:25.101914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0131825c-d062-4f2c-8b97-ea63782ca8a4 req-28149669-28cf-4467-89f6-ae84b58628a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041130 Oct 11 01:47:25.102977 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2448/4941] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:25.230711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:25.231627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:25.245648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:25.246112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:25.246559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:25.247994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:25.249456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:25.250073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:25.512912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:25.522759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da6ec860-3106-4850-8f66-1f3b04786ed7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1680 microversion: 2.1 time: 0.297821 Oct 11 01:47:25.528419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2494/4942] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:25 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1680 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:25.862752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:25.863536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:25.873250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:25.874252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:25.875634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:25.879988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:25.880772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:25.881590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:26.103541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-plugged", "status": "completed", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:26.119905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:26.125346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:26.126910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:26.140362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:26.149744 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] Creating event network-vif-plugged:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:47:26.151591 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24d5a83e-e3bc-4d61-9b7b-d5614b53e049 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1293 microversion: 2.1 time: 0.294671 Oct 11 01:47:26.166368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2449/4943] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:25 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1293 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:26.166591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-41e83d44-476d-455e-869e-92b41c933a28 req-59be7366-7ecf-4d60-9467-1b7959362529 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058430 Oct 11 01:47:26.166591 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2495/4944] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:27.178577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:27.179204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:27.191746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:27.192244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:27.192675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:27.193572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:27.194189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:27.194775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:27.441283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:27.453544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9df9945-fbb6-4701-af7b-a024a98442ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.279224 Oct 11 01:47:27.454499 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2450/4945] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:27 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:28.320850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b032e747-3e10-4877-a5bb-21db7c9b9448", "tag": "6460334e-a692-415c-beb9-b4187d0e9322"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:28.343744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:28.346247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:28.347324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:28.374302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] Creating event network-changed:6460334e-a692-415c-beb9-b4187d0e9322 for instance b032e747-3e10-4877-a5bb-21db7c9b9448 on n-h2-772273-9 Oct 11 01:47:28.382040 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-56ad8802-bf4a-4de1-b210-f7ef6a3e2db4 req-34098a70-4512-41a1-9f2f-65983a54b221 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068395 Oct 11 01:47:28.383261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2496/4946] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:28.477239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:28.478779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:28.490233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:28.493408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:28.493904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:28.494651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:28.495117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:28.495575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:28.807613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:28.818635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d227999-dd8e-4fd7-bfd3-b0ba6ccb4be4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.345387 Oct 11 01:47:28.819237 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2451/4947] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:28 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:29.846379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:29.848181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:29.858782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:29.859834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:29.865117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:29.866824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:29.867782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:29.868447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:30.037039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:30.040912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:30.046345 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8a6117f-9bc0-4ea3-ba98-1e26d068702d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.203916 Oct 11 01:47:30.047662 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2497/4948] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:29 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:31.070746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:31.079570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:31.095130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:31.095667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:31.096702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:31.097435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:31.097901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:31.098339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:31.437039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:31.449350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e36e74d-c600-4493-80fe-d3c9bc148bfb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.382430 Oct 11 01:47:31.450088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2452/4949] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:31 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:32.474791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:32.475933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:32.483588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:32.485159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:32.485655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:32.486527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:32.487972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:32.489245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:32.490059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:32.696256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:32.709810 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0eb01f6e-2316-4bb7-a1ed-e2fd567007bf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.239577 Oct 11 01:47:32.710427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2498/4950] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:32 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:33.739292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:33.739905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:33.747959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:33.748554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:33.749220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:33.750151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:33.750806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:33.751480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:33.963018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:33.972046 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4eb3212c-e39a-4a0b-b76b-cfdfac9e7534 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.237614 Oct 11 01:47:33.975990 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2453/4951] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:33 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:34.174150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:34.175120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:34.189158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.189704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.190982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.195143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.195699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.196151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.209814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:34.232606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.233430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.234619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.238663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:47:34.268526 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] Creating event network-changed:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:47:34.275087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fdaeff08-95af-432b-83d7-83c8b5f39d93 req-4d152cdc-3aff-456e-9e05-e590be62d0c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072018 Oct 11 01:47:34.277716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2454/4952] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:34.429846 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b597fe9a-1aed-4d35-9930-29b00b5d14b9 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "DELETE /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 204 len: 0 microversion: 2.1 time: 0.260119 Oct 11 01:47:34.430933 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2499/4953] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:47:34 2022] DELETE /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:47:34.435232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b032e747-3e10-4877-a5bb-21db7c9b9448", "name": "network-vif-plugged", "status": "completed", "tag": "6460334e-a692-415c-beb9-b4187d0e9322"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:34.443652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:34.444700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:34.467246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.467820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.468261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.468979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.469761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.470466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.472282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:34.473101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:34.473966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:34.483852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:34.520372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] Creating event network-vif-plugged:6460334e-a692-415c-beb9-b4187d0e9322 for instance b032e747-3e10-4877-a5bb-21db7c9b9448 on n-h2-772273-9 Oct 11 01:47:34.530424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9009e193-7a9b-4d9f-9b1e-4834df78868a req-27b87893-b22e-4430-b000-a466772eb00c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099677 Oct 11 01:47:34.531094 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2455/4954] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:34.891009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:34.891009 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aabd5405-eebc-4cf0-9f68-c68aa61059d0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1585 microversion: 2.1 time: 0.389548 Oct 11 01:47:34.891009 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2500/4955] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:34 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1585 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:35.004459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:35.009847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:35.010789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:35.019556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:35.020478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:35.020932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:35.021672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:35.025602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:35.025725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:35.412005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:35.422334 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eef0fdbe-7809-4edb-908a-f74bf18b11c4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.421199 Oct 11 01:47:35.423676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2456/4956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:34 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:35.856732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:35.858276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:35.866449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:35.870701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:35.872075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:35.873111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:35.874665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:35.876212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:35.876909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:36.179551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:36.192282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f30ee48-6a55-400c-b3d4-b0f9adc03ceb tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1585 microversion: 2.1 time: 0.341250 Oct 11 01:47:36.193492 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2501/4957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:35 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1585 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:36.451162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:36.451821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:36.472651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:36.473277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:36.473802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:36.474536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:36.475015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:36.475468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:36.655117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:36.663232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa3bb929-a9c7-49a0-8a72-029308ea7d62 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1366 microversion: 2.1 time: 0.217386 Oct 11 01:47:36.663840 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2457/4958] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:36 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:37.222086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:37.222801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:37.246934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:37.251572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:37.252675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:37.255046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:37.255585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:37.256096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:37.287801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a734be-d1a6-48e2-8e68-685be3d8b640", "name": "network-vif-deleted", "tag": "734fc24b-55cb-4e18-9478-255530f87987"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:37.308797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:37.310254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:37.311799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:37.338095 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] Creating event network-vif-deleted:734fc24b-55cb-4e18-9478-255530f87987 for instance 46a734be-d1a6-48e2-8e68-685be3d8b640 on n-h2-772273-9 Oct 11 01:47:37.347823 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c2935429-33f6-49c3-8ded-b97ed857f48a req-34f91937-920b-43cb-aceb-a67533a89ca2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064006 Oct 11 01:47:37.351476 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2458/4959] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:37.363862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:37.381802 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fd19977-4b66-4e6e-aabc-d438aa6f835f tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1399 microversion: 2.1 time: 0.163719 Oct 11 01:47:37.384029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2502/4960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:37 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1399 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:37.687698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:37.688430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:37.709586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:37.710097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:37.711236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:37.712032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:37.712515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:37.712960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:37.958633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:37.981071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa1521c9-7098-4e3c-bc93-4c1892de4523 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1556 microversion: 2.1 time: 0.298607 Oct 11 01:47:37.981668 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2459/4961] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:37 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1556 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:38.005678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:38.006540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:38.023360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:38.032069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:38.035646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:38.035646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:38.035646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:38.035646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:38.149105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11e48c52-9679-4573-850a-93a3072a9322 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148199 Oct 11 01:47:38.150088 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2503/4962] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:47:37 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:38.409745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:38.410932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:38.418632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:38.419312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:38.419944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:38.421224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:38.421936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:38.422532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:38.521609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:38.542490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96be3567-9e0c-4309-9be4-11aa5a88a324 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1230 microversion: 2.1 time: 0.139280 Oct 11 01:47:38.544657 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2460/4963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:38 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1230 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:39.566335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:39.567728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:39.577068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:39.578006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:39.578686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:39.579646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:39.580354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:39.580993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:39.726084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:39.734909 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ccde6470-e2cd-478b-a185-a546d18e8819 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1230 microversion: 2.1 time: 0.172432 Oct 11 01:47:39.751792 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2504/4964] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:39 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1230 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:39.778631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b032e747-3e10-4877-a5bb-21db7c9b9448", "tag": "6460334e-a692-415c-beb9-b4187d0e9322"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:39.807446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:39.808178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:39.808772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:39.829937 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] Creating event network-changed:6460334e-a692-415c-beb9-b4187d0e9322 for instance b032e747-3e10-4877-a5bb-21db7c9b9448 on n-h2-772273-9 Oct 11 01:47:39.842628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-abdfa7fc-8849-49d8-9cff-6ffb3c89ffce req-207c98e1-8b5e-49e8-b574-b7937f26e705 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071663 Oct 11 01:47:39.846597 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2461/4965] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:40.763538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:40.764750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:40.774244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:40.775000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:40.775679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:40.776614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:40.777271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:40.777916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:40.889984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:40.912060 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c0db8d0b-a3f2-4edc-aafb-440621745681 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1230 microversion: 2.1 time: 0.157096 Oct 11 01:47:40.917902 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2505/4966] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:40 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:41.948195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:41.948924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:41.967176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:41.968043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:41.969502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:41.970959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:41.971601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:41.972552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:42.084419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:42.100730 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10f3e897-2442-4404-87c6-669c76bb9ba0 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1230 microversion: 2.1 time: 0.160934 Oct 11 01:47:42.101661 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2462/4967] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:41 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:43.124544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:43.125161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:43.133921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:43.148183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:43.148651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:43.149418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:43.149876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:43.150497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:43.210257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:43.210933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:43.211765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:43.212716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lazy-loading 'fault' on Instance uuid 46a734be-d1a6-48e2-8e68-685be3d8b640 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:47:43.263611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122cfc7febc2449b9c58eb84c9c1ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1077476ea1424b8d7cb1183da19c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:43.274080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7bf24560-c04e-4260-ba68-eb6543a4b2fa tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 200 len: 1235 microversion: 2.1 time: 0.152589 Oct 11 01:47:43.285468 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2506/4968] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:43 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 1235 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:44.299637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:44.300885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] [instance: 46a734be-d1a6-48e2-8e68-685be3d8b640] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:44.309481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:44.309973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:44.310630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:44.311117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:44.311595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:44.312195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:44.330128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] HTTP exception thrown: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Request method failure captured: Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 HTTP/1.1 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMpXNyBXO4f3QPtxXuB2W6j0W-nHOCqIwdjrvk5mVI88CYfcn4M8I_OMtYKmj5exPoQIUpDL562fUAOU1XpSkAcy-jCUbScwekgjQa3kbEKlFhTbCDKJ-HjfA9veLcYLh-tFLdS04u-7J9DS7LgLc424O_RZ-VfBiR0kktaIpYOA9cI Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: dd1077476ea1424b8d7cb1183da19c20 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBackupRestore-607162195 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd1077476ea1424b8d7cb1183da19c20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd1077476ea1424b8d7cb1183da19c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd1077476ea1424b8d7cb1183da19c20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd1077476ea1424b8d7cb1183da19c20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBackupRestore-607162195 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: dd1077476ea1424b8d7cb1183da19c20 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBackupRestore-607162195 Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBackupRestore-607162195-project Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 122cfc7febc2449b9c58eb84c9c1ecfa Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBackupRestore-607162195-project Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '46a734be-d1a6-48e2-8e68-685be3d8b640'} Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:47:44.332507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. Oct 11 01:47:44.338073 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:47:44.341785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Returning 404 to user: Instance 46a734be-d1a6-48e2-8e68-685be3d8b640 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:47:44.342898 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5512c3d-94f2-43e7-bedd-08269ddded50 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640" status: 404 len: 111 microversion: 2.1 time: 0.048167 Oct 11 01:47:44.343998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2463/4969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:44 2022] GET /compute/v2.1/servers/46a734be-d1a6-48e2-8e68-685be3d8b640 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:47:44.546286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2143130-82f7-465e-a2af-cf41e5000610 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] Calling method '.version_select at 0x7f11388b44c0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:44.591841 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2143130-82f7-465e-a2af-cf41e5000610 tempest-TestVolumeBackupRestore-607162195 tempest-TestVolumeBackupRestore-607162195-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1965077558" status: 202 len: 0 microversion: 2.1 time: 0.049707 Oct 11 01:47:44.597052 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2507/4970] 10.222.0.66 () {58 vars in 1269 bytes} [Tue Oct 11 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1965077558 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:47:45.875512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1516653109", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "e94fc197-8b28-487e-ac8e-46fa4f41b411"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:45.960958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] validate_networks() for [('e94fc197-8b28-487e-ac8e-46fa4f41b411', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:47:46.665697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:47:46.666453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:47:46.667114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:47:46.667769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:47:46.668672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:47:46.693869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:46.694375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:46.698558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:46.699448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:46.703069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:46.703720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:46.715501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:46.734694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:47:46.742712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for user 284a096df3f64ab8a2d77331498880ba and project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:47:46.766529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:47:46.769045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:47:46.859401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4721f092-1bc5-4caf-b3e4-7811b48ed762 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152308 Oct 11 01:47:46.861005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2464/4971] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:47:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:47:46.874004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70e73b2c-3e5e-485a-b48d-4694e064eb66 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:46.874588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70e73b2c-3e5e-485a-b48d-4694e064eb66 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:47.027165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70e73b2c-3e5e-485a-b48d-4694e064eb66 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:47.053994 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70e73b2c-3e5e-485a-b48d-4694e064eb66 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1218 microversion: 2.1 time: 0.185030 Oct 11 01:47:47.054617 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2508/4972] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:46 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:48.082317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:48.083645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:48.105566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:48.106084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:48.106533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:48.107377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:48.107851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:48.108287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:48.212245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:48.224568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff9fbd51-1a6f-44f3-b8ff-1ae9d5746c96 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1222 microversion: 2.1 time: 0.148629 Oct 11 01:47:48.236885 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2465/4973] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:48 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:49.250311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:49.250980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:49.273185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:49.273694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:49.274147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:49.274888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:49.275380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:49.275823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:49.492092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:49.518355 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75be7a55-f969-4443-a74e-f2610cf5e0c4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1288 microversion: 2.1 time: 0.266622 Oct 11 01:47:49.519547 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2509/4974] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:49 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1288 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:49.824502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:49.826870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:49.858232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:49.860188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:49.860688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:49.865743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:49.866417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:49.866888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:49.978938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-829a860b-2cc0-4438-a93b-e4560a0b3725 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action" status: 200 len: 63235 microversion: 2.1 time: 0.158395 Oct 11 01:47:49.980548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2466/4975] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:47:49 2022] POST /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede/action => generated 63235 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:47:50.547020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:50.547775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:50.563272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:50.564785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:50.567362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:50.568262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:50.568855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:50.571094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:50.697308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:50.706155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97a549de-17ec-4bfb-a448-a09608acf169 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1276 microversion: 2.1 time: 0.164371 Oct 11 01:47:50.719694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2510/4976] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:50 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:51.734519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:51.735329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:51.768832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:51.769669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:51.770461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:51.793826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:51.800588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:51.801356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:52.480624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7c98a9-af8d-4e49-87db-38a7d7b733d7", "tag": "4a519691-461d-429b-b438-76cf5f0bf040"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:52.508005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:52.508621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:52.509153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:52.539738 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] Creating event network-changed:4a519691-461d-429b-b438-76cf5f0bf040 for instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 on n-h1-772273-9 Oct 11 01:47:52.551949 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7d4878c4-96aa-4070-b195-c861ec0f9123 req-13eb54d5-fcca-47e5-8286-56071be09663 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074908 Oct 11 01:47:52.553668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2511/4977] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:52.846328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:52.856491 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-016d81ef-5c2e-4d23-81b6-d97d3a4c9a0b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 1.126477 Oct 11 01:47:52.866835 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2467/4978] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:51 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:53.897697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:53.899078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:53.907882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:53.908700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:53.909355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:53.910269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:53.911067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:53.911772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:54.149911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:54.162331 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97c9c550-8373-4035-96c8-98f2aa6730d7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.272233 Oct 11 01:47:54.178690 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2512/4979] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:53 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:55.186331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:55.187049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:55.191562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:55.196353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:55.197025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:55.197465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:55.198300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:55.198761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:55.199221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:55.384273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:55.394862 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ccffa4b-8aeb-4c6d-b68d-22422b4b21cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.212497 Oct 11 01:47:55.395839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2468/4980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:55 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:56.418557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:56.419223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:56.435796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:56.436270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:56.436779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:56.437435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:56.437893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:56.438319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:56.467039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:56.467706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:56.474718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:56.475587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:56.476290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:56.477283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:56.477956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:56.478599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:56.698925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:56.712275 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12064ce4-62ef-486a-ab04-da1decb3f46d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.297828 Oct 11 01:47:56.713215 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2469/4981] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:56 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:47:56.720042 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ace50b8a-767a-414d-b315-f675e406cd39 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1831 microversion: 2.1 time: 0.485614 Oct 11 01:47:56.721303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2513/4982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:56 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1831 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:57.738011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:57.738850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:57.741184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:57.742980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:57.765084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:57.781057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:57.781753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:57.782728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:57.784306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:57.785009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.024885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7c98a9-af8d-4e49-87db-38a7d7b733d7", "name": "network-vif-plugged", "status": "completed", "tag": "4a519691-461d-429b-b438-76cf5f0bf040"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:58.050149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:58.059985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.060811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.062062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.107422 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] Creating event network-vif-plugged:4a519691-461d-429b-b438-76cf5f0bf040 for instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 on n-h1-772273-9 Oct 11 01:47:58.120559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5cd82c56-47b1-4480-ae14-dfbb7c9621de req-58d95c48-b6ed-405f-8d9f-59ee053165ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101967 Oct 11 01:47:58.126513 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2514/4983] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:47:58.149374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:58.153659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:58.164109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.181342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.181814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.182583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.183050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.183522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.226149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:58.234250 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94cba6a9-6774-41b0-a526-e0ae3bc7bfef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.501257 Oct 11 01:47:58.234843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2470/4984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:57 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:58.251666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:47:58.268953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:47:58.290648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.291141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.291659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.317441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] Creating event network-changed:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:47:58.326120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-bd91e5d4-8e7c-4414-a700-e94e769843ee req-bd0b8750-940e-4c26-8b5e-32fd31c1e36b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090003 Oct 11 01:47:58.326808 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2471/4985] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:47:58.350980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:47:58.429781 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0056f194-e9d1-4ccc-864e-db10d7d99408 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 204 len: 0 microversion: 2.1 time: 0.287549 Oct 11 01:47:58.431110 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2515/4986] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:47:58 2022] DELETE /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:47:58.440149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:58.440868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:58.457095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.457095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.457095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.457772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:58.458236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:58.458669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:58.687828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:58.697112 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-272b7b7b-0d5b-41f4-9df3-c5ac7831d754 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1686 microversion: 2.1 time: 0.261370 Oct 11 01:47:58.702012 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2472/4987] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:58 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1686 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:59.264550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:59.266571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:59.275898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:59.276716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:59.277878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:59.278862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:59.279722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:59.280389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:59.528445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:59.548056 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0547dc5a-c76b-496c-aedd-568159185974 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.288377 Oct 11 01:47:59.549367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2516/4988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:59 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:47:59.727286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:47:59.728744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:47:59.736417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:59.737466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:59.738118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:59.739062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:47:59.739830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:47:59.740774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:47:59.911898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:47:59.923029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d879830-a9a3-4122-824e-9fce629b049a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1686 microversion: 2.1 time: 0.199772 Oct 11 01:47:59.924964 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2473/4989] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:47:59 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:00.570185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:00.572073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:00.579975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:00.580709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:00.581472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:00.582859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:00.583553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:00.584216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:00.804563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:00.816633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6071f73f-7cbd-43dc-8e16-cc2f74c4a5c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1318 microversion: 2.1 time: 0.250396 Oct 11 01:48:00.817575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2517/4990] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:00 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:00.953016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:00.953827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:00.967695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:00.968190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:00.968633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:00.969355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:00.969809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:00.970239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:01.233969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced93dd1-34c9-4d86-8863-a0eaebf61ede", "name": "network-vif-deleted", "tag": "36ca40ad-a5e7-4b07-8cd6-6ae9620168cd"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:01.254772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:01.263664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:01.264409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:01.264882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:01.270049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-245793b2-1feb-4885-9561-6c336a8666b4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 200 len: 1568 microversion: 2.1 time: 0.321015 Oct 11 01:48:01.270871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2474/4991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:00 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:01.295602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] Creating event network-vif-deleted:36ca40ad-a5e7-4b07-8cd6-6ae9620168cd for instance ced93dd1-34c9-4d86-8863-a0eaebf61ede on n-h1-772273-9 Oct 11 01:48:01.302885 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7968e616-31c2-4ebf-a8b0-61452908b5c0 req-b24d6de0-c4fc-4a74-82fd-d3123f034ad5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073193 Oct 11 01:48:01.303892 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2518/4992] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:48:01.709932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:01.711278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:01.717346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:01.718061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:01.718606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:01.719401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:01.719952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:01.720434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:01.745870 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5946cde-e7c7-4bdb-8572-404dbe2db2ca tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/ips" status: 200 len: 147 microversion: 2.1 time: 0.039562 Oct 11 01:48:01.753453 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2475/4993] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:48:01 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:01.842261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:01.842971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:01.851324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:01.852765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:01.853726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:01.854821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:01.855493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:01.856691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.060137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:02.069569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-776c0edb-779c-466d-9a58-1ce782c4f73d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1508 microversion: 2.1 time: 0.232450 Oct 11 01:48:02.070428 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2519/4994] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:01 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:02.092186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:02.093729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:02.106653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.107526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.108215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.109588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.110211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.110819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.295538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:02.296442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: ced93dd1-34c9-4d86-8863-a0eaebf61ede] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:02.307389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.307895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.308330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.309146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.309478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.311818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.330543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:02.333250 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] HTTP exception thrown: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Request method failure captured: Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede HTTP/1.1 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMn3D9UHXOzpoEETJuHkb0QZUhhN94qVB3YbtTqVU9y6aLSCHC2Msq2z039wPrmpCbXOiUJtC7zEV9geYJvdTi8H2HiH97eDc1TlOUK3pxqVpkdISfS5blTLYGAKVbT7sNuhRJMixvZ6uppuSZ8YTk4UsQsYfAuwtgOb2jqJk46PPks Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: b6965eb3a6a74e62a184ea493c8fcb76 Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ced93dd1-34c9-4d86-8863-a0eaebf61ede'} Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:02.336373 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. Oct 11 01:48:02.341183 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:02.343998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Returning 404 to user: Instance ced93dd1-34c9-4d86-8863-a0eaebf61ede could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:48:02.345040 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be77a087-b7e7-43d8-abc0-17897f6eb04e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede" status: 404 len: 111 microversion: 2.1 time: 0.054662 Oct 11 01:48:02.346308 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2520/4995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:02 2022] GET /compute/v2.1/servers/ced93dd1-34c9-4d86-8863-a0eaebf61ede => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:48:02.346880 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b92fbae4-c40a-4135-be44-a5d3d6dadae5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1508 microversion: 2.1 time: 0.258183 Oct 11 01:48:02.355396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2476/4996] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:02 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:02.380585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:02.383568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:02.392042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.393933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.394483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.395485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.396069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.396792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.503741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:48:02.504559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:48:02.505262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:48:02.506020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:48:02.506683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:48:02.624382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:02.653083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:02.659931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.660890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.662518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.669393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.670597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.673436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.745701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27d07dac-b5ab-4630-aafa-e2bc27f7352f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "POST /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7/action" status: 202 len: 1110 microversion: 2.1 time: 0.369928 Oct 11 01:48:02.757608 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2521/4997] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:48:02 2022] POST /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7/action => generated 1110 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 01:48:02.772929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:02.774752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:02.783667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.784218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.784862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.785952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:02.786498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:02.786972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:02.971681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:02.981063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8473fd2-0a01-4c37-8b89-ce1ee20dde05 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.215549 Oct 11 01:48:02.982145 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2477/4998] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:02 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:04.005928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:04.007167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:04.016639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:04.017339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:04.018269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:04.019147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:04.033373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:04.034239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:04.246818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:04.267641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba3742ab-7b03-4cba-b9af-d817d88fcd97 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.265412 Oct 11 01:48:04.268895 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2522/4999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:03 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:04.445347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc182012-121f-4aaf-9049-270450d76ed8"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:04.449120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:04.457918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:04.458666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:04.459275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:04.460268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:04.461472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:04.462143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:04.819692 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-119aff51-d96e-4a73-bed8-41ec9344b0fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378319 Oct 11 01:48:04.820779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2478/5000] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:48:04 2022] POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:05.291743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:05.292514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:05.300248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:05.301010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:05.301631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:05.302841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:05.303550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:05.304501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:05.479571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:05.492489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a44981d-3b53-4d8e-953a-1da84149db5c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.204482 Oct 11 01:48:05.493884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2523/5001] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:05 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:06.523916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:06.524770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:06.534932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:06.536390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:06.536932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:06.537834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:06.538396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:06.538923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:06.844355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:06.853253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-035e2ec0-ddfb-4fc9-917e-394c69fdcaa2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.339214 Oct 11 01:48:06.865963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0476d75a-4358-4132-9cfc-28dce614cd6c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '.version_select at 0x7f11388b4700>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:06.868166 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2479/5002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:06 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:06.890668 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0476d75a-4358-4132-9cfc-28dce614cd6c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-929528035" status: 202 len: 0 microversion: 2.1 time: 0.029198 Oct 11 01:48:06.891609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2524/5003] 10.222.0.66 () {58 vars in 1281 bytes} [Tue Oct 11 01:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-929528035 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:48:06.931615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac9949de-677a-4eda-a584-58f5172bcc86 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: .version_select at 0x7f112f3b5ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1212028325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuBg+M5CnD31kMyhN0H/g6A3Aa5Vqe6aYZpdx2j5dqorzRsiIww3DCY5p+D/OMaXag0t6NXz7Hjt91ZD5ySD2ck1IptFGne46OheBzuoNczsV70uA3k7snaKY3qg4G12w=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:06.956086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ac9949de-677a-4eda-a584-58f5172bcc86 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:48:06.963401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-ac9949de-677a-4eda-a584-58f5172bcc86 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:48:06.997194 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac9949de-677a-4eda-a584-58f5172bcc86 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.069869 Oct 11 01:48:06.999625 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2480/5004] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:48:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:48:07.885317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:07.887402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:07.902999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:07.903940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:07.904766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:07.906070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:07.906934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:07.908115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:08.106121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:08.116869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-420f3b67-c18b-4a2c-a97e-1026596174c6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.242236 Oct 11 01:48:08.118155 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2525/5005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:07 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:09.141025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:09.142417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:09.149521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:09.150016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:09.150777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:09.151907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:09.152500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:09.152949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:09.436679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:09.445757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-451a5300-52fa-4181-bf54-9c51b8c2510d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.309800 Oct 11 01:48:09.459858 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2481/5006] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:09 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:10.470712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:10.471330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:10.486670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:10.487192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:10.487930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:10.488656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:10.489115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:10.489546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:10.698359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:10.709264 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee7cdb77-56f9-4ac1-a596-b1aa6d412baf tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.242727 Oct 11 01:48:10.710544 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2526/5007] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:10 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:11.736551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:11.737503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:11.753682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:11.754501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:11.754963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:11.755715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:11.758075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:11.761797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:11.835736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:12.050972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:12.060196 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e06a095-fcd9-4bfb-a814-ec89070d1731 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.331151 Oct 11 01:48:12.061243 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2482/5008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:11 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:13.090514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:13.091143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:13.101200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:13.101885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:13.102487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:13.103467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:13.105355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:13.105563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:13.347208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:13.357859 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-692999c3-a2fe-43b3-861a-c61b21ec0713 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.277588 Oct 11 01:48:13.359490 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2527/5009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:13 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:13.661368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-995856727", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "90e704e1-b309-4b2b-8e2d-2cb8bcbfd878"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1212028325", "security_groups": [{"name": "tempest-secgroup-smoke-2114428279"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:13.827454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] validate_networks() for [('90e704e1-b309-4b2b-8e2d-2cb8bcbfd878', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:48:14.330164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:48:14.330919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:48:14.331601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:48:14.332205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:48:14.332815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:48:14.342476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:14.342967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:14.343454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:14.344196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:14.344821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:14.346033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:14.371399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:48:14.377500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:48:14.383533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:14.384307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:14.392715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:48:14.395074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:48:14.396652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:14.399860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:14.400437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:14.402063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:14.405781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:14.406435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:14.473824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88aa859a-b7bc-4bf9-8323-ce79a86d3e09 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.816918 Oct 11 01:48:14.474500 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2483/5010] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:48:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:48:14.490373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2179d16f-9cfd-49b5-a436-fee8a19100a4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:14.510969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2179d16f-9cfd-49b5-a436-fee8a19100a4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:14.601469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2179d16f-9cfd-49b5-a436-fee8a19100a4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:14.610441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2179d16f-9cfd-49b5-a436-fee8a19100a4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1266 microversion: 2.1 time: 0.127828 Oct 11 01:48:14.611461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2484/5011] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:14 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:14.676741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:14.685862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a78d12e0-4009-4273-8a46-e5ab7011b9cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.307846 Oct 11 01:48:14.686926 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2528/5012] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:14 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:15.636848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:15.638273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:15.649059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:15.649944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:15.650396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:15.651329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:15.651823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:15.652261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:15.714823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:15.716723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:15.730411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:15.731452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:15.733127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:15.733955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:15.734210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:15.734777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:15.735481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:15.745118 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6dcbcc1-8b8d-451b-96c5-f23a361fb354 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1318 microversion: 2.1 time: 0.113057 Oct 11 01:48:15.746832 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2485/5013] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:15 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1318 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:15.958210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:15.969789 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16366fef-1b6d-4018-8e74-dd6607f190a3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.258914 Oct 11 01:48:15.983888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2529/5014] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:15 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:16.769813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:16.770477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:16.777922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:16.778418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:16.778864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:16.779609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:16.780072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:16.780503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:16.873753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:16.883898 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-74830c1f-9cc1-4b45-937b-cdd49a74a022 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1324 microversion: 2.1 time: 0.117767 Oct 11 01:48:16.896230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2486/5015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:16 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:16.995453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:16.996814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:17.006149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:17.006843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:17.007523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:17.008409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:17.009168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:17.009773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:17.272933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:17.291598 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c6489ee-83f2-4b4b-b8d9-dbbb69f8e557 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.300885 Oct 11 01:48:17.304175 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2530/5016] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:16 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:17.912289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:17.919266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:17.932496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:17.940459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:17.941374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:17.944639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:17.945354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:17.946031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.174858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:18.197412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.197914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.198579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.224225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:18.229103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:48:18.261328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:18.271865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4707cb1-d848-4ea2-af20-fe643840abaf tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.366165 Oct 11 01:48:18.280452 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2487/5017] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:17 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:18.302260 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a929ef59-f78b-44fa-b037-aa402da6f9da tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action" status: 202 len: 0 microversion: 2.1 time: 0.132398 Oct 11 01:48:18.307283 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2531/5018] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:48:18 2022] POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:48:18.316080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:18.317474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:18.320025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:18.321174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:18.329937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.331192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.332142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.332422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.333251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.334419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.334954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.335710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.336045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.336442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.336999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.337458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.645021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:18.654024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:18.654994 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5918079f-e9b6-432b-93cc-cbdf1cc5b3ce tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.340919 Oct 11 01:48:18.656409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2532/5019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:18 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:18.670188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f0c3671-d19c-47f9-a5f7-b79871d0be46 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.361330 Oct 11 01:48:18.677212 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2488/5020] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:18 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:18.773020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:18.786673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:18.787172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:18.787661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:18.802246 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] Creating event network-changed:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h1-772273-9 Oct 11 01:48:18.808404 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-94473924-f1a8-4b79-8494-d0ea76cb8265 req-f1bfce52-0f36-4644-b9dc-92f0b2142f14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039614 Oct 11 01:48:18.809524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2533/5021] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:19.297778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:19.298731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:19.305974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.306865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.307433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.308408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.310228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.310760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.446669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:19.454397 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9256474e-90a4-4ccb-bccc-3d6f3d9747f5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.161203 Oct 11 01:48:19.455682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2489/5022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:19 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:19.685025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:19.685735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:19.696639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:19.697470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:19.701725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.702221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.702672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.703927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.703927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.704291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.711654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.712373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.712817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.713533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:19.713998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:19.714432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:19.920821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:19.928933 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6f9c0db-700f-4355-a8f8-1a73e5c6ec1b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.248966 Oct 11 01:48:19.929724 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2534/5023] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:19 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:19.933231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:19.941960 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a5a0cdc-333f-4367-bbcd-22b87d1f073f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.249489 Oct 11 01:48:19.942707 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2490/5024] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:19 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:20.480825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:20.481505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:20.491701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.492324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.492867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:20.493816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.494518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.495018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:20.772423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:20.781137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6abb40a1-485b-4ca8-b149-4b33069b5c42 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.304996 Oct 11 01:48:20.781916 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2535/5025] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:20 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:20.953076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:20.953695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:20.966231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:20.967043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:20.973403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.973906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.974347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:20.975286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.975545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.975988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:20.981760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.982259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.982707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:20.983448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:20.983906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:20.984337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:21.200573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:21.206771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:21.209514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3acd4521-7a06-42f4-a4a7-5f4fab7cce45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.247381 Oct 11 01:48:21.210235 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2536/5026] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:20 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:21.219619 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aea49d3b-a1ba-4719-8847-c8b4310b6f47 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.265619 Oct 11 01:48:21.219619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2491/5027] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:20 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:21.804893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:21.805655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:21.812447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:21.813111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:21.813662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:21.814500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:21.815070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:21.815656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:21.956956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:21.965670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a8f4648-2fb2-4c48-b78e-cfdede1b600d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.164845 Oct 11 01:48:21.966258 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2492/5028] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:21 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:22.232531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:22.233322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:22.238009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:22.238631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:22.241310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.242034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:22.242601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:22.243445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.244081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:22.244674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:22.245295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.245788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:22.246234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:22.246940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.247422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:22.247852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:22.495321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:22.496977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:22.513997 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d95975a-a8ee-4fb1-9f06-38fc968a6a1f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.280487 Oct 11 01:48:22.514588 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2493/5029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:22 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:22.517971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e61e7ccc-f589-4901-976a-55ee84b303c5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.287757 Oct 11 01:48:22.531449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2537/5030] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:22 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:22.990306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:22.990916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:22.997771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.998256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:22.998696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:22.999418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:22.999872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.000296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.142497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:23.150562 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9443436e-87a4-4997-b2ce-26d993409ef5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.165051 Oct 11 01:48:23.151282 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2494/5031] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:22 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:23.538937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:23.539613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:23.543089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:23.544333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:23.553124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:23.553936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.554116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:23.554497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.554947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.555111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.556044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:23.556184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:23.556793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.556927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.557401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.557706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.796153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:23.801862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:23.805853 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-befe11ab-1c87-42b1-a9c2-7bc76928ddc0 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.270991 Oct 11 01:48:23.806459 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2538/5032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:23 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:23.812282 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76c535bd-449f-4266-bdf8-2eb69c57b84d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.274079 Oct 11 01:48:23.821063 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2495/5033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:23 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:23.970266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "name": "network-vif-plugged", "status": "completed", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:23.980365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:23.980928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:23.981436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:23.993355 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] Creating event network-vif-plugged:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h1-772273-9 Oct 11 01:48:23.998729 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f0645327-ff03-4ce5-9d6b-860345b48906 req-61560b3e-ed73-41e2-94c2-1aa0c81e8315 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032129 Oct 11 01:48:23.999372 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2539/5034] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:24.174580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:24.175198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:24.182483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.182972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.183460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:24.184164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.184622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.185053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:24.312838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:24.321215 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84107b97-9ebe-4ece-b067-d80cb2b2e01f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1392 microversion: 2.1 time: 0.151102 Oct 11 01:48:24.321820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2496/5035] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:24 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:24.831806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:24.832642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:24.835274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:24.836211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:24.839408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:24.839593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.840293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.840485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:24.841108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:24.841978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.842459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.843145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:24.844308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.844775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.845749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:24.846759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:24.847424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:24.847862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:25.043998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:25.049199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:25.053298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d00b777-661d-404c-886a-11e3f4d19250 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.226754 Oct 11 01:48:25.054062 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2540/5036] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:24 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:25.065805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4039c36f-7ad5-49a1-98a4-b4c90497ba04 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.234251 Oct 11 01:48:25.066595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2497/5037] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:24 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:25.347486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:25.348481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:25.355166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:25.355704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:25.356164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:25.357154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:25.357743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:25.358174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:25.497307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:25.505259 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-603c3a52-a67a-4da6-8f4e-e650171871a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1564 microversion: 2.1 time: 0.163255 Oct 11 01:48:25.505847 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2541/5038] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:25 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:25.527141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:25.527789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:25.530404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:25.536304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:25.536785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:25.537221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:25.537906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:25.538356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:25.538785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:25.685984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:25.693824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee05f81a-6ab0-4f68-b8b2-6bb0552b0ded tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1564 microversion: 2.1 time: 0.170506 Oct 11 01:48:25.694399 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2498/5039] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:25 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:26.078547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:26.079171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:26.086501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:26.087269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:26.087739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:26.088459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:26.088918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:26.089118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:26.089525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:26.089735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:26.099695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:26.100216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:26.100648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:26.101375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:26.101835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:26.102262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:26.349821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:26.359838 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7750622d-3515-4531-a1e3-ac85462c2256 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.285150 Oct 11 01:48:26.362258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2542/5040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:26 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:26.416382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:26.428929 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c78bee48-f06e-4e1b-b409-aa8fe32885f4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.343596 Oct 11 01:48:26.432205 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2499/5041] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:26 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:27.384943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:27.386381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:27.393844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:27.394347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:27.394793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:27.395547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:27.396177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:27.396615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:27.454244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:27.454969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:27.462139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:27.462636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:27.463084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:27.463831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:27.464297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:27.464729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:27.857261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:27.865978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:27.868342 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f6bd424-15f8-4b7b-a33b-08efcfeef8ef tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.487189 Oct 11 01:48:27.869670 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2543/5042] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:27 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:27.880570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:27.897044 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48639482-5aeb-4e71-a5b6-3ba67cf1fc0b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.446691 Oct 11 01:48:27.897790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2500/5043] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:27 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:28.067498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:28.068372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:28.078403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.079375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.081024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.081914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.082525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.083169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.091571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:28.102497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.103299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.104334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.121026 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] Creating event network-changed:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h1-772273-9 Oct 11 01:48:28.130909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-30b4a9a3-bfdf-4201-8b02-9d3e1793e7ba req-1831269b-8154-487d-8782-523757c240cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039635 Oct 11 01:48:28.133433 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2501/5044] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:28.367205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:28.390305 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ebeb258-f9f1-47a1-a753-0e05e1dd44d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1564 microversion: 2.1 time: 0.322706 Oct 11 01:48:28.392212 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2544/5045] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:28 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:28.896887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:28.897690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:28.905277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.905990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.906606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.907594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.908938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.909587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.921170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:28.922119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:28.929896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.930662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.931310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:28.932262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:28.932941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:28.933586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:29.167526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:29.176417 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c80478db-d962-488c-97cf-7eedeaa7817a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.284383 Oct 11 01:48:29.183599 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2502/5046] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:28 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:29.186677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:29.204629 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02bd1e0f-dd5d-4bb9-b5fd-40c137cbfd28 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.288085 Oct 11 01:48:29.206086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2545/5047] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:28 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:30.200285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:30.200903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:30.208724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:30.209461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:30.210363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:30.211068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:30.211708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:30.212862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:30.229625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:30.231166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:30.243911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:30.244405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:30.244886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:30.245707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:30.246020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:30.246422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:30.448582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:30.457474 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b39c01f-ffa7-4c6c-9bbc-6cede540172c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.261409 Oct 11 01:48:30.471770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:30.472473 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2503/5048] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:30 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:30.478398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c52c45e-f169-400d-86eb-efe0152bb7e5 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.252635 Oct 11 01:48:30.479252 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2546/5049] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:30 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:31.482301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:31.483115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:31.491080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:31.491831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:31.492276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:31.492988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:31.493451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:31.493883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:31.508142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:31.509451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:31.516765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:31.517356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:31.517903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:31.518673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:31.519233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:31.519753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:31.709560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:31.713793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:31.722928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94bd4a31-5c24-4a98-b233-9b634e810e8c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.244570 Oct 11 01:48:31.723832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88621add-8c9d-47e3-84f7-b90fc57adf79 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.219035 Oct 11 01:48:31.729719 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2547/5050] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:31 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:31.729855 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2504/5051] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:31 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:32.747226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:32.747821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:32.748190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:32.748466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:32.754826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:32.756252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:32.756747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:32.756862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:32.757179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:32.757348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:32.757686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:32.758248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:32.758604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:32.758764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:32.759152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:32.759637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:32.760419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:32.783743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:32.964703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:32.968210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:32.973370 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d565ce60-9023-4770-969c-96ace4f9799c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.229170 Oct 11 01:48:32.974351 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2505/5052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:32 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:32.976467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f0e98d76-ea9d-4f64-81e8-b74af1338b39 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.234100 Oct 11 01:48:32.983391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2548/5053] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:32 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:33.996828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:33.998060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:34.000016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:34.001118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:34.005055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:34.005544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:34.006013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:34.006697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:34.007169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:34.007608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:34.008319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:34.008923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:34.009360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:34.010253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:34.010876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:34.013006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:34.213340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:34.216952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:34.222231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26f7b8d9-f5af-46db-bff0-29f5326f449a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1725 microversion: 2.1 time: 0.229290 Oct 11 01:48:34.222923 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2506/5054] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:33 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:34.225481 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57463c90-fcfa-4760-a3b1-4395037adbf8 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1515 microversion: 2.1 time: 0.229814 Oct 11 01:48:34.229341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2549/5055] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:33 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:35.246600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:35.247133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:35.249234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:35.249987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:35.254503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.254996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.255470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.256169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.256625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.257053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.257238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.257989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.258437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.259271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.259642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.260272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.457569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:35.462019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:35.466504 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38bb2337-8c99-44b6-91fd-1467a7df72d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1702 microversion: 2.1 time: 0.224255 Oct 11 01:48:35.467207 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2507/5056] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:35 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1702 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:35.470963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce322f43-1978-4e1a-ba89-b8146616b825 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.225035 Oct 11 01:48:35.471558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2550/5057] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:35 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:35.491015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:35.497087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.497520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.497962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.519868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 01:48:35.562023 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4815e9fe-f892-4456-85c1-9c0cde7021e3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action" status: 202 len: 0 microversion: 2.1 time: 0.074980 Oct 11 01:48:35.562644 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2508/5058] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:48:35 2022] POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:48:35.570945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:35.571844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:35.578660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.579200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.580273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.580992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:35.581485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:35.582095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:35.808174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:35.817854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-442e369d-83a1-4f19-9844-a1b5b25e37d4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1711 microversion: 2.1 time: 0.250783 Oct 11 01:48:35.818464 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2551/5059] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:35 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1711 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:36.495616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:36.496230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:36.504088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:36.504676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:36.505115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:36.505814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:36.506269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:36.506699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:36.642765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:36.651084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b84ad676-9b94-44f3-91e1-b903e5326e19 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.160910 Oct 11 01:48:36.651806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2509/5060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:36 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:36.842182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:36.843193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:36.852824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:36.853318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:36.853838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:36.854860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:36.855406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:36.856107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:37.015907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:37.021303 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36ac7d33-6dcb-4b1d-bef8-ad03a5d53066 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1711 microversion: 2.1 time: 0.182824 Oct 11 01:48:37.025640 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2552/5061] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:36 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:37.675257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:37.675912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:37.682666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:37.683146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:37.683611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:37.684302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:37.684753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:37.685174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:37.812371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:37.820549 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a27cd87b-5fa1-42c7-b215-f98650272b04 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.149760 Oct 11 01:48:37.821121 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2510/5062] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:37 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:38.049746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:38.050810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:38.059363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:38.059947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:38.061247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:38.062180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:38.062867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:38.063559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:38.225446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7c98a9-af8d-4e49-87db-38a7d7b733d7", "name": "network-vif-unplugged", "status": "completed", "tag": "4a519691-461d-429b-b438-76cf5f0bf040"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:38.242515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:38.246867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:38.247386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:38.247838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:38.252188 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-591d6600-de1d-4192-9d99-d7242ad7685b tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1715 microversion: 2.1 time: 0.210919 Oct 11 01:48:38.255414 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2553/5063] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:38 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1715 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:38.259916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] Creating event network-vif-unplugged:4a519691-461d-429b-b438-76cf5f0bf040 for instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 on n-h1-772273-9 Oct 11 01:48:38.264792 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-755ed74d-7dd0-403b-b222-d7e0c296f1a5 req-66c0e36c-fcd9-4c4b-a95b-ca407f998a05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202622 Oct 11 01:48:38.265741 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2511/5064] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:48:38.843274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:38.844465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:38.850832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:38.851329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:38.851804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:38.852511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:38.852974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:38.853408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:39.002812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:39.014986 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-94eb17a5-76a7-41a3-9816-4d17a3e88a40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.174855 Oct 11 01:48:39.023309 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2554/5065] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:38 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:40.046331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:40.047035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:40.062778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:40.063268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:40.063763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:40.064468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:40.064919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:40.065340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:40.211414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:40.220627 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a6c4f52-e30d-4417-befa-48cc950b1ba9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.177654 Oct 11 01:48:40.221636 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2512/5066] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:40 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:40.280060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7c98a9-af8d-4e49-87db-38a7d7b733d7", "name": "network-vif-plugged", "status": "completed", "tag": "4a519691-461d-429b-b438-76cf5f0bf040"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:40.291175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:40.291864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:40.292226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:40.307171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] Creating event network-vif-plugged:4a519691-461d-429b-b438-76cf5f0bf040 for instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 on n-h1-772273-9 Oct 11 01:48:40.312800 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1336371b-1389-4a16-98f6-f5d583a3df56 req-67b1b99d-95cf-40d8-b648-3237b9d0007f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036254 Oct 11 01:48:40.313416 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2555/5067] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:41.244220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:41.244839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:41.252263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:41.252747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:41.253185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:41.253879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:41.254334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:41.254763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:41.391299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:41.399207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ee6077e-697f-4faf-b3b5-6156cb3275be tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1521 microversion: 2.1 time: 0.158878 Oct 11 01:48:41.399820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2513/5068] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:41 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:42.422678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:42.423412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:42.431057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.431583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.432032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.432733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.433194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.433632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.568840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:42.577110 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d437de6c-b27d-405a-b2de-dcdb7a53a4f5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1506 microversion: 2.1 time: 0.158751 Oct 11 01:48:42.577704 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2556/5069] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:42 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:42.599864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:42.600492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:42.607421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.607912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.608352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.609115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.609574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.610001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.743674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:42.751482 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48c06321-bc55-47e6-91ff-879968757634 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 200 len: 1506 microversion: 2.1 time: 0.155465 Oct 11 01:48:42.752061 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2514/5070] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:42 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:42.774213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:42.774718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:42.780735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.781223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.781667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.782361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:42.782820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:42.783245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:42.808105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:48:42.887684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a03124e-7c4e-4d00-90e8-ec7bdc0299bd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 204 len: 0 microversion: 2.1 time: 0.117067 Oct 11 01:48:42.888749 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2557/5071] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:48:42 2022] DELETE /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:48:43.010984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-345342738", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "e94fc197-8b28-487e-ac8e-46fa4f41b411"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:43.067007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] validate_networks() for [('e94fc197-8b28-487e-ac8e-46fa4f41b411', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:48:43.453066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:48:43.453492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:48:43.453971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:48:43.454389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:48:43.454800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:48:43.464724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:43.465382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:43.465836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:43.466928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:43.467363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:43.467749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:43.485545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:48:43.491722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for user 284a096df3f64ab8a2d77331498880ba and project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:48:43.504037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:48:43.506365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:48:43.553106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c54f4dc-eb31-4003-ba3e-1d3d622a2510 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545938 Oct 11 01:48:43.553953 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2515/5072] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:48:43.567441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee5ac706-fbf7-4cfb-9176-19d336ebed43 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:43.568166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ee5ac706-fbf7-4cfb-9176-19d336ebed43 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:43.632735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee5ac706-fbf7-4cfb-9176-19d336ebed43 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:43.644453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee5ac706-fbf7-4cfb-9176-19d336ebed43 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1217 microversion: 2.1 time: 0.082740 Oct 11 01:48:43.645136 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2558/5073] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:43 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:44.668697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:44.669425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:44.697410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:44.698295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:44.699466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:44.702293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:44.703264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:44.705331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:44.807795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:44.829052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed2f02b6-bbe2-416e-8245-c3f971463301 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1287 microversion: 2.1 time: 0.165253 Oct 11 01:48:44.831358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2516/5074] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:44 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:44.944915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7c98a9-af8d-4e49-87db-38a7d7b733d7", "name": "network-vif-deleted", "tag": "4a519691-461d-429b-b438-76cf5f0bf040"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:44.961219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:44.961713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:44.962356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:44.978233 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] Creating event network-vif-deleted:4a519691-461d-429b-b438-76cf5f0bf040 for instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 on n-h1-772273-9 Oct 11 01:48:44.983421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-940d81b3-002e-4365-9185-10306af1b69e req-532f79ed-57df-4dbf-89d5-3814371602a6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042220 Oct 11 01:48:44.984680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2559/5075] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:45.852757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:45.853382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:45.860755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:45.861245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:45.861681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:45.863408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:45.863877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:45.864321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:46.009754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:46.019146 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d020085-359c-4b3a-be55-49a38cadb1d9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.170121 Oct 11 01:48:46.019978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2517/5076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:45 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:46.280602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af5db52-390f-487f-b464-a4be620a3ff2", "tag": "cc21a407-699b-4f29-b9b7-083155afaf4b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:46.297054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:46.297910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:46.299985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:46.322631 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] Creating event network-changed:cc21a407-699b-4f29-b9b7-083155afaf4b for instance 4af5db52-390f-487f-b464-a4be620a3ff2 on n-h2-772273-9 Oct 11 01:48:46.330548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-82f80c33-9487-42c8-a405-d3af8858054c req-d6941253-bea2-4018-b2cc-fc3e5bdaa964 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053662 Oct 11 01:48:46.331808 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2560/5077] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:47.042418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:47.043073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:47.049991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:47.050481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:47.050923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:47.051644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:47.052103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:47.052533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:47.073964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:47.197788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:47.205491 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-975d1613-cb71-481e-a9ee-5734bf43285c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.167254 Oct 11 01:48:47.206568 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2518/5078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:47 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:48.229078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:48.229776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:48.236806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:48.237287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:48.238000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:48.238681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:48.239133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:48.239579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:48.372524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:48.380858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f1e4050d-dc9f-439a-a77c-a16967c4e499 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.155988 Oct 11 01:48:48.381435 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2561/5079] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:48 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:49.404111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:49.404724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:49.412001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:49.412485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:49.412920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:49.413616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:49.414063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:49.414483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:49.560518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:49.570182 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d629b2f3-2d39-4b15-810c-11305aebbc6d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.169845 Oct 11 01:48:49.583794 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2519/5080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:49 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:50.594350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:50.595122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:50.602663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:50.603167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:50.603637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:50.604524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:50.604805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:50.605270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:50.766412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:50.775267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8775e20a-6744-4b44-9f16-c4c1924e17d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.184977 Oct 11 01:48:50.776267 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2562/5081] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:50 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:51.691952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:51.694294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:51.701301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:51.701723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:51.702157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:51.702842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:51.703294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:51.703802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:51.755388 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5c7b1ee-6bb5-43f1-87c0-d76dbe74c80e tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action" status: 200 len: 24572 microversion: 2.1 time: 0.067152 Oct 11 01:48:51.762467 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2520/5082] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:48:51 2022] POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:48:51.798381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:51.799171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:51.807915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:51.808417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:51.808890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:51.809609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:51.810075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:51.810510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:51.948056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:51.956438 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e8ebb87-9895-4b09-98ff-d7df89c3f126 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.161590 Oct 11 01:48:51.956971 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2563/5083] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:51 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:52.679578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af5db52-390f-487f-b464-a4be620a3ff2", "name": "network-vif-plugged", "status": "completed", "tag": "cc21a407-699b-4f29-b9b7-083155afaf4b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:52.692412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:52.693023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:52.693327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:52.705046 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] Creating event network-vif-plugged:cc21a407-699b-4f29-b9b7-083155afaf4b for instance 4af5db52-390f-487f-b464-a4be620a3ff2 on n-h2-772273-9 Oct 11 01:48:52.711150 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-38bd884a-1299-4e4d-9aeb-a21ac6c7e5b8 req-815629f4-a88b-4db7-8ac0-f3d5c3cacc84 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036128 Oct 11 01:48:52.711804 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2521/5084] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:52.979472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:52.980007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:52.987236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:52.988018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:52.988457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:52.989143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:52.989596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:52.990047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.126107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:53.135501 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3b5fecd-897d-415f-bd93-b46c90b228cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.159896 Oct 11 01:48:53.136284 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2564/5085] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:52 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:53.507133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:53.507748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:53.510245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:53.510928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:53.517751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.518238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.518683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.519491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.519953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.520383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.544259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fefdd8fb-6551-45f3-9d2d-0c2f0129dfb2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/ips" status: 200 len: 150 microversion: 2.1 time: 0.042069 Oct 11 01:48:53.544846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2522/5086] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:48:53 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:53.557101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd531724-efe7-477e-8934-58b0688ee31e"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:53.559555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:53.566580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.566580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.566983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.567804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.568261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.568716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.637616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:53.650346 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/os-volume_attachments HTTP/1.1 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 74 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: {"volumeAttachment": {"volumeId": "bd531724-efe7-477e-8934-58b0688ee31e"}} Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': 'b032e747-3e10-4877-a5bb-21db7c9b9448', 'body': {'volumeAttachment': {'volumeId': 'bd531724-efe7-477e-8934-58b0688ee31e'}}} Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:48:53.652117 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 400 to user: Invalid volume: volume bd531724-efe7-477e-8934-58b0688ee31e is already attached to instances: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:48:53.657398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3dc4c58-b6fb-4ebf-b8ab-8193067eb8b5 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100662 Oct 11 01:48:53.658853 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2565/5087] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:48:53 2022] POST /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 01:48:53.662645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:53.663148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:53.669840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.670328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.670768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.671498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.671951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.672382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.699120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:48:53.775723 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0849192c-f63e-4983-a0cd-e3516a0d556c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 204 len: 0 microversion: 2.1 time: 0.116882 Oct 11 01:48:53.776581 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2523/5088] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:48:53 2022] DELETE /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:48:53.785476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:53.786091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:53.792260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.792747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.793184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.793870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:53.794321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:53.794739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:53.815460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:53.941764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:53.949840 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdf3de19-bf83-4a6a-816a-4c3272d413ad tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1681 microversion: 2.1 time: 0.168863 Oct 11 01:48:53.950435 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2566/5089] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:53 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:54.160021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:54.160728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:54.167905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:54.168397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:54.168835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:54.169522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:54.169973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:54.170397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:54.306453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:54.314477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6ecfd87-b7dc-4b00-94e7-d39e272c2975 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1317 microversion: 2.1 time: 0.158798 Oct 11 01:48:54.315776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2524/5090] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:54 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:54.975792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:54.976427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:54.983240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:54.983768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:54.984217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:54.985207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:54.985644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:54.986078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.132682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:55.140619 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-278577a0-5632-46fb-b0ec-7273f52920b6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1681 microversion: 2.1 time: 0.168981 Oct 11 01:48:55.141203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2567/5091] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:54 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:55.338036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:55.338661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:55.345799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.346824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.347244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.347980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.348452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.348885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.501904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:55.516045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a222dbae-456c-4e1c-875c-04807fb837c3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1507 microversion: 2.1 time: 0.181885 Oct 11 01:48:55.516954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2525/5092] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:55 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:55.540396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:55.541508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:55.548119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.548921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.550166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.550973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.551690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.552344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.701670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:55.711963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7da11b8-e084-4063-9ee3-4867e8dd85e9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1507 microversion: 2.1 time: 0.175854 Oct 11 01:48:55.712720 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2568/5093] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:55 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:55.735017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:55.737786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:55.751888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:48:55.758029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.758650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.759200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.760188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.761252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.761252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.831749 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1592661-bb25-4f15-a19c-3579ee3d5452 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "PUT /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1079 microversion: 2.1 time: 0.100517 Oct 11 01:48:55.832998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2526/5094] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:48:55 2022] PUT /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1079 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:55.851462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:55.852088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:55.865374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.865794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.866232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:55.866931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:55.867405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:55.867967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.021667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:56.042803 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d59b7195-a308-4dbc-8e1e-65bf01fb19b3 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1505 microversion: 2.1 time: 0.195140 Oct 11 01:48:56.043470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2569/5095] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:55 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:56.068736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:56.070127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:56.083405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.087973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.089116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.090157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.090889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.091877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.164466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:56.164979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:56.174288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.174785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.175220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.178216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.178860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.179492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.278712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:56.284929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:56.293867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-02a7c7e2-7cff-47f5-8920-ce5775c7fc2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1505 microversion: 2.1 time: 0.230740 Oct 11 01:48:56.294817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2527/5096] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:56 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:56.300421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b496ba41-1850-4139-9db7-63533dede8cf tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 200 len: 1614 microversion: 2.1 time: 0.140109 Oct 11 01:48:56.301092 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2570/5097] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:56 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 1614 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:56.339438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:56.342316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:56.351114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.351726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.352927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.353707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.354363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.354860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.431063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b032e747-3e10-4877-a5bb-21db7c9b9448", "name": "network-vif-deleted", "tag": "6460334e-a692-415c-beb9-b4187d0e9322"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:48:56.443747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.444240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.444853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.460119 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] Creating event network-vif-deleted:6460334e-a692-415c-beb9-b4187d0e9322 for instance b032e747-3e10-4877-a5bb-21db7c9b9448 on n-h2-772273-9 Oct 11 01:48:56.463090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:48:56.463662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:48:56.464563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:48:56.465329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:48:56.465880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-db616429-98fa-44dd-a7a0-f669cdd60b9a req-d60a265e-1b27-4ac3-bd46-711dcb57e3c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042289 Oct 11 01:48:56.466240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:48:56.466810 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2571/5098] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:56.615046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:56.646541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.647119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.647771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.648696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.649281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.649926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.685725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8d33a96-834e-42ed-a2af-abb6b4a00d6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "POST /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2/action" status: 202 len: 1111 microversion: 2.1 time: 0.372275 Oct 11 01:48:56.686278 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2528/5099] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:48:56 2022] POST /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2/action => generated 1111 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 01:48:56.713709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:56.714458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:56.723258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.724057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.724665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:56.725542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:56.726182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:56.726776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:57.332069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:57.332688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:57.340471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:57.341178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:57.341393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:57.342112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:57.342572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:57.343005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:57.358572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:48:57.364181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:57.372988 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b4e40f7-4905-45b9-896a-448a7bcc4f62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.668007 Oct 11 01:48:57.373584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2572/5100] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:56 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 HTTP/1.1 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b032e747-3e10-4877-a5bb-21db7c9b9448'} Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:48:57.389455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0449df30-17bf-41cc-8d24-c0d7208cab68 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 404 len: 111 microversion: 2.1 time: 0.053840 Oct 11 01:48:57.396494 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2529/5101] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:57 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:48:57.397305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d91481ea-cfad-43ea-be02-7aa627c6b8a3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '.version_select at 0x7f1138805040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:57.417525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d91481ea-cfad-43ea-be02-7aa627c6b8a3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140206830" status: 202 len: 0 microversion: 2.1 time: 0.030752 Oct 11 01:48:57.421536 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2573/5102] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140206830 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:48:58.171358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:58.171853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:58.178359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.178837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.179269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.179977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.180447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.180975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.266977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lazy-loading 'services' on Instance uuid 5886fe0d-cbdb-4ff6-a253-b7564c291e8c {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:48:58.341360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0b676d6-40aa-4a16-a4d8-94d2e746a61c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments/bd531724-efe7-477e-8934-58b0688ee31e" status: 202 len: 0 microversion: 2.1 time: 0.173755 Oct 11 01:48:58.342351 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2530/5103] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:48:58 2022] DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments/bd531724-efe7-477e-8934-58b0688ee31e => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:48:58.353612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:58.355819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:58.364435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.365120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.365607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.366700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.367681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.368135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.407628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:58.411195 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b57dfd99-fc3e-4e92-b7b4-4b19cb1a5fc9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064050 Oct 11 01:48:58.411816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:58.412398 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2574/5104] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:48:58 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:58.422648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.423145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.423645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.425096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:58.425557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:58.425982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:58.814637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:48:58.823306 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20473790-c171-46a9-870f-c30cb7ef212e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.420140 Oct 11 01:48:58.823935 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2531/5105] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:58 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:48:59.425755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:59.428249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:59.437142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:59.437643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:59.438097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:59.438814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:59.439275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:59.439770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:59.471179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc193d55-863d-4e09-8f17-1ae87511aa9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050568 Oct 11 01:48:59.471985 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2575/5106] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:48:59 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:48:59.848581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:48:59.849275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:48:59.856394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:59.856997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:59.857559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:59.858370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:48:59.859098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:48:59.859653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:48:59.865076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:00.012323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:00.020497 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe7a481e-9e79-4a26-bf14-174e3eb0106b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.177118 Oct 11 01:49:00.021059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2532/5107] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:48:59 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:00.484179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:00.486459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:00.493780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:00.494273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:00.494712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:00.495447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:00.495898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:00.496318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:00.529805 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29d991b5-2fd7-450e-8f8f-27889ef69520 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049620 Oct 11 01:49:00.530309 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2576/5108] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:49:00 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:01.044650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:01.045297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:01.053329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:01.053825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:01.054268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:01.054968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:01.055460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:01.055897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:01.207381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:01.215807 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d3d4ae3-d94d-40fa-8f99-39b695a3ad6b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.175756 Oct 11 01:49:01.216933 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2533/5109] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:01 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:01.542832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:01.545390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:01.552472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:01.553090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:01.553694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:01.554500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:01.555057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:01.555614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:01.587496 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd4a71e3-bcc5-49b9-978c-e41ab67bbb56 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049084 Oct 11 01:49:01.588416 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2577/5110] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:49:01 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:02.240285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:02.241054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:02.247899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.248624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.249182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.250007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.250575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.251110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.409054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:02.417190 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8db571d-c30e-4262-a399-97f912a163cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.181951 Oct 11 01:49:02.417883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2534/5111] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:02 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:02.603682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:02.606942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:02.616265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.616765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.617613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.618749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.619847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.620289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.663165 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2cae3b25-31f1-439f-bc22-88b542ad23b1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065026 Oct 11 01:49:02.664470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2578/5112] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:49:02 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:02.690567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:02.691419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:02.697634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.698203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.698719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.699532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.700064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.700586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.840442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:02.848827 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3c29f9a-383f-4604-a86e-f55b91e98524 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1682 microversion: 2.1 time: 0.162209 Oct 11 01:49:02.849735 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2535/5113] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:02 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:02.952254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:02.954619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:02.957400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:02.962932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.963608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.964151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:02.964958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:02.965518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:02.966042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.033144 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-913bed02-a2b7-477f-85bf-bd41b3a6058c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action" status: 200 len: 32644 microversion: 2.1 time: 0.084431 Oct 11 01:49:03.034074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2579/5114] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:49:02 2022] POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action => generated 32644 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:49:03.216335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:03.216966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.223121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.223657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.224110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.224831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.225298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.225736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.363975 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10c1f14c-74fb-4194-8a2d-cd0dc9ef61e9 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1833 microversion: 2.1 time: 0.151466 Oct 11 01:49:03.364905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2536/5115] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:03 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1833 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:03.394175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:03.396765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.403911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.404402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.404857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.405564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.406028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.406460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.432592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lazy-loading 'flavor' on Instance uuid 58e66d95-a00e-4166-844d-7f7de87b334a {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:49:03.441303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:03.441925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.446396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Going to try to live migrate instance to another host {{(pid=120493) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 01:49:03.447834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.448329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.448774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.449477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.449942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.450378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.602387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:03.611439 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-824e9fd3-bd7c-4a16-b4a9-b5f29d96009f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.173848 Oct 11 01:49:03.612085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2537/5116] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:03 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:03.676225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:03.678694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.685856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.686356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.686816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.687745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.688206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.688629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.721942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb1f71ea-c257-4aed-b4e9-4f07842a4c9c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049633 Oct 11 01:49:03.722656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2538/5117] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:49:03 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 01:49:03.793682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:03.794151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.803833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.804535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.805153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.806061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.806804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.807249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.837558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:49:03.931467 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef02179c-7d7e-4480-b757-b87ee01e1803 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 204 len: 0 microversion: 2.1 time: 0.143371 Oct 11 01:49:03.933780 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2539/5118] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:03 2022] DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:49:03.940814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:03.941527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:03.947594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.948093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.948526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:03.949238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:03.949697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:03.950127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:04.137065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:04.145833 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e861c7ed-774c-44d9-9f83-629e4cf9a7f6 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1681 microversion: 2.1 time: 0.209334 Oct 11 01:49:04.146401 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2540/5119] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:03 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:04.635774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:04.636448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:04.643821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:04.644307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:04.644748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:04.645443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:04.645902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:04.646332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:04.778835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:04.787560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eae1fd6a-5058-4bf0-8b38-0ea743b78d52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.155619 Oct 11 01:49:04.788145 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2541/5120] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:04 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:05.169255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:05.169892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:05.175963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.176453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.176891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:05.177593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.178046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.178671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:05.325522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:05.334025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-964b5e89-9f6e-4177-a2f2-fef5deeab914 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1681 microversion: 2.1 time: 0.168779 Oct 11 01:49:05.334600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2542/5121] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:05 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:05.774773 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-676e1f37-7df1-4092-924b-ee7791b5f48b tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action" status: 202 len: 0 microversion: 2.1 time: 2.385294 Oct 11 01:49:05.775795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2580/5122] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:49:03 2022] POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action => generated 0 bytes in 2387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:49:05.787191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:05.788967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:05.813182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:05.814384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:05.821642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.826364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.826894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:05.827686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.829747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.830230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:05.836858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.837384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.838038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:05.838805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:05.839304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:05.843948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:06.200488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:06.209857 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40e87587-fd63-4e73-b1d4-dab3b8ef7feb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.429080 Oct 11 01:49:06.211102 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2543/5123] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:05 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:06.258060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:06.266431 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3fc4d26f-e6a0-4365-a1ef-f424f43ce319 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.459304 Oct 11 01:49:06.269875 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2581/5124] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:05 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:06.365521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:06.366807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:06.375632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:06.376708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:06.378510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:06.379516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:06.380442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:06.381121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:06.647647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:06.660228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b34961d1-1aed-43be-b843-b7d0d9612a84 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 200 len: 1614 microversion: 2.1 time: 0.301138 Oct 11 01:49:06.663071 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2544/5125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:06 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 1614 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:06.821359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886fe0d-cbdb-4ff6-a253-b7564c291e8c", "name": "network-vif-deleted", "tag": "2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:06.839010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:06.839574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:06.841505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:06.876396 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] Creating event network-vif-deleted:2a53a1f4-8a27-4fe9-9469-00d8dfa81c5c for instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c on n-h2-772273-9 Oct 11 01:49:06.885646 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b343e619-8c90-44ae-9d0f-e6f655407427 req-e11fee06-b268-4560-bcb1-2783be8de7b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067942 Oct 11 01:49:06.894666 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2582/5126] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:07.234848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:07.235656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:07.245084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.245948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.247118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.248115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.248800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.249581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.294761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:07.295523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:07.321205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.321720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.322162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.327990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.328484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.328928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.753587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:07.763496 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2729f192-8c2b-491d-9993-8d1efb2a533f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.474055 Oct 11 01:49:07.764100 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2583/5127] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:07 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:07.774188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:07.782889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7029467c-6c27-479f-b81f-cef32d9d4544 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.552088 Oct 11 01:49:07.786257 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2545/5128] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:07 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:07.791241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "name": "network-vif-unplugged", "status": "completed", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:07.801109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:07.802244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:07.813163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.815817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.816276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.819047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.819656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.820189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.820984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:07.821517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:07.822083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:07.824763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:07.844547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:49:07.845992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] Creating event network-vif-unplugged:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h1-772273-9 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c HTTP/1.1 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5886fe0d-cbdb-4ff6-a253-b7564c291e8c'} Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:07.846828 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:07.852052 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-503fdb2d-e967-4119-a212-60545686de5f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 404 len: 111 microversion: 2.1 time: 0.063220 Oct 11 01:49:07.856136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4ae94a4b-2cf8-4665-9266-6a457ddf34a8 req-61639163-bcec-4a18-8a79-1f0153fd6272 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090818 Oct 11 01:49:07.856746 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2546/5129] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:07 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:49:07.862212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6ba2c48-ead7-4e30-a07b-1d9c26a72e21 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '.version_select at 0x7f112f3b59d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:07.862883 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2584/5130] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:07.888506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6ba2c48-ead7-4e30-a07b-1d9c26a72e21 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896116298" status: 202 len: 0 microversion: 2.1 time: 0.030437 Oct 11 01:49:07.889534 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2547/5131] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896116298 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:49:08.791212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:08.791952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:08.800189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:08.800700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:08.801143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:08.803836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:08.804492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:08.804935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:08.813063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:08.814782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:08.825794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:08.826307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:08.826755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:08.827539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:08.828017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:08.828445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:09.033866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:09.042569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cad65281-69e5-4242-b372-fe71853fe30b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.256590 Oct 11 01:49:09.043170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2585/5132] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:08 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:09.049644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd9c2f91-c298-4c7f-a73c-9288b3dc8ae1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: .version_select at 0x7f112f9c75e0>, body: {"keypair": {"name": "tempest-keypair-848024019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg19Jy1Or6FAcNqsx+hurvqBNWVfNrfK9i1HNuGLKmKhNvgS2JBG+F5tLQov3eQb1dN7qmy1FWHYG2HLFcI7hIjfbQ5EaXr/QmkRRNpFzOeDATb5/KRALus92Mwvq1ifQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:09.056838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:09.061909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:09.066694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-bd9c2f91-c298-4c7f-a73c-9288b3dc8ae1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:09.068583 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ad51652-a8b6-4ca2-9c65-3b483bf7f0fb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.259784 Oct 11 01:49:09.072727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-bd9c2f91-c298-4c7f-a73c-9288b3dc8ae1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:09.084027 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2548/5133] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:08 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:09.101745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd9c2f91-c298-4c7f-a73c-9288b3dc8ae1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056644 Oct 11 01:49:09.102729 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2586/5134] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:49:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:09.885231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:09.898185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:09.898673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:09.899420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:09.911666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] Creating event network-changed:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h1-772273-9 Oct 11 01:49:09.917242 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-81f1455f-d18b-4e6a-8713-53d72e6abf9c req-fbeca28b-44ac-4cfb-8d12-7636437a3f58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035581 Oct 11 01:49:09.918131 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2549/5135] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:10.068843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:10.069464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:10.080666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:10.081383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:10.081960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:10.082919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:10.083725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:10.084784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:10.098455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:10.099574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:10.113791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:10.116455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:10.117092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:10.118441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:10.120371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:10.120989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:10.363779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:10.389948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30c7231b-889a-4be4-a5cb-7d000738bf6c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.325896 Oct 11 01:49:10.390539 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2587/5136] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:10 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:10.460056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:10.473208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e94482b2-c704-46a2-a29a-4c4e9ddb8fb2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.382046 Oct 11 01:49:10.474175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2550/5137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:10 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:10.528613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1872029916", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e93cb-284f-427c-82a6-2e0f725420b8"}], "security_groups": [{"name": "tempest-securitygroup--380113093"}], "key_name": "tempest-keypair-848024019", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:10.683513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] validate_networks() for [('859e93cb-284f-427c-82a6-2e0f725420b8', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:49:11.417779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:11.418408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:11.428643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.429451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.429898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.430636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.431096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.431564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.465797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:49:11.466274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:49:11.466681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:49:11.467411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:49:11.468000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:49:11.476959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.477696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.478277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.479008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.479492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.479909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.498811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:11.505281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:11.518155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:49:11.520658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:49:11.581313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:11.585770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4698d846-0374-43b9-9838-dc796de661a4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.061602 Oct 11 01:49:11.592076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5e93fdc-1c89-4d5d-85c5-e5a37b17affe tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.178343 Oct 11 01:49:11.593134 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2551/5138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:11 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:11.601935 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2588/5139] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:49:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:49:11.604259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:11.605246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:11.606789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a4db607-5896-4970-b9ea-169be1e95e13 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:11.607435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a4db607-5896-4970-b9ea-169be1e95e13 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:11.629624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.630244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.630799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.631655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.632511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.634219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.671583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a4db607-5896-4970-b9ea-169be1e95e13 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:11.679522 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a4db607-5896-4970-b9ea-169be1e95e13 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1241 microversion: 2.1 time: 0.076428 Oct 11 01:49:11.680443 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2589/5140] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:11 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:11.738598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:11.739192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:11.745994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.746492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.746929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.747662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:11.748635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:11.748635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:11.788518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:11.796362 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b29f774-a34b-4fe0-aa7e-3d9f9c7ee148 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.199849 Oct 11 01:49:11.797330 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2552/5141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:11 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:11.842579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lazy-loading 'services' on Instance uuid 193e8756-59a7-4efd-9b1a-0da421763394 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:49:11.921181 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ffb0246-ec34-4fcc-89c3-bd994ffbe6d6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments/fc182012-121f-4aaf-9049-270450d76ed8" status: 202 len: 0 microversion: 2.1 time: 0.188635 Oct 11 01:49:11.921825 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2590/5142] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:49:11 2022] DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments/fc182012-121f-4aaf-9049-270450d76ed8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:49:12.619187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:12.620626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:12.629667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.630584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.631237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.632236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.632941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.633696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.706176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:12.707027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:12.717616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.718314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.719698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.721013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.722780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.723476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.818277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:12.825040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:12.833373 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e304b792-50f4-45fb-a479-deca17fe8295 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1293 microversion: 2.1 time: 0.134885 Oct 11 01:49:12.833659 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90450109-1d0e-43f0-bdb2-d99402e27359 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.219734 Oct 11 01:49:12.834311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2591/5143] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:12 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:12.835227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2553/5144] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:12 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:12.839666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:12.840443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:12.846919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.847554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.848098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.848900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:12.849479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:12.849981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:12.988257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:12.996714 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e76d7ce-92a9-493b-a398-15ebc79f1923 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.161082 Oct 11 01:49:12.997300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2592/5145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:12 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:13.858025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:13.863854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:13.865306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:13.868031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:13.880565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:13.881076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:13.881523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:13.882266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:13.882726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:13.883159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:13.884543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:13.885431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:13.885880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:13.886621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:13.887077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:13.887548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:14.397783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:14.416424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f690f29-9a22-4f1c-8680-7c1592888bdc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.556590 Oct 11 01:49:14.416424 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2554/5146] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:13 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:14.425278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:14.427202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:14.439558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:14.440891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:14.444470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:14.446929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:14.447923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:14.448576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:14.449352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:14.454591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82507b66-ba17-441f-877c-73bd4cca290c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.601521 Oct 11 01:49:14.455247 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2593/5147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:13 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:14.798096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:14.813498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3588e479-644a-4644-a07b-03892889d007 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.398892 Oct 11 01:49:14.814843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2555/5148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:14 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:15.438095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:15.438796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:15.453729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.454196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.454637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.455434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.455881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.456305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.466313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff", "tag": "37c29a8e-2578-4f04-8f0f-986c7d23973b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:15.499400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.499890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.500502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.524014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] Creating event network-changed:37c29a8e-2578-4f04-8f0f-986c7d23973b for instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff on n-h1-772273-9 Oct 11 01:49:15.530741 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1d138e84-084e-4cb8-8d9a-2e838f16d2b0 req-0d8fdaa7-2fce-4911-bd1c-3b4448c8efb0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067999 Oct 11 01:49:15.531678 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2556/5149] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:49:15.537590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:15.538301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:15.545035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.545535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.545973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.546676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.547129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.547758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.866988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:15.875294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:15.878970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29ca0ec1-aa21-4305-b10f-682f5c2a4a52 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.444583 Oct 11 01:49:15.891362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2594/5150] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:15 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:15.891362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:15.891362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:15.897315 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08cada2a-ddad-4ca2-8532-9b0ee86df1e4 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.361050 Oct 11 01:49:15.897819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.897819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.897819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:15.897819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:15.898317 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2557/5151] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:15 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:15.901216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:15.901836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:16.119015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:16.138200 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08f81cfa-0269-43cd-8444-d1817fe28d7a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.255007 Oct 11 01:49:16.157029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2595/5152] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:15 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:16.905599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:16.906205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:16.917899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:16.918458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:16.918583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:16.919072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:16.919211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:16.919831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:16.920288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:16.920807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:16.927806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:16.928396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:16.929095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:16.929898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:16.930451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:16.931106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:17.152086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:17.158535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:17.162407 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71e21f7d-17c2-43be-b89f-d4059044b9f9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.249034 Oct 11 01:49:17.163700 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2596/5153] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:16 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:17.169972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:17.170838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:17.177184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:17.177932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:17.178589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:17.179556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:17.180358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:17.180848 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4140306-ba0c-4c90-b585-804c094f2e7f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.279523 Oct 11 01:49:17.181362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:17.181589 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2558/5154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:16 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:17.494249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:17.505685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c9fb0034-b530-48c0-a6b3-00cfdf67efe2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.339679 Oct 11 01:49:17.507620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2597/5155] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:17 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:18.185874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:18.187770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:18.195987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.196797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.197628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.198554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.204716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:18.205927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:18.213321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.214163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.219992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.222728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.223574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.224563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.225199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.225802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.695818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:18.702165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:18.709698 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aeaf5734-7328-489c-8b33-706b634f294e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.526197 Oct 11 01:49:18.711508 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2559/5156] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:18 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:18.716100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a48dd43-0c74-487f-827b-cb84fcc45d06 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.515494 Oct 11 01:49:18.720008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:18.731830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.732512 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2598/5157] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:18 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:18.733090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.733819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.742795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:18.743750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:18.750294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.751163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.751864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.753559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:18.754236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:18.754900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:18.767305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:49:18.819425 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-daf645ee-1e90-4243-8dd3-d571f527769d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action" status: 202 len: 0 microversion: 2.1 time: 0.106086 Oct 11 01:49:18.820341 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2560/5158] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:49:18 2022] POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:49:18.827505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-153295847", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "1b58806f-ba96-44c7-acc6-276b915a2146"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:18.894000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] validate_networks() for [('1b58806f-ba96-44c7-acc6-276b915a2146', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:49:19.030205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:19.039561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30e25272-b8dc-4c3a-9b25-aa2dd0210364 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.305689 Oct 11 01:49:19.040538 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2599/5159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:18 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:19.045347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:19.046254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:19.055481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.056621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.057213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.058017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.058976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.059563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.378037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:19.386360 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-348b6e9d-981f-4613-918d-bf26914b7c97 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.344628 Oct 11 01:49:19.387092 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2600/5160] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:19 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:19.685113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:49:19.685564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:49:19.686024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:49:19.686444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:49:19.686866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:49:19.705730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.706224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.706667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.707516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.707979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.708413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.726560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Getting quotas for project 4cdd2ee9af774b4a85240a3832d39545. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:19.732260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Getting quotas for user 489f0e5ba2ac4a998df2128eb0866de9 and project 4cdd2ee9af774b4a85240a3832d39545. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:19.739821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:19.739821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:19.746942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.747270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:49:19.747711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.748259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.749095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.749664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.749772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:49:19.750338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.800391 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51841104-acf2-4133-bb81-fe5886346cec tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977197 Oct 11 01:49:19.800785 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2561/5161] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:49:19.805328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:19.805975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:19.814017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.814370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.814860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:19.815600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:19.816064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:19.816498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.108360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:20.120603 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66216702-ec4c-4ca4-beac-c53422522150 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.386540 Oct 11 01:49:20.121244 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2601/5162] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:19 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:20.136279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4bef5a78-1f35-46a3-afbb-099375f0ddf6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:20.136942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4bef5a78-1f35-46a3-afbb-099375f0ddf6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:20.154971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:20.167283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f616f0d-6e55-4f6f-8ea9-62e89a69f2d4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.365294 Oct 11 01:49:20.168346 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2562/5163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:19 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:20.175561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:20.176448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:20.182096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:20.183682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:20.184532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:20.185156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.186164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:20.186882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:20.187524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.279443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4bef5a78-1f35-46a3-afbb-099375f0ddf6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:20.292255 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4bef5a78-1f35-46a3-afbb-099375f0ddf6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1218 microversion: 2.1 time: 0.169906 Oct 11 01:49:20.292882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2602/5164] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:20 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:20.380050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:20.390610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21ab4653-0453-4413-9f90-ee1711ed7c58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1692 microversion: 2.1 time: 0.219309 Oct 11 01:49:20.392011 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2563/5165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:20 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1692 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:20.410755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:20.411395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:20.430217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:20.430851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:20.431172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.431993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:20.432527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:20.432879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.480540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff", "name": "network-vif-plugged", "status": "completed", "tag": "37c29a8e-2578-4f04-8f0f-986c7d23973b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:20.491575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:20.492369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:20.492837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:20.508838 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] Creating event network-vif-plugged:37c29a8e-2578-4f04-8f0f-986c7d23973b for instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff on n-h1-772273-9 Oct 11 01:49:20.515702 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1e85d11e-fa41-4564-bb87-dcf78e5b406f req-8793fe94-1e9f-4195-9847-76539fc9cbf5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040848 Oct 11 01:49:20.516688 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2564/5166] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:20.691438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:20.700558 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e54a63f-ffed-4491-ba98-a73ac3cacb6d tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.294339 Oct 11 01:49:20.701381 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2603/5167] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:20 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:21.148939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.149676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.156169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.156672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.157119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.157865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.158977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.159457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.191580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.192255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.198660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.199225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.199695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.200396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.201023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.201616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.222451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:21.432883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:21.440671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cf60d82-1539-45ae-81fb-3679487a81b0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1366 microversion: 2.1 time: 0.295966 Oct 11 01:49:21.441237 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2565/5168] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:21.445735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.446414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.452599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.453233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.453687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.454456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.455495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.456001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.481521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:21.488093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:21.490987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-445fc3b8-92f4-47ee-89c9-65eaaeb6867c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.303320 Oct 11 01:49:21.491882 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2604/5169] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:21.496285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.496928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.504338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.504834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.505277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.505976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.506443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.506948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.548605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:21.556429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-359838e9-fd7d-4e49-a55e-ba22558389b9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1276 microversion: 2.1 time: 0.114223 Oct 11 01:49:21.557006 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2566/5170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:21.695758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:21.704582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f027fcc5-6d5f-4fef-a452-ba92bf56d989 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1682 microversion: 2.1 time: 0.211861 Oct 11 01:49:21.705911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2605/5171] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:21.724622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.725443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.728973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:21.729591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:21.731887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.732388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.732821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.733726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.734345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.734931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.735673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.736176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.736619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.738162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:21.738640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:21.739076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:21.739999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:22.040185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:22.051184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-32089019-306d-46a6-bd74-252f10aeb72f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.331242 Oct 11 01:49:22.055790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2567/5172] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:22.059909 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63494771-13f9-4d28-90eb-05cace472619 tempest-TestNetworkAdvancedServerOps-1348284147 tempest-TestNetworkAdvancedServerOps-1348284147-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1833 microversion: 2.1 time: 0.334636 Oct 11 01:49:22.060596 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2606/5173] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:21 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1833 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:22.085207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:22.085818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:22.091979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.092435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.092874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.093576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.094036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.094461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.284271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:22.291951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42088a04-9680-4a24-b9ff-34d90a56eda2 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1682 microversion: 2.1 time: 0.211195 Oct 11 01:49:22.292531 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2568/5174] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:22 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:22.464103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:22.464865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:22.475583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.476209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.476901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.477744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.478323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.479007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.514430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:22.515403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:22.521627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.522124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.522570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.523282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.523783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.524217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.785864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:22.793949 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d45e2d5a-6452-4179-9791-10a41e56f0c0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1556 microversion: 2.1 time: 0.333931 Oct 11 01:49:22.794545 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2607/5175] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:22 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1556 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.807505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.808203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.808203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.821669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:22.831575 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16281a8e-84d2-4703-8783-1b1e3bf49714 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1516 microversion: 2.1 time: 0.321275 Oct 11 01:49:22.835864 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2569/5176] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:22 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:22.840495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:22.841112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:22.848400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.849826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.850295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:22.851071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:22.851907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:22.852056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:23.004519 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52588101-77ca-4036-9fbb-1c1bb86b7137 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170548 Oct 11 01:49:23.005118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2570/5177] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:49:22 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:23.074379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:23.074993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:23.081807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:23.082498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:23.082964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:23.083872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:23.084353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:23.084775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:23.168615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:23.176369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ced619b5-ba5b-49e1-bf94-f8eb3bebf80d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.380872 Oct 11 01:49:23.176951 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2608/5178] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:22 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:23.489904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:23.497681 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d77178d3-b8f3-4670-ac51-9aef065717d0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.427268 Oct 11 01:49:23.498269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2571/5179] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:23 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:23.857324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:23.857933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:23.866069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:23.866563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:23.867012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:23.867751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:23.868241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:23.868680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.182464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:24.190470 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d8d213c-0e35-4d69-bf5c-33c0afc71389 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.337134 Oct 11 01:49:24.191071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2609/5180] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:23 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:24.199806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:24.200584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:24.207510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.208004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.208447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.209153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.209613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.210043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.422181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:24.425069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:24.431137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.431824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.432272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.432980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.433443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.433871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.489213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:24.496977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1803ae6-cc77-41de-a984-024e1ee90fba tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.300983 Oct 11 01:49:24.511362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2572/5181] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:24 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:24.511362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0794737f-6c46-4fe8-9284-26b413e2bbc5", "tag": "aabf0773-f384-4663-92ae-2f3926b56c52"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:24.517420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.517923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.518470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.530457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] Creating event network-changed:aabf0773-f384-4663-92ae-2f3926b56c52 for instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 on n-h2-772273-9 Oct 11 01:49:24.535921 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9ad02906-9d7c-4735-8534-9f9d8ff1ec4b req-1d018c44-c2ce-4ada-9189-501befa0e5c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036886 Oct 11 01:49:24.536622 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2573/5182] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:24.541795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:24.542508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:24.549474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.549970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.550414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.551122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:24.551609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:24.552046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:24.798503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:24.807121 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b29b343-7b71-450c-a70a-1cdddcd813ce tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.269253 Oct 11 01:49:24.807746 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2574/5183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:24 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:25.214680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:25.215326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:25.222576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.223073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.223536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.224237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.224690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.225115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.358179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:25.367429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6874df19-2a92-4b62-a58e-1914354bac50 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.157022 Oct 11 01:49:25.368360 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2575/5184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:25 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:25.521098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:25.521786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:25.527970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.528472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.528919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.529650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.530093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.530552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.665895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:25.673787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8922ab3d-1241-4624-9892-63c1bb3404db tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.156654 Oct 11 01:49:25.674372 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2576/5185] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:25 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:25.830769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:25.832717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:25.838871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.839418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.839831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.841453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:25.841453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:25.841680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:25.974330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:25.982252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b5f7d0f-612b-4c71-9dd9-934e88f24ae8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.156088 Oct 11 01:49:25.982927 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2577/5186] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:25 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:26.390344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:26.390966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:26.397407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:26.397946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:26.398391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:26.399090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:26.399573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:26.400004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:26.412600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58b885bf-b060-422c-ba50-c2da7765ca58 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action" status: 200 len: 38632 microversion: 2.1 time: 1.994179 Oct 11 01:49:26.413508 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2610/5187] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:49:24 2022] POST /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a/action => generated 38632 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 01:49:26.566221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff", "tag": "37c29a8e-2578-4f04-8f0f-986c7d23973b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:26.576554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:26.577142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:26.577667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:26.592633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] Creating event network-changed:37c29a8e-2578-4f04-8f0f-986c7d23973b for instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff on n-h1-772273-9 Oct 11 01:49:26.598178 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3ef3f34c-c565-42b2-bcad-f12fdd5a045f req-dbd44b35-8ecd-4b06-b735-22e9de7d0bd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Oct 11 01:49:26.598878 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2611/5188] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:26.619880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:26.647314 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11841017-c135-4bda-8cff-70ebb19443de tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.260820 Oct 11 01:49:26.663138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2578/5189] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:26 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:26.697862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:26.698880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:26.706464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:26.707369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:26.708162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:26.708970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:26.709524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:26.710045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.007145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:27.007544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:27.018481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.019143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.019789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.020716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.021279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.022283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.040160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:27.051256 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3e82f305-afdf-4d8c-a340-6a274f4f892a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.357876 Oct 11 01:49:27.054435 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2612/5190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:26 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:27.303571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:27.311468 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ca3a0bb-48aa-4f0f-83ee-65ff56d2f768 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.309144 Oct 11 01:49:27.312258 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2579/5191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:27 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:27.453986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:27.454516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:27.459316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:27.466148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.466656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.467371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.467845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.468309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.470437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.475905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:27.498250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.498755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.499943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.514415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:49:27.530280 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] Creating event network-changed:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h2-772273-9 Oct 11 01:49:27.537748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a4115b7b-c489-482b-a791-9335939e6456 req-b188ac37-e2c9-436a-902f-842689e20ff4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064995 Oct 11 01:49:27.538655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2580/5192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:49:27.657575 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a47ed1fe-c247-4043-bd70-2623084f88ae tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 204 len: 0 microversion: 2.1 time: 0.207263 Oct 11 01:49:27.659395 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2613/5193] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:27 2022] DELETE /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:49:27.667694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:27.668414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:27.672173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:27.673223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:27.674687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.675403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.675856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.676572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.677036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.677472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.681098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.681600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.682222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.683040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:27.684047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:27.684497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:27.929289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:27.938231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee671550-ddb2-4534-a43f-99eb9df29780 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1688 microversion: 2.1 time: 0.275244 Oct 11 01:49:27.938824 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2581/5194] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:27 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:27.948771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:27.959995 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12f1351f-a379-4f95-a0b0-955ae3f1ef62 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.293411 Oct 11 01:49:27.960895 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2614/5195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:27 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:28.080506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:28.081036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:28.087295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.087849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.088298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.089006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.089502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.089941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.227035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:28.235090 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0cb989e-efca-4842-8063-2363f86cbc86 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.158698 Oct 11 01:49:28.235710 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2582/5196] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:28 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:28.336160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:28.336696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:28.343446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.344206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.344718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.345453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.346466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.346902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.488216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:28.496313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6e7d99b-48ed-49f6-8411-0819d2bb5410 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1679 microversion: 2.1 time: 0.165981 Oct 11 01:49:28.503427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2615/5197] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:28 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:28.962303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:28.963080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:28.969674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.970172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.971275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.972020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.972490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.972927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.984315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:28.984944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:28.992212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.992977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.993606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:28.994321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:28.994786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:28.995220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.208955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:29.212266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:29.217507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e00b4da6-358f-425b-9dfe-3f23333a5919 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1688 microversion: 2.1 time: 0.259195 Oct 11 01:49:29.218212 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2583/5198] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:28 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:29.222046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f5f1544-2a9a-4c4b-aa5f-8d29b5912d3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.241495 Oct 11 01:49:29.222639 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2616/5199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:28 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:29.223725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af5db52-390f-487f-b464-a4be620a3ff2", "name": "network-vif-unplugged", "status": "completed", "tag": "cc21a407-699b-4f29-b9b7-083155afaf4b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:29.232937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.233426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.233865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.246637 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] Creating event network-vif-unplugged:cc21a407-699b-4f29-b9b7-083155afaf4b for instance 4af5db52-390f-487f-b464-a4be620a3ff2 on n-h2-772273-9 Oct 11 01:49:29.251689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d08d7f6e-3207-49c4-8231-5f65c2d877d9 req-b8e42543-8736-462a-aff7-b2c8a8625737 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031889 Oct 11 01:49:29.252867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2584/5200] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:29.260614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:29.261303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:29.267271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.268376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.268817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.269515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.269967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.270393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.399556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:29.407163 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-44c43239-cc56-4e83-996a-a0fa92a58465 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.150724 Oct 11 01:49:29.407770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2617/5201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:29 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:29.520095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:29.520808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:29.526950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.527483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.527935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.528638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.529100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.529534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.660466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:29.668228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42a35ff8-96dd-487d-aa7c-ea2e9a96cbb4 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1656 microversion: 2.1 time: 0.152513 Oct 11 01:49:29.668810 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2585/5202] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:29 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:29.691648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:29.697751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.698245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.698675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.727723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Going to try to start instance {{(pid=120493) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 01:49:29.772672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a9df99d-a22b-4a60-82ee-41f172fccce9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action" status: 202 len: 0 microversion: 2.1 time: 0.085342 Oct 11 01:49:29.773305 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2618/5203] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:49:29 2022] POST /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:49:29.781739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:29.782476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:29.785088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:29.785986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:29.792933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.793491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.793948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.794674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:29.795149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:29.795609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:29.801935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:30.016974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:30.026632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39abdcde-64d1-4ef6-9302-2d6ef897625e tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1665 microversion: 2.1 time: 0.248864 Oct 11 01:49:30.027561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2586/5204] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:29 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1665 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:30.242325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:30.243042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:30.245050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:30.245779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:30.254977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.256041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.257789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.258256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.259160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.259822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.260678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.261171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.263380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.264009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.264476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.265156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.287644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:30.292156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:30.730420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:30.740131 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46fbf2e3-107a-4677-8243-4da19a5c99cb tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.499026 Oct 11 01:49:30.740897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2587/5205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:30 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:30.746223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:30.747090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:30.753808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.754599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.755287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.756238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.757249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.757910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.766461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:30.785149 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13d9b299-79dd-497b-8b2f-9ebbc4c55673 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 200 len: 1688 microversion: 2.1 time: 0.547501 Oct 11 01:49:30.786223 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2619/5206] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:30 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 1688 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:30.955767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e66d95-a00e-4166-844d-7f7de87b334a", "name": "network-vif-deleted", "tag": "5ecbf48c-5b9a-4e52-a82c-fe5552703595"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:30.978034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:30.979950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:30.981253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:30.999087 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] Creating event network-vif-deleted:5ecbf48c-5b9a-4e52-a82c-fe5552703595 for instance 58e66d95-a00e-4166-844d-7f7de87b334a on n-h2-772273-9 Oct 11 01:49:31.006252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1ad5742e-b40f-49d7-9b1b-5a3ee29b4ea2 req-7d9a8e18-2487-44bb-83f6-b7318eec206d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056787 Oct 11 01:49:31.007145 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2620/5207] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:31.021486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:31.040256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a18d4cc7-24b3-4b6e-8742-d73c0fbb9938 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.298016 Oct 11 01:49:31.054979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:31.056021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2588/5208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:30 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:31.058898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:31.067439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.067942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.068885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.069151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.069617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.071262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.225956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:31.236396 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-764eab0b-e0d5-4143-8477-9524bce41ee8 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1665 microversion: 2.1 time: 0.189282 Oct 11 01:49:31.237021 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2621/5209] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:31 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:31.273027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af5db52-390f-487f-b464-a4be620a3ff2", "name": "network-vif-plugged", "status": "completed", "tag": "cc21a407-699b-4f29-b9b7-083155afaf4b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:31.287090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.287610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.288247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.300819 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] Creating event network-vif-plugged:cc21a407-699b-4f29-b9b7-083155afaf4b for instance 4af5db52-390f-487f-b464-a4be620a3ff2 on n-h2-772273-9 Oct 11 01:49:31.305949 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9796e843-a14c-4cf8-9bc2-597b45209156 req-4ce41a4b-7efe-4737-b1a7-14a0f6883a29 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037195 Oct 11 01:49:31.306887 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2589/5210] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:31.764322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:31.764866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:31.771793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.772338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.772713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.773406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.773868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.774299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.809434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:31.810142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 58e66d95-a00e-4166-844d-7f7de87b334a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:31.817310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.817818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.818264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.818983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:31.819479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:31.819950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:31.833400 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] HTTP exception thrown: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Request method failure captured: Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a HTTP/1.1 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMn3D9UHXOzpoEETJuHkb0QZUhhN94qVB3YbtTqVU9y6aLSCHC2Msq2z039wPrmpCbXOiUJtC7zEV9geYJvdTi8H2HiH97eDc1TlOUK3pxqVpkdISfS5blTLYGAKVbT7sNuhRJMixvZ6uppuSZ8YTk4UsQsYfAuwtgOb2jqJk46PPks Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b6965eb3a6a74e62a184ea493c8fcb76 Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '58e66d95-a00e-4166-844d-7f7de87b334a'} Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:31.835080 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Returning 404 to user: Instance 58e66d95-a00e-4166-844d-7f7de87b334a could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf7a8ad0-bfc2-4eb2-b11c-e3e8c97568b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a" status: 404 len: 111 microversion: 2.1 time: 0.031387 Oct 11 01:49:31.839976 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2590/5211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:31 2022] GET /compute/v2.1/servers/58e66d95-a00e-4166-844d-7f7de87b334a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:49:31.909985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:31.917892 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29208807-d24e-40b8-8ecf-d6b0ba5e1671 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1522 microversion: 2.1 time: 0.157609 Oct 11 01:49:31.918480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2622/5212] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:31 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:32.065356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:32.066090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:32.072889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.073382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.073825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:32.074528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.074987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.076030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:32.209349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:32.217190 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81e6b349-d9ab-4d7a-9fb5-7341b6d23644 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.155928 Oct 11 01:49:32.217767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2591/5213] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:32 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:32.261717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:32.262337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:32.268354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.268851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.269295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:32.270006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.270470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.270904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:32.406334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:32.414670 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc1aaa59-5123-40f0-a72e-a982abd65860 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1669 microversion: 2.1 time: 0.157035 Oct 11 01:49:32.415246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2623/5214] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:32 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:32.941715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:32.942353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:32.958470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.958988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.960303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:32.961237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:32.962087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:32.962693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.123966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:33.132331 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac2a4b6b-61c7-4ded-9334-6909cf3eb53d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1507 microversion: 2.1 time: 0.195167 Oct 11 01:49:33.132936 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2592/5215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:32 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:33.156865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:33.158585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:33.170860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.171640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.172260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.173318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.174154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.174772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.242372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:33.243027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:33.249455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.249959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.250403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.251329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.252039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.252638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.368295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:33.376561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2203a11-fa77-4157-84b2-c709461505fd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 200 len: 1507 microversion: 2.1 time: 0.224106 Oct 11 01:49:33.377326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2624/5216] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:33 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:33.399587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:33.400293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:33.406277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.407011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.407479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.408789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:33.409250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:33.409679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:33.416707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:33.424888 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fd05c357-0c9d-4876-9d7f-309f9b9db0e6 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.187575 Oct 11 01:49:33.430693 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2593/5217] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:33 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:33.436202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:49:33.527525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d1ac6ee-45a4-41cc-b4a6-da29afa59ea6 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 204 len: 0 microversion: 2.1 time: 0.131453 Oct 11 01:49:33.528188 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2625/5218] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:33 2022] DELETE /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:49:33.586673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1196555449", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "e94fc197-8b28-487e-ac8e-46fa4f41b411"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:33.650645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] validate_networks() for [('e94fc197-8b28-487e-ac8e-46fa4f41b411', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:49:34.096694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:49:34.097327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:49:34.097913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:49:34.098427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:49:34.099067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:49:34.108471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:34.109189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:34.109813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:34.110840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:34.112032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:34.112888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:34.132758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:34.138371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Getting quotas for user 284a096df3f64ab8a2d77331498880ba and project f855744e6c7447cca550d3a2084627de. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:34.151680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:49:34.154004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:49:34.216377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acbc702d-e111-4d0a-bea0-0d3a58cf40d5 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633829 Oct 11 01:49:34.217336 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2594/5219] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:49:34.229642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da360128-0ceb-4a59-8eaf-7a69a1f5245d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:34.230979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da360128-0ceb-4a59-8eaf-7a69a1f5245d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:34.314656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da360128-0ceb-4a59-8eaf-7a69a1f5245d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:34.332956 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da360128-0ceb-4a59-8eaf-7a69a1f5245d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1218 microversion: 2.1 time: 0.107444 Oct 11 01:49:34.346190 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2626/5220] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:34 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:34.456673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:34.457671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:34.481027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:34.481640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:34.482165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:34.483146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:34.483709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:34.484221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:34.647416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:34.660478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcbf09e9-039d-4f13-bca1-8af1845707a2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.216470 Oct 11 01:49:34.661513 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2595/5221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:34 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:35.151941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0794737f-6c46-4fe8-9284-26b413e2bbc5", "name": "network-vif-plugged", "status": "completed", "tag": "aabf0773-f384-4663-92ae-2f3926b56c52"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:35.168063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.168745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.169581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.184660 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] Creating event network-vif-plugged:aabf0773-f384-4663-92ae-2f3926b56c52 for instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 on n-h2-772273-9 Oct 11 01:49:35.190532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b6fb46a6-3955-4529-9863-a72d4ac0d835 req-24849f2f-c941-4c18-885b-f64cf8561d3e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044062 Oct 11 01:49:35.191697 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2627/5222] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:49:35.358824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:35.359559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:35.367124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.367648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.368106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.369031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.369505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.370105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.440088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:35.467255 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59808986-8054-4c3b-b5f1-6d06a1a33ca4 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1270 microversion: 2.1 time: 0.113362 Oct 11 01:49:35.468430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2596/5223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:35 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:35.684404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:35.685045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:35.699225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.700217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.700861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.701779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.702439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.705154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.795023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af5db52-390f-487f-b464-a4be620a3ff2", "name": "network-vif-deleted", "tag": "cc21a407-699b-4f29-b9b7-083155afaf4b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:35.806571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:35.807149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:35.807728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:35.820141 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] Creating event network-vif-deleted:cc21a407-699b-4f29-b9b7-083155afaf4b for instance 4af5db52-390f-487f-b464-a4be620a3ff2 on n-h2-772273-9 Oct 11 01:49:35.825241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-223eaf53-1cdf-41e5-8642-b5a70661edb6 req-1267f66e-1989-41f3-b840-5332b7efe091 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033995 Oct 11 01:49:35.825961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2597/5224] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:49:35.960361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:35.969516 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-788a67b0-52b5-42b1-bda7-d80157ef086d tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.289427 Oct 11 01:49:35.980979 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2628/5225] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:35 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:35.990557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8d4027e-87c5-4ada-8c73-5f207eddfa4f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '.version_select at 0x7f112f687ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:36.012342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8d4027e-87c5-4ada-8c73-5f207eddfa4f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1212028325" status: 202 len: 0 microversion: 2.1 time: 0.025987 Oct 11 01:49:36.014008 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2598/5226] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 01:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1212028325 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:49:36.043783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ea31263-8e1e-4306-b8fa-619dfd79d4c7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: .version_select at 0x7f11348c6b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1603207512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw5onBrUHWZQZJrhO7N8sB2AZ8uvyQSMQBGSyztWTWuK24Up8YdkISKTmmKZSzw2M+A6pZb/JGdAVaJRb8SH2+14Ay61txRo1y9vOkbLchvTMBp5y3sW4Eb41PWoVWbng=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:36.061440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1ea31263-8e1e-4306-b8fa-619dfd79d4c7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:36.067461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1ea31263-8e1e-4306-b8fa-619dfd79d4c7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:36.092960 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ea31263-8e1e-4306-b8fa-619dfd79d4c7 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053173 Oct 11 01:49:36.093903 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2629/5227] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:49:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:36.495134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:36.495936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:36.505409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:36.506271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:36.506781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:36.507768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:36.508231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:36.508803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:36.839286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:36.854084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-790294a4-4992-45ad-84b1-f452c94c2da7 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.362824 Oct 11 01:49:36.854733 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2599/5228] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:36 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:36.993945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:36.994566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:37.001824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:37.002342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:37.003007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:37.003751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:37.004211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:37.004639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:37.242445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:37.254686 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04f8a044-5617-4357-b7e0-9761e9c66ae9 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1506 microversion: 2.1 time: 0.266809 Oct 11 01:49:37.259251 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2630/5229] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:36 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:37.526720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ae510f-4b20-4049-a770-7b0685340eeb", "tag": "3dbef01e-4045-42f7-852f-bfa4be320de8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:37.547231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:37.548204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:37.549300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:37.567057 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] Creating event network-changed:3dbef01e-4045-42f7-852f-bfa4be320de8 for instance 34ae510f-4b20-4049-a770-7b0685340eeb on n-h1-772273-9 Oct 11 01:49:37.576559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-374689ae-e0da-4bda-b401-4f78f7ba337a req-af8d4c50-6bb2-4db5-8187-df3964b5bdc0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053994 Oct 11 01:49:37.577468 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2600/5230] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:49:37.878937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:37.880057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:37.889098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:37.889767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:37.890397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:37.891437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:37.892385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:37.892999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:38.141546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:38.152067 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-513ec086-a2e7-49b6-81be-41c92fe64c40 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.278481 Oct 11 01:49:38.152813 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2631/5231] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:37 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:39.175502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:39.176220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:39.190346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:39.190848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:39.191295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:39.192038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:39.192500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:39.192930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:39.413906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:39.427994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59923e01-c63b-41c8-a908-f88dca40bcd2 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.257127 Oct 11 01:49:39.430182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2601/5232] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:39 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:40.455813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:40.456441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:40.464242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:40.464744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:40.465192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:40.466105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:40.466748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:40.467503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:40.658507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:40.671737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54582415-3692-4676-9913-44956d22ac8d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.219374 Oct 11 01:49:40.674040 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2632/5233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:40 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:41.697068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:41.698358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:41.705649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:41.706517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:41.707235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:41.708128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:41.709027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:41.709803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:41.930982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:41.940748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63645c02-20bf-4966-8926-3f2694865142 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.248254 Oct 11 01:49:41.941349 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2602/5234] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:41 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:42.645253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ae510f-4b20-4049-a770-7b0685340eeb", "name": "network-vif-plugged", "status": "completed", "tag": "3dbef01e-4045-42f7-852f-bfa4be320de8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:42.672675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:42.673376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:42.674080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:42.701967 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] Creating event network-vif-plugged:3dbef01e-4045-42f7-852f-bfa4be320de8 for instance 34ae510f-4b20-4049-a770-7b0685340eeb on n-h1-772273-9 Oct 11 01:49:42.708413 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-436aba0a-7c26-4713-9132-c45c8fa7aa4e req-395019a7-32bd-4fe6-b5be-0423c0581209 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067990 Oct 11 01:49:42.709616 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2633/5235] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:42.964683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:42.965411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:42.976555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:42.977201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:42.978136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:42.980993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:42.981828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:42.982742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:43.268758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:43.278598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a2a9e25c-52fe-4d07-9c00-09ff88d964cc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1318 microversion: 2.1 time: 0.318140 Oct 11 01:49:43.280072 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2603/5236] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:42 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:43.446948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1843192124", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "8c4eccb5-c6d4-49f1-a209-4ef77799a45d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1603207512", "security_groups": [{"name": "tempest-secgroup-smoke-586017238"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:43.567939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] validate_networks() for [('8c4eccb5-c6d4-49f1-a209-4ef77799a45d', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:49:44.073533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:49:44.074087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:49:44.074526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:49:44.075013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:49:44.075535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:49:44.092595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.097836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.098381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.099238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.099973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.102251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.133758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:49:44.143570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Getting quotas for user b6965eb3a6a74e62a184ea493c8fcb76 and project 2a0d0254a7ec463c891af24123953ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:49:44.200264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:49:44.206643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:49:44.318320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:44.318946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:44.322731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:44.323493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:44.334573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d176d62-a05e-4d5f-bd2c-4130154d37a1 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.893388 Oct 11 01:49:44.337837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2634/5237] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:49:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:49:44.348562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.349317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.349933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.350600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86fff16a-1c58-41d9-959e-14fd80d4cc51 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:44.351088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.351217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-86fff16a-1c58-41d9-959e-14fd80d4cc51 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:44.351833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.362411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.481545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-86fff16a-1c58-41d9-959e-14fd80d4cc51 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:44.490369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86fff16a-1c58-41d9-959e-14fd80d4cc51 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1267 microversion: 2.1 time: 0.146776 Oct 11 01:49:44.492579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2635/5238] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:44 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:44.615228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:44.624989 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6ba8e53-e797-40d5-b080-67c255f41041 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1508 microversion: 2.1 time: 0.311719 Oct 11 01:49:44.626140 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2604/5239] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:44 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:44.653274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:44.653888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:44.684953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.685461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.693136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.695781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.696405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.696998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.932096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:44.945682 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9532e8db-6262-48bd-9638-1c7d0837f655 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1508 microversion: 2.1 time: 0.296227 Oct 11 01:49:44.963123 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2636/5240] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:44 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:44.969073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:44.972237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:44.974218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:44.986041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.987058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.988980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:44.989768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:44.990239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:44.990667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.105835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bfdd86d-fdf8-46c9-881e-33e6c861431a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "PUT /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1080 microversion: 2.1 time: 0.140782 Oct 11 01:49:45.107556 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2605/5241] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:49:44 2022] PUT /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1080 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:45.126328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:45.128803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:45.138942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.139984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.143219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.144920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.145934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.146490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.317143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:45.328491 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-110bfbb3-8350-4b37-885e-47e83bdc2e1c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1506 microversion: 2.1 time: 0.206173 Oct 11 01:49:45.348283 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2637/5242] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:45 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:45.357733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:45.358617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:45.387790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.388579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.389917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.390774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.391245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.391975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.414061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:45.516933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:45.517614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:45.526120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.526627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.527072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.528324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.528810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.529233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.592051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:45.604374 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6fe894e0-8691-43af-b422-34645f3772f9 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1506 microversion: 2.1 time: 0.253934 Oct 11 01:49:45.605370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2606/5243] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:45 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:45.630807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:45.636291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:45.656637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.657169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.657620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.658433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.658896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.659328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.685078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:45.703429 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72aa78a9-fea3-4340-8853-670be701a2b5 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1319 microversion: 2.1 time: 0.190255 Oct 11 01:49:45.707418 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2638/5244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:45 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:45.760964 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7717cb7-b416-4aae-aeb6-0dc43783cb3f tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "PUT /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1082 microversion: 2.1 time: 0.137470 Oct 11 01:49:45.761871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2607/5245] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 01:49:45 2022] PUT /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1082 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:45.782244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:45.783607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:45.791959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.793111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.794045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.794929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:45.795797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:45.796596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:45.985033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:45.995299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c91ce64-9e3b-41b4-9d22-b6492773ac51 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1508 microversion: 2.1 time: 0.217600 Oct 11 01:49:45.996759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2639/5246] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:45 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:46.024591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:46.025225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:46.036639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.037158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.038768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.039534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.040188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.040844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.246555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:46.257650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88ed2f4f-e3f2-4a59-88dd-ad08f769f798 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1508 microversion: 2.1 time: 0.237853 Oct 11 01:49:46.258767 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2608/5247] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:46 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:46.281711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:46.282272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:46.289944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.290703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.291229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.292269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.293241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.294018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.314987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:46.347516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:49:46.480289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:46.493625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2536fc8a-4285-4cbd-a6e3-4e21442c206c tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 204 len: 0 microversion: 2.1 time: 0.215848 Oct 11 01:49:46.494821 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2640/5248] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:46 2022] DELETE /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:49:46.505610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:46.506151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:46.514896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.515418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.515873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.516606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.517073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.517549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.560086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:49:46.627981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Instance is already in deleting state, ignoring this request Oct 11 01:49:46.629366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d935ab7b-14dd-4898-8bc6-9d0eabdaf44b tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 204 len: 0 microversion: 2.1 time: 0.127757 Oct 11 01:49:46.630558 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2609/5249] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:46 2022] DELETE /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:49:46.641779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:46.641779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:46.650258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.650906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.651545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.652373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.652945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.653475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.733190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:46.737387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:46.746709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.747716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.748509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.749662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:46.750297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:46.750901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:46.881851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:46.896658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-23f8862a-ec56-4127-ab3a-d18df0804991 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1514 microversion: 2.1 time: 0.261436 Oct 11 01:49:46.911384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2641/5250] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:46 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:47.011996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:47.022469 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ddfe0f8-e89c-47b8-9f1a-db76e42b21fd tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.293306 Oct 11 01:49:47.029318 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2610/5251] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:46 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:47.925493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:47.926135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:47.935060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:47.936152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:47.936987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:47.939703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:47.940237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:47.940696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:47.963978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:47.977256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:47.978331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:47.979217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:48.002279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] Creating event network-changed:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:49:48.020577 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-cc4bb8d6-23cd-4210-8e9d-bdf43b51976b req-3de66e1e-a0fe-4313-b7ee-d11bc84e8e4b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167180 Oct 11 01:49:48.021210 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2642/5252] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:48.059814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:48.061181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:48.069864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:48.070635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:48.071176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:48.072330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:48.072992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:48.073621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:48.226245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:48.236945 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c296f503-0eac-4763-8859-b840010f637d tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1514 microversion: 2.1 time: 0.314479 Oct 11 01:49:48.246843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2611/5253] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:47 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:48.399722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:48.408348 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1681ddb5-6ed1-489b-8cde-a97da392d72f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.360310 Oct 11 01:49:48.410168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2643/5254] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:48 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:49:49.065593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ae510f-4b20-4049-a770-7b0685340eeb", "name": "network-vif-deleted", "tag": "3dbef01e-4045-42f7-852f-bfa4be320de8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:49.083292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.083993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.084448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.098362 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] Creating event network-vif-deleted:3dbef01e-4045-42f7-852f-bfa4be320de8 for instance 34ae510f-4b20-4049-a770-7b0685340eeb on n-h1-772273-9 Oct 11 01:49:49.106164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cc04e693-b858-40bd-80c2-b4f22fdfb83a req-b5a8d2ad-c6db-4965-86bd-59081fc0be41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043363 Oct 11 01:49:49.107101 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2612/5255] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:49.261555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:49.262382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:49.270486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.270983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.271810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.273267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.273892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.274489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.320786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.321549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.322221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.322861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lazy-loading 'fault' on Instance uuid 34ae510f-4b20-4049-a770-7b0685340eeb {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:49:49.373063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a096df3f64ab8a2d77331498880ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f855744e6c7447cca550d3a2084627de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:49.381929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86317d46-b043-4c88-86e8-8c5a6608a303 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 200 len: 1308 microversion: 2.1 time: 0.124514 Oct 11 01:49:49.383380 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2644/5256] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:49 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:49.434379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:49.435188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:49.442410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.444035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.444484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.445200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:49.445665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:49.446096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:49.587501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:49.597232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46bb8d50-8ac9-4222-af58-e1f7b8c3114b tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.167163 Oct 11 01:49:49.598088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2613/5257] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:49 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:50.406762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.408623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 34ae510f-4b20-4049-a770-7b0685340eeb] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.415439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.415961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.416402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.417102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.417563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.417994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.434385 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] HTTP exception thrown: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Request method failure captured: Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb HTTP/1.1 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMtBkr7ltzmQIYSl1d3Pck2K8XC1qZDQ__Zm7qyCw_eK-EhesV9nKitpT37j_KUWjkl2cWYmwuej_lev3B34exdun11Y5imSYNPL5uhxtfLRHDq3uxWYOL6xU_5mKLmj9n5i7wivkdYwv88O2NKcgt_QlYd_MNVLNjcLzjMDbk640eI Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f855744e6c7447cca550d3a2084627de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f855744e6c7447cca550d3a2084627de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 284a096df3f64ab8a2d77331498880ba Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '34ae510f-4b20-4049-a770-7b0685340eeb'} Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.436112 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Returning 404 to user: Instance 34ae510f-4b20-4049-a770-7b0685340eeb could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:50.441697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d358614f-47c5-4cb7-bacd-d9f0a9c4be2e tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb" status: 404 len: 111 microversion: 2.1 time: 0.035271 Oct 11 01:49:50.444265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2645/5258] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:50 2022] GET /compute/v2.1/servers/34ae510f-4b20-4049-a770-7b0685340eeb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:49:50.449771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.450801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.461652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.462155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.462604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.463322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.463818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.464311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.481843 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] HTTP exception thrown: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Request method failure captured: Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 HTTP/1.1 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMtBkr7ltzmQIYSl1d3Pck2K8XC1qZDQ__Zm7qyCw_eK-EhesV9nKitpT37j_KUWjkl2cWYmwuej_lev3B34exdun11Y5imSYNPL5uhxtfLRHDq3uxWYOL6xU_5mKLmj9n5i7wivkdYwv88O2NKcgt_QlYd_MNVLNjcLzjMDbk640eI Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f855744e6c7447cca550d3a2084627de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f855744e6c7447cca550d3a2084627de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 284a096df3f64ab8a2d77331498880ba Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '4af5db52-390f-487f-b464-a4be620a3ff2'} Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:50.483639 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Returning 404 to user: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-608a8ebc-88c8-49dc-b113-050f66435b78 tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 404 len: 111 microversion: 2.1 time: 0.041912 Oct 11 01:49:50.488202 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2614/5259] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:50 2022] DELETE /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:49:50.494166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.494817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 4af5db52-390f-487f-b464-a4be620a3ff2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.500955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.501469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.501914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.502614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.503084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.503549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.517814 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] HTTP exception thrown: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Request method failure captured: Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 HTTP/1.1 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMtBkr7ltzmQIYSl1d3Pck2K8XC1qZDQ__Zm7qyCw_eK-EhesV9nKitpT37j_KUWjkl2cWYmwuej_lev3B34exdun11Y5imSYNPL5uhxtfLRHDq3uxWYOL6xU_5mKLmj9n5i7wivkdYwv88O2NKcgt_QlYd_MNVLNjcLzjMDbk640eI Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f855744e6c7447cca550d3a2084627de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f855744e6c7447cca550d3a2084627de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 284a096df3f64ab8a2d77331498880ba Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4af5db52-390f-487f-b464-a4be620a3ff2'} Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.519446 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Returning 404 to user: Instance 4af5db52-390f-487f-b464-a4be620a3ff2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27dedec3-88ba-4ba2-93f7-e72f4be950bc tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2" status: 404 len: 111 microversion: 2.1 time: 0.030657 Oct 11 01:49:50.524060 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2646/5260] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:50 2022] GET /compute/v2.1/servers/4af5db52-390f-487f-b464-a4be620a3ff2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:49:50.529557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.530095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.536856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.537353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.537800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.538503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.538964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.539424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.554873 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] HTTP exception thrown: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Request method failure captured: Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 HTTP/1.1 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMtBkr7ltzmQIYSl1d3Pck2K8XC1qZDQ__Zm7qyCw_eK-EhesV9nKitpT37j_KUWjkl2cWYmwuej_lev3B34exdun11Y5imSYNPL5uhxtfLRHDq3uxWYOL6xU_5mKLmj9n5i7wivkdYwv88O2NKcgt_QlYd_MNVLNjcLzjMDbk640eI Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f855744e6c7447cca550d3a2084627de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f855744e6c7447cca550d3a2084627de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 284a096df3f64ab8a2d77331498880ba Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0e7c98a9-af8d-4e49-87db-38a7d7b733d7'} Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:50.556507 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Returning 404 to user: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a81af55-e6b2-4276-8d5c-d513fd0f321a tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 404 len: 111 microversion: 2.1 time: 0.032263 Oct 11 01:49:50.561129 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2615/5261] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:49:50 2022] DELETE /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:49:50.566514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.567143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] [instance: 0e7c98a9-af8d-4e49-87db-38a7d7b733d7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.574163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.574669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.575116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.575880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.576344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.576871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.591631 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] HTTP exception thrown: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Request method failure captured: Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 HTTP/1.1 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMtBkr7ltzmQIYSl1d3Pck2K8XC1qZDQ__Zm7qyCw_eK-EhesV9nKitpT37j_KUWjkl2cWYmwuej_lev3B34exdun11Y5imSYNPL5uhxtfLRHDq3uxWYOL6xU_5mKLmj9n5i7wivkdYwv88O2NKcgt_QlYd_MNVLNjcLzjMDbk640eI Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f855744e6c7447cca550d3a2084627de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f855744e6c7447cca550d3a2084627de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f855744e6c7447cca550d3a2084627de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f855744e6c7447cca550d3a2084627de Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665900466 Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 284a096df3f64ab8a2d77331498880ba Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665900466-project Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0e7c98a9-af8d-4e49-87db-38a7d7b733d7'} Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:49:50.593212 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] Returning 404 to user: Instance 0e7c98a9-af8d-4e49-87db-38a7d7b733d7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d7ae353b-b759-4c1c-913d-394ad40f54cd tempest-ServerDiskConfigTestJSON-1665900466 tempest-ServerDiskConfigTestJSON-1665900466-project] 10.222.0.66 "GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7" status: 404 len: 111 microversion: 2.1 time: 0.032053 Oct 11 01:49:50.598559 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2647/5262] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:50 2022] GET /compute/v2.1/servers/0e7c98a9-af8d-4e49-87db-38a7d7b733d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:49:50.622054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:50.622811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:50.629218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.629794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.630512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.631801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:50.632337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:50.633032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:50.801446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:50.810470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a410d727-182f-4949-a099-2522b3955eed tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.192471 Oct 11 01:49:50.811463 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2616/5263] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:50 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:51.835723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:51.836989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:51.844206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:51.844947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:51.845670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:51.846538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:51.847066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:51.847595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:52.012546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:52.021620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9f2dc6e-6b9b-44f6-8f3b-548f1252147f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.191356 Oct 11 01:49:52.036018 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2648/5264] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:51 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:53.046218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:53.046868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:53.054864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:53.055841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:53.056297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:53.057134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:53.057478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:53.058221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:53.224591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:53.233407 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a214b324-b7cf-4bac-bcb7-ce0428249bd4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.191087 Oct 11 01:49:53.247377 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2617/5265] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:53 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:54.259427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:54.260058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:54.264092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:54.268701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:54.269221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:54.269664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:54.270385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:54.270850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:54.277739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:54.423357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:54.432668 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a9e617b9-58b0-45b5-a403-4e747908f1c9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.177103 Oct 11 01:49:54.433663 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2649/5266] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:54 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:55.236465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "name": "network-vif-plugged", "status": "completed", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:55.257442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:55.258327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:55.258999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:55.280369 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] Creating event network-vif-plugged:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:49:55.288265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ce6738fb-a22a-4964-afbd-5e8750300295 req-74bbe6a2-4532-4206-bfb1-44feaab92317 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057635 Oct 11 01:49:55.290186 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2618/5267] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:49:55.459017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:55.460389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:55.466988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:49:55.469846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:55.470444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:55.470954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:55.471769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:55.472331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:55.472849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:55.629501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:55.639658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f84651af-c0d9-4368-a36d-8044d22f32b8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.186950 Oct 11 01:49:55.640375 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2650/5268] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:55 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:56.666445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:56.667178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:56.679874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:56.680883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:56.681463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:56.682356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:56.683082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:56.683934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:56.914491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:56.931530 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0a7ebc3-7065-4995-9db4-8dd0b9557034 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1392 microversion: 2.1 time: 0.271335 Oct 11 01:49:56.937982 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2619/5269] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:56 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:57.960687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:57.961416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:57.968247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:57.968740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:57.969179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:57.969876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:57.970334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:57.970764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:58.131305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:58.140003 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2822cced-3515-45b0-9e4c-ebca4e88c5b0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1565 microversion: 2.1 time: 0.183158 Oct 11 01:49:58.141529 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2651/5270] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:57 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:58.164675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:49:58.165311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:58.172488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:58.173855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:58.175446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:58.177032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:58.177617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:58.178299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:58.316388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1a4e6ac-0c0c-4673-b63a-0764419ca88a", "device": "/dev/sdb"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:49:58.319196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:49:58.325577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:58.326077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:58.326521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:58.327282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:49:58.327783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:49:58.328213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:49:58.380797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:49:58.391518 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-495f94bc-fdb3-4e9b-8ca5-7bfb799fe4d9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1565 microversion: 2.1 time: 0.230668 Oct 11 01:49:58.406595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2620/5271] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:49:58 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:49:58.750350 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a6b3bec-c216-435a-a509-ee49c0d34acc tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "POST /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438022 Oct 11 01:49:58.750899 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2652/5272] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:49:58 2022] POST /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:00.824306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:00.824929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:00.847616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:00.848119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:00.848565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:00.856115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:00.856942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:00.858413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:01.065702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:01.081663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:01.082458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:01.083062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:01.100363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] Creating event network-changed:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:50:01.116786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ed9fbada-b9f2-4acf-a9b6-452edf6d7b30 req-2616d5ce-4990-492b-84d3-5cdd0608d09f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300243 Oct 11 01:50:01.118449 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2653/5273] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:01.127788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:01.128685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:01.140483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:01.147971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:01.148543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:01.155667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:01.159051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:01.160885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:01.161460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:01.165133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94be579e-9e77-47c9-96a3-7310b73bcfc9 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1565 microversion: 2.1 time: 0.344568 Oct 11 01:50:01.165738 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2621/5274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:00 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1565 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:01.233831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b34b62eb-1fdf-49bd-91be-7077441b7d17 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/ips" status: 200 len: 149 microversion: 2.1 time: 0.113802 Oct 11 01:50:01.235036 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2654/5275] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:50:01 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:01.336496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-701164463", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "3e306e05-b3a0-4c73-a9e6-d2db982d85fb"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:01.446077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] validate_networks() for [('3e306e05-b3a0-4c73-a9e6-d2db982d85fb', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:50:02.087643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:50:02.088589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:50:02.089095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:50:02.089518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:50:02.089940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:50:02.107987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:02.111464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:02.113728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:02.115919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:02.117419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:02.118048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:02.150434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Getting quotas for project 5622ecb46ec44c889bf711a48e8d729d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:02.156735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Getting quotas for user bb24278f7a7d4d8dbf1337bef4bff5ce and project 5622ecb46ec44c889bf711a48e8d729d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:02.172936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:50:02.176162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:50:02.231707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064253 Oct 11 01:50:02.232751 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2622/5276] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:50:02.245683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aaad855e-91e8-43f0-a07e-dfbe389a36d3 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:02.246572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aaad855e-91e8-43f0-a07e-dfbe389a36d3 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:02.373077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aaad855e-91e8-43f0-a07e-dfbe389a36d3 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:02.384766 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aaad855e-91e8-43f0-a07e-dfbe389a36d3 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1216 microversion: 2.1 time: 0.142949 Oct 11 01:50:02.385665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2655/5277] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:02 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:03.410269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:03.411580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:03.435090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:03.435642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:03.436694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:03.437442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:03.440067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:03.440524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:03.644921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:03.653298 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a06e8fe-bd44-4dc3-8c5f-ac3d45495318 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1268 microversion: 2.1 time: 0.246946 Oct 11 01:50:03.654303 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2623/5278] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:03 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:03.982870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1359b45-5c3e-4f95-9130-daffeed67d40"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:03.985473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:03.994931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:03.995604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:03.996111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:03.996905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:03.997729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:03.998336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:04.431697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:04.451856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ddd36366-b039-4292-b4af-64b3c541cba3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470683 Oct 11 01:50:04.454270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2656/5279] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:50:03 2022] POST /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:04.677342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:04.677979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:04.692534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:04.693054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:04.693513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:04.694251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:04.696382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:04.696872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:04.738507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:04.820076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:04.829238 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db97032a-bfe6-4666-9e65-552442cba521 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1274 microversion: 2.1 time: 0.156363 Oct 11 01:50:04.830453 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2624/5280] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:04 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:05.854167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:05.854962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:05.867373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:05.867810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:05.871044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:05.872079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:05.872556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:05.872993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:06.114789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:06.130144 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0c7a24b8-8107-42ee-86ef-0b95e2c19e38 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1316 microversion: 2.1 time: 0.281528 Oct 11 01:50:06.130741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2657/5281] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:05 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:06.270253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e941b83d-a389-4238-bef9-18e321aaaa2d", "tag": "c555f573-1e23-4f2a-88ae-696cebf0e9c4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:06.293081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:06.293579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:06.294024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:06.311912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] Creating event network-changed:c555f573-1e23-4f2a-88ae-696cebf0e9c4 for instance e941b83d-a389-4238-bef9-18e321aaaa2d on n-h1-772273-9 Oct 11 01:50:06.320389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6d48ec7d-07e5-4015-a072-e00b5b61143d req-eec14459-8664-49d3-8bd9-54d494b76e16 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054629 Oct 11 01:50:06.321853 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2625/5282] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:07.155211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:07.155870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:07.164207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.164704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.165146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.165846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.166323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.166755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.337377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:07.348390 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5401c12a-6de9-4e57-8b28-a30d523a46a7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1316 microversion: 2.1 time: 0.196996 Oct 11 01:50:07.349004 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2658/5283] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:07 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:07.716393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:07.719542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:07.727932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.728442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.729105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.729836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.730310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.730747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.762654 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e27dc2c-6d25-44c8-bf45-af911a045e37 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050636 Oct 11 01:50:07.763234 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2626/5284] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:07 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:50:07.830209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:07.830711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:07.836813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.837304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.837747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.838512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.838981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.839431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.866077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:50:07.959714 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f62a4e7c-a66f-4a8e-9105-5a597506a4f9 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 204 len: 0 microversion: 2.1 time: 0.132291 Oct 11 01:50:07.961361 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2659/5285] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:50:07 2022] DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:50:07.969686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:07.970923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:07.977276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.977845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.978390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:07.980019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:07.980543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:07.980977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:08.375202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:08.376284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:08.383963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:08.384468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:08.384969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:08.385843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:08.386309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:08.386764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:08.505497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:08.531982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d6eae90-748f-499c-b1d0-331e13283640 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1675 microversion: 2.1 time: 0.565953 Oct 11 01:50:08.533806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2627/5286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:07 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1675 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:08.561242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:08.570054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9af2e9c-9590-40f8-90f2-7bcf95d1b53c tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1316 microversion: 2.1 time: 0.199639 Oct 11 01:50:08.570684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2660/5287] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:08 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:09.557204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:09.557862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:09.566138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:09.566637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:09.567090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:09.567832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:09.568296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:09.568731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:09.594502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:09.595833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:09.603889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:09.604716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:09.605396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:09.606177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:09.606705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:09.607240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:09.843663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:09.852783 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f6958d0-bb46-4361-b595-3909c29eff52 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1675 microversion: 2.1 time: 0.299326 Oct 11 01:50:09.855093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:09.861927 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2628/5288] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:09 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1675 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:09.863897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e287aa9-3ee6-4e86-9e90-b245579f4378 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1316 microversion: 2.1 time: 0.274054 Oct 11 01:50:09.864470 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2661/5289] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:09 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:10.676560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e941b83d-a389-4238-bef9-18e321aaaa2d", "name": "network-vif-plugged", "status": "completed", "tag": "c555f573-1e23-4f2a-88ae-696cebf0e9c4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:10.687586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.688385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.689090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.703034 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] Creating event network-vif-plugged:c555f573-1e23-4f2a-88ae-696cebf0e9c4 for instance e941b83d-a389-4238-bef9-18e321aaaa2d on n-h1-772273-9 Oct 11 01:50:10.709656 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a38f5f0e-c23f-4a65-975a-638629dc5757 req-9295e82e-5520-4f1f-9a29-40faa75fc5ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036954 Oct 11 01:50:10.711282 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2629/5290] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:10.766142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193e8756-59a7-4efd-9b1a-0da421763394", "name": "network-vif-deleted", "tag": "fb70815a-c158-4ed5-8f1b-05ced35df48d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:10.783046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.783750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.788330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.810590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] Creating event network-vif-deleted:fb70815a-c158-4ed5-8f1b-05ced35df48d for instance 193e8756-59a7-4efd-9b1a-0da421763394 on n-h1-772273-9 Oct 11 01:50:10.816524 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-cd6e0a46-b116-43b9-a0ae-1277608e4d58 req-dbcebdbb-e730-4c39-99d7-7ee4140bcf5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053860 Oct 11 01:50:10.817957 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2662/5291] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:10.881018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:10.882031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:10.890506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:10.891511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:10.905271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.905620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.906205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.906991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.909285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.909838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.910653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.911893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.912465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.913035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.913575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.914275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.988314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:10.988816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:10.989269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:10.989722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lazy-loading 'fault' on Instance uuid 193e8756-59a7-4efd-9b1a-0da421763394 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:11.052005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:11.059729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72559a4b-8038-4096-ac5c-fe692bb7557f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 200 len: 1328 microversion: 2.1 time: 0.186340 Oct 11 01:50:11.060447 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2630/5292] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:10 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 1328 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:11.124054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:11.132576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ac83c51-b214-4ef9-b77d-b272efdce6cb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1316 microversion: 2.1 time: 0.246818 Oct 11 01:50:11.133161 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2663/5293] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:10 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:12.083996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:12.085233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:12.092083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.092571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.093015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.093716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.094171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.094598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.108909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 HTTP/1.1 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '193e8756-59a7-4efd-9b1a-0da421763394'} Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:12.110574 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:12.116243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-524979df-36d0-4e8b-bca6-65fb4d572378 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 404 len: 111 microversion: 2.1 time: 0.032492 Oct 11 01:50:12.116969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2631/5294] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:12 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:50:12.122989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9cb77eee-16ae-46ef-8aa8-310d29ed8a1a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '.version_select at 0x7f11388b4280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:12.146904 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9cb77eee-16ae-46ef-8aa8-310d29ed8a1a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012509503" status: 202 len: 0 microversion: 2.1 time: 0.028683 Oct 11 01:50:12.147755 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2664/5295] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012509503 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:50:12.155979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:12.156594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:12.159150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:12.164623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.165118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.165559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.166289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.166743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.167168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.167793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:12.309554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:12.321372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8dcc938-f9ee-4be6-8e38-4dde8718833e tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1506 microversion: 2.1 time: 0.169233 Oct 11 01:50:12.321966 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2632/5296] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:12 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:12.347514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:12.348144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:12.355955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.356535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.357080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.358271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.358757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.359246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.378902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:12.392323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:12.393358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-886a12f3-4aab-4cff-9310-dca128efb38d tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/os-instance-actions/req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a" status: 200 len: 313 microversion: 2.1 time: 0.051043 Oct 11 01:50:12.402774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2665/5297] 10.222.0.66 () {58 vars in 1419 bytes} [Tue Oct 11 01:50:12 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/os-instance-actions/req-e65eda2b-c408-426f-8bfe-2fb64b5c1d5a => generated 313 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:12.409378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:12.411702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:12.418100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.418802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.419240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.419965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.420496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.420828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.551071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eba83206-cde9-4a7d-81cb-5fc4a92e0922 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "POST /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/action" status: 202 len: 0 microversion: 2.1 time: 0.143248 Oct 11 01:50:12.552781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2633/5298] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:50:12 2022] POST /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:50:12.561648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:12.562560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:12.575464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.576053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.576521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.581046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:12.581631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:12.582090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:12.837037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:12.848112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8294873-ff47-4136-bc21-cc8f6f43ff67 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1508 microversion: 2.1 time: 0.290501 Oct 11 01:50:12.849341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2666/5299] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:12 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:12.932761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-250e053b-7c8e-4312-a356-7978c6882210 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: .version_select at 0x7f113408e550>, body: {"keypair": {"name": "tempest-keypair-53020995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKW4JUgMuTDwyXjc9dxTMGTeI2G9UgQ2rKlcX7TMLJnGevutT/Z2Y+AChZZrx8o0MftiQ50o3+zD7URL8p2/H1pXZ6FYUF2iadKXdZa8pLA/sxtZgKc91+4x+CyRjr50w=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:12.949047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-250e053b-7c8e-4312-a356-7978c6882210 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:12.955504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-250e053b-7c8e-4312-a356-7978c6882210 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for user f15178e558aa48bcadc6ac21c55d1119 and project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:12.979191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-250e053b-7c8e-4312-a356-7978c6882210 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050707 Oct 11 01:50:12.979925 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2634/5300] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:50:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:13.873150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:13.873769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:13.881306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:13.882046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:13.882676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:13.883452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:13.884249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:13.884676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.037411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:14.052166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-822cf97b-73d7-4145-ba67-5d97a2cbf6b0 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1506 microversion: 2.1 time: 0.183302 Oct 11 01:50:14.053012 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2667/5301] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:13 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:14.078269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '.version_select at 0x7f11387d98b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:14.078975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:14.088431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.089054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.090007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.090358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.090824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.091280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.128239 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-883d6b0a-958f-4d0a-a562-50084ad1f268 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.055559 Oct 11 01:50:14.129226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2635/5302] 10.222.0.66 () {58 vars in 1296 bytes} [Tue Oct 11 01:50:14 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:14.146098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:14.147656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:14.166246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.167757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.168563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.169517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.170198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.170891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.204006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:50:14.310991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72e61d1a-64ad-4d61-a625-c6d6dcdd1a61 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 204 len: 0 microversion: 2.1 time: 0.172020 Oct 11 01:50:14.311642 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2668/5303] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:50:14 2022] DELETE /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:50:14.320901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:14.321532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:14.327676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.328172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.328618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.329903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:14.330586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:14.331017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:14.475641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:14.486728 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c982887-6438-4e13-846f-2d98ba31b3f7 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1512 microversion: 2.1 time: 0.169713 Oct 11 01:50:14.487899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2636/5304] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:14 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:14.947815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1197640464", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e960fff-dd8a-429f-b90d-73cc19a9145f"}], "security_groups": [{"name": "tempest-securitygroup--92503001"}], "key_name": "tempest-keypair-53020995", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:15.069274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] validate_networks() for [('4e960fff-dd8a-429f-b90d-73cc19a9145f', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:50:15.456765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:50:15.457292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:50:15.457900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:50:15.458389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:50:15.458881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:50:15.468271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:15.468840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:15.469354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:15.470672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:15.471555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:15.472060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:15.489666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:15.495050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Getting quotas for user f15178e558aa48bcadc6ac21c55d1119 and project c40b8e49319c4771b76e7c3fe5819c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:15.508213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:50:15.510589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:50:15.512044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:15.512754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:15.515908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:15.521936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:15.522747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:15.523270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:15.524095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:15.524633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:15.525156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:15.561733 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-692d5507-c379-4a93-adfe-8270b1634f03 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.618659 Oct 11 01:50:15.562388 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2669/5305] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:50:14 2022] POST /compute/v2.1/servers => generated 400 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:50:15.573776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50857826-c2b8-4367-a452-430f163660dc tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:15.574388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50857826-c2b8-4367-a452-430f163660dc tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:15.637079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50857826-c2b8-4367-a452-430f163660dc tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:15.644788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50857826-c2b8-4367-a452-430f163660dc tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1236 microversion: 2.1 time: 0.074886 Oct 11 01:50:15.645413 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2670/5306] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:15 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:15.706013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:15.714741 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9262c8df-6818-408c-b3cf-83a54b69cbdb tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1512 microversion: 2.1 time: 0.206780 Oct 11 01:50:15.715604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2637/5307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:15 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:16.579072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e941b83d-a389-4238-bef9-18e321aaaa2d", "name": "network-vif-deleted", "tag": "c555f573-1e23-4f2a-88ae-696cebf0e9c4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:16.587914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:16.595510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:16.596059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:16.596498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:16.612207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] Creating event network-vif-deleted:c555f573-1e23-4f2a-88ae-696cebf0e9c4 for instance e941b83d-a389-4238-bef9-18e321aaaa2d on n-h1-772273-9 Oct 11 01:50:16.616155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-13eeb27f-6d33-4742-894f-99b10567a24d req-2998f4e6-b60e-44de-89d0-ff58ba194ccc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041741 Oct 11 01:50:16.616787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2671/5308] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:16.668201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:16.669375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:16.676767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:16.677270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:16.677710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:16.678434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:16.678892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:16.679322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:16.739549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:16.740266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:16.748069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:16.749335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:16.750144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:16.751391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:16.752034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:16.752663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:16.781920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:16.790985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b5ff6e1-69d0-4e59-b02e-91a669a0e980 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1288 microversion: 2.1 time: 0.126575 Oct 11 01:50:16.791995 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2638/5309] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:16 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:16.842679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb24278f7a7d4d8dbf1337bef4bff5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5622ecb46ec44c889bf711a48e8d729d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:16.851957 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b52f5af2-b59a-43e8-b558-9ffe15f6c093 tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 200 len: 1301 microversion: 2.1 time: 0.117386 Oct 11 01:50:16.852816 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2672/5310] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:16 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:17.133469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1359b45-5c3e-4f95-9130-daffeed67d40"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:17.135992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:17.142588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.143085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.143678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.144389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.144851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.145284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.233965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments HTTP/1.1 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 74 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: {"volumeAttachment": {"volumeId": "d1359b45-5c3e-4f95-9130-daffeed67d40"}} Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: exception: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': 'b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff', 'body': {'volumeAttachment': {'volumeId': 'd1359b45-5c3e-4f95-9130-daffeed67d40'}}} Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:50:17.236116 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 400 to user: Invalid volume: volume d1359b45-5c3e-4f95-9130-daffeed67d40 is already attached to instances: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5dfccbc7-45d6-49c1-85f8-233c7261fbda tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108371 Oct 11 01:50:17.241472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2639/5311] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:50:17 2022] POST /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 01:50:17.333999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:17.334894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:17.342232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.343640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.344165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.345074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.345547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.345969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.456552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lazy-loading 'services' on Instance uuid b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:17.460936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:17.543845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a8c8a24-47f8-42b3-a711-e2c51fe02a76 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments/d1359b45-5c3e-4f95-9130-daffeed67d40" status: 202 len: 0 microversion: 2.1 time: 0.215386 Oct 11 01:50:17.544665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2673/5312] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:50:17 2022] DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments/d1359b45-5c3e-4f95-9130-daffeed67d40 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:50:17.554241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:17.558281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:17.567156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.568229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.568773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.569724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.570410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.571069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.611259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51249c42-349a-4c0f-9495-b047e599be09 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060538 Oct 11 01:50:17.612414 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2640/5313] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:17 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:17.816922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:17.817824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:17.824820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.825393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.826013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.826902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.827572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.827999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.886194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:17.889981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] [instance: e941b83d-a389-4238-bef9-18e321aaaa2d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:17.900372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.900860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.901313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.902035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:17.902500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:17.903092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:17.918328 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] HTTP exception thrown: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Request method failure captured: Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d HTTP/1.1 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMvITeFJVRDXE9_vYW53nJ-RvWLBR9ArvCuQC2xROFj8DTBbLmsDMTK4w3Alv8Gpjfet6IQVKlDgKEs7AGRNXTuXhJEZUss14y9o_DzllMGtPc717AvT1wMEhMZrg7fkspxrb8IPC9fJV0GBZoYz8V-578xLP48WilnMZY85H-lg0Qo Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5622ecb46ec44c889bf711a48e8d729d Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-InstanceActionsTestJSON-1122135193 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5622ecb46ec44c889bf711a48e8d729d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5622ecb46ec44c889bf711a48e8d729d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5622ecb46ec44c889bf711a48e8d729d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5622ecb46ec44c889bf711a48e8d729d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-InstanceActionsTestJSON-1122135193 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5622ecb46ec44c889bf711a48e8d729d Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1122135193 Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-InstanceActionsTestJSON-1122135193-project Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: bb24278f7a7d4d8dbf1337bef4bff5ce Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-InstanceActionsTestJSON-1122135193-project Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e941b83d-a389-4238-bef9-18e321aaaa2d'} Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:17.920054 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:17.925998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] Returning 404 to user: Instance e941b83d-a389-4238-bef9-18e321aaaa2d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:17.926951 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18d35a1b-ba35-478e-b78d-d3d1a324a72b tempest-InstanceActionsTestJSON-1122135193 tempest-InstanceActionsTestJSON-1122135193-project] 10.222.0.66 "GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d" status: 404 len: 111 microversion: 2.1 time: 0.047291 Oct 11 01:50:17.931304 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2641/5314] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:17 2022] GET /compute/v2.1/servers/e941b83d-a389-4238-bef9-18e321aaaa2d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:50:18.098901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:18.110286 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3541004-3986-41c4-b19b-0e32f40bbc44 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.298446 Oct 11 01:50:18.111696 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2674/5315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:17 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:18.625370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:18.628531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:18.644506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:18.646434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:18.647275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:18.648125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:18.650750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:18.651283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:18.740513 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f379c1e3-8f5e-4711-86a8-e3b09b012205 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118517 Oct 11 01:50:18.741322 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2642/5316] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:18 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:18.917334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d30a17-7de6-4b46-88a0-30dedcfc974d", "tag": "36919514-f66f-415f-8ff5-58f1c84339da"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:18.946823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:18.950743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:18.953401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:18.987208 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] Creating event network-changed:36919514-f66f-415f-8ff5-58f1c84339da for instance d9d30a17-7de6-4b46-88a0-30dedcfc974d on n-h1-772273-9 Oct 11 01:50:19.002143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-240e649c-5df8-4798-b5cd-8de4167e1d33 req-38b72c06-14fe-443a-a691-5f54df07a713 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091645 Oct 11 01:50:19.005997 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2675/5317] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:19.138131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:19.139409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:19.151712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:19.152220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:19.152678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:19.153409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:19.153911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:19.154350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:19.182213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:19.411666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:19.424188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-013966c5-5d26-4ef5-8ffd-bb75aa91ec89 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.290516 Oct 11 01:50:19.425765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2643/5318] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:19 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:19.753384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:19.756072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:19.762397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:19.762889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:19.763326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:19.764056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:19.764509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:19.764930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:19.796230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f524f34-df76-4bea-8a28-fa3c123427a1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Oct 11 01:50:19.796826 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2676/5319] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:19 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:20.447367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:20.449304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:20.458583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:20.459501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:20.460382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:20.461350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:20.462312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:20.462976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:20.810917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:20.813328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:20.826943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:20.827393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:20.827838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:20.830862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:20.831362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:20.831804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:20.915074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30cbe92a-b1e7-45c9-a3ab-7a3957fa3d4c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109341 Oct 11 01:50:20.915712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2677/5320] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:20 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:21.534862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:21.547515 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c8c8d922-87a5-4501-9d27-57a4319b5506 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 1.104328 Oct 11 01:50:21.553058 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2644/5321] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:20 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:21.931850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:21.948204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:21.968513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:21.969438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:21.973916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:21.976270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:21.977084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:21.977871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:22.044206 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c418301-b300-4971-ba30-69e76b79c3d1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117744 Oct 11 01:50:22.045035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2678/5322] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:21 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:22.578280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:22.581010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:22.596337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:22.597397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:22.598574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:22.600316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:22.601615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:22.602590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:22.947461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:22.971893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:22.992524 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e8237dc-58e8-4597-9b88-0eee22c44a65 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.418066 Oct 11 01:50:23.013915 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2645/5323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:22 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:23.058459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:23.061582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:23.078768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:23.080262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:23.080950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:23.082298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:23.083682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:23.084361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:23.145166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2bb6bd57-9908-486e-9518-97b184cd3a97 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091181 Oct 11 01:50:23.146243 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2679/5324] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:23 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:24.034420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:24.035049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:24.041431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.041873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.042384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.043074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.043525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.043975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.160236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:24.162437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:24.171499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.172601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.173297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.174839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.175891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.176957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.194215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:24.206069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e291cd17-732f-41c4-984e-bd61c39aa02c tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.181106 Oct 11 01:50:24.207816 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2646/5325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:24 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:24.214295 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bcf44bed-f932-4ec6-9d4d-698c71518f46 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060035 Oct 11 01:50:24.220646 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2680/5326] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:50:24 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:50:24.288504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:24.289019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:24.295679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.296373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.296822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.297533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.298020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.298446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.324949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:50:24.417892 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a01ffa47-ebfa-452e-9012-a01822b2fa50 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 204 len: 0 microversion: 2.1 time: 0.132375 Oct 11 01:50:24.418879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2647/5327] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:50:24 2022] DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:50:24.427563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:24.428206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:24.434418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.434916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.435628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.436355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.436851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.437464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.647658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:24.656061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e55805b-ec41-4d0f-ba67-55604af3bce9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1680 microversion: 2.1 time: 0.232240 Oct 11 01:50:24.656879 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2681/5328] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:24 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:24.728954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d30a17-7de6-4b46-88a0-30dedcfc974d", "name": "network-vif-plugged", "status": "completed", "tag": "36919514-f66f-415f-8ff5-58f1c84339da"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:24.757388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:24.758717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:24.759455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:24.773371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] Creating event network-vif-plugged:36919514-f66f-415f-8ff5-58f1c84339da for instance d9d30a17-7de6-4b46-88a0-30dedcfc974d on n-h1-772273-9 Oct 11 01:50:24.779946 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-82ea87c7-5cf4-4c5d-95c5-7389e2482f44 req-a3109809-7c21-4923-b3d5-4266bd81e2a5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057564 Oct 11 01:50:24.781763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2648/5329] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:25.236892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:25.237889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:25.246280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:25.246607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:25.247058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:25.247833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:25.248305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:25.249018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:25.448700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:25.458183 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d34cbec2-f229-409a-9627-1e3f8f9e64ac tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.227707 Oct 11 01:50:25.459027 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2682/5330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:25 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:25.689837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:25.691310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:25.713658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:25.714548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:25.716674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:25.717677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:25.718652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:25.719902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:25.974672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:25.984296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67e80963-55b4-4cb5-a8ee-2bdaf30d71af tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1680 microversion: 2.1 time: 0.306065 Oct 11 01:50:25.992440 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2649/5331] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:25 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:26.478082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:26.478898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:26.484819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:26.486578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:26.512866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:26.513670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:26.514358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:26.517304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:26.517960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:26.518570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:26.794098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:26.809230 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47a7be4d-64d4-4ab9-89b1-1bb60b3e8bd3 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1360 microversion: 2.1 time: 0.331671 Oct 11 01:50:26.821782 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2683/5332] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:26 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1360 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:27.008183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:27.010233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:27.023314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:27.023784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:27.024148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:27.031602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:27.033122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:27.033743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:27.144761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:27.156559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-129cad95-9e0b-49b4-a963-5896d1703d6f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1613 microversion: 2.1 time: 0.152320 Oct 11 01:50:27.157199 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2650/5333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:27 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:27.385625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff", "name": "network-vif-deleted", "tag": "37c29a8e-2578-4f04-8f0f-986c7d23973b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:27.396448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:27.396939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:27.397383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:27.410568 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] Creating event network-vif-deleted:37c29a8e-2578-4f04-8f0f-986c7d23973b for instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff on n-h1-772273-9 Oct 11 01:50:27.417092 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9fce092d-ed16-4716-ae85-762a8f0117ad req-3cc9c541-a893-40d7-ab8a-75c4e1ab52e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Oct 11 01:50:27.421668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2684/5334] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:27.834742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:27.835444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:27.846382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:27.846602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:27.847053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:27.847815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:27.848284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:27.848719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.189913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:28.191555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:28.198776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:28.199573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:28.200194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.201257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:28.201876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:28.202506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.241083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:28.241794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:28.242398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.243013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lazy-loading 'fault' on Instance uuid b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:28.246889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:28.256840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29142090-370a-4f13-8db1-9b6445dacc45 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1547 microversion: 2.1 time: 0.426583 Oct 11 01:50:28.262745 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2651/5335] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:27 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1547 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:28.288328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:28.289238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:28.300032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:28.301276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:28.301916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.302837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:28.303782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:28.304890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:28.318731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:28.333588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f58392d-b380-43a6-bfd1-633eae4a2d0b tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 200 len: 1331 microversion: 2.1 time: 0.149128 Oct 11 01:50:28.334523 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2685/5336] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:28 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:28.532342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cda563ba-561a-44f0-881f-f2170c814ead tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249424 Oct 11 01:50:28.533170 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2652/5337] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:50:28 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-interface => generated 285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:29.183836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:29.184343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:29.191136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:29.191862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:29.192129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:29.192874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:29.199268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:29.199796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:29.301924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lazy-loading 'services' on Instance uuid 0794737f-6c46-4fe8-9284-26b413e2bbc5 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:29.363672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:29.364300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:29.387568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:29.388204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:29.389614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:29.391057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:29.392098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:29.392776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:29.420043 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff HTTP/1.1 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff'} Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:29.422126 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:50:29.428248 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:29.429081 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14191287-96df-4ed9-acbf-22e557842335 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5/os-volume_attachments/f1a4e6ac-0c0c-4673-b63a-0764419ca88a" status: 202 len: 0 microversion: 2.1 time: 0.244947 Oct 11 01:50:29.429951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:29.431049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-888a1be9-49cd-4350-963d-6b801fdf99cb tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 404 len: 111 microversion: 2.1 time: 0.074289 Oct 11 01:50:29.435844 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2653/5338] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:29 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:50:29.439642 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2686/5339] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:50:29 2022] DELETE /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5/os-volume_attachments/f1a4e6ac-0c0c-4673-b63a-0764419ca88a => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:50:29.444045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d4eaaa5-d87b-4116-877b-3fa2a86c0058 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '.version_select at 0x7f112f2bf160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:29.499650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d4eaaa5-d87b-4116-877b-3fa2a86c0058 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848024019" status: 202 len: 0 microversion: 2.1 time: 0.061957 Oct 11 01:50:29.511438 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2654/5340] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 01:50:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848024019 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:50:30.507202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88a6d69d-337c-4fcc-9662-c3d437b46ca7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: .version_select at 0x7f112fe635e0>, body: {"keypair": {"name": "tempest-keypair-1447030912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlLyHeo/zkaJ7v2DqMnN2z7A2ngQWORB0AzSJl9HW8473nsua+dsfKc63I9J7ZVilO5Zv1vJIyk9pY2m8whFJ02Xfv22D5OO4eBwKsl5d/d0NPhI587Tdfpd7Df+XOB0Q=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:30.527886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-88a6d69d-337c-4fcc-9662-c3d437b46ca7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:30.534246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-88a6d69d-337c-4fcc-9662-c3d437b46ca7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:30.581396 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88a6d69d-337c-4fcc-9662-c3d437b46ca7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078994 Oct 11 01:50:30.593997 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2687/5341] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:50:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:30.874963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d30a17-7de6-4b46-88a0-30dedcfc974d", "tag": "36919514-f66f-415f-8ff5-58f1c84339da"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:30.894914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:30.904117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:30.904588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:30.922165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] Creating event network-changed:36919514-f66f-415f-8ff5-58f1c84339da for instance d9d30a17-7de6-4b46-88a0-30dedcfc974d on n-h1-772273-9 Oct 11 01:50:30.938049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-254a8bae-9ad3-4fdb-a3ea-2d31e07594df req-61ce82fa-d702-47ab-8ed7-408a03473f48 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070733 Oct 11 01:50:30.941627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2655/5342] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:32.591820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1692538247", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "175277bd-b335-45a2-80f4-03150d448953"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:32.694177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] validate_networks() for [('175277bd-b335-45a2-80f4-03150d448953', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:50:32.773910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521148358", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e93cb-284f-427c-82a6-2e0f725420b8"}], "security_groups": [{"name": "tempest-securitygroup--1209179752"}], "key_name": "tempest-keypair-1447030912", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:33.051115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] validate_networks() for [('859e93cb-284f-427c-82a6-2e0f725420b8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:50:33.362875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:50:33.363309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:50:33.363813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:50:33.364224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:50:33.364640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:50:33.377690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:33.379056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:33.379778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:33.381288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:33.382652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:33.383381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:33.406662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Getting quotas for project ed9299e8fdb8413ea6dc983589e5889d. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:33.416319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Getting quotas for user 9319a0566e34480d9ff42c5e683ed313 and project ed9299e8fdb8413ea6dc983589e5889d. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:33.434265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:50:33.437286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:50:33.501927 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd29d777-d3f8-48c6-b187-b89b279dd415 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115004 Oct 11 01:50:33.509922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2688/5343] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:50:33.517330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dfc02222-6796-4805-87fe-fa908e1623f1 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:33.518212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dfc02222-6796-4805-87fe-fa908e1623f1 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:33.610474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dfc02222-6796-4805-87fe-fa908e1623f1 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:33.620869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dfc02222-6796-4805-87fe-fa908e1623f1 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1225 microversion: 2.1 time: 0.109486 Oct 11 01:50:33.624911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2689/5344] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:33 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:33.685737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:50:33.686167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:50:33.686645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:50:33.687064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:50:33.687641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:50:33.697941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:33.698366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:33.698815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:33.699574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:33.700422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:33.701019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:33.721679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:33.727328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Getting quotas for user cd4d766a40634e1eb885221d16118af9 and project e7ff48ca7e2c43098f864610fdc55361. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:33.743673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:50:33.746712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:50:33.807189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-434a22ef-3bdf-47ec-82fe-0be14da66752 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.037981 Oct 11 01:50:33.814912 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2656/5345] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:50:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:50:33.819733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba64ca30-b2ec-40b8-a73d-defe13d7bf5c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:33.820356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba64ca30-b2ec-40b8-a73d-defe13d7bf5c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:33.923866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba64ca30-b2ec-40b8-a73d-defe13d7bf5c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:33.933706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba64ca30-b2ec-40b8-a73d-defe13d7bf5c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1242 microversion: 2.1 time: 0.117846 Oct 11 01:50:33.936925 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2690/5346] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:33 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:34.651321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:34.652111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:34.663524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:34.664274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:34.664800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:34.665594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:34.666131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:34.666708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:34.767469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:34.775719 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7940e63e-3c6a-46e4-96a2-1d3e58fbd665 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1277 microversion: 2.1 time: 0.130522 Oct 11 01:50:34.776303 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2657/5347] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:34 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:34.960357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:34.960983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:34.973799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:34.976667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:34.977310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:34.978630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:34.979281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:34.979951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:35.100769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:35.117590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91513bff-fb73-4f0e-a99d-656b3f554751 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1238 microversion: 2.1 time: 0.161115 Oct 11 01:50:35.118519 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2691/5348] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:34 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:35.800642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:35.802162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:35.822982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:35.823506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:35.823948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:35.824664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:35.825117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:35.825545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:35.955720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:35.964421 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a03f498-f7e3-4400-b0ec-ffb6eb5da075 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1283 microversion: 2.1 time: 0.170100 Oct 11 01:50:35.979560 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2658/5349] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:35 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:36.143199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:36.144029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:36.151665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.152354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.152993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.154954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.155958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.156904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.252310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:36.253697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:36.256402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:36.264784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.265910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.267143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.268122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58b3fd7b-d519-43ce-9ea0-258246d99fe9 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1300 microversion: 2.1 time: 0.129235 Oct 11 01:50:36.268439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.269102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.269734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.275174 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2692/5350] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:36 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:36.307109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:50:36.441520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6dd351eb-9e7c-4fd5-9a41-b7ae4034ba99 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 204 len: 0 microversion: 2.1 time: 0.192903 Oct 11 01:50:36.442147 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2659/5351] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:50:36 2022] DELETE /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:50:36.451836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:36.453653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:36.464257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.465544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.466192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.468201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.471750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.472844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.724135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:36.732391 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2b65f94-3b22-448b-bc43-763a5b2e0860 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1512 microversion: 2.1 time: 0.284972 Oct 11 01:50:36.748248 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2693/5352] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:36 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:36.964194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:36.967510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:36.976186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.976978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.977677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.978610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:36.979287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:36.979988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:36.989096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:36.990110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:37.000709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.002098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.002906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.003967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.004585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.005194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.011774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:37.220486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:37.230225 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3cf3702-9373-415e-971b-2598379e8a2a tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.245130 Oct 11 01:50:37.230840 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2694/5353] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:36 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:37.246341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2d5c0c-1550-410e-8c6f-79f2ad4ef807", "tag": "370bfd4c-673f-440a-8420-0571a7ac8c6a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:37.259671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.261214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.261836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.277296 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] Creating event network-changed:370bfd4c-673f-440a-8420-0571a7ac8c6a for instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 on n-h1-772273-9 Oct 11 01:50:37.283238 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c2cd4676-1c40-485e-94ac-c9a86d04c824 req-ac88802d-3ba9-476d-9a00-15f393d46d6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043065 Oct 11 01:50:37.284103 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2695/5354] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:37.293660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:37.294625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:37.301723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.302227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.302669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.303406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.303863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.304494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.545548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:37.554531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49e2da14-b42a-4596-911f-be12882f0ac7 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.265796 Oct 11 01:50:37.561605 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2696/5355] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:37 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:37.566818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e433669f-a27c-491b-9e9e-da56211868c6", "tag": "8de2bdb0-94b8-4b31-ab24-1babf8ad4dff"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:37.577655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.578463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.579652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.592313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] Creating event network-changed:8de2bdb0-94b8-4b31-ab24-1babf8ad4dff for instance e433669f-a27c-491b-9e9e-da56211868c6 on n-h1-772273-9 Oct 11 01:50:37.598786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d4c68684-ab2b-4ae8-b408-2bfb322b77cd req-6898d3dc-c158-4d0f-afcb-070dce667e9d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035686 Oct 11 01:50:37.600225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2697/5356] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:37.604597 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b6e6e2c-bc4d-4a53-b87d-790fa7a3c8ce tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action" status: 200 len: 24570 microversion: 2.1 time: 0.644486 Oct 11 01:50:37.605499 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2660/5357] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:50:36 2022] POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action => generated 24570 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:50:37.757474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:37.758320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:37.764619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.765105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.765544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.766251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:37.767247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:37.767729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:37.911757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:37.919552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29a6291a-4a16-4ca1-92de-3bc85d92a429 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1512 microversion: 2.1 time: 0.166366 Oct 11 01:50:37.920120 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2698/5358] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:37 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:38.254403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:38.255117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:38.262677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.263176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.263653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.264364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.264828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.265269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.270535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:38.400131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:38.409038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cf7abbe-25cf-4eb1-aeb4-631e70845cc0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.158933 Oct 11 01:50:38.409867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2661/5359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:38 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:38.578121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:38.578743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:38.586097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.586629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.587045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.587797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.588268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.588705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.734926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:38.743891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ccfa017a-50aa-48d3-969e-fdef26fc3a2f tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.169629 Oct 11 01:50:38.744757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2699/5360] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:38 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:38.944052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:38.944675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:38.951161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.951688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.952136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.952841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.953306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.953741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.985794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:38.986289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:38.986736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:38.987190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lazy-loading 'fault' on Instance uuid 0794737f-6c46-4fe8-9284-26b413e2bbc5 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:39.028767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:39.036596 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5bca8ff-7161-431a-a01a-b434d0763b98 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 200 len: 1308 microversion: 2.1 time: 0.096486 Oct 11 01:50:39.037203 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2662/5361] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:38 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:39.432043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:39.432576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:39.439173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:39.439713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:39.440133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:39.440819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:39.441273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:39.441698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:39.568480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:39.576135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9600cf5-3174-40af-a281-44a2af355914 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.148132 Oct 11 01:50:39.576711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2700/5362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:39 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:39.617101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0794737f-6c46-4fe8-9284-26b413e2bbc5", "name": "network-vif-deleted", "tag": "aabf0773-f384-4663-92ae-2f3926b56c52"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:39.627625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:39.628384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:39.628996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:39.640956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] Creating event network-vif-deleted:aabf0773-f384-4663-92ae-2f3926b56c52 for instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 on n-h2-772273-9 Oct 11 01:50:39.645881 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-abe4dd06-3dd8-4546-b781-ae5af1fe259a req-df925a7b-e9f2-4246-bf02-9159969e56ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032667 Oct 11 01:50:39.646807 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2663/5363] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:39.768568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:39.769286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:39.776582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:39.777088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:39.777529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:39.778462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:39.778913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:39.779375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:39.995238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:40.004218 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-706683d8-029b-4663-a0e3-1f1f428f0999 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.239290 Oct 11 01:50:40.010644 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2701/5364] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:39 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:40.059692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:40.060422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: 0794737f-6c46-4fe8-9284-26b413e2bbc5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:40.068378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:40.068883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:40.069336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:40.070059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:40.070527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:40.071196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:40.086910 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] HTTP exception thrown: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Request method failure captured: Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 HTTP/1.1 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMtkBDiepnHO294z5135yONg563QM12Bmn-W3khtdkDMeKDcnx3XVggZUZfBfF6NQQWSWakgvaEpu1cnasii2uLAt1Sno6qI84PGDljCkSO5bwoMMFlFGnMRWKAXbpcaZsfI0gOyOMxrboal88-Hw8twmW6HykeK5DQ8OwWkaFrkIGo Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cdd2ee9af774b4a85240a3832d39545 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cdd2ee9af774b4a85240a3832d39545 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotTestJSON-693841583-project Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 489f0e5ba2ac4a998df2128eb0866de9 Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotTestJSON-693841583-project Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0794737f-6c46-4fe8-9284-26b413e2bbc5'} Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:40.089560 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Returning 404 to user: Instance 0794737f-6c46-4fe8-9284-26b413e2bbc5 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca360f9a-d22a-4ee4-ad5e-00e7c33f1229 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5" status: 404 len: 111 microversion: 2.1 time: 0.036921 Oct 11 01:50:40.095461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2664/5365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:40 2022] GET /compute/v2.1/servers/0794737f-6c46-4fe8-9284-26b413e2bbc5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:50:40.600574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:40.601217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:40.607603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:40.608102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:40.608542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:40.609243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:40.609694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:40.610317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:40.751887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:40.760221 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d543f4c-3c4d-4513-9419-bab6b56b90e4 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.165301 Oct 11 01:50:40.760941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2702/5366] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:40 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:50:41.026179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:41.027537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:41.036180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:41.036854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:41.037493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:41.038209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:41.039331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:41.039963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:41.179100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:41.187004 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2ed202fd-357b-4915-851d-42896943e495 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.164719 Oct 11 01:50:41.187561 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2665/5367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:41 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:41.784341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:41.784968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:41.791768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:41.792261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:41.792704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:41.793402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:41.793871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:41.794330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:41.926067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:41.933757 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f7adda1c-ccb1-42a5-a313-6996f87071c0 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.153464 Oct 11 01:50:41.934337 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2703/5368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:41 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:42.209782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:42.210444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:42.217413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:42.217907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:42.218363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:42.219074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:42.219743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:42.220183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:42.347152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:42.354852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e68c878-769a-45d0-b533-75f3e3b2f8e0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.149031 Oct 11 01:50:42.355462 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2666/5369] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:42 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:42.767928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433669f-a27c-491b-9e9e-da56211868c6", "name": "network-vif-plugged", "status": "completed", "tag": "8de2bdb0-94b8-4b31-ab24-1babf8ad4dff"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:42.777899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:42.778456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:42.778952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:42.792170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] Creating event network-vif-plugged:8de2bdb0-94b8-4b31-ab24-1babf8ad4dff for instance e433669f-a27c-491b-9e9e-da56211868c6 on n-h1-772273-9 Oct 11 01:50:42.798256 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2307a8d8-904a-4d8e-b806-9e1d8b90d40e req-4f138741-2e7a-4d30-b903-151866e47e00 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Oct 11 01:50:42.798929 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2704/5370] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:42.960414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:42.961369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:42.974900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:42.975534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:42.976247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:42.977681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:42.978227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:42.978741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:43.134604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:43.143590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55d74fca-caa2-466f-a75c-a5725dcfec21 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.189916 Oct 11 01:50:43.144204 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2667/5371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:42 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:43.379633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:43.380295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:43.386535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:43.387031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:43.387499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:43.388197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:43.388658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:43.389086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:43.394934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:43.525015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:43.532909 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e72bfc57-2e98-4137-9c6f-96b5e1bb9e60 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1368 microversion: 2.1 time: 0.158401 Oct 11 01:50:43.533487 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2705/5372] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:43 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:44.167225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:44.167879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:44.170656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:44.171359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:44.177683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.178181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.178627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.179332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.179823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.180257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.311626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:44.319634 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b1c97497-9671-4013-a906-3175c47c401f tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.156264 Oct 11 01:50:44.320417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2668/5373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:44 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:44.556196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:44.556808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:44.559647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:44.560199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:44.565809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.566382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.566849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.567542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.567993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.568412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.699204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:44.707469 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4eb920fd-4ca7-40e9-8edb-9ac4d5db715c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1557 microversion: 2.1 time: 0.155151 Oct 11 01:50:44.708050 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2706/5374] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:44 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:44.730341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:44.730846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:44.737880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.738386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.738884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.739771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.740236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.740675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.821485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2d5c0c-1550-410e-8c6f-79f2ad4ef807", "name": "network-vif-plugged", "status": "completed", "tag": "370bfd4c-673f-440a-8420-0571a7ac8c6a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:44.832148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:44.832641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:44.833085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:44.844844 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] Creating event network-vif-plugged:370bfd4c-673f-440a-8420-0571a7ac8c6a for instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 on n-h1-772273-9 Oct 11 01:50:44.850279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b8273056-6949-4201-b1bb-7c91e370e27c req-981df67e-e215-44c5-8f22-14e00861b1b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032552 Oct 11 01:50:44.851093 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2707/5375] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:44.877281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe8bba8a-f0f6-4d66-9fc2-033c2ed7f2c1 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150893 Oct 11 01:50:44.878232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2669/5376] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:50:44 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:45.342647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:45.343529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:45.349694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:45.350178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:45.350622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:45.351377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:45.351842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:45.352270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:45.502004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:45.509980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe386f67-91e7-4d0d-9b78-3bead331e87c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1325 microversion: 2.1 time: 0.171614 Oct 11 01:50:45.510565 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2708/5377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:45 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:46.245170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e433669f-a27c-491b-9e9e-da56211868c6", "tag": "8de2bdb0-94b8-4b31-ab24-1babf8ad4dff"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:46.255476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:46.263687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:46.264554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:46.265068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:46.280008 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] Creating event network-changed:8de2bdb0-94b8-4b31-ab24-1babf8ad4dff for instance e433669f-a27c-491b-9e9e-da56211868c6 on n-h1-772273-9 Oct 11 01:50:46.285594 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0c5b1205-ab90-45c8-a1c4-e2927f626def req-6714d67f-9933-47ce-a2a7-830941f984d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044884 Oct 11 01:50:46.286334 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2670/5378] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:46.534031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:46.536186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:46.544696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:46.545334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:46.545800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:46.546867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:46.547327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:46.547961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:46.964329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-420524147", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "1b58806f-ba96-44c7-acc6-276b915a2146"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:47.010607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:47.019793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a68c2b8-3efc-44e5-b934-df9c106bba0d tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1521 microversion: 2.1 time: 0.490729 Oct 11 01:50:47.021113 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2709/5379] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:46 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:47.027727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] validate_networks() for [('1b58806f-ba96-44c7-acc6-276b915a2146', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:50:47.043404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:47.044031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:47.050893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.051582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.052086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.052859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.053394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.053885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.086592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] HTTP exception thrown: Action 999 not found Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Request method failure captured: Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807/os-instance-actions/999 HTTP/1.1 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMvo-j8NWwezcx1v2UrQH7mWTees6aGIIz1-MNY_bNxDLnhOt8nt21jXxjzXK5wlA-fD2mwHSlRc_Orl046oaTs4gCs-VzBwZw-CbIkCxnsr_RRiAbyFK00iohIDpIV81qMRwuh_pUcvUiRECNZsmqwBTXsbb24zgnvR7rnKZx4qn-Q Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 9319a0566e34480d9ff42c5e683ed313 Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: exception: Action 999 not found Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': 'ec2d5c0c-1550-410e-8c6f-79f2ad4ef807', 'id': '999'} Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 11 01:50:47.098489 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.102987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Returning 404 to user: Action 999 not found {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:47.102987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2f41e6a-4765-43de-8054-77fa35eda40c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.060729 Oct 11 01:50:47.102987 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2710/5380] 10.222.0.66 () {58 vars in 1308 bytes} [Tue Oct 11 01:50:47 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807/os-instance-actions/999 => generated 66 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:50:47.110878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '.version_select at 0x7f112f88b280>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:47.111593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: 0ad2fec3-8e24-4d58-a11e-2c04b1d06051] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:47.118303 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] HTTP exception thrown: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Request method failure captured: Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/0ad2fec3-8e24-4d58-a11e-2c04b1d06051/os-instance-actions HTTP/1.1 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMvo-j8NWwezcx1v2UrQH7mWTees6aGIIz1-MNY_bNxDLnhOt8nt21jXxjzXK5wlA-fD2mwHSlRc_Orl046oaTs4gCs-VzBwZw-CbIkCxnsr_RRiAbyFK00iohIDpIV81qMRwuh_pUcvUiRECNZsmqwBTXsbb24zgnvR7rnKZx4qn-Q Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 9319a0566e34480d9ff42c5e683ed313 Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: method: Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '0ad2fec3-8e24-4d58-a11e-2c04b1d06051'} Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:47.119916 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Returning 404 to user: Instance 0ad2fec3-8e24-4d58-a11e-2c04b1d06051 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8bd3a4b9-d975-4d1c-8aed-71ab6b8f39cb tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/0ad2fec3-8e24-4d58-a11e-2c04b1d06051/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015505 Oct 11 01:50:47.126485 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2711/5381] 10.222.0.66 () {58 vars in 1296 bytes} [Tue Oct 11 01:50:47 2022] GET /compute/v2.1/servers/0ad2fec3-8e24-4d58-a11e-2c04b1d06051/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:50:47.130627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:47.131127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:47.141083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.141618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.142065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.142775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.143234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.143693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.170510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:50:47.229305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:47.267031 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e020c36-eb51-4d12-b03c-26eb465baf09 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 204 len: 0 microversion: 2.1 time: 0.139770 Oct 11 01:50:47.270886 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2712/5382] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:50:47 2022] DELETE /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:50:47.276905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:47.277773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:47.286036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.286698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.287281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.288705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.291249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.291249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.522997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:47.530804 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee9291c7-7cd9-4f54-bec3-b1118f81fdfc tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1527 microversion: 2.1 time: 0.258317 Oct 11 01:50:47.531409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2713/5383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:47 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:47.589523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:50:47.590085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:50:47.590443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:50:47.590885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:50:47.591308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:50:47.600755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.601245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.601692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.602435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:47.602901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:47.603366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:47.620221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Getting quotas for project 4cdd2ee9af774b4a85240a3832d39545. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:47.625553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Getting quotas for user 489f0e5ba2ac4a998df2128eb0866de9 and project 4cdd2ee9af774b4a85240a3832d39545. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:47.637741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:50:47.640200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:50:47.685715 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb3c120e-d956-4abf-af7c-d41dd2b90d8f tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726354 Oct 11 01:50:47.686310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2671/5384] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:50:47.697896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c0ad9f0d-9c8f-41ac-a391-27bdaccdb49c tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:47.698623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c0ad9f0d-9c8f-41ac-a391-27bdaccdb49c tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:47.753084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c0ad9f0d-9c8f-41ac-a391-27bdaccdb49c tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:47.760247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c0ad9f0d-9c8f-41ac-a391-27bdaccdb49c tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1218 microversion: 2.1 time: 0.066394 Oct 11 01:50:47.760824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2714/5385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:47 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:48.555710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:48.556326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:48.563250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:48.563781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:48.564216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:48.564910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:48.565364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:48.565788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:48.699077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:48.707632 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3efbacc-2477-4169-932e-86ee273ca224 tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1527 microversion: 2.1 time: 0.156724 Oct 11 01:50:48.724026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2672/5386] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:48 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:48.784979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:48.785772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:48.796023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:48.797024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:48.798120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:48.798922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:48.800511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:48.800984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:48.892698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:48.901569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59892b6e-d5b9-4505-b1e7-c1fbf813e081 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1276 microversion: 2.1 time: 0.122476 Oct 11 01:50:48.902416 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2715/5387] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:48 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:49.247378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2d5c0c-1550-410e-8c6f-79f2ad4ef807", "name": "network-vif-deleted", "tag": "370bfd4c-673f-440a-8420-0571a7ac8c6a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:49.258595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.259562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.259972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:49.273195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] Creating event network-vif-deleted:370bfd4c-673f-440a-8420-0571a7ac8c6a for instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 on n-h1-772273-9 Oct 11 01:50:49.278470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7d093615-09fe-4872-8d3e-43285a467aa2 req-558783db-6dd1-4f55-bd7a-491626de89b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Oct 11 01:50:49.279093 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2673/5388] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:49.732214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:49.733207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:49.740262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.740750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.741191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:49.741895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.742360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.742929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:49.786161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.786737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.787310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:49.787794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lazy-loading 'fault' on Instance uuid ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:50:49.838887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9319a0566e34480d9ff42c5e683ed313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9299e8fdb8413ea6dc983589e5889d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:49.847182 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b7205bf-172f-406b-9c24-92b660f7740e tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 200 len: 1315 microversion: 2.1 time: 0.119038 Oct 11 01:50:49.847827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2716/5389] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:49 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:49.926567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:49.927277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:49.934339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.934902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.935436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:49.936134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:49.936594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:49.937017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:50.078603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:50.087372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31de192b-5489-469a-8d5c-fad8b1643e33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.165530 Oct 11 01:50:50.089511 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2674/5390] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:49 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:50.103920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb08a06f-661e-4062-8291-675d49dfce1d", "tag": "9039b138-1238-436e-881c-20b262514016"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:50.116290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:50.117101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:50.117624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:50.132560 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] Creating event network-changed:9039b138-1238-436e-881c-20b262514016 for instance fb08a06f-661e-4062-8291-675d49dfce1d on n-h2-772273-9 Oct 11 01:50:50.137148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8f1cea33-cd31-4a74-bf50-7d9e7c4ee418 req-56d4f37b-f4b1-4871-ac7b-e52c3102797e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037906 Oct 11 01:50:50.137757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2717/5391] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:50:50.872100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:50.872726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] [instance: ec2d5c0c-1550-410e-8c6f-79f2ad4ef807] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:50.879215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:50.879738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:50.880181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:50.880885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:50.881347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:50.881782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:50.895388 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] HTTP exception thrown: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Request method failure captured: Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 HTTP/1.1 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMvo-j8NWwezcx1v2UrQH7mWTees6aGIIz1-MNY_bNxDLnhOt8nt21jXxjzXK5wlA-fD2mwHSlRc_Orl046oaTs4gCs-VzBwZw-CbIkCxnsr_RRiAbyFK00iohIDpIV81qMRwuh_pUcvUiRECNZsmqwBTXsbb24zgnvR7rnKZx4qn-Q Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed9299e8fdb8413ea6dc983589e5889d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: ed9299e8fdb8413ea6dc983589e5889d Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1736333743 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 9319a0566e34480d9ff42c5e683ed313 Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1736333743-project Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ec2d5c0c-1550-410e-8c6f-79f2ad4ef807'} Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:50.897028 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] Returning 404 to user: Instance ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f61a752-8006-48c6-a0b9-4d181120026c tempest-InstanceActionsNegativeTestJSON-1736333743 tempest-InstanceActionsNegativeTestJSON-1736333743-project] 10.222.0.66 "GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807" status: 404 len: 111 microversion: 2.1 time: 0.030429 Oct 11 01:50:50.902186 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2675/5392] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:50 2022] GET /compute/v2.1/servers/ec2d5c0c-1550-410e-8c6f-79f2ad4ef807 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:50:51.116346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:51.117058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:51.123303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:51.123764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:51.124207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:51.124903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:51.125365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:51.126394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:51.260118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:51.268080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-713cb388-4426-4cd3-807b-f5d190422761 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.157746 Oct 11 01:50:51.268661 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2718/5393] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:51 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:52.291496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:52.292073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:52.299884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:52.300698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:52.301210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:52.301991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:52.302521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:52.303025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:52.532482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:52.540496 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d54ba20-aba9-4b62-a41f-a92f8b50ab0b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.253033 Oct 11 01:50:52.541102 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2676/5394] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:52 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:53.564451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:53.565239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:53.575462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:53.576182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:53.576807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:53.577530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:53.577992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:53.578424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:53.819507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:53.828888 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2674c69-5400-40d1-a103-a1fa9802f4f2 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.268893 Oct 11 01:50:53.830630 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2719/5395] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:53 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:54.857347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:54.858518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:54.867326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:54.867863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:54.868312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:54.869029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:54.869649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:54.870091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:55.008515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:55.024252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5da89ac7-f63a-4222-ae9c-2e8d41550ba5 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.173818 Oct 11 01:50:55.033498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2677/5396] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:54 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:56.048584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:56.049355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:56.057359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:56.058105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:56.058777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:56.059536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:56.060314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:56.061027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:56.322339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:56.334537 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65a7310c-f0b1-46aa-b99d-e65bc3f9a838 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.290174 Oct 11 01:50:56.335421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2720/5397] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:56 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:57.359159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:57.360840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:57.369613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:57.370274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:57.370822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:57.371669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:57.372210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:57.372850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:57.480635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb08a06f-661e-4062-8291-675d49dfce1d", "name": "network-vif-plugged", "status": "completed", "tag": "9039b138-1238-436e-881c-20b262514016"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:57.492879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:57.493432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:57.493949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:57.508493 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] Creating event network-vif-plugged:9039b138-1238-436e-881c-20b262514016 for instance fb08a06f-661e-4062-8291-675d49dfce1d on n-h2-772273-9 Oct 11 01:50:57.514261 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8e5aba94-e0da-49ef-af44-a3c26680504e req-38089843-4333-41b6-ad4d-dd00c5a2e5ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037551 Oct 11 01:50:57.515457 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2721/5398] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:50:57.615582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:57.632545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:57.827111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:57.840550 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-674c7902-d263-4bc0-b05d-a96076431c26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.485658 Oct 11 01:50:57.841922 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2678/5399] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:57 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:58.865426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:50:58.874505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:50:58.876582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:50:58.884787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:58.885919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:58.886606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:58.887604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:50:58.888311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:50:58.888963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:50:59.152605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:50:59.162338 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70b1c273-d529-4678-912e-5f8afc44ec33 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1318 microversion: 2.1 time: 0.298899 Oct 11 01:50:59.162938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2722/5400] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:50:58 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:50:59.792141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1a68450-dbcc-4042-a2e2-cae9dd067b77 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: .version_select at 0x7f1134241ee0>, body: {"keypair": {"name": "tempest-keypair-2115940454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnVWxpeNJiT2tTVKuXgUVP+EHtQBVypJpRGxMcMGvuZ6ZUgCLpbTP6xhmO3aW1W4gBjBagF4XXO6/JgfgGxSsml4yIAGV5UV2SlQftRoHGt2k/dfjlPvEsYdz6KEZgYIw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:50:59.809687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a1a68450-dbcc-4042-a2e2-cae9dd067b77 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:50:59.815748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a1a68450-dbcc-4042-a2e2-cae9dd067b77 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:50:59.842772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1a68450-dbcc-4042-a2e2-cae9dd067b77 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187971 Oct 11 01:50:59.843790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2679/5401] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:00.186009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:00.186620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:00.193667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:00.194152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:00.194589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:00.195279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:00.195757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:00.196177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:00.350663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:00.358620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-02fd493a-9c44-4fd8-b4f8-3725c5e33d3b tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1507 microversion: 2.1 time: 0.176569 Oct 11 01:51:00.359193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2723/5402] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:00 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:00.382782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf98fd20-5157-4959-87d0-b6a9d7a0f45c", "device": "/dev/sdb"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:00.385353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:00.392211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:00.392735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:00.393179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:00.393885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:00.394346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:00.394779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:00.667225 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2afbff08-83f1-4f26-aa1f-61233f85fe4a tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "POST /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288139 Oct 11 01:51:00.667900 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2680/5403] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:51:00 2022] POST /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:01.228017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-364255587", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "965a3985-e7ee-410f-a1b3-0de185ed76ac"}], "security_groups": [{"name": "tempest-securitygroup--77662608"}], "key_name": "tempest-keypair-2115940454", "user_data": "}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:01.341340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] validate_networks() for [('965a3985-e7ee-410f-a1b3-0de185ed76ac', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:51:01.817305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:51:01.817845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:51:01.818388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:51:01.818806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:51:01.819257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:51:01.829623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:01.830192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:01.830633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:01.831552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:01.832215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:01.832649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:01.850968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:51:01.856318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:51:01.870496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:51:01.873221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:51:01.926617 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c968af68-a430-4e15-b794-8ec1f7ed5829 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.702925 Oct 11 01:51:01.927282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2724/5404] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:51:01 2022] POST /compute/v2.1/servers => generated 407 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:51:01.940037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79ad29b5-34b9-42c0-8faf-18d5220d317f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:01.941432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79ad29b5-34b9-42c0-8faf-18d5220d317f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:02.006481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79ad29b5-34b9-42c0-8faf-18d5220d317f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:02.013762 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79ad29b5-34b9-42c0-8faf-18d5220d317f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1238 microversion: 2.1 time: 0.078897 Oct 11 01:51:02.014945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2681/5405] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:01 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:03.039375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:03.039989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:03.047094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:03.047617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:03.048245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:03.049265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:03.049902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:03.050493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:03.130075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:03.139984 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7c77271-cf8c-4e05-8d9a-e66cb17213e7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1290 microversion: 2.1 time: 0.105177 Oct 11 01:51:03.155632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2725/5406] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:03 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:04.165753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:04.168209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:04.180135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:04.181533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:04.182261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:04.183166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:04.184361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:04.184976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:04.231287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:04.453183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:04.461990 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccf98892-2b10-4d08-bcdb-5387516f6cf9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.301572 Oct 11 01:51:04.462792 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2682/5407] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:04 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:04.881619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:04.896244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:04.896901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:04.897595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:04.926142 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] Creating event network-changed:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:51:04.932862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bc11ca2d-65e2-4fb4-8828-023081191cca req-dd86ed6f-9494-4785-b69f-435b20c2916d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057642 Oct 11 01:51:04.933793 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2726/5408] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:05.484006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:05.485289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:05.492457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:05.492959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:05.493411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:05.494342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:05.494581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:05.495015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:05.643358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:05.653211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e892f893-5885-4e99-837c-834522ee8214 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.172712 Oct 11 01:51:05.659388 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2683/5409] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:05 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:06.677454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:06.678318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:06.685975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:06.686649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:06.687212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:06.688586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:06.689276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:06.689802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:06.846355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:06.854137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ac3444f0-8dc7-47ee-b7b6-4f803019847d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.181108 Oct 11 01:51:06.854809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2727/5410] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:06 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:07.877369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:07.878013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:07.884966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:07.885490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:07.885934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:07.886638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:07.887095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:07.887555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:07.965290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:07.965786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:07.972797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:07.973314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:07.973747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:07.974438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:07.974890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:07.975308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:07.998694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1233cecd-6367-4877-9319-07be648e961f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037508 Oct 11 01:51:07.999281 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2728/5411] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:51:07 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:51:08.021681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:08.029655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3542f0e5-0da4-4812-9c83-cf8e5869a86c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.156184 Oct 11 01:51:08.030456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2684/5412] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:07 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:08.075270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:08.078156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:08.084670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.085153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.085587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.086276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.086736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.087161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.174622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:51:08.174622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:51:08.174887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:51:08.175219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:51:08.175660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:51:08.239556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:08.245958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.246534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.247078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.247903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.248359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.248791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.277590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36619382-4d9e-4c4b-8cde-abde954324f4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action" status: 202 len: 1139 microversion: 2.1 time: 0.206172 Oct 11 01:51:08.278261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2729/5413] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:51:08 2022] POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action => generated 1139 bytes in 208 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 01:51:08.303388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:08.304042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:08.310446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.311170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.312272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.313826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:08.314477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:08.315081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:08.473948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:08.482188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14486a6b-08d6-472b-9fd1-1ff9a87df263 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.182971 Oct 11 01:51:08.482786 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2685/5414] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:08 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:09.052802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:09.054013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:09.065171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.065948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.066553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.067473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.068090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.068692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.206632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:09.221832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ab52a127-f2e8-4cd8-bfaf-b43657e5ea83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.173389 Oct 11 01:51:09.222651 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2730/5415] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:09 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:09.361429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03a7fcaa-1653-409f-8562-4f85c141a139"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:09.364394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:09.371242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.371976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.372419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.373129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.373593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.374026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.507300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:09.507984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:09.514101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.514583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.515230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.515960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:09.516416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:09.517025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:09.521316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:09.630292 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e307864b-690c-41bc-bd22-5c9a04155119 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273304 Oct 11 01:51:09.635407 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2686/5416] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:51:09 2022] POST /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:09.668501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:09.678632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b71b9726-700a-45aa-b9cc-f12a9061c1d4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.175923 Oct 11 01:51:09.680105 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2731/5417] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:09 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:10.246521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:10.247385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:10.254190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:10.254688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:10.255141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:10.255882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:10.256583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:10.256795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:10.394820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:10.403037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68929ed2-264d-47c6-b51f-806315ad9c78 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.160958 Oct 11 01:51:10.403664 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2687/5418] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:10 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:10.702631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:10.703770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:10.711273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:10.711812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:10.712260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:10.712969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:10.713533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:10.713954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:10.865535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:10.874267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f6a389e-1416-4ce3-ae8e-8781b3e59a47 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.175648 Oct 11 01:51:10.874963 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2732/5419] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:10 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:10.894981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-plugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:10.908949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:10.909808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:10.910502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:10.924369 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] Creating event network-vif-plugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:51:10.930403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1a9290ad-85f0-42fb-b46f-ee80a6088ed9 req-322d11d0-7391-4283-b1c5-838ff51a7f52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040566 Oct 11 01:51:10.931654 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2688/5420] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:11.428243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:11.429158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:11.437150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:11.438290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:11.438751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:11.439522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:11.440015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:11.441256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:11.581378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:11.589134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f9872ea-3017-4981-9492-b414a27d1e82 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1362 microversion: 2.1 time: 0.166703 Oct 11 01:51:11.589716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2733/5421] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:11 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:11.898275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:11.898978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:11.906040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:11.907045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:11.907524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:11.908240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:11.908697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:11.909125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:12.011445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:12.055299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:12.063020 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a499ac2-23fe-40ad-83cd-f7cec7476722 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.169059 Oct 11 01:51:12.063634 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2689/5422] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:11 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:12.612884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:12.613442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:12.620786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:12.621471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:12.623716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:12.627561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:12.629168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:12.629922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:12.630398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:12.630841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:12.776312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:12.785683 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9f1bbc2-7223-49ec-aa67-050136405684 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1550 microversion: 2.1 time: 0.177016 Oct 11 01:51:12.786397 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2734/5423] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1550 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:12.808815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:12.809829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:12.817022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:12.817637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:12.818275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:12.819142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:12.819701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:12.820231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:12.923925 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-077ac19f-56a2-4ac1-83ce-e3608a14ed37 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119122 Oct 11 01:51:12.929305 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2690/5424] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 01:51:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:13.087355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:13.088376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:13.095896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:13.096707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:13.097387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:13.098471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:13.099166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:13.099939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:13.244506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:13.263716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a00582c-fab4-407b-830b-3f1e922ba831 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.180255 Oct 11 01:51:13.283087 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2735/5425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:13 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:14.292645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:14.293843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:14.300832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:14.301543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:14.302448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:14.303426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:14.304064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:14.304950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:14.464058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:14.472447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:14.476341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:14.478701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:14.479331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:14.483249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-963f8c62-2267-4da1-968e-6ceae754fa8a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.195559 Oct 11 01:51:14.483907 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2691/5426] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:14 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:14.504229 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] Creating event network-changed:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:51:14.509842 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-909f261e-a689-4186-8045-d94b3f0b1b67 req-4b43ea06-d534-4ea3-9aca-56dc3806808f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049716 Oct 11 01:51:14.511152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2736/5427] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:51:15.506683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:15.507408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:15.514655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:15.515139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:15.515602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:15.517998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:15.517998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:15.518490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:15.998580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:16.006784 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2aa8eb0d-6e11-48b3-b5ff-3a92326474a8 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.504042 Oct 11 01:51:16.007395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2692/5428] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:15 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:17.033287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:17.033998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:17.036028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:17.041418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:17.041906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:17.042343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:17.043041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:17.043534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:17.043968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:17.188881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:17.196762 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e614b06-a705-46e2-bf1c-18d075a3c536 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.168690 Oct 11 01:51:17.197341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2737/5429] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:17 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:18.221947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:18.222621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:18.226473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:18.229859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:18.230339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:18.230775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:18.231522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:18.231976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:18.232592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:18.456936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:18.465284 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f93aabb-9ac3-43d5-9098-a425bd6e4c93 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.247687 Oct 11 01:51:18.465897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2693/5430] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:18 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:19.490189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:19.490805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:19.498301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:19.498795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:19.499242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:19.499983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:19.500438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:19.502201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:19.716205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:19.724608 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2ef5a92-060b-4836-9412-e6bbbb72754c tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.238692 Oct 11 01:51:19.725189 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2738/5431] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:19 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:20.749542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:20.750162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:20.757249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:20.757782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:20.758226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:20.759001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:20.759555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:20.759989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:20.899527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:20.907861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ea7fe122-641b-47b3-ab2a-2f1549e2c5df tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.162414 Oct 11 01:51:20.908451 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2694/5432] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:20 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:21.695536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:21.697743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:21.704351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.704833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.705888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:21.706581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.707035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.707489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:21.739529 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c16fc0e6-dc07-426c-97d2-ad188ca4f127 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047901 Oct 11 01:51:21.740094 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2739/5433] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:21 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:21.750871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:21.751518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:21.759031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.759568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.760019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:21.760728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.761807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.762251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:21.792830 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e774576-3872-42c1-8f1d-1f3b12e28b87 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139" status: 200 len: 194 microversion: 2.1 time: 0.045987 Oct 11 01:51:21.793582 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2695/5434] 10.222.0.66 () {58 vars in 1413 bytes} [Tue Oct 11 01:51:21 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:21.931981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:21.932592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:21.938909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.939433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.940082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:21.941035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:21.941495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:21.941924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:22.141455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:22.150463 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d8ed298-1c79-4b8c-91b6-ff692a771e8f tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.222579 Oct 11 01:51:22.151518 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2740/5435] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:21 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:22.384582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:22.385115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:22.394185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:22.394610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:22.395050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:22.395782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:22.396242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:22.396673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:22.420155 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04095e8e-dd7d-4ae1-9cb8-6599c2333d32 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.043005 Oct 11 01:51:22.421169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2696/5436] 10.222.0.66 () {58 vars in 1248 bytes} [Tue Oct 11 01:51:22 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:23.192310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:23.192310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:23.204383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.204891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.205914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:23.206620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.207084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.207553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:23.360303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:23.369372 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-facf148c-7628-4aa9-97f4-2c33c530ee8d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.194988 Oct 11 01:51:23.369951 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2741/5437] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:23 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:23.491958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:23.492497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:23.499711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.500213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.500654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:23.501370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.503607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.504071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:23.597051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lazy-loading 'services' on Instance uuid fb08a06f-661e-4062-8291-675d49dfce1d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:23.677259 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62bc7316-7b42-4ee7-a093-c18dca7cc852 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d/os-volume_attachments/cf98fd20-5157-4959-87d0-b6a9d7a0f45c" status: 202 len: 0 microversion: 2.1 time: 0.189502 Oct 11 01:51:23.678026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2697/5438] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:51:23 2022] DELETE /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d/os-volume_attachments/cf98fd20-5157-4959-87d0-b6a9d7a0f45c => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:51:23.850975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "538760d4-5fce-4fcc-83a3-92d3e56e9d19"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:23.853448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:23.859451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.859942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.860388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:23.861078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:23.862119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:23.862550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:24.097735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a71e56c-a121-4950-b35b-c66693cb9fea tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "POST /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250685 Oct 11 01:51:24.098398 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2742/5439] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:51:23 2022] POST /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:24.256507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c3bb105-b5ca-4fee-aafa-00b30d7ca74e"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:24.259054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:24.265357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:24.265854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:24.266296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:24.267005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:24.268018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:24.268454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:24.286544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:24.396513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:24.397453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:24.404069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:24.404559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:24.405054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:24.405761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:24.406276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:24.406704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:24.548353 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01cfaaf0-7dd3-4c00-912d-0acb85625f7f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "POST /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296292 Oct 11 01:51:24.549150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2698/5440] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 01:51:24 2022] POST /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:24.562748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:24.573167 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a32cd549-1896-46f7-a9df-1e8d922e02b3 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1693 microversion: 2.1 time: 0.182379 Oct 11 01:51:24.574109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2743/5441] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:24 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:25.600525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:25.602533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:25.609241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:25.609744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:25.610193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:25.610912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:25.611912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:25.612354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:25.757255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:25.765217 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b02c84e-0cfc-44ba-b460-6a6ad39b2f66 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1699 microversion: 2.1 time: 0.170643 Oct 11 01:51:25.765802 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2699/5442] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:25 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:26.789204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:26.789809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:26.796712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:26.797212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:26.797790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:26.798503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:26.798966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:26.799590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:26.931986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:26.940423 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-56791e75-b308-4e28-9fcb-3ec69f968ab4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1699 microversion: 2.1 time: 0.155271 Oct 11 01:51:26.941008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2744/5443] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:26 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:27.965620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:27.966232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:27.973617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:27.974117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:27.974563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:27.975280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:27.975799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:27.976226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:28.116031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:28.124324 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-491de28a-5c12-4fa6-b3c8-7cefd0d75498 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1699 microversion: 2.1 time: 0.162653 Oct 11 01:51:28.125017 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2700/5444] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:27 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:29.150204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:29.150746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:29.157660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:29.158161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:29.158725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:29.159548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:29.160004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:29.160442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:29.295498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:29.304000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c48540d2-cf1d-4e20-960a-bf13cd13babb tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1699 microversion: 2.1 time: 0.158072 Oct 11 01:51:29.304582 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2745/5445] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:29 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:29.630856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:29.649244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:29.650505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:29.651275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:29.666184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] Creating event network-vif-unplugged:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:51:29.672179 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-30360aab-cff1-402d-8eb7-f7e7726ea551 req-47858c24-f915-4a37-b53c-5d2a0681e0b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045551 Oct 11 01:51:29.672825 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2701/5446] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:30.328740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:30.329288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:30.337031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:30.337516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:30.337955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:30.338646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:30.339100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:30.339557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:30.483582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:30.498548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aca856cc-22de-4368-868c-bf1886b94166 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1684 microversion: 2.1 time: 0.173916 Oct 11 01:51:30.499364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2746/5447] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:30 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:31.704184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "name": "network-vif-plugged", "status": "completed", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:31.713934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:31.714412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:31.714841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:31.725576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] Creating event network-vif-plugged:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:51:31.730469 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f08cb805-6f1c-42d2-a444-233ad40d007d req-005d9070-4b86-43d3-be83-36872cf8d674 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 Oct 11 01:51:31.731046 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2702/5448] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:37.297153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:37.297651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:37.305368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.305865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.306308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.307016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.307511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.307946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.312092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:37.335750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:51:37.427380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07c0fde7-0101-4e6a-81d1-cd0d262c4af7 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 204 len: 0 microversion: 2.1 time: 0.133810 Oct 11 01:51:37.427956 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2747/5449] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:37 2022] DELETE /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:51:37.436652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:37.437398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:37.444805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.445299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.445746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.446455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.446917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.447584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.531002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:37.531789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:37.538085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.538581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.539025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.539756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.540218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.540653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.585154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:37.592879 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-843a94c9-cf42-4e31-b49a-3e90b926ecae tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1513 microversion: 2.1 time: 0.160496 Oct 11 01:51:37.593479 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2703/5450] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:37 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:37.623087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lazy-loading 'services' on Instance uuid e433669f-a27c-491b-9e9e-da56211868c6 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:37.691789 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b677f386-5984-49be-9567-695864cd5f5e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments/538760d4-5fce-4fcc-83a3-92d3e56e9d19" status: 202 len: 0 microversion: 2.1 time: 0.164957 Oct 11 01:51:37.692396 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2748/5451] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:51:37 2022] DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments/538760d4-5fce-4fcc-83a3-92d3e56e9d19 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:51:37.700721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:37.702927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:37.709773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.710404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.711055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.711919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:37.712388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:37.712959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:37.746080 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee0de9dc-ef79-406e-ae5a-7f66ae164fd3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049228 Oct 11 01:51:37.746587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2704/5452] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:37 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:38.620089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:38.620822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:38.627647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:38.628422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:38.629098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:38.630484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:38.630484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:38.630859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:38.759371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:38.762399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:38.771072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:38.771718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:38.772257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:38.773019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:38.773177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:38.773691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:38.774211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:38.782015 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-458dcea2-e227-4537-8aca-c136f6d8a30e tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1513 microversion: 2.1 time: 0.169017 Oct 11 01:51:38.782609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2749/5453] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:38 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:38.806558 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01c342cd-c1fc-425a-bed1-603569f71063 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051766 Oct 11 01:51:38.807221 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2705/5454] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:38 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:51:39.531258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb08a06f-661e-4062-8291-675d49dfce1d", "name": "network-vif-deleted", "tag": "9039b138-1238-436e-881c-20b262514016"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:39.544875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.545480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.551061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.560228 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] Creating event network-vif-deleted:9039b138-1238-436e-881c-20b262514016 for instance fb08a06f-661e-4062-8291-675d49dfce1d on n-h2-772273-9 Oct 11 01:51:39.568512 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-31f84fec-0f4c-4362-91ab-0b2aabb760c2 req-4ff15acd-7696-484f-80b3-e9aed3512de9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042201 Oct 11 01:51:39.573939 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2750/5455] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:39.628798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:39.631278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:39.645776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.646279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.646728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.647508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.648305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.648908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.683644 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3539e528-1a6e-4a3a-a147-cbbf9fd272fe tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058812 Oct 11 01:51:39.684848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2706/5456] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:39 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:39.808372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:39.809077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:39.818307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:39.820533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.821198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.821747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.822479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.822933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.823315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:39.823469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.831074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.832056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.832628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.833443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.834137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.834643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.859351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.859844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.860308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.860748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lazy-loading 'fault' on Instance uuid fb08a06f-661e-4062-8291-675d49dfce1d {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:39.866673 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6d7336d-6cf8-4236-a471-830b39e8d85d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052462 Oct 11 01:51:39.867425 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2707/5457] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:39 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:51:39.872449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:39.873013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:39.878997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.879611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.880127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.880909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.881561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.882157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.905206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489f0e5ba2ac4a998df2128eb0866de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdd2ee9af774b4a85240a3832d39545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:39.913743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89fe68ca-1fe1-42dc-b5e9-0597cf52174a tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139" status: 200 len: 194 microversion: 2.1 time: 0.045034 Oct 11 01:51:39.914229 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e2d1916-1109-4b1e-bb29-69f2a4487a26 tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 200 len: 1308 microversion: 2.1 time: 0.112000 Oct 11 01:51:39.914368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2708/5458] 10.222.0.66 () {58 vars in 1413 bytes} [Tue Oct 11 01:51:39 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:39.915047 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2751/5459] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:39 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:39.924541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:39.925045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:39.931059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.931610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.932065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:39.932778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:39.933239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:39.933744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:40.022332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lazy-loading 'services' on Instance uuid d9d30a17-7de6-4b46-88a0-30dedcfc974d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:40.105382 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ee59747-7cf2-408b-9ba8-40acac17fc93 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139" status: 202 len: 0 microversion: 2.1 time: 0.184391 Oct 11 01:51:40.107440 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2709/5460] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:51:39 2022] DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/03a7fcaa-1653-409f-8562-4f85c141a139 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:51:40.879070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:40.881379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:40.888336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:40.888901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:40.889428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:40.890200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:40.890728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:40.891225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:40.922257 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b75c8ff0-6493-4884-9c10-7fbeafe78553 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Oct 11 01:51:40.922850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2752/5461] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:40 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:40.938883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:40.939710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] [instance: fb08a06f-661e-4062-8291-675d49dfce1d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:40.946111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:40.946684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:40.947204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:40.948000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:40.948539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:40.949048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:40.962496 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] HTTP exception thrown: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Request method failure captured: Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d HTTP/1.1 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMtkBDiepnHO294z5135yONg563QM12Bmn-W3khtdkDMeKDcnx3XVggZUZfBfF6NQQWSWakgvaEpu1cnasii2uLAt1Sno6qI84PGDljCkSO5bwoMMFlFGnMRWKAXbpcaZsfI0gOyOMxrboal88-Hw8twmW6HykeK5DQ8OwWkaFrkIGo Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4cdd2ee9af774b4a85240a3832d39545 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cdd2ee9af774b4a85240a3832d39545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4cdd2ee9af774b4a85240a3832d39545 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-693841583 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotTestJSON-693841583-project Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 489f0e5ba2ac4a998df2128eb0866de9 Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotTestJSON-693841583-project Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'fb08a06f-661e-4062-8291-675d49dfce1d'} Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:40.964331 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] Returning 404 to user: Instance fb08a06f-661e-4062-8291-675d49dfce1d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8c78566-a3bf-473b-b6d2-9f57b85f5feb tempest-VolumesSnapshotTestJSON-693841583 tempest-VolumesSnapshotTestJSON-693841583-project] 10.222.0.66 "GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d" status: 404 len: 111 microversion: 2.1 time: 0.032046 Oct 11 01:51:40.969347 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2710/5462] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:40 2022] GET /compute/v2.1/servers/fb08a06f-661e-4062-8291-675d49dfce1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:41.935482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:41.937725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:41.944666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:41.945164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:41.945605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:41.946312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:41.946769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:41.947202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:41.977697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d10e9a77-e1af-41bc-9407-c11668b2fb74 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Oct 11 01:51:41.978278 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2753/5463] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:41 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:42.999014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:43.002286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:43.020157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.023805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.024352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.025326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.025869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.026378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.075469 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b748e76b-1d7e-4332-9b78-21afcf6662dd tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080797 Oct 11 01:51:43.076390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2711/5464] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:42 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:51:43.158632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:43.159549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:43.166798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.166925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.167427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.168379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.168906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.169410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.196315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:51:43.281514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a08e53f2-9197-4583-adcf-b6421a30930c tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 204 len: 0 microversion: 2.1 time: 0.127274 Oct 11 01:51:43.283547 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2754/5465] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:43 2022] DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:51:43.292322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:43.293128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:43.301765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.302416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.302968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.303808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:43.304555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:43.305139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:43.452442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:43.461236 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a2ccc8b-a6a1-46bb-b9d6-991098db0aae tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1682 microversion: 2.1 time: 0.173248 Oct 11 01:51:43.462262 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2712/5466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:43 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:51:44.487303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:44.488397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:44.495875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:44.496373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:44.496817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:44.497524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:44.498559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:44.499113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:44.638567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:44.651762 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03b37874-d9f9-4d38-9a7b-63606681ff7e tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1682 microversion: 2.1 time: 0.169321 Oct 11 01:51:44.652643 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2755/5467] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:44 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:45.676274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:45.682369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:45.700354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:45.705569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:45.706345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:45.707439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:45.709375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:45.710060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:45.824949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4d766a40634e1eb885221d16118af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ff48ca7e2c43098f864610fdc55361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:45.835176 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c078a96-a1e0-49b3-a23c-4654009ecb2d tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 200 len: 1614 microversion: 2.1 time: 0.162729 Oct 11 01:51:45.836238 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2713/5468] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:45 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 1614 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:45.950498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433669f-a27c-491b-9e9e-da56211868c6", "name": "network-vif-deleted", "tag": "8de2bdb0-94b8-4b31-ab24-1babf8ad4dff"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:45.963362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:45.963872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:45.964311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:45.979625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] Creating event network-vif-deleted:8de2bdb0-94b8-4b31-ab24-1babf8ad4dff for instance e433669f-a27c-491b-9e9e-da56211868c6 on n-h1-772273-9 Oct 11 01:51:45.986837 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b02c2dd4-b1d6-45f1-9f4c-fae851442080 req-a536b42f-10fb-4d4e-ae87-4dc5bf1e3426 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039906 Oct 11 01:51:45.988314 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2756/5469] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:46.863269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:46.864835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:46.873223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:46.874293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:46.875033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:46.876080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:46.877491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:46.878314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:46.898878 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 HTTP/1.1 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e433669f-a27c-491b-9e9e-da56211868c6'} Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:46.900809 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d474ed3a-91a6-4460-acca-f35d8ed54fab tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 404 len: 111 microversion: 2.1 time: 0.046545 Oct 11 01:51:46.906310 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2714/5470] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:46 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:46.916176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c4c754a2-4441-4c67-a122-34f50b9a10ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '.version_select at 0x7f112f69fdc0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:46.945435 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c4c754a2-4441-4c67-a122-34f50b9a10ac tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447030912" status: 202 len: 0 microversion: 2.1 time: 0.033781 Oct 11 01:51:46.946331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2757/5471] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:51:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447030912 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:51:47.327029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:47.327913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:47.339618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:47.340441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:47.341358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:47.342091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:47.342561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:47.343002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:47.375700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:47.381438 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-992c207d-4a66-482c-8cda-fb8c7c49a6df tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/2c3bb105-b5ca-4fee-aafa-00b30d7ca74e" status: 200 len: 194 microversion: 2.1 time: 0.058390 Oct 11 01:51:47.382378 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2715/5472] 10.222.0.66 () {58 vars in 1413 bytes} [Tue Oct 11 01:51:47 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/2c3bb105-b5ca-4fee-aafa-00b30d7ca74e => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:47.393046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:47.394294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:47.397502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:47.403727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:47.404446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:47.404886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:47.405597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:47.406061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:47.406635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:47.497306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lazy-loading 'services' on Instance uuid d9d30a17-7de6-4b46-88a0-30dedcfc974d {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:47.582483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37cf8b1e-38df-43fc-8912-f7662f695467 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/2c3bb105-b5ca-4fee-aafa-00b30d7ca74e" status: 202 len: 0 microversion: 2.1 time: 0.193355 Oct 11 01:51:47.583419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2758/5473] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 01:51:47 2022] DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments/2c3bb105-b5ca-4fee-aafa-00b30d7ca74e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:51:50.432731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:50.433359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:50.438192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=46 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:50.443262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:50.443827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:50.446059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:50.446059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:50.446059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:50.446059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:50.727831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:50.741022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-596368a3-3d4d-4050-9b8a-061fb9540fa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.312590 Oct 11 01:51:50.743482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2716/5474] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:50 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:50.804714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:50.806189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:50.820764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:50.826467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:50.830176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:50.831692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:50.832180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:50.836397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.061097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:51.061880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:51.074969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.075483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.075952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.076660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.077120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.077552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.116414 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 HTTP/1.1 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e433669f-a27c-491b-9e9e-da56211868c6'} Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:51.118259 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.123700 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.125050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:51.128473 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d471cea2-2df8-4522-b1b1-390a6fbe9cc0 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 404 len: 111 microversion: 2.1 time: 0.070538 Oct 11 01:51:51.132181 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2717/5475] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:51 2022] DELETE /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:51:51.134142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:51.143725 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b85e6080-be01-4f71-90d9-11146ab665a7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.344657 Oct 11 01:51:51.144313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2759/5476] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:50 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:51.147032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:51.151270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: e433669f-a27c-491b-9e9e-da56211868c6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:51.165799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.166820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:51.167645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:51.176984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.177709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.178685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.180939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.182693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.183157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.185667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.186304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.186892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.195901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.196978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.226752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 HTTP/1.1 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e433669f-a27c-491b-9e9e-da56211868c6'} Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:51.228801 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance e433669f-a27c-491b-9e9e-da56211868c6 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f92a5bd-ed1a-4b3c-847a-43a9710829e3 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6" status: 404 len: 111 microversion: 2.1 time: 0.094967 Oct 11 01:51:51.234435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2718/5477] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:51 2022] GET /compute/v2.1/servers/e433669f-a27c-491b-9e9e-da56211868c6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:51.431466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:51.441211 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-01eb5824-db91-4c5b-b7c9-e6992c6f29ef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.278500 Oct 11 01:51:51.455877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2760/5478] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:51 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:51.464639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-183182"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:51.467754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:51.476328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.476850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.477307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.478051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:51.478520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:51.478957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:51.847896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84aeeb8f-26ff-4862-b032-c0120368f9eb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.382054 Oct 11 01:51:51.859329 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2719/5479] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:51:51 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 01:51:54.289626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:54.292486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:54.301103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.301976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.302746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.303777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.304441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.304862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.309235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:51:54.339187 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c154927-99de-44bb-9479-960da1cfc512 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053245 Oct 11 01:51:54.345221 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2761/5480] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:54 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:51:54.497620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:54.500533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:54.509040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.509805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.510493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.511664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.512363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.513035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.544721 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3616bbd-c210-4a06-86b2-aedc170ccf72 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051350 Oct 11 01:51:54.545664 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2720/5481] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 01:51:54 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:51:54.639587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:54.640132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:54.646064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.646531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.646971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.647720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.649539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.649539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.675098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:51:54.788654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e0fdd566-15fa-4071-a80d-4314deb94843 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 204 len: 0 microversion: 2.1 time: 0.151814 Oct 11 01:51:54.789532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2762/5482] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:54 2022] DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:51:54.798088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:54.799521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:54.805790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.806408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.806929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.807744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:54.808393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:54.809003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:54.965568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:54.981912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f919869f-6293-46bc-b63c-0e02d96335fa tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1671 microversion: 2.1 time: 0.187959 Oct 11 01:51:54.982938 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2721/5483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:54 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:56.008180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:56.008910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:56.016753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.017541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.018253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.019154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.019814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.020696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.162829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:56.171214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bcfed275-76d4-4724-b832-d58ca4202e60 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1671 microversion: 2.1 time: 0.168293 Oct 11 01:51:56.172018 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2763/5484] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:56 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:56.785421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:56.786936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:56.795188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.797297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.797974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.799013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.799772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.800486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.820275 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff HTTP/1.1 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff'} Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:56.822438 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.829019 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.833405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:56.835849 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63075eb7-ce5b-44e3-bcaf-ae56ce738577 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 404 len: 111 microversion: 2.1 time: 0.054264 Oct 11 01:51:56.838035 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2722/5485] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:56 2022] DELETE /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:56.846054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:56.846686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:56.857576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.858089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.858539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.859268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.864828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.865226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.894404 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff HTTP/1.1 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff'} Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.900692 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a7ffdb56-1ea8-4af4-a89d-96bd90068268 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff" status: 404 len: 111 microversion: 2.1 time: 0.060416 Oct 11 01:51:56.908920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2764/5486] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:56 2022] GET /compute/v2.1/servers/b44bdab7-3d7a-4c4f-b97c-ff50fb96fdff => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:51:56.914564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:56.915260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:56.922599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.923463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.924146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.925208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:56.925686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:56.926134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:56.968852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 HTTP/1.1 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b032e747-3e10-4877-a5bb-21db7c9b9448'} Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:56.978405 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:56.983043 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c3c9956-fdee-4023-b90e-6d99c4b219cc tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 404 len: 111 microversion: 2.1 time: 0.071108 Oct 11 01:51:56.986174 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2723/5487] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:51:56 2022] DELETE /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:56.992687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:56.993316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: b032e747-3e10-4877-a5bb-21db7c9b9448] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:57.004346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:57.004839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:57.005279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:57.005989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:57.006451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:57.006871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:57.063247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 HTTP/1.1 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b032e747-3e10-4877-a5bb-21db7c9b9448'} Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:57.071176 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. Oct 11 01:51:57.076701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:57.078452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance b032e747-3e10-4877-a5bb-21db7c9b9448 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:57.081132 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b531c927-4f93-4ab4-b3ba-afd18a63d608 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448" status: 404 len: 111 microversion: 2.1 time: 0.091172 Oct 11 01:51:57.085159 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2765/5488] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:56 2022] GET /compute/v2.1/servers/b032e747-3e10-4877-a5bb-21db7c9b9448 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:51:57.196391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:57.197523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:57.212953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:57.217339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:57.218016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:57.218935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:57.222322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:57.223009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:57.401740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-plugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:57.424731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:57.437063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:57.437656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:57.465681 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] Creating event network-vif-plugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:51:57.477135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9ddc3a1b-a13a-4fe6-906c-22afbd5b9a9b req-731f626d-6c70-4b2f-a6cf-91cdb36b4441 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078682 Oct 11 01:51:57.480770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2766/5489] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:57.688525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:57.702901 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c97ff983-e44b-4bdd-8f23-b664b2f489f6 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1671 microversion: 2.1 time: 0.508141 Oct 11 01:51:57.705723 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2724/5490] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:57 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1671 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:58.317787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d30a17-7de6-4b46-88a0-30dedcfc974d", "name": "network-vif-deleted", "tag": "36919514-f66f-415f-8ff5-58f1c84339da"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:51:58.359772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:58.374983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:58.378183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:58.426987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] Creating event network-vif-deleted:36919514-f66f-415f-8ff5-58f1c84339da for instance d9d30a17-7de6-4b46-88a0-30dedcfc974d on n-h1-772273-9 Oct 11 01:51:58.458363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fea23db6-d948-42d6-81ab-2a40f763c358 req-6257b171-4624-4139-9ec8-f52bc56e78c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145908 Oct 11 01:51:58.466839 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2767/5491] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:51:58.730055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:58.730685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:58.757754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:58.758289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:58.758721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:58.759494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:58.759961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:58.760421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:58.806787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:58.807584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:58.808197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:58.808842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lazy-loading 'fault' on Instance uuid d9d30a17-7de6-4b46-88a0-30dedcfc974d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:51:58.861265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15178e558aa48bcadc6ac21c55d1119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b8e49319c4771b76e7c3fe5819c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:51:58.871639 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f86b7ea-002d-45d5-87fb-f8424b833dad tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 200 len: 1326 microversion: 2.1 time: 0.144818 Oct 11 01:51:58.887759 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2725/5492] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:58 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:51:59.896933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:59.897639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:51:59.913884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:59.914768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:59.915438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:59.916346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:51:59.916979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:51:59.917642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:51:59.959750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d HTTP/1.1 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd9d30a17-7de6-4b46-88a0-30dedcfc974d'} Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:51:59.961736 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:51:59.967394 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:51:59.969184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:51:59.971511 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-490902d2-0df4-4e88-bb02-46bdfa21c906 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 404 len: 111 microversion: 2.1 time: 0.081194 Oct 11 01:51:59.993022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28413c73-b47d-421b-aed9-c07e3c9562e7 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '.version_select at 0x7f1134241940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:51:59.999077 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2768/5493] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:51:59 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:00.026514 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28413c73-b47d-421b-aed9-c07e3c9562e7 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-53020995" status: 202 len: 0 microversion: 2.1 time: 0.042238 Oct 11 01:52:00.031692 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2726/5494] 10.222.0.66 () {58 vars in 1215 bytes} [Tue Oct 11 01:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-53020995 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:52:01.748097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:01.749618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:01.761616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:01.764504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:01.765017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:01.768081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:01.769028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:01.769657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:01.789845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c HTTP/1.1 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '5886fe0d-cbdb-4ff6-a253-b7564c291e8c'} Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:01.792988 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.798984 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.802606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:01.804860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-696ac294-f10f-4c18-b453-8f4a18351fec tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 404 len: 111 microversion: 2.1 time: 0.060872 Oct 11 01:52:01.805693 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2769/5495] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:52:01 2022] DELETE /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:01.816321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:01.817147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] [instance: 5886fe0d-cbdb-4ff6-a253-b7564c291e8c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:01.834071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:01.836176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:01.837109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:01.839171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:01.840969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:01.842671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:01.883913 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] HTTP exception thrown: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Request method failure captured: Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c HTTP/1.1 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMqsWIaxhlKC4CPlrn4Ipy3kTwP6UbMbfiCcgnLmUCYgw6ZrSe_OvRLIdrcNoAw6hPJSAwEaMY31mokRaVoSx-NQQJ90kk3mTjRa0v3vRey90yWHxo6XKV06l2zhbfn5KvDJ0NNRvToqmAUzn09ZcIwiBqvJOU3GPKTQsM7bmJJhVOE Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e7ff48ca7e2c43098f864610fdc55361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: e7ff48ca7e2c43098f864610fdc55361 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-803107121 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: cd4d766a40634e1eb885221d16118af9 Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-803107121-project Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '5886fe0d-cbdb-4ff6-a253-b7564c291e8c'} Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:01.888293 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. Oct 11 01:52:01.893647 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:01.898535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] Returning 404 to user: Instance 5886fe0d-cbdb-4ff6-a253-b7564c291e8c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:01.900106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc001fa7-7409-4d86-b744-d6aeb164f0f2 tempest-AttachVolumeNegativeTest-803107121 tempest-AttachVolumeNegativeTest-803107121-project] 10.222.0.66 "GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c" status: 404 len: 111 microversion: 2.1 time: 0.089917 Oct 11 01:52:01.934042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2727/5496] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:01 2022] GET /compute/v2.1/servers/5886fe0d-cbdb-4ff6-a253-b7564c291e8c => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:06.757632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:06.759913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:06.782635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:06.783160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:06.787279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:06.788337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:06.789062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:06.789683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:06.859198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2862cfa6-1ac5-4f2e-8d27-6b8a05da32e4 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action" status: 200 len: 24574 microversion: 2.1 time: 0.105307 Oct 11 01:52:06.860320 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2770/5497] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:52:06 2022] POST /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead/action => generated 24574 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:52:11.565522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:11.566908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:11.574946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:11.575799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:11.576480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:11.577445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:11.578149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:11.578812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:11.593116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d HTTP/1.1 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd9d30a17-7de6-4b46-88a0-30dedcfc974d'} Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:11.595684 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.600955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:11.603100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ebd48ad-e6db-4080-927c-eb2b3dc967c0 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 404 len: 111 microversion: 2.1 time: 0.040489 Oct 11 01:52:11.603100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2728/5498] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:52:11 2022] DELETE /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:11.613437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:11.614944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: d9d30a17-7de6-4b46-88a0-30dedcfc974d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:11.624202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:11.624871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:11.625248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:11.625953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:11.627155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:11.627815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:11.646808 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d HTTP/1.1 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd9d30a17-7de6-4b46-88a0-30dedcfc974d'} Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:11.649194 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:11.654260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance d9d30a17-7de6-4b46-88a0-30dedcfc974d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:11.657200 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e38e1e68-54b8-4897-a50e-4972c386bbe2 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d" status: 404 len: 111 microversion: 2.1 time: 0.047577 Oct 11 01:52:11.663167 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2771/5499] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:11 2022] GET /compute/v2.1/servers/d9d30a17-7de6-4b46-88a0-30dedcfc974d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:16.300710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:16.301775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:16.309316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.309811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.310248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:16.310962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.311440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.312011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:16.343920 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 HTTP/1.1 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '193e8756-59a7-4efd-9b1a-0da421763394'} Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:16.350818 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.355673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.357376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:16.359707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7aa2eb16-fc9f-43e3-aeb6-0c7992704581 tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 404 len: 111 microversion: 2.1 time: 0.063449 Oct 11 01:52:16.361357 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2729/5500] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:52:16 2022] DELETE /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:16.370096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:16.370727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] [instance: 193e8756-59a7-4efd-9b1a-0da421763394] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:16.391681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.392459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.396648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:16.399827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.400837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.401471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:16.421490 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] HTTP exception thrown: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Request method failure captured: Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 HTTP/1.1 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMsXef60dDdYFOuAbSl9NNKQHjZKwY5XXBlmXoFCOVIu37a8_VPVHR7i_QENX1wJVFUyu-u_W36PrfbgL-lKtCLSPkkvrU3GytGzdqOrNLESAcbrDpv47Q0X3CUMKCbZVlR3TauSZKtydixP79th1NeIenc4U6LbP9OKmxd3xjmq5EM Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c40b8e49319c4771b76e7c3fe5819c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c40b8e49319c4771b76e7c3fe5819c8a Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2047985958 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f15178e558aa48bcadc6ac21c55d1119 Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-AttachVolumeTestJSON-2047985958-project Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '193e8756-59a7-4efd-9b1a-0da421763394'} Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:16.424791 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] Returning 404 to user: Instance 193e8756-59a7-4efd-9b1a-0da421763394 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8279dc6-757e-44f0-bfa6-2b51e42c380f tempest-AttachVolumeTestJSON-2047985958 tempest-AttachVolumeTestJSON-2047985958-project] 10.222.0.66 "GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394" status: 404 len: 111 microversion: 2.1 time: 0.061998 Oct 11 01:52:16.443744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2772/5501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:16 2022] GET /compute/v2.1/servers/193e8756-59a7-4efd-9b1a-0da421763394 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:52:16.938185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:16.942019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:16.962824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.963768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.964437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:16.965385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:16.966063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:16.966724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:17.285656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:17.295622 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f71284e4-93fb-4768-af0e-711bf9baf215 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.359498 Oct 11 01:52:17.297776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2730/5502] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:16 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:17.332347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1280579764"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:17.335318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:17.349682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:17.350413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:17.350954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:17.352114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:17.358034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:17.358785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:17.961106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8b59de76-af33-4e72-913d-5eb8342dbce0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.639065 Oct 11 01:52:17.964975 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2773/5503] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:52:17 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 01:52:21.907945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-unplugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:21.923279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:52:21.940552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:21.941059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:21.946121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:21.992609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:52:22.002956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] Creating event network-vif-unplugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:52:22.011358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-50f360a3-58f2-4c62-89f0-57d0759b2011 req-59fa0e97-2a4a-4947-93d5-6e49de168036 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107825 Oct 11 01:52:22.015557 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2731/5504] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:25.425911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-plugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:25.448387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:52:25.448387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:25.456896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:25.457483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:25.469276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:52:25.498348 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] Creating event network-vif-plugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:52:25.510275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e2a13ebf-4c31-426c-9777-f3c01d386366 req-469d6a0a-18f8-4efd-ab97-af2e6ad7c6c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087943 Oct 11 01:52:25.514539 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2774/5505] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:41.012694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:41.014084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:41.027033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.027978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.028684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.032066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.032527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.033235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.434304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:41.453320 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83f9cfa6-bf21-4ec4-b73b-e4e9072a45b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.443060 Oct 11 01:52:41.455379 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2732/5506] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:41 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:41.480672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1364587672"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:41.484956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:41.494966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.495856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.496554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.497509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.498172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.498900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.745137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55abc5e3-984c-4251-99f4-9102ef4d9bdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.267707 Oct 11 01:52:41.749303 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2775/5507] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:52:41 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 01:52:41.755955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:41.756595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:41.764135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.764771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.765303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.766858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:41.767452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:41.767932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:41.940613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:41.950171 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38d248c3-daa5-4fdb-a8d7-f3c4dfd5ceaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.199180 Oct 11 01:52:41.968596 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2733/5508] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:41 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:42.974557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:42.975170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:42.990092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:42.991234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:42.993741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:42.996241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:42.999448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:43.000074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:43.193691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:43.202933 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a91ab49-77bb-471b-b99e-1f90a429deea tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.233304 Oct 11 01:52:43.217294 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2776/5509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:42 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:44.230076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:44.234159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:44.239963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:44.240454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:44.240896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:44.242186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:44.242903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:44.243229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:44.452730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:44.463764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44ed2634-1f83-4cc9-af7f-b61e8c54ed46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1686 microversion: 2.1 time: 0.238387 Oct 11 01:52:44.465087 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2734/5510] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:44 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1686 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:45.489287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:45.490882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:45.519319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:45.519865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:45.532024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:45.534070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:45.535140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:45.535961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:45.630398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-unplugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:45.657492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:45.657992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:45.658440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:45.684460 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] Creating event network-vif-unplugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:52:45.700312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3a38cf83-9471-4e78-a406-7d60177161b1 req-915fc5bd-e653-4b42-aa21-e775f8032444 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072436 Oct 11 01:52:45.703029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2735/5511] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:45.931656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:45.948613 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed927c00-9f78-448e-bad7-41c08c90629f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.463658 Oct 11 01:52:45.949679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2777/5512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:45 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:46.973918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:46.974642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:46.992373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:46.993548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:46.995461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:46.996609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:46.997788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:46.998707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:47.296134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:47.313218 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38d049cd-bc81-491c-b8e4-8e3f9b07782c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.344536 Oct 11 01:52:47.313963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2736/5513] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:46 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:47.747596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-plugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:47.767961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:47.769741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:47.770886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:47.787880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] Creating event network-vif-plugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:52:47.795974 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e9902530-b1af-48e1-a03f-04619f50c01b req-011e7f7b-b2a3-44a0-9373-9196b6c89b8c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052624 Oct 11 01:52:47.803220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2778/5514] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:48.103049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:48.103909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:48.106451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:48.130907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.133550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.135354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.138908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.139166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.139884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.142842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.143579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.145942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.178043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] Creating event network-changed:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:52:48.189785 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c5b81610-1f64-48b1-8fe4-7a900b0107a6 req-d4b46b2c-8e8b-44f1-a423-ecd119c01c36 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094375 Oct 11 01:52:48.193468 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2779/5515] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:48.213374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:52:48.341696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:48.343057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:48.356151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.358003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.361017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.363657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.365673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.366396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.426490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1755ac47-3aa2-47eb-8ebb-ba1e0ad304ab tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 204 len: 0 microversion: 2.1 time: 0.333922 Oct 11 01:52:48.427118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2737/5516] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:52:48 2022] DELETE /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:52:48.444554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:48.445317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:48.466080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.466512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.466979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.467759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:48.468235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:48.468802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:48.715547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:48.733848 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70f7cec6-0ca4-4488-babc-ca24fe15b36a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.397251 Oct 11 01:52:48.735538 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2780/5517] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:48 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:48.892487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:48.905815 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c71ef340-ddb8-46fb-a988-0ea9149800c0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1690 microversion: 2.1 time: 0.471268 Oct 11 01:52:48.908521 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2738/5518] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:48 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1690 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:49.769062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:49.770702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:49.778613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:49.779430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:49.780151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:49.781123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:49.783039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:49.783538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:49.948703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:49.949499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:49.968711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:49.975201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:49.977319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:49.978345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:49.979093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:49.980050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:50.520583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:50.534288 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2649c84-5ab6-4a72-b7ab-84b2c7e4c991 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1690 microversion: 2.1 time: 0.600273 Oct 11 01:52:50.535853 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2739/5519] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:49 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1690 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:51.356571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:51.377213 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c958065-f7e9-4286-8ffc-01289cad0855 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 1.619011 Oct 11 01:52:51.378373 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2781/5520] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:49 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:51.563307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:51.564752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:51.573347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:51.574285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:51.574983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:51.576187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:51.576892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:51.577606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:52.141419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:52.151444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de0ce7a8-08c6-481d-b7c7-46ccbd6c767d tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1571 microversion: 2.1 time: 0.593047 Oct 11 01:52:52.152034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2740/5521] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:51 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1571 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:52.428256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:52.428904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:52.455791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:52.456369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:52.456817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:52.459171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:52.459680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:52.460190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:52.751746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead", "name": "network-vif-deleted", "tag": "dbf0b3ac-9031-4aa7-8dbf-3a5231eba719"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:52:52.769835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:52.770864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:52.772443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:52.796199 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] Creating event network-vif-deleted:dbf0b3ac-9031-4aa7-8dbf-3a5231eba719 for instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead on n-h2-772273-9 Oct 11 01:52:52.803554 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5fa8b048-1df7-4986-a22a-197fe468f42e req-395d05cc-8d4b-49bf-87f5-822916b41cd7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060965 Oct 11 01:52:52.807393 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2741/5522] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:52:52.932256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:52.946522 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c7b4349-3ae1-4681-8f42-be3a2568c1f0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.542331 Oct 11 01:52:52.967727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2782/5523] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:52 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:53.177875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:53.178696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:53.208118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:53.209580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:53.215252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:53.221265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:53.225194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:53.228591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:53.346510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:53.347893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:53.348698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:53.349511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lazy-loading 'fault' on Instance uuid 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:52:53.909318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6965eb3a6a74e62a184ea493c8fcb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0d0254a7ec463c891af24123953ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:53.919179 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9ee9bbb-43a4-476b-894a-d1e446a2332a tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 200 len: 1357 microversion: 2.1 time: 0.747341 Oct 11 01:52:53.939762 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2742/5524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:53 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 1357 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:53.976149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:53.977143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:54.001442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:54.005252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:54.006923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:54.015677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:54.016332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:54.019634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:54.642769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:54.650470 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2d110f7-416f-4274-a07d-1bebba8620fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.681145 Oct 11 01:52:54.653908 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2783/5525] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:53 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:54.946563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:54.947929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] [instance: 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:54.962406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:54.965928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:54.966748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:54.976222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:54.983876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:54.985274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:55.024288 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] HTTP exception thrown: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Request method failure captured: Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead HTTP/1.1 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMn3D9UHXOzpoEETJuHkb0QZUhhN94qVB3YbtTqVU9y6aLSCHC2Msq2z039wPrmpCbXOiUJtC7zEV9geYJvdTi8H2HiH97eDc1TlOUK3pxqVpkdISfS5blTLYGAKVbT7sNuhRJMixvZ6uppuSZ8YTk4UsQsYfAuwtgOb2jqJk46PPks Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a0d0254a7ec463c891af24123953ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 2a0d0254a7ec463c891af24123953ca2 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1813169898 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: b6965eb3a6a74e62a184ea493c8fcb76 Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1813169898-project Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead'} Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:55.026163 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. Oct 11 01:52:55.033493 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:52:55.036797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Returning 404 to user: Instance 1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:52:55.045924 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed62f31a-e35d-4edf-901a-008d141362e0 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead" status: 404 len: 111 microversion: 2.1 time: 0.103458 Oct 11 01:52:55.051716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2743/5526] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:54 2022] GET /compute/v2.1/servers/1d3c8f2e-c7b5-429d-9bdf-58ad666b9ead => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:52:55.675302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:55.676567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:55.688931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:55.694130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:55.695875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:55.697328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:55.700140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:55.707208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:55.985110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:55.998624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2863e111-16fe-40b0-b5ce-f391fd4b9ec2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.327271 Oct 11 01:52:56.014069 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2784/5527] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:55 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:52:57.025252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:57.026046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:57.047049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:57.050697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:57.054675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:57.055698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:57.056331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:57.057520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:57.582590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:57.600117 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b3704ed-c587-4576-b8d8-43b4777c9006 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.579373 Oct 11 01:52:57.601518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2744/5528] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:57 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:52:58.626158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:52:58.626784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:52:58.660830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:58.661434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:58.661896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:58.662656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:52:58.663126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:52:58.663593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:52:59.054903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:52:59.075471 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3d4e583-1951-494d-a76a-3c736571a87a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.453183 Oct 11 01:52:59.081281 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2785/5529] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:52:58 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:00.107384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:00.108658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:00.120167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:00.123289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:00.126527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:00.128105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:00.129959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:00.131030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:00.697562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:00.710050 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6507fb3-a036-4380-ae29-ec890999c5cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.611789 Oct 11 01:53:00.723503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2745/5530] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:00 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:01.754148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:01.755829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:01.779578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:01.782652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:01.783302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:01.795466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:01.801147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:01.807868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:02.558605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:02.571097 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a896b014-9cd3-4cf9-bbdc-7c326a17272f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.824961 Oct 11 01:53:02.574789 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2786/5531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:01 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:03.600766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:03.601576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:03.624958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:03.625702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:03.631216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:03.632786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:03.633291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:03.637043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:04.160408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:04.183156 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a26742a1-4466-4b30-abf2-d79bcd09deb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.581627 Oct 11 01:53:04.184828 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2746/5532] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:03 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:04.981800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-783d04bf-4dd7-46d9-8ddb-b2835ee17073 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] Calling method '.version_select at 0x7f112f12e9d0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:05.065414 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-783d04bf-4dd7-46d9-8ddb-b2835ee17073 tempest-TestNetworkAdvancedServerOps-1813169898 tempest-TestNetworkAdvancedServerOps-1813169898-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1603207512" status: 202 len: 0 microversion: 2.1 time: 0.088107 Oct 11 01:53:05.066707 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2787/5533] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 01:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1603207512 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:53:05.223972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:05.227499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:05.240468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:05.244627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:05.245494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:05.246547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:05.247509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:05.248308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:05.732902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:05.747656 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e552f0ec-37c1-469d-bc3c-a050f1d87b92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.539133 Oct 11 01:53:05.750954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2747/5534] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:05 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:06.773841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:06.774771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:06.798521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:06.799728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:06.800457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:06.804081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:06.805660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:06.806136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:07.374626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:07.387649 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc0a44f3-3af3-4e67-9ea9-425b3952a675 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.617597 Oct 11 01:53:07.407513 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2788/5535] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:06 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:08.423353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:08.455038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:08.462021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:08.462517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:08.463018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:08.463925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:08.464580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:08.465202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:08.526911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:09.001676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:09.021487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb3a4ff8-ba9f-41c7-8686-4c121c3a322b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.603050 Oct 11 01:53:09.045838 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2748/5536] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:08 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:10.051752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:10.053002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:10.068907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:10.069734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:10.070877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:10.075436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:10.076160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:10.076854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:10.482280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:10.503435 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2943ed1-7ebc-40d0-99de-5ee028b22ccf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1681 microversion: 2.1 time: 0.457132 Oct 11 01:53:10.508566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2789/5537] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:10 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1681 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:11.538457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:11.539088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:11.554562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:11.559489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:11.559991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:11.560440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:11.561157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:11.561617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:11.562242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:11.571814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:11.742455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:11.750367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05d01967-333e-428a-93d3-513f3044d42d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.221778 Oct 11 01:53:11.751036 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2790/5538] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:11 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:11.840043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ceb3e67-312e-4989-af75-d18e062d1a96 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-263777164", "availability_zone": "foo_zone"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:11.867302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.aggregate [None req-1ceb3e67-312e-4989-af75-d18e062d1a96 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Generated uuid 37bfed8c-5901-4674-97a1-3bfd40a0101f for aggregate {{(pid=120494) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 01:53:11.873705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:11.924976 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ceb3e67-312e-4989-af75-d18e062d1a96 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] [2edf359c-f680-41ab-b1be-9469cf280eb5] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 01:53:12.934219 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ceb3e67-312e-4989-af75-d18e062d1a96 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] [2edf359c-f680-41ab-b1be-9469cf280eb5] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 52078. Oct 11 01:53:12.941441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:12.942675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:12.946464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ceb3e67-312e-4989-af75-d18e062d1a96 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.546233 Oct 11 01:53:12.947418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2749/5539] 10.222.0.66 () {60 vars in 1164 bytes} [Tue Oct 11 01:53:11 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:12.959206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6867f39f-9df6-457d-9b6f-26f88600578e tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:12.971692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:12.974264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:12.975184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:12.976114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:12.977325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:12.978217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:12.999296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6867f39f-9df6-457d-9b6f-26f88600578e tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.043871 Oct 11 01:53:13.002117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2750/5540] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:53:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:13.013914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:13.019266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:13.020423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:13.021078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:13.021895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:13.022357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:13.022785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:13.054319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38d51a5f-7558-41d1-b9cc-a2e0d5216931 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044399 Oct 11 01:53:13.059823 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2751/5541] 10.222.0.66 () {58 vars in 1176 bytes} [Tue Oct 11 01:53:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:53:13.067186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5019fb2-9237-40ee-bf36-a4f1db0ac4ce tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:13.075612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5019fb2-9237-40ee-bf36-a4f1db0ac4ce tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.012082 Oct 11 01:53:13.076349 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2752/5542] 10.222.0.66 () {58 vars in 1143 bytes} [Tue Oct 11 01:53:13 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:53:13.087768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55d63dda-d14a-4dd4-8feb-312d18be2b66 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-772273-9"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:13.102491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d63dda-d14a-4dd4-8feb-312d18be2b66 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:13.103001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d63dda-d14a-4dd4-8feb-312d18be2b66 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:13.103673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55d63dda-d14a-4dd4-8feb-312d18be2b66 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:13.194787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:13.204856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e9b8c29-5215-4083-9975-e176168ad754 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.280463 Oct 11 01:53:13.206735 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2791/5543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:13.691936 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55d63dda-d14a-4dd4-8feb-312d18be2b66 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.607323 Oct 11 01:53:13.694460 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2753/5544] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:53:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:13.705854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-240747db-843d-4d05-9805-4c99b132dd3a tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:13.723528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-240747db-843d-4d05-9805-4c99b132dd3a tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.020276 Oct 11 01:53:13.725944 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2792/5545] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:53:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:13.736457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd5e74a2-e674-45d0-9773-a3589040fc6a tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2086982017", "availability_zone": "foo_zone"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:14.049598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd5e74a2-e674-45d0-9773-a3589040fc6a tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.316408 Oct 11 01:53:14.051990 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2754/5546] 10.222.0.66 () {60 vars in 1173 bytes} [Tue Oct 11 01:53:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:53:14.065699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-23ee514c-71bc-46b2-af45-149730b86946 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:14.132460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-23ee514c-71bc-46b2-af45-149730b86946 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.073011 Oct 11 01:53:14.137090 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2793/5547] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:53:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:14.149495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07e79e66-c05d-4cca-96d7-6e8b28b5c41b tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:14.180914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07e79e66-c05d-4cca-96d7-6e8b28b5c41b tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.035712 Oct 11 01:53:14.183051 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2755/5548] 10.222.0.66 () {58 vars in 1152 bytes} [Tue Oct 11 01:53:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:14.195892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57a945bf-aad4-4158-899e-61b0c79aab07 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-772273-9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:14.220086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57a945bf-aad4-4158-899e-61b0c79aab07 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:14.220836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57a945bf-aad4-4158-899e-61b0c79aab07 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:14.221538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57a945bf-aad4-4158-899e-61b0c79aab07 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:14.953298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57a945bf-aad4-4158-899e-61b0c79aab07 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.761728 Oct 11 01:53:14.956258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2794/5549] 10.222.0.66 () {60 vars in 1194 bytes} [Tue Oct 11 01:53:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:14.969092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0563b755-8a5a-4692-bbfa-245dc9910cc4 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:15.029340 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0563b755-8a5a-4692-bbfa-245dc9910cc4 tempest-TestAggregatesBasicOps-246837869 tempest-TestAggregatesBasicOps-246837869-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.064052 Oct 11 01:53:15.030913 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2756/5550] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 01:53:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 01:53:15.659236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-unplugged", "status": "completed", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:15.689646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:15.695705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:15.695705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:15.722856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] Creating event network-vif-unplugged:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:53:15.750799 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d2d8ab0e-a5f3-4853-b6b6-853b35f75d43 req-a9e85f01-2f46-4834-88dc-472a436f9be7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092674 Oct 11 01:53:15.751495 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2795/5551] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:53:16.001097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:16.002473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:16.043525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.044215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.047185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:16.049621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.050115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.050556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:16.446509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:16.461852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-245e3562-5c35-4a8c-a77d-09744895f0b0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.468174 Oct 11 01:53:16.480586 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2757/5552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:15 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:16.486653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:16.487697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:16.502509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.503021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.505702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:16.506525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.507014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.507480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:16.906838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:16.936238 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19553e64-46b9-4dfe-b69e-cd2a95be143d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.454885 Oct 11 01:53:16.937790 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2796/5553] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:16 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:16.963722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:16.964447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:16.974000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.974631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.975175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:16.976030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:16.976592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:16.981449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:17.556991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:17.569426 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72f90fa8-cb5a-47f0-9807-3b01248d4749 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.610037 Oct 11 01:53:17.593942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:17.596321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:17.596549 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2758/5554] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:16 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:17.603171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:17.603615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:17.604266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:17.604744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:17.605196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:17.605620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:17.736500 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f0adf5ee-c388-44f5-9be1-b96a320512ff tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.146163 Oct 11 01:53:17.738476 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2797/5555] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:53:17 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:53:17.747834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:17.748839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:17.765613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:17.769485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:17.770392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:17.771731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:17.772893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:17.774961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:18.484955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:18.500614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb158293-a80b-4454-8c37-feeff1d78d46 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1670 microversion: 2.1 time: 0.756180 Oct 11 01:53:18.503940 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2759/5556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:17 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1670 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:19.527170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:19.528487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:19.554609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:19.555122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:19.555602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:19.556331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:19.556795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:19.557228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:19.940299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:19.954700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28672484-9ac0-4eea-bd21-d2d3fa01f963 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1670 microversion: 2.1 time: 0.432245 Oct 11 01:53:19.956405 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2798/5557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:19 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:20.986967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:20.990287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:20.999188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.000101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.001100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:21.002928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.003767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.004555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:21.368133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:21.380229 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8aa26b52-bd0f-4c85-8baf-8ca79a4f235e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.401724 Oct 11 01:53:21.381504 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2760/5558] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:20 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:21.404148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:21.409663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:21.418639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.419894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.420574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:21.421587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.422269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.422911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:21.485637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd9d484c-4f47-462b-992e-606d170cbaa2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 200 len: 322 microversion: 2.1 time: 0.085888 Oct 11 01:53:21.486724 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2799/5559] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:53:21 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:21.497044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:21.498314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:21.511785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.513528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.514117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:21.515048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:21.549224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:21.550048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:22.071404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:22.082418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fd0f2df-35ed-4d6a-96c4-9b66dd2abac2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.587132 Oct 11 01:53:22.096321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2761/5560] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:21 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:22.111542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:22.112167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:22.131558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:22.132678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:22.133808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:22.140847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:22.143913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:22.144618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:22.780431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:22.807504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a7f7f89-0b34-48a7-aca8-90c75f822c1e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.701094 Oct 11 01:53:22.821035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2800/5561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:22.830791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:22.831647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:22.840713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:22.841662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:22.842297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:22.843248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:22.845154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:22.846123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:23.039717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:23.137869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:23.166394 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbc5afca-961b-4096-883e-fa5058210136 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.328250 Oct 11 01:53:23.176702 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2762/5562] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:23.195652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:23.196805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:23.208056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:23.209569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:23.210156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:23.215622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:23.219357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:23.222831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:23.549376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:23.565137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-851a8180-31ce-41d1-8961-7f36960bf4f7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.373880 Oct 11 01:53:23.570443 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2801/5563] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:23 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:23.731882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2064311568", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "965a3985-e7ee-410f-a1b3-0de185ed76ac"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:23.872466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] validate_networks() for [('965a3985-e7ee-410f-a1b3-0de185ed76ac', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:53:25.046761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:53:25.047290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:53:25.047690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:53:25.048111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:53:25.048531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:53:25.066078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:25.066594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:25.067049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:25.067836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:25.068308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:25.068748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:25.120351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:53:25.137346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:53:25.163652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:53:25.166030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:53:25.372030 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99d168c1-c737-4cad-9404-5f8cf49155a0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639644 Oct 11 01:53:25.373085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2763/5564] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:53:25.385074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1bfa4851-2c6f-46d0-ba14-1ef9c2268a28 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:25.385704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1bfa4851-2c6f-46d0-ba14-1ef9c2268a28 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:25.494746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1bfa4851-2c6f-46d0-ba14-1ef9c2268a28 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:25.505789 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1bfa4851-2c6f-46d0-ba14-1ef9c2268a28 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1215 microversion: 2.1 time: 0.124985 Oct 11 01:53:25.509778 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2802/5565] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:25 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:26.534421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7abc92da-1628-40bd-909e-83f5edca7077 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:26.535162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7abc92da-1628-40bd-909e-83f5edca7077 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:26.659589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7abc92da-1628-40bd-909e-83f5edca7077 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:26.669311 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7abc92da-1628-40bd-909e-83f5edca7077 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1215 microversion: 2.1 time: 0.136925 Oct 11 01:53:26.672392 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2764/5566] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:26 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:27.696797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de3706a0-7f42-418a-9c87-cd3f7454bf02 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:27.698865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de3706a0-7f42-418a-9c87-cd3f7454bf02 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:28.661853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de3706a0-7f42-418a-9c87-cd3f7454bf02 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:28.679034 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de3706a0-7f42-418a-9c87-cd3f7454bf02 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1215 microversion: 2.1 time: 0.983693 Oct 11 01:53:28.679742 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2803/5567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:27 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1215 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:29.701839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:29.702565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:29.717469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:29.727819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:29.729090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:29.732756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:29.736770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:29.737282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:29.891588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:29.902942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afbc887d-04da-4aec-a30f-4d20d58fd0b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1219 microversion: 2.1 time: 0.204543 Oct 11 01:53:29.904013 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2765/5568] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:29 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:30.931122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:30.933295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:30.979796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:30.980329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:30.984405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:30.989982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:30.989982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:30.989982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:31.135194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:31.160545 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f83b7f0f-949a-4b29-bc67-92c5c678d7fd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1211 microversion: 2.1 time: 0.234716 Oct 11 01:53:31.177433 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2804/5569] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:30 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1211 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:32.191507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:32.193075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:32.212617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:32.222956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:32.226462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:32.231311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:32.233981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:32.235094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:32.345998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:32.363480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b027874-994c-478e-8158-5f16841a4a4e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1273 microversion: 2.1 time: 0.176232 Oct 11 01:53:32.364353 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2766/5570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:32 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:33.388425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:33.389039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:33.409670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:33.411010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:33.411659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:33.417022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:33.417740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:33.418322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:33.578001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:33.590862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aed830f0-9a82-4c6f-8f74-3fb53fc5bdb0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1273 microversion: 2.1 time: 0.206339 Oct 11 01:53:33.592156 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2805/5571] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:33 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:34.596456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:34.599027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:34.599903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:34.600522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:34.601746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:34.602663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:34.603462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:34.615168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:34.615986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:34.636222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:34.636839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:34.638177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:34.641949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:34.644520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:34.645713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:34.686945 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1aedcf7e-5288-4123-bcea-a3bf8dd27bf4 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.548068 Oct 11 01:53:34.686945 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2767/5572] 10.222.0.66 () {58 vars in 1185 bytes} [Tue Oct 11 01:53:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:34.870134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:34.879661 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89e2700a-8788-425c-b6b8-11fc83726a03 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.269058 Oct 11 01:53:34.881025 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2806/5573] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:34 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:34.966629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2078764155", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "availability_zone": "nova:n-h2-772273-9", "networks": [{"uuid": "d2a21450-65c5-4761-b70d-3fd0bd148a00"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:35.064219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] validate_networks() for [('d2a21450-65c5-4761-b70d-3fd0bd148a00', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:53:35.627946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a242ed5-9ef0-420a-9674-4532ebdaff91", "tag": "c2f8cb4e-17b5-45a8-821d-fc65e4308558"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:35.654297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:35.654837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:35.656849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:35.681334 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] Creating event network-changed:c2f8cb4e-17b5-45a8-821d-fc65e4308558 for instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 on n-h2-772273-9 Oct 11 01:53:35.696995 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9442da0d-c095-49e1-aaea-f562b925e89e req-494ce05c-49a6-4462-8670-f52aa9ced81f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074604 Oct 11 01:53:35.700981 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2807/5574] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:53:35.904631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:35.905561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:35.917549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:35.918361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:35.919125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:35.920697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:35.922599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:35.923202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:36.337203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:53:36.339148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:53:36.339663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:53:36.340078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:53:36.340630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:53:36.366232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:36.367774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:36.368373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:36.370781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:36.371445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:36.373175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:36.424408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Getting quotas for project 5f47212274ec4b61821a9db637f99856. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:53:36.451621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Getting quotas for user dc820ba153434ab6a495a20b86ac1103 and project 5f47212274ec4b61821a9db637f99856. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:53:36.474617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:36.489021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:53:36.491540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:53:36.599427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2594472e-405f-4b1f-a3da-16528e053fa5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638625 Oct 11 01:53:36.602872 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2768/5575] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:53:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:53:36.615404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:36.618773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cfa410e7-55f4-4991-80c6-523c00d1023b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:36.621139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cfa410e7-55f4-4991-80c6-523c00d1023b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:36.632698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0cd936f3-a24e-46b5-a0c0-e8ffa97ca07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.729989 Oct 11 01:53:36.635909 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2808/5576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:35 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:36.778648 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cfa410e7-55f4-4991-80c6-523c00d1023b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1329 microversion: 2.1 time: 0.169010 Oct 11 01:53:36.779255 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2769/5577] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:36 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:37.675804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:37.676369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:37.693346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:37.694125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:37.694758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:37.695637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:37.696474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:37.697076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:37.802127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95611d58-7b16-4da3-b6e2-ed25fd3ef4ad tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:37.802830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95611d58-7b16-4da3-b6e2-ed25fd3ef4ad tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:38.029655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:38.066497 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95611d58-7b16-4da3-b6e2-ed25fd3ef4ad tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1329 microversion: 2.1 time: 0.267282 Oct 11 01:53:38.067678 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfb699a6-2f7a-402a-8729-680c92846d6e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.412555 Oct 11 01:53:38.069248 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2770/5578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:37 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:38.070808 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2809/5579] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:37 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:39.091372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-540d24a0-7452-4b01-a522-6e88db0d493a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:39.092215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-540d24a0-7452-4b01-a522-6e88db0d493a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:39.113283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:39.114136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:39.124830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:39.134528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:39.136012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:39.136467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:39.137882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:39.141841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:39.143381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:39.478608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-540d24a0-7452-4b01-a522-6e88db0d493a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1329 microversion: 2.1 time: 0.392107 Oct 11 01:53:39.482271 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2771/5580] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:39 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1329 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:39.791223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:39.807314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d412576b-0191-4b73-916c-e44dfca98833 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.700918 Oct 11 01:53:39.808509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2810/5581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:39 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:40.512293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-261c407f-8c72-48d1-89d7-4ee498c76b3d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:40.512932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-261c407f-8c72-48d1-89d7-4ee498c76b3d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:40.772342 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-261c407f-8c72-48d1-89d7-4ee498c76b3d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1329 microversion: 2.1 time: 0.266628 Oct 11 01:53:40.776359 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2772/5582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:40 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1329 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:40.831417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:40.832813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:40.862192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:40.879294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:40.884063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:40.886967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:40.888421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:40.889047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:41.202744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:41.213740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:41.219025 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cff36623-544e-45bd-9713-1888bbe4a5e6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.391949 Oct 11 01:53:41.222890 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2811/5583] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:40 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:41.798714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:41.799363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:41.814595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:41.818427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:41.819122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:41.820060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:41.822663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:41.823364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:41.877125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=64 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:42.018135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90b8e3dd-ddf0-4e4a-a3a2-5f6cd70474ea tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1424 microversion: 2.1 time: 0.223433 Oct 11 01:53:42.018957 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2773/5584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:41 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1424 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:42.262040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:42.264631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:42.273191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:42.292976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:42.293743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:42.294346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:42.295697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:42.297040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:42.298003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:42.730139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:42.748115 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-44a7ac7b-7596-44ac-9385-a84aaefd817a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.503767 Oct 11 01:53:42.750760 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2812/5585] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:42 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:43.047801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:43.048455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:43.060405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:43.060908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:43.061356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:43.062113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:43.066810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:43.067331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:43.778780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:43.779437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:43.790179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:43.793741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:43.794352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:43.795864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:43.796376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:43.801043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:44.040607 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-031a6ebb-3d38-4b6a-a883-18de60eae639 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.998208 Oct 11 01:53:44.041166 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2774/5586] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:43 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:44.281857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:44.309786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f68de4f-778e-49b1-a6a8-b6b519b5b712 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.531566 Oct 11 01:53:44.312851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2813/5587] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:43 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:45.082145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:45.086405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:45.099631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:45.100714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:45.102646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:45.104652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:45.105139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:45.106362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:45.254615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a242ed5-9ef0-420a-9674-4532ebdaff91", "name": "network-vif-plugged", "status": "completed", "tag": "c2f8cb4e-17b5-45a8-821d-fc65e4308558"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:45.277977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:45.278621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:45.279196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:45.328242 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] Creating event network-vif-plugged:c2f8cb4e-17b5-45a8-821d-fc65e4308558 for instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 on n-h2-772273-9 Oct 11 01:53:45.369977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-68153e70-dbcc-4f7d-9a81-ebeb1550f6c5 req-0995143d-28a1-4c05-bf01-3203c2e07dee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.563350 Oct 11 01:53:45.370647 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2775/5588] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:45.377136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:45.377847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:45.394198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:45.394697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:45.395832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:45.396725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:45.400380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:45.401226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:45.899854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25611408-8376-4cab-96ab-214ef920f1ce tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.839591 Oct 11 01:53:45.911725 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2814/5589] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:45 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:45.982356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:45.998392 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-420898a9-b1c5-4f9f-b902-d163a762438b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.626051 Oct 11 01:53:46.002770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2776/5590] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:45 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:46.577069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680d193f-63de-4a39-bd67-83acf7b70722", "tag": "1a8c95b5-6a5b-4078-a356-7120b0ad12ea"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:46.589713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:46.590209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:46.590691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:46.609238 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] Creating event network-changed:1a8c95b5-6a5b-4078-a356-7120b0ad12ea for instance 680d193f-63de-4a39-bd67-83acf7b70722 on n-h2-772273-9 Oct 11 01:53:46.615912 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-cb935832-75aa-4937-b209-5a06ad9b3eb6 req-c87d41a7-fa95-4de2-a97c-1cc58c34e04b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042866 Oct 11 01:53:46.617636 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2815/5591] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:46.924618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:46.927897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:46.930478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:46.946428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:46.947873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:46.950424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:46.963043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:46.964130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:46.964727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:47.038318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:47.039431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:47.099195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:47.106639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:47.107878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:47.114615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:47.115220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:47.115999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:47.444908 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f624e27-b6fb-485e-a9a9-4576d937cdbb tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.524435 Oct 11 01:53:47.455669 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2777/5592] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:46 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:47.654729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:47.671994 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07e6a5f0-3741-447a-97f1-b4f47e193c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1315 microversion: 2.1 time: 0.643086 Oct 11 01:53:47.689178 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2816/5593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:47 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:47.903642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53ae198a-03b9-443c-9d90-f98e1ed47f41 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: .version_select at 0x7f11343e88b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1931742140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhtADzeiUGwCq9vuOsp8xa40uAF8ZJw9ZvPLawMiUuqFtEDQVrFi6nd9uEsNGdmOHIZYbzBQKG6QWw+jthxEWcMryOQqJ+0wEcjVuqpeCUKSeeB8yGLf8/zUl9S2ynEg=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:47.944931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-53ae198a-03b9-443c-9d90-f98e1ed47f41 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:53:47.955412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-53ae198a-03b9-443c-9d90-f98e1ed47f41 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:53:48.020527 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53ae198a-03b9-443c-9d90-f98e1ed47f41 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.121363 Oct 11 01:53:48.021454 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2778/5594] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:53:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:48.474704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:48.475362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:48.504876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:48.505399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:48.505848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:48.506580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:48.507044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:48.507519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:48.700211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:48.700840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:48.711879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:48.717275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:48.719832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:48.720519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:48.721001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:48.721438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:49.303044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7dfae7f3-c618-4898-b4a7-653c27a502fc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.834094 Oct 11 01:53:49.303667 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2817/5595] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:48 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:49.335881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:49.350063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42a165c2-5dc6-4ee5-8fe3-a1a07879d487 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1503 microversion: 2.1 time: 0.654746 Oct 11 01:53:49.353296 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2779/5596] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:48 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1503 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:49.378708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:49.386824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:49.387322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:49.393911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:49.447378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:53:49.541198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fadc8be5-fc0b-442b-b3c9-14cbea9657ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91/action" status: 202 len: 0 microversion: 2.1 time: 0.166430 Oct 11 01:53:49.542109 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2818/5597] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:53:49 2022] POST /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:53:49.551626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:49.552260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:49.558509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:49.559019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:49.559745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:49.561839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:49.562625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:49.563242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:49.808866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:49.828417 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5387cf3a-59e9-44e3-967d-ceea99825d5d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.281120 Oct 11 01:53:49.830548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2780/5598] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:49 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:50.331247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:50.332278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:50.349041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:50.350737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:50.351220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:50.352028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:50.352911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:50.354789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:50.596123 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d6cdcdc3-310c-4dae-92a2-107b7edfaa7d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.272200 Oct 11 01:53:50.600076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2819/5599] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:50 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:50.684280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-71100684", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "91b421a2-1cd5-4411-82ec-b8cf577fac5c"}], "key_name": "tempest-TestNetworkBasicOps-1931742140", "security_groups": [{"name": "tempest-secgroup-smoke-491467224"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:50.865764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:50.866723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:50.877839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:50.887143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] validate_networks() for [('91b421a2-1cd5-4411-82ec-b8cf577fac5c', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:53:50.894742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:50.908003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:50.908951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:50.909546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:50.910084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:51.215319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:51.233023 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b678391-2a55-4c10-8fbd-326ce4c04794 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.368191 Oct 11 01:53:51.236330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2820/5600] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:50 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:51.542269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:53:51.542969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:53:51.543446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:53:51.544378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:53:51.544842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:53:51.554620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:51.555322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:51.555987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:51.557079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:51.557609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:51.558045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:51.593439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:53:51.600339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:53:51.615370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:53:51.618422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:53:51.621888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:51.622511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:51.635912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:51.636941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:51.637402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:51.649111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:51.650192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:51.652528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:51.696071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-869a2eac-397f-47b6-8e83-83f3893be970 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.015692 Oct 11 01:53:51.704261 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2781/5601] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:53:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:53:51.711015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63bc641e-ca5b-4cbe-b647-23d3aacfeb30 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:51.711996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63bc641e-ca5b-4cbe-b647-23d3aacfeb30 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:51.874983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63bc641e-ca5b-4cbe-b647-23d3aacfeb30 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:51.884307 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63bc641e-ca5b-4cbe-b647-23d3aacfeb30 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1247 microversion: 2.1 time: 0.178174 Oct 11 01:53:51.887989 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2782/5602] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:51 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1247 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:51.977231 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93e92aeb-c1b1-4ac6-a533-aea0cff609f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.358936 Oct 11 01:53:51.982504 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2821/5603] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:51 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:52.266992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:52.267730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:52.277331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:52.277848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:52.278288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:52.281317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:52.283737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:52.284618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:52.451982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:52.461528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03511c7d-f4cd-49e9-b47e-07e6e465bcaf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.198910 Oct 11 01:53:52.462090 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2783/5604] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:52 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:52.918273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:52.919562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:52.927441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:52.928005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:52.928449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:52.929338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:52.929794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:52.930224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:53.006052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:53.006528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:53.007434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:53.014726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:53.015592 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e4de829-5762-4426-8bac-b0808a211b1b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1299 microversion: 2.1 time: 0.101948 Oct 11 01:53:53.016194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:53.016637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:53.019297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:53.019949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:53.020560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:53.024086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2822/5605] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:52 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:53.320803 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b4d4414-0411-4933-8595-4835a9881b83 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.317734 Oct 11 01:53:53.322035 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2784/5606] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:53 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:53.484521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:53.485152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:53.493534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:53.495630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:53.496355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:53.497346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:53.498421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:53.499095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:53.739709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:53.748552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48843de9-f69b-4746-8b6f-26be2b472e3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.267959 Oct 11 01:53:53.759802 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2823/5607] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:53 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:54.043529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:54.044147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:54.051894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.052377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.053010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:54.053860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.054446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.055016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:54.353369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:54.355005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:54.369297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.370316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.371875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:54.374569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.375276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.377441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:54.415133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:54.425813 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3745080-7489-4f2b-b15a-c52a20e6d11a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.386156 Oct 11 01:53:54.428214 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2785/5608] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:54 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:54.739691 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19b908b2-10f4-4839-9bae-20e187e1b156 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.394509 Oct 11 01:53:54.740287 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2824/5609] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:54 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:54.773456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:54.774363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:54.783816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.786037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.786595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:54.788502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:54.790457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:54.791008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:55.463416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:55.464154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:55.479841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:55.480834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:55.481473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:55.488903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:55.489557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:55.490247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:55.525600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:55.537405 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a97173a4-a5e3-4eec-96ba-df23b93f1e62 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.768646 Oct 11 01:53:55.552588 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2786/5610] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:54 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:55.766144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:55.767216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:55.774471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:55.775714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:55.778754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:55.779856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:55.780610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:55.781438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:55.792101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:55.803389 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15f26f70-acc4-4ecb-b5dc-cac9e3b0fe0d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.350921 Oct 11 01:53:55.804006 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2825/5611] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:55 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:56.109665 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c66eb3e4-e8eb-429c-a8d1-99a3e5147756 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.347878 Oct 11 01:53:56.111021 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2787/5612] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:55 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:56.166246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701c67fa-fb6b-4e3b-809c-31f646417eee", "tag": "50be1317-08db-42f6-97fe-6dd4adae447e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:56.192207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:56.192696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:56.194471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:56.225962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] Creating event network-changed:50be1317-08db-42f6-97fe-6dd4adae447e for instance 701c67fa-fb6b-4e3b-809c-31f646417eee on n-h1-772273-9 Oct 11 01:53:56.242213 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1c5c420b-9135-4142-87e5-598b21f62880 req-ca74b8a6-93d7-4de9-b238-b0344ea1a170 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079665 Oct 11 01:53:56.244806 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2826/5613] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:56.569137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:56.570482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:56.582051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:56.583600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:56.584741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:56.588011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:56.590893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:56.591587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:56.837422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:56.838746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:56.849960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:56.851290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:56.851950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:56.853375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:56.854413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:56.855295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:56.892400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:56.906571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d86ec894-2537-4efd-819c-797cdfcdc39f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.343831 Oct 11 01:53:56.909401 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2788/5614] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:56 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:57.063909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680d193f-63de-4a39-bd67-83acf7b70722", "name": "network-vif-plugged", "status": "completed", "tag": "1a8c95b5-6a5b-4078-a356-7120b0ad12ea"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:53:57.074266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:57.084734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:57.085234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:57.085675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:57.086620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8b9c393-4b20-4849-98ca-61c6f377696a tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.261204 Oct 11 01:53:57.087570 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2827/5615] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:56 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:57.098475 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] Creating event network-vif-plugged:1a8c95b5-6a5b-4078-a356-7120b0ad12ea for instance 680d193f-63de-4a39-bd67-83acf7b70722 on n-h2-772273-9 Oct 11 01:53:57.108303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d78f6292-cd60-4fe2-aa49-290cb904246d req-28829df2-8ae1-4c99-8de1-4f7256f83e8e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047256 Oct 11 01:53:57.109629 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2789/5616] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:53:57.140711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:57.141436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:57.149420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:57.149905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:57.150504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:57.151232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:57.151723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:57.152157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:57.398244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:53:57.415738 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b13a55d2-3a17-4276-aedf-b702bd678ee5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.277865 Oct 11 01:53:57.416332 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2828/5617] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:57 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:57.936548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:57.937785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:57.950220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:57.953308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:57.953308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:57.953308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:57.953308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:57.953308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:58.119918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:58.120872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:58.131289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:58.132220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:58.132848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:58.133760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:58.134444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:58.135084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:58.477830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:58.491835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57fe2ca6-85da-49fe-afa3-ef374864b69c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.559277 Oct 11 01:53:58.494851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2790/5618] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:57 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:58.521759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:58.522598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:58.544591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:58.545910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:58.547209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:58.549241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:58.550394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:58.551325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:58.647587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:58.658304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f51cef4-7e62-4355-b560-bbab06467030 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.547139 Oct 11 01:53:58.665851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2829/5619] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:58 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:58.916873 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46e213d3-558d-47ca-8063-e96b10c3af1a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1464 microversion: 2.1 time: 0.413252 Oct 11 01:53:58.917825 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2791/5620] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:58 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:59.517589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:59.519053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:59.527576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.528667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.529262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:59.530958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.531610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.532315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:59.682151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:59.682626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:59.692957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.693449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.694151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:59.695036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.695666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.696238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:59.731712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:59.740672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2acf5453-eb51-43ac-8001-16f43142a07d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.227447 Oct 11 01:53:59.757579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2830/5621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:59 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:53:59.883488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:53:59.894444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af33190e-962b-4dc3-8235-954618ef4df1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.216669 Oct 11 01:53:59.895581 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2792/5622] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:59 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:53:59.943366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:53:59.944559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:53:59.952237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.952701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.953308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:53:59.954152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:53:59.956236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:53:59.956836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.153611 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-30a4e263-d745-4a24-931a-faa71385def1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1649 microversion: 2.1 time: 0.213861 Oct 11 01:54:00.154834 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2831/5623] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:53:59 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1649 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:00.180053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:00.180867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:00.187676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.188177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.188631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.189506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.189982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.190552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.334849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:00.342502 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07f94a13-2a82-422b-a1cf-6ce4ca1e519d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1649 microversion: 2.1 time: 0.169170 Oct 11 01:54:00.360431 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2793/5624] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:00 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1649 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:00.366854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:00.367511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:00.373633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.374171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.374619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.375544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.376049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.376477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.525923 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81d4e8df-a41f-476f-bbfe-f3ba9d81e564 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1649 microversion: 2.1 time: 0.162709 Oct 11 01:54:00.527296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2832/5625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:00 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1649 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:00.683461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1891574211", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "availability_zone": "nova:n-h1-772273-9", "networks": [{"uuid": "d2a21450-65c5-4761-b70d-3fd0bd148a00"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:00.767324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:00.768049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:00.778139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] validate_networks() for [('d2a21450-65c5-4761-b70d-3fd0bd148a00', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:54:00.780239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.780995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.782606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:00.783582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:00.785703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:00.786312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.067150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:01.079702 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e37ba4e2-d939-4d81-8bf4-f973684e5c36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.316601 Oct 11 01:54:01.080321 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2833/5626] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:00 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:01.101378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:01.102330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:01.109762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:01.110448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:01.111159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.112073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:01.113136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:01.114166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.376813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:01.391471 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-073b98b1-367b-4f08-b750-736052b19856 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.291203 Oct 11 01:54:01.393706 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2834/5627] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:01 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:01.424987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:54:01.425427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:54:01.425906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:54:01.426326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:54:01.426744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:54:01.437161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=35 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:01.440956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:01.441475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:01.441919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.443209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:01.443717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:01.444150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.471784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Getting quotas for project 5f47212274ec4b61821a9db637f99856. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:54:01.478838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:01.480615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Getting quotas for user dc820ba153434ab6a495a20b86ac1103 and project 5f47212274ec4b61821a9db637f99856. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:54:01.498591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:54:01.502183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:54:01.572743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42943855-f3ae-4bad-a480-0951618e79f1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893332 Oct 11 01:54:01.575069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2794/5628] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:54:01.587841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5477c00-36a1-4d98-a925-1259b89c2d38 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:01.596214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5477c00-36a1-4d98-a925-1259b89c2d38 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:01.705370 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5477c00-36a1-4d98-a925-1259b89c2d38 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1329 microversion: 2.1 time: 0.122586 Oct 11 01:54:01.708869 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2835/5629] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:01 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:01.824787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701c67fa-fb6b-4e3b-809c-31f646417eee", "name": "network-vif-plugged", "status": "completed", "tag": "50be1317-08db-42f6-97fe-6dd4adae447e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:01.843298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:01.843846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:01.847885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:01.870616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] Creating event network-vif-plugged:50be1317-08db-42f6-97fe-6dd4adae447e for instance 701c67fa-fb6b-4e3b-809c-31f646417eee on n-h1-772273-9 Oct 11 01:54:01.880696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c46ce6fe-95ea-46a0-9741-9872f7c96cc4 req-07621866-9857-42a6-ad35-8a4be9c353d4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060545 Oct 11 01:54:01.887844 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2795/5630] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:02.103939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:02.104572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:02.116952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.120010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.120723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.121565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.122153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.122752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.271736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:02.288211 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfad3514-c6e0-4e05-b91a-e55780a07d41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.189070 Oct 11 01:54:02.291034 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2836/5631] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:02 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:02.415894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:02.416642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:02.423550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.425467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.428575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.430212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.431030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.432363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.599661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:02.609114 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccd30a6c-0edf-4811-8f3f-5d0f7bbe5634 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1372 microversion: 2.1 time: 0.197981 Oct 11 01:54:02.610247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2796/5632] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:02 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:02.730526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:02.731220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:02.738077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.738573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.739187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.740114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:02.740762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:02.741380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:02.828958 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40cec8cc-e953-4c6d-9ee6-a24c04cae089 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1338 microversion: 2.1 time: 0.102617 Oct 11 01:54:02.829623 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2837/5633] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:02 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:03.319163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:03.320497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:03.329110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.329780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.330350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.331076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.334137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.334137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.503550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:03.511626 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82961555-d4f7-45a8-b4fd-c736a635fffa tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.202517 Oct 11 01:54:03.512694 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2797/5634] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:03 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:03.636952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:03.637960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:03.648586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.649415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.650136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.651066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.652863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.653511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.854755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:03.855527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:03.865966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.868398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.870864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.871715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.877456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.877456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.930613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:03.950643 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b02e2bab-7079-47f1-a90d-3325cd3194ec tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1544 microversion: 2.1 time: 0.319832 Oct 11 01:54:03.951318 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2838/5635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:03 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1544 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:03.976165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:03.976950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:03.985303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.985787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.986245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:03.986929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:03.987682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:03.988111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:04.028981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35ae5344-3e3c-41f9-9b1c-b5216774c579 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1422 microversion: 2.1 time: 0.179981 Oct 11 01:54:04.029587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2798/5636] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:03 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1422 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:04.246464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:04.259400 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4853503-c32f-4de7-9947-4f47573b9d84 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1544 microversion: 2.1 time: 0.287919 Oct 11 01:54:04.262374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2839/5637] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:03 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:04.535834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:04.536455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:04.543568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:04.544055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:04.544675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:04.545396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:04.546401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:04.546841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:05.019928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:05.036547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-77a1260c-eab5-4dc0-a202-c8c02ae10890 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.504740 Oct 11 01:54:05.037470 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2799/5638] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:04 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:05.054888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:05.056093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:05.063696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:05.064441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:05.065220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:05.066232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:05.066857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:05.067574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:05.605193 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0334ac51-945a-4d71-80c4-d0dd5552253e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.553589 Oct 11 01:54:05.606908 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2840/5639] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:05 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:06.062731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:06.063375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:06.072806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:06.073472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:06.073924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:06.074970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:06.075471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:06.076060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:06.630102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:06.630832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:06.638401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:06.639184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:06.640510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:06.641388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:06.642008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:06.642590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:06.860145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:06.879093 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dc94fe2-e13a-4670-9959-b624a00980d0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.820663 Oct 11 01:54:06.879993 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2800/5640] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:06 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:07.268505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a7fe5fe6-cbb3-4a6c-bd54-f7b5c277c4a1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.642049 Oct 11 01:54:07.269119 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2841/5641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:06 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:07.902299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:07.902919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:07.912842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:07.920548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:07.921705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:07.922622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:07.923973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:07.924564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:08.092246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a74c0f-c3d4-45c1-a0fa-99f19952cfee", "tag": "1be100ef-a115-4d8b-9711-2bb5754d09c2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:08.104865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:08.105617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:08.106259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:08.125858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] Creating event network-changed:1be100ef-a115-4d8b-9711-2bb5754d09c2 for instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee on n-h1-772273-9 Oct 11 01:54:08.132043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ef4f682b-ef36-47b9-b690-9c48c2c95400 req-0df653e9-a7e3-43bc-815a-8019238ed627 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043694 Oct 11 01:54:08.132906 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2842/5642] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:54:08.294155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:08.294869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:08.301918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:08.302417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:08.302886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:08.303646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:08.304066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:08.304915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:08.470383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:08.480861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98852d21-67f4-4954-84b8-0e32c5a55f9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.582513 Oct 11 01:54:08.483411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2801/5643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:07 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:09.131576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-409c6bec-bc8e-46b8-95bd-0eeef3fd5ac5 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.842194 Oct 11 01:54:09.143829 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2843/5644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:08 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:09.505936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:09.506639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:09.518432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:09.519075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:09.519763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:09.520599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:09.521175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:09.521976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:09.773065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:09.783670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62291fb5-88b6-4a70-b1f8-91124ae620cf tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.281479 Oct 11 01:54:09.784272 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2802/5645] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:09 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:10.156437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:10.157070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:10.164004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701c67fa-fb6b-4e3b-809c-31f646417eee", "tag": "50be1317-08db-42f6-97fe-6dd4adae447e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:10.168135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:10.168643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:10.169107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:10.169808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:10.170273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:10.171430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:10.177838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:10.178571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:10.179159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:10.194442 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] Creating event network-changed:50be1317-08db-42f6-97fe-6dd4adae447e for instance 701c67fa-fb6b-4e3b-809c-31f646417eee on n-h1-772273-9 Oct 11 01:54:10.200154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-87514f15-369e-4875-809f-2faaf2aac18b req-28f6375e-ac0d-4e65-b7b5-6715ad64c456 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040186 Oct 11 01:54:10.201350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2803/5646] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:10.459731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d68ee151-5dad-429d-ac58-2a49fa66395a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.308277 Oct 11 01:54:10.474796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2844/5647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:10 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:10.808304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:10.809188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:10.823544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:10.824206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:10.830670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:10.831767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:10.832473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:10.832916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:11.409814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:11.427425 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39e98546-bfaf-46f6-bb84-d2f41754b8a8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.619043 Oct 11 01:54:11.441525 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2804/5648] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:10 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:11.483655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:11.485262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:11.493228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:11.494068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:11.495042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:11.495984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:11.497142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:11.497913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:11.712649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:11.812841 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-237e2a99-7800-4619-a81f-5699160b81d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.332855 Oct 11 01:54:11.813441 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2845/5649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:11 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:12.456703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:12.458191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:12.460465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:12.462207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=5 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:12.469601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:12.470104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:12.470554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:12.471280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:12.471768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:12.472208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:12.664347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:12.676536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d0ea698-2554-4fdc-8955-995ce0052b52 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.225763 Oct 11 01:54:12.677871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2805/5650] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:12 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:12.836980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:12.837602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:12.840640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=70 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:12.846065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:12.846563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:12.847006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:12.847753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:12.848199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:12.848624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:13.125764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c167d691-c303-45dd-a280-71bea67d8ba3 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.292441 Oct 11 01:54:13.126647 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2846/5651] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:12 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:13.703227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:13.709572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:13.721841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:13.723237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:13.723988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:13.725009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:13.734194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a74c0f-c3d4-45c1-a0fa-99f19952cfee", "name": "network-vif-plugged", "status": "completed", "tag": "1be100ef-a115-4d8b-9711-2bb5754d09c2"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:13.739217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:13.742572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:13.777712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:13.778727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:13.784027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:13.796050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:13.817987 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] Creating event network-vif-plugged:1be100ef-a115-4d8b-9711-2bb5754d09c2 for instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee on n-h1-772273-9 Oct 11 01:54:13.823908 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e08e2e87-94ea-4c9c-afc0-cfb7b62be561 req-110b0d98-80f8-4948-a3c6-ac0157e03965 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094208 Oct 11 01:54:13.828209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2847/5652] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:14.151501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:14.152170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:14.158494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:14.158992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:14.159454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:14.160158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:14.160619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:14.161051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:14.178503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:14.187542 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27a88a65-04a9-47a8-9d89-9bb9bb9eac15 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.489187 Oct 11 01:54:14.188244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2806/5653] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:13 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:14.429677 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba4b3e2a-893d-455a-98d0-352f3a600824 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1464 microversion: 2.1 time: 0.283312 Oct 11 01:54:14.430676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2848/5654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:14 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:15.212610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:15.213387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:15.223198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.224989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.225822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:15.226875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.227725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.228483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:15.456290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:15.456959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:15.465119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.465609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.466202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:15.467083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.467595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.468022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:15.651104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:15.659672 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41fda44a-fb95-4682-8fc5-fb40a97d8fc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.451551 Oct 11 01:54:15.666082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2807/5655] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:15 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:15.814072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f9800da-13e2-4c68-8e4c-c2d27e050acc tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1649 microversion: 2.1 time: 0.361852 Oct 11 01:54:15.823614 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2849/5656] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:15 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1649 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:15.837855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:15.838544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:15.848145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.848878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.849522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:15.850737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:15.851415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:15.851855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.034239 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ee79c26-53a0-4b1a-86a1-36e8b6e5c843 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1649 microversion: 2.1 time: 0.200538 Oct 11 01:54:16.038375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2808/5657] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:15 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1649 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:16.060711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:16.061894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:16.068570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.069064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.069509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.070412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.070878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.071312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.226373 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-068ed532-d59b-4f0b-8edc-6b7638a3c356 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1649 microversion: 2.1 time: 0.170082 Oct 11 01:54:16.227374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2850/5658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:16 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1649 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:16.252698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:16.253223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:16.259860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.260363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.260809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.261528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.261992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.262430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.294431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:54:16.402490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d5dfd69-1296-4993-b085-d9115787813a tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 204 len: 0 microversion: 2.1 time: 0.150251 Oct 11 01:54:16.404098 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2809/5659] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:54:16 2022] DELETE /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:54:16.414534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:16.415373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:16.425660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.426724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.427256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.427979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.428350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.428772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.624511 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f21d3e2c-9445-4cf2-8d32-3af69a94b8b8 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1655 microversion: 2.1 time: 0.214797 Oct 11 01:54:16.627372 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2851/5660] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:16 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1655 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:16.683525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:16.684249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:16.693386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.693906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.694354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.695188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:16.695705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:16.696477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:16.868501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:16.877320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:16.880958 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65b586be-28f6-47ab-9a6f-e08a818f5bb6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1513 microversion: 2.1 time: 0.202035 Oct 11 01:54:16.882048 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2810/5661] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:16 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:17.648437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:17.649777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:17.658271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:17.658947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:17.659527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:17.660250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:17.660708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:17.661134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:17.905756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:17.906980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:17.914712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:17.915520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:17.916121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:17.916999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:17.917618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:17.918243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:17.971972 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-713d46f8-699e-43b5-9344-03c492c62b74 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1655 microversion: 2.1 time: 0.327175 Oct 11 01:54:17.972736 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2852/5662] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:17 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1655 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:18.261967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:18.268796 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c149fc8f-179e-4d65-a94b-ea3339193033 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1490 microversion: 2.1 time: 0.366918 Oct 11 01:54:18.269698 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2811/5663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:17 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1490 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:18.291711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:18.294727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:18.302833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.303379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.303853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.304571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.305036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.305469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.364032 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5334a2c0-0d57-49e9-9c90-db78c9bca3a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 200 len: 165 microversion: 2.1 time: 0.076183 Oct 11 01:54:18.369289 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2853/5664] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:18 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 165 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:54:18.375293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:18.375943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:18.382219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.382719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.383167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.384078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.384557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.384998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.695739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:18.705771 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18629046-d78e-421a-88f8-65334f92f892 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.335117 Oct 11 01:54:18.706648 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2812/5665] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:18 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:18.736777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:18.737798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:18.751308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.751916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.752359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.753068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.753526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.753955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.899084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a74c0f-c3d4-45c1-a0fa-99f19952cfee", "name": "network-vif-deleted", "tag": "1be100ef-a115-4d8b-9711-2bb5754d09c2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:18.911624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:18.912736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:18.913354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:18.935293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] Creating event network-vif-deleted:1be100ef-a115-4d8b-9711-2bb5754d09c2 for instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee on n-h1-772273-9 Oct 11 01:54:18.941537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fe6aee8a-9f13-4e90-8b1a-49fcc89450a3 req-486e2ef4-9667-4c03-b587-3060374a72ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050715 Oct 11 01:54:18.942894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2813/5666] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:18.999703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:19.000724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:19.014509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.016371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.017084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.018690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.019419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.020446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.029695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:19.046679 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a74013b6-af4d-4165-8fc0-e6cb13925a08 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.313435 Oct 11 01:54:19.059473 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2854/5667] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:18 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:19.077329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:19.082764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:19.091899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.092584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.093234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.094064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.094632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.095161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.185317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39765209-9875-4147-9e96-ae01304c6307 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 200 len: 1449 microversion: 2.1 time: 0.191664 Oct 11 01:54:19.206314 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2814/5668] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:18 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 1449 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:19.298017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:19.306610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-054d2951-781d-4cd6-9819-504f85399919 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.239178 Oct 11 01:54:19.307197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2855/5669] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:19 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:19.329597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:19.330274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:19.336809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.337516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.338142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.339002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:19.339643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:19.340225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:19.527578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:19.536483 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b59812f-742c-46f6-babe-4a780645e0cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.211200 Oct 11 01:54:19.537614 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2815/5670] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:19 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:19.666004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1615093002", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "965a3985-e7ee-410f-a1b3-0de185ed76ac"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:19.730083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] validate_networks() for [('965a3985-e7ee-410f-a1b3-0de185ed76ac', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:54:20.163617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:54:20.164647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:54:20.165304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:54:20.165874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:54:20.166439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:54:20.175485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.176221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.176808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.177758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.178219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.178645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.196454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:54:20.202475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:54:20.213266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:20.214568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 18a74c0f-c3d4-45c1-a0fa-99f19952cfee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:20.221823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.222903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.223695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.224738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.225421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.226150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.230380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:54:20.235282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:54:20.243961 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] HTTP exception thrown: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Request method failure captured: Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee HTTP/1.1 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMyecgR2DOQtqwFgus1qKEvDqDeXIGFV2aOhuz41BXSB4KP1-8K2BAFiZ4hEs0VrpS16E8ODZ0lI7gydTiFYxoXoGmIyBAE-zUOFaG7Pdgkh0edWs7Yyj_yEED1wJSjFcJ0bk1chrm1z8h2HOKuKTYrGqtHOFmLhbbCkHivXkxW2lh8 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5f47212274ec4b61821a9db637f99856 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestServerMultinode-1287013174 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5f47212274ec4b61821a9db637f99856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5f47212274ec4b61821a9db637f99856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f47212274ec4b61821a9db637f99856"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f47212274ec4b61821a9db637f99856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestServerMultinode-1287013174 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5f47212274ec4b61821a9db637f99856 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestServerMultinode-1287013174 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestServerMultinode-1287013174-project-admin Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc820ba153434ab6a495a20b86ac1103 Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestServerMultinode-1287013174-project-admin Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '18a74c0f-c3d4-45c1-a0fa-99f19952cfee'} Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:20.246022 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. Oct 11 01:54:20.255165 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:20.257036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Returning 404 to user: Instance 18a74c0f-c3d4-45c1-a0fa-99f19952cfee could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:54:20.257930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d268a3a-1c80-4923-b457-9bf9114ab577 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee" status: 404 len: 111 microversion: 2.1 time: 0.049063 Oct 11 01:54:20.258507 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2816/5671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:20 2022] GET /compute/v2.1/servers/18a74c0f-c3d4-45c1-a0fa-99f19952cfee => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:54:20.268160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:20.268893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:20.276058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.276711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.277406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.278439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.279102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.279926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.308787 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-022aa33b-ac01-4e29-8b62-0bf23ffa1a94 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646615 Oct 11 01:54:20.310557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2856/5672] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:54:20.322198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e81bcd65-ce8d-488e-b5c9-8be15aa8ac9c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:20.323888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e81bcd65-ce8d-488e-b5c9-8be15aa8ac9c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:20.338631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:54:20.422046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e81bcd65-ce8d-488e-b5c9-8be15aa8ac9c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:20.433708 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e81bcd65-ce8d-488e-b5c9-8be15aa8ac9c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1215 microversion: 2.1 time: 0.115636 Oct 11 01:54:20.437685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2857/5673] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:20 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:20.492465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-205c6205-e748-444f-8690-a24b87e478d1 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 204 len: 0 microversion: 2.1 time: 0.228899 Oct 11 01:54:20.493782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2817/5674] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:54:20 2022] DELETE /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:54:20.503981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:20.505206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:20.529094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.529687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.530201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.532355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:20.532728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:20.533174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:20.735714 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0979dc16-d1a9-4d25-b101-0866c392e27b tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1655 microversion: 2.1 time: 0.237195 Oct 11 01:54:20.736721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2858/5675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:20 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1655 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:21.462758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:21.463752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:21.476136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:21.477306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:21.478137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:21.479718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:21.480192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:21.493577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:21.581378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:21.590225 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f82b5edc-a219-469f-8efa-382587cf665c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1267 microversion: 2.1 time: 0.132174 Oct 11 01:54:21.590820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2818/5676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:21 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:21.763272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:21.765251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:21.774304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:21.775163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:21.775870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:21.776867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:21.777567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:21.778273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:22.492103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b05670ed-f010-4a9c-b4ad-493b709d880e tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1655 microversion: 2.1 time: 0.734632 Oct 11 01:54:22.501351 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2859/5677] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:21 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1655 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:22.615897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:22.617640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:22.625958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:22.626738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:22.627417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:22.628984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:22.629927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:22.630744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:22.856183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:22.865548 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-715fca99-80fd-47ae-800b-057c663cffce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1273 microversion: 2.1 time: 0.254747 Oct 11 01:54:22.866149 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2819/5678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:22 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:23.469111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680d193f-63de-4a39-bd67-83acf7b70722", "name": "network-vif-deleted", "tag": "1a8c95b5-6a5b-4078-a356-7120b0ad12ea"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:23.481943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:23.482664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:23.483519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:23.505154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] Creating event network-vif-deleted:1a8c95b5-6a5b-4078-a356-7120b0ad12ea for instance 680d193f-63de-4a39-bd67-83acf7b70722 on n-h2-772273-9 Oct 11 01:54:23.510621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fac8bfa3-f5ef-4318-ade1-560ef2a4ee23 req-ffcdc80f-4528-4a7b-a5ba-590322fa7f75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049197 Oct 11 01:54:23.512028 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2860/5679] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:23.520594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:23.521706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:23.528830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:23.530416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:23.531072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:23.532218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:23.533043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:23.534417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:23.684292 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80f1e910-de0b-490e-850c-842d1260806d tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 200 len: 1449 microversion: 2.1 time: 0.170413 Oct 11 01:54:23.684939 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2820/5680] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:23 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:23.890889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:23.891858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:23.898794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:23.899703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:23.900156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:23.901242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:23.901883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:23.902520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:24.602556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:24.624160 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f4455f4c-2dd6-43ec-b766-da57f80a5603 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.736620 Oct 11 01:54:24.626837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2861/5681] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:23 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:24.719792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:24.723669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] [instance: 680d193f-63de-4a39-bd67-83acf7b70722] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:24.739937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:24.741212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:24.741816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:24.742727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:24.743370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:24.744493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:24.764098 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] HTTP exception thrown: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Request method failure captured: Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 HTTP/1.1 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMyecgR2DOQtqwFgus1qKEvDqDeXIGFV2aOhuz41BXSB4KP1-8K2BAFiZ4hEs0VrpS16E8ODZ0lI7gydTiFYxoXoGmIyBAE-zUOFaG7Pdgkh0edWs7Yyj_yEED1wJSjFcJ0bk1chrm1z8h2HOKuKTYrGqtHOFmLhbbCkHivXkxW2lh8 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 5f47212274ec4b61821a9db637f99856 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestServerMultinode-1287013174 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5f47212274ec4b61821a9db637f99856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5f47212274ec4b61821a9db637f99856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f47212274ec4b61821a9db637f99856"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f47212274ec4b61821a9db637f99856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestServerMultinode-1287013174 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 5f47212274ec4b61821a9db637f99856 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestServerMultinode-1287013174 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestServerMultinode-1287013174-project-admin Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dc820ba153434ab6a495a20b86ac1103 Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestServerMultinode-1287013174-project-admin Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '680d193f-63de-4a39-bd67-83acf7b70722'} Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:24.767502 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. Oct 11 01:54:24.771729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:54:24.773727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] Returning 404 to user: Instance 680d193f-63de-4a39-bd67-83acf7b70722 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:54:24.775366 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5416c3ce-2856-4b9a-8410-0de408653b32 tempest-TestServerMultinode-1287013174 tempest-TestServerMultinode-1287013174-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722" status: 404 len: 111 microversion: 2.1 time: 0.067585 Oct 11 01:54:24.776599 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2821/5682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:24 2022] GET /compute/v2.1/servers/680d193f-63de-4a39-bd67-83acf7b70722 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:54:25.649195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:25.650512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:25.658609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:25.659225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:25.659868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:25.660680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:25.661232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:25.661755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:25.966099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:25.974830 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49fb566e-b48a-4875-ae4a-6789f7152b0e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.329379 Oct 11 01:54:25.991533 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2862/5683] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:25 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:26.275044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8eab78-57fc-4af8-b540-401af0633e2b", "tag": "79cfa346-cc3b-42dd-9444-fd9133108ea9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:26.313790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:26.314297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:26.314749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:26.341536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] Creating event network-changed:79cfa346-cc3b-42dd-9444-fd9133108ea9 for instance fe8eab78-57fc-4af8-b540-401af0633e2b on n-h1-772273-9 Oct 11 01:54:26.348068 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cd0e18c1-7db8-4857-91bd-9d0d2fe15eac req-c58ea6f1-5057-4c34-84d8-7dab45b5d628 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076383 Oct 11 01:54:26.349445 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2822/5684] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:54:26.998522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:26.999149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:27.006398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:27.006905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:27.007492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:27.008079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:27.018849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:27.019302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:27.548408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:27.556897 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-220925af-afe1-4dfa-80ef-c93091ec1a61 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.562168 Oct 11 01:54:27.557502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2863/5685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:26 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:28.589164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:28.590458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:28.600002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:28.600579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:28.601099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:28.602106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:28.602673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:28.605895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:28.833999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:28.844293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7401b42d-a186-4b2a-8277-aada90ae5e01 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.265302 Oct 11 01:54:28.845821 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2823/5686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:28 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:29.868212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:29.868861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:29.876761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:29.877137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:29.877750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:29.878821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:29.879664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:29.880247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:30.119929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:30.131193 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8050907a-048f-4e95-9988-c574e3c77068 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.266950 Oct 11 01:54:30.131866 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2864/5687] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:29 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:30.322590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:30.331954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:30.370829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:30.371460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:30.371860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:30.372613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:30.373127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:30.374194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:30.463765 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf816ac0-db08-4964-b803-10286066f9fc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee/action" status: 200 len: 24572 microversion: 2.1 time: 0.153447 Oct 11 01:54:30.464703 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2824/5688] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:30 2022] POST /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee/action => generated 24572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:54:31.156111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:31.157308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:31.161320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:31.163911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:31.181104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:31.181613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:31.182739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:31.183672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:31.186707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:31.187362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:31.658276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:31.674368 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d642161-86e5-4fd1-9d6d-25e1f6481df5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.523099 Oct 11 01:54:31.675052 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2865/5689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:31 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:32.148878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8eab78-57fc-4af8-b540-401af0633e2b", "name": "network-vif-plugged", "status": "completed", "tag": "79cfa346-cc3b-42dd-9444-fd9133108ea9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:32.168045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:32.180726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:32.181523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:32.182149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:32.219399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] Creating event network-vif-plugged:79cfa346-cc3b-42dd-9444-fd9133108ea9 for instance fe8eab78-57fc-4af8-b540-401af0633e2b on n-h1-772273-9 Oct 11 01:54:32.225584 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f8f69e62-a225-44ee-81b8-d3554cbc2820 req-b82d74b0-0800-42f7-bbb7-cd45afa14195 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083167 Oct 11 01:54:32.226729 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2825/5690] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:32.698379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:32.700072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:32.708272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:32.709163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:32.709793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:32.710845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:32.711552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:32.712193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:32.876924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:32.885990 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cafd4ff9-b760-4f96-9752-08c5111a522a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1315 microversion: 2.1 time: 0.191424 Oct 11 01:54:32.886980 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2866/5691] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:32 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:33.912033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:33.913511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:33.920126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:33.920620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:33.921058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:33.921758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:33.922217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:33.922647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:34.149733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:34.160409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09154aea-85a3-41d5-b8e0-ae6b7672cf9f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1503 microversion: 2.1 time: 0.254079 Oct 11 01:54:34.161009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2826/5692] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:33 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:34.185086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:34.188359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:34.195277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:34.195966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:34.196655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:34.197375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:34.197893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:34.198347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:34.203073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:34.241880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f9d6376-c248-448f-a0e0-29c28abfa5af tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.061147 Oct 11 01:54:34.242721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2867/5693] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:34 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:35.254706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:35.257281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:35.264656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:35.265385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:35.265967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:35.266926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:35.267766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:35.268381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:35.309884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5497fffc-be3d-4de0-bb85-bfda2ffb3aeb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.059521 Oct 11 01:54:35.313639 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2827/5694] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:35 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:36.321988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:36.326163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:36.334830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:36.335452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:36.335977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:36.337058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:36.337580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:36.338360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:36.388333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27967421-730e-420a-ac4b-8f952b2dcd92 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.070972 Oct 11 01:54:36.389519 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2868/5695] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:36 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:37.400147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:37.409508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:37.419450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:37.420839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:37.421514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:37.422558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:37.423209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:37.423837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:37.474618 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be3c0442-e41b-4feb-9ce4-bc36ede8bc83 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.078887 Oct 11 01:54:37.475877 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2828/5696] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:37 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:38.488202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:38.491828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:38.507776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:38.508278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:38.512253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:38.513168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:38.514141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:38.515168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:38.583089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66355940-3a0d-4aa9-9aad-974b16767797 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.099345 Oct 11 01:54:38.583976 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2869/5697] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:38 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:39.597244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:39.600099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:39.608551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:39.609202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:39.609656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:39.610383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:39.611011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:39.611662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:39.704242 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-679ffbe1-d421-45ef-9d92-66e6840cd6ce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.112742 Oct 11 01:54:39.705461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2829/5698] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:39 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:40.726593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:40.730864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:40.762055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:40.762556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:40.763005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:40.763783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:40.768034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:40.768344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:40.846333 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93e9cd23-66fd-4dce-b518-6b706af29de8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.132174 Oct 11 01:54:40.847725 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2870/5699] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:40 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:41.859073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:41.861560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:41.877550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:41.878511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:41.879209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:41.880184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:41.880742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:41.881395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:41.901787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:41.930919 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5907da91-c27d-45c1-94ec-f927dc954de5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.075661 Oct 11 01:54:41.931628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2830/5700] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:41 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:42.946353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:42.949033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:42.952828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:42.964895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:42.965515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:42.966023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:42.967373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:42.968002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:42.968517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:43.012911 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c64cc77-a961-4c2b-a379-fcbf53f20a0f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.073319 Oct 11 01:54:43.014030 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2871/5701] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:42 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:44.037521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:44.041591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:44.056663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:44.057430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:44.058579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:44.059573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:44.060198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:44.061321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:44.110158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1646cd6-4c92-4d9b-a50f-8df5e8af057c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.087756 Oct 11 01:54:44.115048 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2831/5702] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:44 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:45.127861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:45.130952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:45.151119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:45.151808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:45.152479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:45.154025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:45.155195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:45.156394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:45.203884 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3438cec7-9339-44c9-a9e1-44a51833c765 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.080586 Oct 11 01:54:45.204920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2872/5703] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:45 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:45.947461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3267dacc-b138-4235-90d4-8886b85c5620 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: .version_select at 0x7f112f59c820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1994128265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKO5sMcStN1sW00QlgsSytWgN+8Xqxx6O1Hh+1bXEYQCEVcP+ecxOkregvSIJ4N0/0KTTagVwy6buPvGF7RFC5RdhgZ2Fv9yCSxQxq0T8jw1n7wRwPwb7ni+TpR7joe4A=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:45.967226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3267dacc-b138-4235-90d4-8886b85c5620 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:54:45.977351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3267dacc-b138-4235-90d4-8886b85c5620 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:54:46.008188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3267dacc-b138-4235-90d4-8886b85c5620 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.067054 Oct 11 01:54:46.014870 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2832/5704] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:54:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:46.215744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:46.219211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:46.244438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:46.244934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:46.245380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:46.251925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:46.252982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:46.253576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:46.299092 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b2331bc-3c6b-4036-b333-76383f319312 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 14 microversion: 2.1 time: 0.087448 Oct 11 01:54:46.300617 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2873/5705] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:46 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:54:47.337474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:47.381302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:47.413391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:47.413944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:47.414387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:47.415141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:47.415653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:47.416066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:47.520816 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-513e82a1-c377-4b2a-af0c-37e6489ea673 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action" status: 200 len: 8205 microversion: 2.1 time: 0.212604 Oct 11 01:54:47.522160 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2833/5706] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:47 2022] POST /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b/action => generated 8205 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:47.533613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:47.534989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:47.544260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:47.547649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:47.548292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:47.549346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-762131606", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "ab2a1d5e-136c-4d69-b48a-7ea34150a415"}], "key_name": "tempest-TestNetworkBasicOps-1994128265", "security_groups": [{"name": "tempest-secgroup-smoke-380362569"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:47.549677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:47.552721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:47.553861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:47.951984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:47.957622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] validate_networks() for [('ab2a1d5e-136c-4d69-b48a-7ea34150a415', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:54:47.960190 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad8603be-6332-4662-8159-43dc6b9694e4 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.431341 Oct 11 01:54:47.960781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2874/5707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:47 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:47.989069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:47.989688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:48.005376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:48.005880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:48.006321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:48.007034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:48.007524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:48.008096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:48.714714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:48.731741 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-05536a3e-b99b-46eb-8116-78a7e09b8834 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.742567 Oct 11 01:54:48.734509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2875/5708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:47 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:48.758896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:48.759753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:48.773712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:48.774230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:48.774685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:48.778773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:48.779311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:48.781178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.304671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:49.314422 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a27a6b00-3da3-49ae-8627-2bf816b981d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.560961 Oct 11 01:54:49.317684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2876/5709] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:48 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:49.339880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:49.340767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:49.349114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.350159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.350924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.351828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.352444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.353215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.496176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:54:49.500163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:54:49.501596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:54:49.502413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:54:49.503412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:54:49.547287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.548048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.548507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.549287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.549750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.550208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.612905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:54:49.636830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:54:49.691056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:54:49.693169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:54:49.786594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:49.799805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e65c7937-fb88-4a9b-986a-c6872d185b0b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.255783 Oct 11 01:54:49.801627 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f7ae282-535c-4376-abff-078f60a20522 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.465594 Oct 11 01:54:49.803056 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2834/5710] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:54:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:54:49.815832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cad4c002-fd94-478f-af8a-0305deb00e36 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:49.816617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cad4c002-fd94-478f-af8a-0305deb00e36 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:49.825712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2877/5711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:49 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:49.838387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:49.839302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:49.865688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.869072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.870073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.870826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:49.871300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:49.874062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:49.960697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cad4c002-fd94-478f-af8a-0305deb00e36 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:49.971209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cad4c002-fd94-478f-af8a-0305deb00e36 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1248 microversion: 2.1 time: 0.160925 Oct 11 01:54:49.972292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Locking {{(pid=120493) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 11 01:54:49.980170 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2835/5712] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:49 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1248 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:50.060030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f63b4c01-500f-4d17-b0a7-0e677ab4f597 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.227505 Oct 11 01:54:50.064258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2878/5713] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:49 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:54:50.070594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:50.071628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:50.080085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.080617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.082100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.083808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.084668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.086039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.444381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:50.465472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61c6c478-e09a-469d-a8a5-8cd7f9f165fc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.398940 Oct 11 01:54:50.466803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2836/5714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:50 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:50.490372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:50.497248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.498529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.499169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.524358 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action HTTP/1.1 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 15 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: {"os-stop": {}} Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ff1937c8-4cae-4a43-8703-505e052a596a', 'body': {'os-stop': {}}} Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked Oct 11 01:54:50.526026 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:54:50.531522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 409 to user: Instance ff1937c8-4cae-4a43-8703-505e052a596a is locked {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:54:50.532539 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07cda9c3-fc71-4661-b8a5-91e07d9e402f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 409 len: 107 microversion: 2.1 time: 0.046808 Oct 11 01:54:50.542214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:50.543484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:50.547898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2879/5715] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:50 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 107 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 01:54:50.551296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.552059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.552692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.553549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.554166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.554781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.605150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Unlocking {{(pid=120494) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 01:54:50.680761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c6fdc7a-eccf-4df8-a5c7-1766317e9463 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.142865 Oct 11 01:54:50.683779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2837/5716] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:50 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:54:50.690477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:50.701273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.702083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.703605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.742941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:54:50.807584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-10a7a705-d6fb-4fa4-98cb-099df26257ad tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.121027 Oct 11 01:54:50.809797 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2880/5717] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:54:50 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:54:50.818730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:50.819352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:50.828974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.835903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.836557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:50.837505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:50.837980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:50.838421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:51.004271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:51.005569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:51.027077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:51.036464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:51.036994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:51.039118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:51.039831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:51.042526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:51.140904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:51.151100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ff566ca-db6d-4913-8081-6c13673eca1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.336189 Oct 11 01:54:51.155412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2838/5718] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:50 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:51.192461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:51.202573 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46d4341b-096b-4fd8-8970-c04a0302bfde tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1300 microversion: 2.1 time: 0.202949 Oct 11 01:54:51.203604 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2881/5719] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:50 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:52.179566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:52.180700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:52.194086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:52.194797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:52.195429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:52.196294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:52.196905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:52.197487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:52.235254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:52.236467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:52.247677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:52.248575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:52.249443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:52.250303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:52.250914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:52.251525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:52.551092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:52.554929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:52.567380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2af1e947-370f-4847-9040-891e48cebfc5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.336236 Oct 11 01:54:52.572258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2882/5720] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:52 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:52.653747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:52.674227 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38fa5130-901f-4b04-8c0a-e68153df2f20 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.490083 Oct 11 01:54:52.675240 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2839/5721] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:52 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:53.509512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffa3913-6519-475e-8b37-6b9ccf3ff8c0", "tag": "e2aff0e4-13aa-4828-8849-1bc2102993a6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:54:53.523772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:53.524542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:53.525151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:53.538273 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] Creating event network-changed:e2aff0e4-13aa-4828-8849-1bc2102993a6 for instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 on n-h2-772273-9 Oct 11 01:54:53.544261 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fe1c37f6-8a44-4653-98df-00c17e380f3c req-0f29a547-29ae-427b-bef4-47b3b1f2e36b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039365 Oct 11 01:54:53.546051 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2883/5722] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:54:53.603066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:53.605879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:53.618731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:53.619909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:53.620886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:53.621830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:53.622508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:53.623964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:53.714072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:53.714766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:53.721779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:53.722568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:53.723254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:53.724192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:53.724880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:53.725383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:53.966108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:53.973996 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89195e8e-605d-4162-8a32-f5f6ae5d282e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.378632 Oct 11 01:54:53.974973 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2840/5723] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:53 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:54.029420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:54.036620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-461d0a2d-0019-4ee4-aac1-0aa76fd774f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.327478 Oct 11 01:54:54.037747 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2884/5724] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:53 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:54.998256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:54.998874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:55.017628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:55.018135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:55.018588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:55.019387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:55.019844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:55.020274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:55.060153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:55.061459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:55.072648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:55.073860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:55.075502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:55.077170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:55.079051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:55.080190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:55.443531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:55.460022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8229240-0c25-4924-bc80-5fcee3ab7021 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.464496 Oct 11 01:54:55.461148 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2841/5725] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:54 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:55.525131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:55.534891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f3d84e5-bfe2-43c3-b17e-9ac7ba170d2f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.478503 Oct 11 01:54:55.536090 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2885/5726] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:55 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:56.484370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:56.485550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:56.493857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:56.494670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:56.495180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:56.496114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:56.496765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:56.497385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:56.559513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:56.561449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:56.570138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:56.570869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:56.571600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:56.572810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:56.573290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:56.573937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:56.890415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:56.898917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-559d9fa5-ffb6-49bf-a782-24489da7dde3 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.419168 Oct 11 01:54:56.912763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2842/5727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:56 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:56.962803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:56.983839 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c60a2cf8-26d5-4a35-b2f7-3505d8a6872d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.427165 Oct 11 01:54:56.984974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2886/5728] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:56 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:57.924529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:57.925153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:57.932028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:57.932521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:57.932964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:57.933665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:57.934123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:57.934552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:58.008362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:58.009593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:58.018945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:58.019728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:58.020988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:58.021945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:58.022419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:58.022859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:58.287874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:58.303085 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1f1694c-5d00-48ef-a61e-dea91e5f8794 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.382207 Oct 11 01:54:58.305449 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2843/5729] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:57 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:58.318392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:58.328737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-993c4999-191d-4158-a798-6ce432f2a421 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.324274 Oct 11 01:54:58.334063 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2887/5730] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:58 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:54:59.329295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:59.330416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:59.338872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:59.339381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:59.339980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:59.340857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:59.341316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:59.342306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:59.355783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:54:59.357016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:54:59.368656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:59.369607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:59.370304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:59.371302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:54:59.371966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:54:59.372531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:54:59.599430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:54:59.629773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:59.642397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:54:59.646148 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46f902b2-593c-4a92-a9a9-d69f3d8976a0 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.321575 Oct 11 01:54:59.652138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8814d933-d72c-447c-ab45-9fd905c3c58c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.301780 Oct 11 01:54:59.660985 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2844/5731] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:59 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:54:59.664925 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2888/5732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:54:59 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:55:00.674029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:00.676594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:00.679124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:00.679833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:00.684743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:00.688726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:00.689468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:00.690120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:00.691117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:00.691411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:00.692028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:00.692148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:00.692816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:00.692948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:00.694084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:00.695008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:00.695712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:00.948880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:00.950397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:00.960393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ce2e92e3-f9eb-435d-ac31-5512649644b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.286114 Oct 11 01:55:00.961708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2889/5733] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:00 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:55:00.966560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffa3913-6519-475e-8b37-6b9ccf3ff8c0", "name": "network-vif-plugged", "status": "completed", "tag": "e2aff0e4-13aa-4828-8849-1bc2102993a6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:00.971599 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed661097-de20-4577-b263-cb526ff33480 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.302453 Oct 11 01:55:00.979856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2845/5734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:00 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:01.003934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:01.004952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:01.006115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:01.055947 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] Creating event network-vif-plugged:e2aff0e4-13aa-4828-8849-1bc2102993a6 for instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 on n-h2-772273-9 Oct 11 01:55:01.062291 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-94ebc5bb-3827-48b9-93d1-3ad1ba57a41f req-f014b3cc-92b7-45fa-8dcc-c3becb2e1dd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099124 Oct 11 01:55:01.062941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2890/5735] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:55:02.012482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:02.014895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:02.019030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:02.019564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:02.034146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.036518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.036518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.037350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.037862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.038667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.039058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.040027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.040522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.041020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.046422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.047068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.599499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:02.615502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d959d9a-0338-47ee-abd8-425ffcb050e8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1373 microversion: 2.1 time: 0.609593 Oct 11 01:55:02.616904 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2891/5736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:02 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1373 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:02.687304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:02.696340 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-87ce4888-e8cc-4c38-a35e-0344d8ced64b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1655 microversion: 2.1 time: 0.694037 Oct 11 01:55:02.702942 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2846/5737] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:02 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1655 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:02.731763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:02.741553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.742579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.743377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.778489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Going to try to start instance {{(pid=120493) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 01:55:02.868833 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7568be47-22b8-4596-914e-0bd1eafe1f33 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.142099 Oct 11 01:55:02.869461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2892/5738] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:55:02 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:02.884773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:02.885413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:02.910880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.911688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.912959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:02.914066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:02.915269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:02.915968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:03.302287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:03.329897 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26499223-1fde-4e5e-8a21-6459fb2da36b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1664 microversion: 2.1 time: 0.454633 Oct 11 01:55:03.339033 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2847/5739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:02 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1664 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:03.649718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:03.650434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:03.657622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:03.658431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:03.659027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:03.660054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:03.660462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:03.661116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:03.957636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:03.965369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f21631f1-ae2b-4926-853f-610469d62322 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1546 microversion: 2.1 time: 0.321424 Oct 11 01:55:03.979719 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2893/5740] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:03 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1546 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:03.988612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:03.989239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:03.991147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:03.999296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:04.000365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:04.000817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:04.001539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:04.002329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:04.002866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:04.008337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:04.261749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:04.273835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92a8ff31-0f19-46f3-a490-0ecd5e4939a9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1546 microversion: 2.1 time: 0.288574 Oct 11 01:55:04.275756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2848/5741] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:03 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:04.356331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:04.356989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:04.364105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:04.365029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:04.365029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:04.365744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:04.366206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:04.366635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:04.698634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:04.731600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3631067b-814f-42ce-869b-0fc99ac1ab72 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1664 microversion: 2.1 time: 0.378932 Oct 11 01:55:04.749234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2894/5742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:04 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1664 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:05.759989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:05.760982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:05.769577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:05.770463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:05.771158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:05.772301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:05.772757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:05.773204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.103890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:06.113094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-146b1731-fff0-496a-aa94-3bb3ee74796c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.357090 Oct 11 01:55:06.113913 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2849/5743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:05 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:06.140526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:06.141597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:06.147977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.148467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.150509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.151776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.152398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.153634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.561195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:06.573146 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a060d2b8-4c80-4d4c-af19-4e638a4dfdc0 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.439803 Oct 11 01:55:06.573924 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2895/5744] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:06 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:06.598005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:06.602254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:06.614499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.615604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.616063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.616801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.623007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.623701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.706853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Unlocking {{(pid=120494) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 01:55:06.779712 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1107635-a43e-4a7b-8a56-777831696070 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.183900 Oct 11 01:55:06.785766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2850/5745] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:55:06 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:06.806026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:06.807667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:06.839701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.840511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.842131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:06.845833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:06.846677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:06.847980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:07.425154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:07.442071 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd7cbfd6-e559-4600-9b66-125047605992 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.655293 Oct 11 01:55:07.445246 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2896/5746] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:06 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:55:07.471776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:07.472672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:07.482338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:07.484220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:07.484828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:07.490979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:07.491688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:07.492371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:07.814648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:07.842265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e3fa5fc-1de8-4701-b0d0-3abeefc58d9a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.374628 Oct 11 01:55:07.856397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2851/5747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:07 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:07.867082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:07.867758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:07.874744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:07.875236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:07.875744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:07.876588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:07.877357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:07.877783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:08.248004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:08.278786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72a931a5-23c5-4ed5-b5df-01dce908b4ee tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.416063 Oct 11 01:55:08.280927 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2897/5748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:07 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:08.305096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:08.305679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:08.314691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:08.315613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:08.316292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:08.317177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:08.317866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:08.318471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:08.407024 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1adc343b-8d59-4c69-976b-7556737b2d8f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.106382 Oct 11 01:55:08.418310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:08.420024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:08.424175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2852/5749] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:55:08 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:08.432436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:08.433005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:08.434773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:08.437588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:08.438076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:08.440433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:08.714062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:08.729809 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd4d5e30-eae1-4eec-bf62-30ba06d87711 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1673 microversion: 2.1 time: 0.316525 Oct 11 01:55:08.730337 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2898/5750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:08 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1673 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:09.762253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:09.764633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:09.774193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:09.775113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:09.775747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:09.776639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:09.777247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:09.777831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:10.109506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:10.129140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0126b52-d4e9-44ec-b38c-c0d13fa88e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1653 microversion: 2.1 time: 0.375116 Oct 11 01:55:10.147457 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2853/5751] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:09 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1653 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:10.163678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:10.164668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:10.171975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:10.172502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:10.172937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:10.174356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:10.174820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:10.175250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:10.248192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:10.356699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-adf1b0f1-b49b-451f-b983-104ee5d068d9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.197833 Oct 11 01:55:10.357887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2899/5752] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:55:10 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:10.372184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:10.373394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:10.389789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:10.400819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:10.401974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:10.404278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:10.405342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:10.406199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:11.069719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:11.080773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b3b3b5c-55b6-4b85-9c26-26d786930c1a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1660 microversion: 2.1 time: 0.718705 Oct 11 01:55:11.081695 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2854/5753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:10 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1660 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:12.110762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:12.111723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:12.123306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.124954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.125748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.126512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.127317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.128184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.305362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:12.318642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c45473c-47e2-45c1-99be-f522140cf389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.212654 Oct 11 01:55:12.320073 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2900/5754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:12.347725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:12.349250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:12.359073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.359734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.360376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.362751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.363525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.364209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.548172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:12.558367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9a6f7b3-9c55-44f1-937c-f3e64e0615ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.215036 Oct 11 01:55:12.568522 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2855/5755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:12.585654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:12.586282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:12.594121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.594914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.595551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.596457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.597073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.597815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.766312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:12.776572 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f3e65f0-6d83-45e5-9947-b4629119ae90 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.194772 Oct 11 01:55:12.777943 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2901/5756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:12.799800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:12.800663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:12.807456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.808400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.809136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:12.810722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:12.811356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:12.812137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:13.154587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:13.176707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78a0fbbd-7b56-4604-8890-733636a0cf41 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.380955 Oct 11 01:55:13.177449 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2856/5757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:13.204510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:13.205527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:13.214010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=62 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:13.215675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:13.216807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:13.217486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:13.218752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:13.219462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:13.220812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:13.698647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:13.708773 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f7f02e3-f63e-4fd8-837d-d7b1e8ce1c5f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.511381 Oct 11 01:55:13.709643 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2902/5758] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:13 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:13.736418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:13.737325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:13.750156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:13.751844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:13.761727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:13.762747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:13.763842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:13.764282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:14.056031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:14.065271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdf871e4-9df0-4274-9c6f-74613fef1e8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.334543 Oct 11 01:55:14.066417 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2857/5759] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:13 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:41.141437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:41.141837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:41.144192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:41.145317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:41.155062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:41.155941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:41.156638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:41.157577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:41.158258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:41.158902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:41.191211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:55:41.333256 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a15410d-e26f-4d2b-9fa2-3cfdc4ac3509 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 204 len: 0 microversion: 2.1 time: 0.192565 Oct 11 01:55:41.344208 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2903/5760] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:55:41 2022] DELETE /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:55:41.363872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:41.364409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:41.376840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=19 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:41.380205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:55:41.400210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:41.402293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:41.402929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:41.405193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:41.406839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:41.408157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:41.723672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:41.734811 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5dbb0df7-f950-4735-b4d8-6e1c20b77ba1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1552 microversion: 2.1 time: 0.387669 Oct 11 01:55:41.735638 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2858/5761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:41 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1552 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:42.760980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:42.761992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:42.770005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:42.770508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:42.771030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:42.772125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:42.772585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:42.773504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:42.913638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:42.922123 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f1203d5-dbb3-45b7-8ce2-6fdbf550b896 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1552 microversion: 2.1 time: 0.165869 Oct 11 01:55:42.922691 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2904/5762] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:42 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:43.690361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffa3913-6519-475e-8b37-6b9ccf3ff8c0", "name": "network-vif-deleted", "tag": "e2aff0e4-13aa-4828-8849-1bc2102993a6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:43.702772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:43.703565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:43.704419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:43.718537 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] Creating event network-vif-deleted:e2aff0e4-13aa-4828-8849-1bc2102993a6 for instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 on n-h2-772273-9 Oct 11 01:55:43.723536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c7f9429b-b6e4-4de8-abf4-ccb0058d8045 req-1d0b5228-5333-448c-95f3-5c18136e754c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227845 Oct 11 01:55:43.724313 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2859/5763] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:55:43.945660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:43.947094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:43.959706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:43.960471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:43.962195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:43.963067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:43.963768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:43.964320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:44.035814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:44.036487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:44.037205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:44.037806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lazy-loading 'fault' on Instance uuid 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:55:44.083985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:44.095448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dcb03434-83b9-4713-8533-0269c6375f60 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 200 len: 1338 microversion: 2.1 time: 0.153670 Oct 11 01:55:44.096632 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2905/5764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:43 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 1338 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:45.121595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:45.122253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:45.129544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:45.130040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:45.130587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:45.131396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:45.132125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:45.132568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:45.150555 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] HTTP exception thrown: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Request method failure captured: Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 HTTP/1.1 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMyfNp8HhBz5L-f1nfZwfusqhacbUxCOxZF1adD-YSWucQscd8WyHx7tKUc_Z3Mainb_DL88kfuLb8C2vymnE2tSsxd-OT9cucxX50GaVBZJFlIkobGEcYRWDL_R5adOSfobrLjQE2yuQBbyzXvg_fiKcfOprfVxlQijnG4OvFy0_Yo Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c493ca733d0d493d92e7963c26db4539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: ab5e64b7a6bd428ba6daafa356162eae Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0ffa3913-6519-475e-8b37-6b9ccf3ff8c0'} Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:55:45.152233 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Returning 404 to user: Instance 0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cbc07b2-d341-4be1-b1ce-cb19a42ab957 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0" status: 404 len: 111 microversion: 2.1 time: 0.038625 Oct 11 01:55:45.160709 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2860/5765] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:45 2022] GET /compute/v2.1/servers/0ffa3913-6519-475e-8b37-6b9ccf3ff8c0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:55:45.323757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-201db8ea-1f30-4daf-9049-6e92f3d20714 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '.version_select at 0x7f11387beca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:45.373035 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-201db8ea-1f30-4daf-9049-6e92f3d20714 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1994128265" status: 202 len: 0 microversion: 2.1 time: 0.053126 Oct 11 01:55:45.377638 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2906/5766] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 01:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1994128265 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:46.406269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:46.409709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:46.419406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:46.419917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:46.420367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:46.421081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:46.421545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:46.421982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:46.503717 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b003372-4004-4e3b-ab42-d77fb1c683f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.102510 Oct 11 01:55:46.508689 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2861/5767] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:55:46 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:55:46.514054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:46.515847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:46.530015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:46.530836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:46.531495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:46.532223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:46.532687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:46.533127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:46.881856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:46.904261 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c031352d-e47c-49fb-9596-f9dbabd1e501 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1670 microversion: 2.1 time: 0.393161 Oct 11 01:55:46.904261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2907/5768] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:46 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:55:47.929933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:47.931858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:47.938742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:47.939242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:47.939791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:47.940507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:47.940967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:47.941599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.045636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:48.046175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:48.062710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:48.063815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:48.064399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.065118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:48.065636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:48.066065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.126953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:55:48.238427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:48.256371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fc3c676-78b8-498d-ab6e-2a264597f2cc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1675 microversion: 2.1 time: 0.331867 Oct 11 01:55:48.258342 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2862/5769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:47 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:55:48.270213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701c67fa-fb6b-4e3b-809c-31f646417eee", "tag": "50be1317-08db-42f6-97fe-6dd4adae447e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:48.290175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:48.290920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:48.292435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.307004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b85eb52-ff35-432d-8b47-6c386b6f5c4e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 204 len: 0 microversion: 2.1 time: 0.266147 Oct 11 01:55:48.308177 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2908/5770] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:55:48 2022] DELETE /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:55:48.319223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:48.320689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:48.326469 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] Creating event network-changed:50be1317-08db-42f6-97fe-6dd4adae447e for instance 701c67fa-fb6b-4e3b-809c-31f646417eee on n-h1-772273-9 Oct 11 01:55:48.328293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:48.328978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:48.329984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.330755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:48.332044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:48.332696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:48.337094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2ff3b7b9-0364-4729-9a4f-d2672a55d018 req-dfe6c961-3100-4120-8bc0-c97f5a344bc5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074651 Oct 11 01:55:48.344899 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2863/5771] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:55:48.524639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:48.533201 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9491429e-01f7-45b4-add2-5342e9318abc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1668 microversion: 2.1 time: 0.220184 Oct 11 01:55:48.548181 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2909/5772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:48 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:49.285292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:49.286012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:49.293850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:49.294432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:49.294881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:49.296094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:49.296625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:49.297151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:49.557665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:49.558266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:49.570776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:49.572368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:49.576683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:49.577791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:49.578421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:49.579256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:49.898875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:49.919781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1e8d137-d1a5-4e9f-a729-a53b80d950e2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.630199 Oct 11 01:55:49.920698 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2864/5773] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:49 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:50.001169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:55:50.012080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f6648ce-34c4-4ef0-b751-489be63acae8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 200 len: 1668 microversion: 2.1 time: 0.458502 Oct 11 01:55:50.019218 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2910/5774] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:49 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:55:50.505684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701c67fa-fb6b-4e3b-809c-31f646417eee", "name": "network-vif-deleted", "tag": "50be1317-08db-42f6-97fe-6dd4adae447e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:55:50.520247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:50.520931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:50.521471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:50.535797 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] Creating event network-vif-deleted:50be1317-08db-42f6-97fe-6dd4adae447e for instance 701c67fa-fb6b-4e3b-809c-31f646417eee on n-h1-772273-9 Oct 11 01:55:50.541016 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f96ed662-63b1-4c64-9908-d741a8e422fb req-8a40c7c2-7aec-4e81-986d-6741b9a009c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132452 Oct 11 01:55:50.541993 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2865/5775] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:55:51.046096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:51.047667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: 701c67fa-fb6b-4e3b-809c-31f646417eee] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:55:51.056389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:51.057677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:51.058542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:51.060267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:55:51.060950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:55:51.061605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:55:51.083426 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] HTTP exception thrown: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Request method failure captured: Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee HTTP/1.1 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMyfNp8HhBz5L-f1nfZwfusqhacbUxCOxZF1adD-YSWucQscd8WyHx7tKUc_Z3Mainb_DL88kfuLb8C2vymnE2tSsxd-OT9cucxX50GaVBZJFlIkobGEcYRWDL_R5adOSfobrLjQE2yuQBbyzXvg_fiKcfOprfVxlQijnG4OvFy0_Yo Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c493ca733d0d493d92e7963c26db4539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ab5e64b7a6bd428ba6daafa356162eae Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '701c67fa-fb6b-4e3b-809c-31f646417eee'} Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:55:51.085910 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. Oct 11 01:55:51.089897 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:55:51.091224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Returning 404 to user: Instance 701c67fa-fb6b-4e3b-809c-31f646417eee could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:55:51.092149 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-734a7ad2-07ce-43fe-bcef-b9275d436ae5 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee" status: 404 len: 111 microversion: 2.1 time: 0.057988 Oct 11 01:55:51.092721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2911/5776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:55:51 2022] GET /compute/v2.1/servers/701c67fa-fb6b-4e3b-809c-31f646417eee => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:55:51.277589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa5719f5-1502-4f89-ad98-8f68f5a9d5a2 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '.version_select at 0x7f112f55f9d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:55:51.307986 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa5719f5-1502-4f89-ad98-8f68f5a9d5a2 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1931742140" status: 202 len: 0 microversion: 2.1 time: 0.034905 Oct 11 01:55:51.310378 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2866/5777] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 01:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1931742140 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:56:01.953225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d2558b5a-bab6-4318-bc66-dbea90876d99 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: .version_select at 0x7f11387be4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-144955468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCkw1yC29ikeOUx8EZLT5CVc0TvvXWvmm6Y0gSoNo7exHD/RZVA1Szif2Pd85TS4yteStl3QGPsKG8cZ2NzBZvq9GQvi0GPId5xVHX9VJGbf7yir0qE7xQ3Tg913Ea5vQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:01.960408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:01.961102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:01.977301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d2558b5a-bab6-4318-bc66-dbea90876d99 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:56:01.984942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d2558b5a-bab6-4318-bc66-dbea90876d99 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:56:02.016589 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d2558b5a-bab6-4318-bc66-dbea90876d99 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.067916 Oct 11 01:56:02.024446 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2912/5778] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:56:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:03.452460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:03.453686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:03.460906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2032595729", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "d194a371-9405-4759-9ea4-9c4757e1d222"}], "key_name": "tempest-TestNetworkBasicOps-144955468", "security_groups": [{"name": "tempest-secgroup-smoke-1965754420"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:03.608037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] validate_networks() for [('d194a371-9405-4759-9ea4-9c4757e1d222', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:56:04.151388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:56:04.152042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:56:04.152563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:56:04.152983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:56:04.153480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:56:04.164138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:04.165063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:04.165677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:04.166954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:04.167661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:04.168830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:04.192304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:56:04.198689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Getting quotas for user ab5e64b7a6bd428ba6daafa356162eae and project c493ca733d0d493d92e7963c26db4539. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:56:04.214232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:56:04.217804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:56:04.277643 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66bfba12-5cba-4cd6-85ad-ee449a9cf555 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828777 Oct 11 01:56:04.284750 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2867/5779] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:56:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:56:04.291096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54baf9fc-0512-4b64-8ac1-44dfb76ff301 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:04.291597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54baf9fc-0512-4b64-8ac1-44dfb76ff301 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:04.391167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54baf9fc-0512-4b64-8ac1-44dfb76ff301 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:04.403329 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54baf9fc-0512-4b64-8ac1-44dfb76ff301 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1248 microversion: 2.1 time: 0.116538 Oct 11 01:56:04.416440 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2913/5780] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:04 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1248 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:56:05.430392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:05.433437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:05.440815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:05.441324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:05.441798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:05.442635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:05.443098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:05.443588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:05.516736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:05.524517 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec3bd8f6-8acf-4c11-9fcc-ee3600bdce50 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1300 microversion: 2.1 time: 0.100402 Oct 11 01:56:05.525106 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2868/5781] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:05 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:56:06.548423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:06.549043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:06.567949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:06.568772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:06.569419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:06.570333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:06.570955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:06.571576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:06.851899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:06.866772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c134805-d90f-4d64-920a-a5e34c7e40bd tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.318379 Oct 11 01:56:06.868711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2914/5782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:06 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:07.723202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa69f55-5274-43cb-ad0c-cf7139abbed0", "tag": "af6ec7b3-12f6-48ba-8eae-c4e03e7435ce"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:07.738183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:07.738894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:07.740397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:07.765487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] Creating event network-changed:af6ec7b3-12f6-48ba-8eae-c4e03e7435ce for instance faa69f55-5274-43cb-ad0c-cf7139abbed0 on n-h2-772273-9 Oct 11 01:56:07.770971 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e48d150b-0140-483a-8106-9c8e99380e0a req-891abc6e-0552-4981-8e16-671330ae788f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053964 Oct 11 01:56:07.771610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2869/5783] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:07.892337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:07.893039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:07.899836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:07.900415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:07.900913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:07.901678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:07.902201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:07.903241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:08.125366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:08.134150 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ef02a3a3-c915-4d4d-9370-cb6c5d6b593b tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.246883 Oct 11 01:56:08.134931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2915/5784] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:07 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:09.159092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:09.159922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:09.170455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:09.171414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:09.172089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:09.173071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:09.174254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:09.174928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:09.316560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:09.324736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe6a14da-4f9c-40f9-a648-137df3c2b306 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.169934 Oct 11 01:56:09.325457 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2870/5785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:09 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:10.348402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:10.349603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:10.357367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:10.358147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:10.358755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:10.359696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:10.360343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:10.360966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:10.662085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:10.675711 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-400ae758-83c3-42bc-89a5-1235a8f2bdf8 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.330298 Oct 11 01:56:10.676532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2916/5786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:10 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:11.698737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:11.700925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:11.708155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:11.709048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:11.709554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:11.710538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:11.711305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:11.712007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:11.861911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:11.877024 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84de092e-882d-4204-90f6-0e649e2c283c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.182460 Oct 11 01:56:11.883864 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2871/5787] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:11 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:12.910766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:12.912851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:12.924943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:12.926021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:12.926781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:12.928025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:12.929574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:12.930188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:13.162561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:13.172462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4753851-49c4-4e11-a1e8-ec64c100d9b9 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.266142 Oct 11 01:56:13.173234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2917/5788] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:12 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:14.198252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:14.198870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:14.201398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:14.206714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:14.207202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:14.207947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:14.208374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:14.208836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:14.209265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:14.209966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:14.349361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:14.357271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1a527ed-5341-449d-befe-1cff19a88f87 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.163113 Oct 11 01:56:14.357860 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2872/5789] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:14 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:14.923406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa69f55-5274-43cb-ad0c-cf7139abbed0", "name": "network-vif-plugged", "status": "completed", "tag": "af6ec7b3-12f6-48ba-8eae-c4e03e7435ce"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:14.930707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:14.937512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:14.937940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:14.938546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:14.950811 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] Creating event network-vif-plugged:af6ec7b3-12f6-48ba-8eae-c4e03e7435ce for instance faa69f55-5274-43cb-ad0c-cf7139abbed0 on n-h2-772273-9 Oct 11 01:56:14.956214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f48c8724-832b-4d36-b423-513e754d9ecc req-3577eb2a-4124-470e-86a8-6128440d861a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037244 Oct 11 01:56:14.956827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2918/5790] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:15.383866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:15.385061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:15.392904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:15.393627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:15.394249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:15.395136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:15.395637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:15.396240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:15.545565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:15.555328 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ce35769-ee11-4c3f-82fa-1029d98fc9a1 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1374 microversion: 2.1 time: 0.176773 Oct 11 01:56:15.556138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2873/5791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:15 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:16.578798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:16.579586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:16.587152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:16.587667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:16.588219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:16.588913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:16.589571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:16.590680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:16.818460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:16.826575 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6287f07-2e1a-4da9-a900-30a2c3bf2f79 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1546 microversion: 2.1 time: 0.252230 Oct 11 01:56:16.844133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2919/5792] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:16 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:16.850029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:16.851282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:16.859156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:16.859993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:16.860649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:16.861851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:16.862521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:16.863163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:17.113795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:17.122352 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-205d20ce-6f4e-40a0-89fb-a450949d2ef7 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1546 microversion: 2.1 time: 0.276394 Oct 11 01:56:17.131503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2874/5793] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:16 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:19.708365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa69f55-5274-43cb-ad0c-cf7139abbed0", "tag": "af6ec7b3-12f6-48ba-8eae-c4e03e7435ce"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:19.722559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:19.723045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:19.723507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:19.751718 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] Creating event network-changed:af6ec7b3-12f6-48ba-8eae-c4e03e7435ce for instance faa69f55-5274-43cb-ad0c-cf7139abbed0 on n-h2-772273-9 Oct 11 01:56:19.765094 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3f1fbf47-4dc7-4242-b43a-65c33dec2992 req-d7b61e2e-0dfd-4296-a8a0-eb86b8048842 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060336 Oct 11 01:56:19.766633 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2920/5794] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:22.196778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:22.197399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:22.204022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.204511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.204948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.205645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.206100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.206522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.377872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:22.387136 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3947cfe-04fe-4351-823b-d02ce75f466d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.513770 Oct 11 01:56:22.388076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2875/5795] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:21 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:22.414949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:22.415859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:22.422481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.422974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.423443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.424470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.424936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.425366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.571606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:22.581251 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03bfad96-0ec2-42f6-8106-d00a83ce45bd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.171688 Oct 11 01:56:22.582201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2921/5796] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:22.604107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:22.604844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:22.612564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.613180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.613698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.614581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.615045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.615640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.762274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:22.770894 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2410e043-2c3b-4e8f-9e28-f5d6a6b8a137 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.171028 Oct 11 01:56:22.771680 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2876/5797] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:22.792926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:22.793546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:22.800155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.800647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.801084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.801787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:22.802238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:22.802661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:22.947031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:22.957599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c1fb6935-49d4-444d-8f30-b3fbddf8da36 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.168485 Oct 11 01:56:22.958391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2922/5798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:23.099221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1778987846", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "965a3985-e7ee-410f-a1b3-0de185ed76ac"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:23.166271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] validate_networks() for [('965a3985-e7ee-410f-a1b3-0de185ed76ac', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:56:23.686764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:56:23.688518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:56:23.689037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:56:23.689461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:56:23.689884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:56:23.702642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:23.703148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:23.703623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:23.704511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:23.705294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:23.706039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:23.727360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:56:23.733796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:56:23.752924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:56:23.755277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:56:23.808038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1eff2c10-bfb1-4a96-9994-1bd5f9f8a90c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712603 Oct 11 01:56:23.809370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2877/5799] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:56:23.820210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b522e7ff-28cd-469d-a5af-847d9a1c899b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:23.820898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b522e7ff-28cd-469d-a5af-847d9a1c899b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:23.899014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b522e7ff-28cd-469d-a5af-847d9a1c899b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:23.908026 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b522e7ff-28cd-469d-a5af-847d9a1c899b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1215 microversion: 2.1 time: 0.091542 Oct 11 01:56:23.922858 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2923/5800] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:23 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:56:24.934824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:24.936009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:24.943784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:24.944671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:24.945274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:24.946169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:24.946843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:24.947501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:25.028822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:25.037591 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91e98542-ec99-4f66-85c9-1babe93768e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1267 microversion: 2.1 time: 0.109768 Oct 11 01:56:25.039126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2878/5801] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:24 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:26.063837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:26.064752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:26.075029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:26.076145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:26.076968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:26.077974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:26.079070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:26.080193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:26.350030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:26.359329 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-add7e144-cdd0-4ca3-8d46-ed28e8332f5a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.300127 Oct 11 01:56:26.360176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2924/5802] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:26 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:26.775045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7240a0-fd41-4ed0-9bd5-c820fea96fc2", "tag": "5f37f6a1-72f5-4a00-804b-7103cc9987d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:26.806208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:26.806769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:26.807294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:26.824729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] Creating event network-changed:5f37f6a1-72f5-4a00-804b-7103cc9987d3 for instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 on n-h1-772273-9 Oct 11 01:56:26.830157 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-09c0e0e8-6b91-4228-af35-5ebc00b25423 req-31df5073-94a8-471d-8b8c-362416e9513e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060987 Oct 11 01:56:26.831169 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2879/5803] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:27.384737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:27.385391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:27.396927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:27.397437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:27.397898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:27.401067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:27.401539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:27.402517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:27.645886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:27.664880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7955e1cd-39a4-4627-bc0e-9a609f11f52e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.284490 Oct 11 01:56:27.665836 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2925/5804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:27 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:28.688959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:28.689678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:28.696614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:28.697506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:28.698114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:28.699050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:28.699545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:28.700139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:28.961813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:28.975252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dce29365-c0d9-455d-9067-8b3731a40d43 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.289140 Oct 11 01:56:29.000907 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2880/5805] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:28 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:30.014543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:30.015392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:30.023594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:30.024708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:30.025332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:30.026346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:30.026950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:30.028256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:30.186287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:30.194880 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4e9a907-19d8-418d-adef-38cb667beca7 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.184956 Oct 11 01:56:30.196270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2926/5806] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:30 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:31.218870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:31.219558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:31.226639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:31.227222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:31.227791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:31.228566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:31.229101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:31.229607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:31.365452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:31.373486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0e340ea-72f0-46c8-8dd4-7af5b2a27eb2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.159241 Oct 11 01:56:31.374087 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2881/5807] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:31 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:32.345781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7240a0-fd41-4ed0-9bd5-c820fea96fc2", "name": "network-vif-plugged", "status": "completed", "tag": "5f37f6a1-72f5-4a00-804b-7103cc9987d3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:32.354416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:32.361138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:32.361887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:32.362508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:32.367012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=65 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:32.376515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] Creating event network-vif-plugged:5f37f6a1-72f5-4a00-804b-7103cc9987d3 for instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 on n-h1-772273-9 Oct 11 01:56:32.382674 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8807f718-270e-42d9-9149-da228bc3c137 req-1a1c15c9-5553-4702-b566-bb41093a0369 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041153 Oct 11 01:56:32.383292 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2927/5808] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:32.397352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:32.398553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:32.406467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:32.407218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:32.407700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:32.408489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:32.409279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:32.409773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:32.602113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:32.610738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f8becda-3b63-45a1-a7fa-6124609cacfe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1315 microversion: 2.1 time: 0.217950 Oct 11 01:56:32.611694 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2882/5809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:32 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:33.638731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:33.641014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:33.648768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:33.649516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:33.650151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:33.651397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:33.652056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:33.653249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:33.829304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:33.838057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f445929d-21eb-42fb-b798-f2230e886ffb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1502 microversion: 2.1 time: 0.205385 Oct 11 01:56:33.855505 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2928/5810] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:33 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:33.863400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:33.864024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:33.870698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:33.871745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:33.873685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:33.875285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:33.875989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:33.876541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:33.877402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:33.877929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:33.878432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:33.883359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=81 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:34.034497 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Removing security group a306f9cd-06b5-4335-a45c-b13e54f3e6ec from port 5f37f6a1-72f5-4a00-804b-7103cc9987d3 Oct 11 01:56:34.409142 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82981150-068f-4011-8ac3-e07d064cf2e9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2/action" status: 202 len: 0 microversion: 2.1 time: 0.549904 Oct 11 01:56:34.409886 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2883/5811] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:56:33 2022] POST /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:56:34.420382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:34.421189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:34.423495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:34.434605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.435366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.436598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.437769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.438876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.439485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.465574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7240a0-fd41-4ed0-9bd5-c820fea96fc2", "tag": "5f37f6a1-72f5-4a00-804b-7103cc9987d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:34.477304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.478192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.489776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.546267 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] Creating event network-changed:5f37f6a1-72f5-4a00-804b-7103cc9987d3 for instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 on n-h1-772273-9 Oct 11 01:56:34.557378 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3307e1ba-3639-4ef6-8c26-a4ff6ea043b9 req-775f0101-9c21-40be-8546-0cab8e3e1ebc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096622 Oct 11 01:56:34.560521 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2884/5812] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:56:34.573347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:34.582524 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2c90beb-e064-4dc8-b0f9-78f96f7972d2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1460 microversion: 2.1 time: 0.168058 Oct 11 01:56:34.595798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2929/5813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:34 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1460 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:34.607471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:34.608346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:34.615477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.616132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.616941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.617761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.618317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.618861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.825333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:34.834630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9026dc11-1cec-479d-8f90-262596a7d860 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.232231 Oct 11 01:56:34.837776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2885/5814] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:34 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:34.870863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:34.872144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:34.881251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.882534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.883397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:34.884985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:34.885641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:34.886399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:35.127885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:35.136126 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-12f34e11-d270-4c01-a393-5b56ee38e20f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.269661 Oct 11 01:56:35.136893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2930/5815] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:34 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:35.160941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:35.163249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:35.171467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:35.172189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:35.173450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:35.174340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:35.174960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:35.175587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:35.352894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:35.361892 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-806ade05-4bdf-4f43-af08-2ad2cb9e12b5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.204950 Oct 11 01:56:35.363088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2886/5816] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:35 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:35.385335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:35.386205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:35.395420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:35.397287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:35.397913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:35.398786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:35.402334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:35.402955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:35.596890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:35.605515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-380bc0a2-8d41-4d73-9140-5896c7690951 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.224027 Oct 11 01:56:35.606275 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2931/5817] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:35 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:56:35.797006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1293749304", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "965a3985-e7ee-410f-a1b3-0de185ed76ac"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:35.868565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] validate_networks() for [('965a3985-e7ee-410f-a1b3-0de185ed76ac', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:56:36.297987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:56:36.299044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:56:36.299559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:56:36.299971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:56:36.300386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:56:36.310422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:36.311079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:36.311735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:36.312574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:36.313025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:36.313737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:36.331747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:56:36.337022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Getting quotas for user f6b2f03ede2d4d4a8e1d58e8e55cd5cc and project 127eef172d854997921cd989f4db5d22. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:56:36.352992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:56:36.355480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:56:36.413682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68632d4a-2ce2-4938-aa82-952054a4cb8b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620405 Oct 11 01:56:36.414427 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2887/5818] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 01:56:36.427708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2aabd456-fd9e-47f8-b7f2-1210bef63bf8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:36.429281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2aabd456-fd9e-47f8-b7f2-1210bef63bf8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:36.537110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2aabd456-fd9e-47f8-b7f2-1210bef63bf8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:36.548236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2aabd456-fd9e-47f8-b7f2-1210bef63bf8 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1215 microversion: 2.1 time: 0.125283 Oct 11 01:56:36.549379 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2932/5819] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:36 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:37.574961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:37.576280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:37.585793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:37.586542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:37.587143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:37.588068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:37.588696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:37.589158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:37.696632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:37.707926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-996accc4-2a2a-4f4b-9103-b6f1e5c633bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1267 microversion: 2.1 time: 0.137362 Oct 11 01:56:37.709153 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2888/5820] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:37 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:38.737246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:38.737980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:38.752341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:38.755269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:38.755858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:38.758464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:38.759065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:38.760529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:39.079538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:39.089689 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32c296f8-0724-43ac-9862-8be0ee74bcb3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.357081 Oct 11 01:56:39.090391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2933/5821] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:38 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:39.592389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c68301-4d7d-4d45-b8b0-d212d2c95e91", "tag": "6680df89-2f32-4463-a91f-6a8370343567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:39.603318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:39.604046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:39.604687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:39.619122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] Creating event network-changed:6680df89-2f32-4463-a91f-6a8370343567 for instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 on n-h2-772273-9 Oct 11 01:56:39.624957 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6a2e3463-34ea-4330-8e55-289c142bd4e6 req-bfee8c5b-1797-4acf-bc88-c0bd584ea372 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036833 Oct 11 01:56:39.626103 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2889/5822] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:40.114103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:40.114728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:40.125361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:40.125860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:40.126609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:40.130376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:40.131534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:40.132047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:40.286694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:40.298120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-877a5e2d-c260-4904-ace9-4af56fb006ba tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.188571 Oct 11 01:56:40.311699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2934/5823] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:40 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:41.322108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:41.323772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:41.332475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:41.333447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:41.334217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:41.335231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:41.336175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:41.336754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:41.491050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:41.500646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6037dd11-f7fe-4c6d-ac59-dd0ee5a4be3f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.183006 Oct 11 01:56:41.501265 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2890/5824] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:41 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:42.526340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:42.527627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:42.534866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:42.535563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:42.536160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:42.537015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:42.537652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:42.538249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:42.780316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:42.795649 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9143a578-0b60-48c5-8e24-f33b3a673773 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.274441 Oct 11 01:56:42.796241 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2935/5825] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:42 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:43.818492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:43.819764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:43.840752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:43.841254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:43.841791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:43.847536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:43.848315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:43.848902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:44.030223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:44.040230 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15d6404a-3ba2-45bf-819c-6740d608562e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.225721 Oct 11 01:56:44.040974 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2891/5826] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:43 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:45.064460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:45.065677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:45.072977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:45.073698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:45.074301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:45.075186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:45.075840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:45.076611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:45.120780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c68301-4d7d-4d45-b8b0-d212d2c95e91", "name": "network-vif-plugged", "status": "completed", "tag": "6680df89-2f32-4463-a91f-6a8370343567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:45.157346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:45.158089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:45.158692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:45.172571 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] Creating event network-vif-plugged:6680df89-2f32-4463-a91f-6a8370343567 for instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 on n-h2-772273-9 Oct 11 01:56:45.178232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f5242aea-f613-4b0d-b91d-395d0c657244 req-e665869f-f4ab-44d9-b86d-9352c778a93b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061208 Oct 11 01:56:45.179438 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2892/5827] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:56:45.279231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:45.300400 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f0d31f3a-4de9-4f9c-814d-d9a8f4269989 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.239737 Oct 11 01:56:45.301013 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2936/5828] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:45 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:46.326164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:46.331080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:46.331889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:46.340292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:46.340778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:46.341224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:46.341934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:46.342377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:46.342799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:46.346894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:46.475747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:46.484204 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f6cdb2e-a20f-4335-9828-be2964e88aec tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1315 microversion: 2.1 time: 0.159330 Oct 11 01:56:46.484618 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2893/5829] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:46 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:47.508074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:47.509365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:47.513387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:47.517549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.518268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.518779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:47.519590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.520124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.520632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:47.664397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:47.674460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2ac427b-a591-475b-aa34-35544d012490 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1502 microversion: 2.1 time: 0.170576 Oct 11 01:56:47.677001 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2937/5830] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:47 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:47.697038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:47.697622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:47.704996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.705485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.705929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:47.706629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.707085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.707553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:47.777573 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9af1802d-e826-482c-b003-824d5e2bccdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91/action" status: 202 len: 0 microversion: 2.1 time: 0.083645 Oct 11 01:56:47.781374 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2894/5831] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:56:47 2022] POST /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:56:47.791462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:47.792386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:47.799628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.800534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.801288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:47.802237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:47.802668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:47.803329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:48.302305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:48.311175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-20f00468-3a55-45d0-a3e7-82038d8ffc8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1507 microversion: 2.1 time: 0.528507 Oct 11 01:56:48.311791 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2938/5832] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:47 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:49.335129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:49.338076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:49.349984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.350872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.351839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:49.353159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.353788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.354464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:49.555902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:49.564314 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf27c528-fe34-468e-8d35-a03fd956001d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1487 microversion: 2.1 time: 0.234115 Oct 11 01:56:49.565083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2895/5833] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:49 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1487 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:49.586977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:49.588190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:49.596641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.597392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.598009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:49.599110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.599919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.600512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:49.631741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lazy-loading 'flavor' on Instance uuid 57c68301-4d7d-4d45-b8b0-d212d2c95e91 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:56:49.905248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7199944-58ab-43fa-b6bc-a89ed61ce668 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91/action" status: 202 len: 0 microversion: 2.1 time: 0.321928 Oct 11 01:56:49.909461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2939/5834] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:56:49 2022] POST /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:56:49.914432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:49.915058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:49.926274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.928129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.928844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:49.929801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:49.930345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:49.931105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:50.122615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:50.131836 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a936a8a7-e83e-4c9f-a602-b15d879264b1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1493 microversion: 2.1 time: 0.221338 Oct 11 01:56:50.132956 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2896/5835] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:49 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:51.156287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:51.158067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:51.167288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:51.168183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:51.168767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:51.169536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:51.169994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:51.170417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:51.312332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:51.322913 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ebd9d55a-c542-45f5-87ec-5ffaa172e752 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1493 microversion: 2.1 time: 0.171778 Oct 11 01:56:51.324252 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2940/5836] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:51 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1493 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:52.347831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:52.349198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:52.358043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:52.358778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:52.359473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:52.360616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:52.361735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:52.363130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:52.605409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:52.615562 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e55f473-4cd8-4ba8-bf51-df711dc9a580 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1514 microversion: 2.1 time: 0.273244 Oct 11 01:56:52.619148 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2897/5837] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:52 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:53.646050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:53.646677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:53.654704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:53.655361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:53.656506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:53.657410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:53.658296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:53.659454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:53.811296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:53.819456 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f48c224-bc8c-48b4-ac0a-283a231e813a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1514 microversion: 2.1 time: 0.177338 Oct 11 01:56:53.820359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2941/5838] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:53 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:54.181327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:54.183605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:54.190906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:54.191426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:54.191863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:54.192559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:54.193008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:54.193602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:54.256618 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1ddc748-082a-4529-bd9b-03796a3c6b69 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0/action" status: 200 len: 24570 microversion: 2.1 time: 0.077165 Oct 11 01:56:54.257042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2898/5839] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:56:54 2022] POST /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:56:54.843705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:54.844323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:54.862346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:54.862834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:54.863275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:54.863995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:54.864444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:54.864865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:55.046933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:55.062648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-eba10df4-7beb-41b6-b45c-fd6e8f438ee3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1514 microversion: 2.1 time: 0.222803 Oct 11 01:56:55.063276 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2942/5840] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:54 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:55.222212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c68301-4d7d-4d45-b8b0-d212d2c95e91", "name": "network-vif-plugged", "status": "completed", "tag": "6680df89-2f32-4463-a91f-6a8370343567"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:56:55.237370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:55.238212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:55.238910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:55.257331 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] Creating event network-vif-plugged:6680df89-2f32-4463-a91f-6a8370343567 for instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 on n-h2-772273-9 Oct 11 01:56:55.263084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-56581511-a7de-4fbd-82f7-081de344b9c8 req-2c04be64-66c2-40d6-804a-7762d642834f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047764 Oct 11 01:56:55.264335 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2899/5841] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:56:56.093023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:56.093650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:56.102958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:56.103459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:56.103897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:56.105135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:56.105594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:56.106018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:56.123536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:56:56.274124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:56.282841 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3f6ccd8b-9738-43f8-b2b2-29ab61fdcf5b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.200165 Oct 11 01:56:56.283487 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2943/5842] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:56 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:57.394690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:57.395425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:57.404162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:57.404810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:57.411453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:57.414429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:57.415027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:57.416155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:57.703663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:57.714388 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1d3db1e6-aef2-406f-ac67-aff4af60e369 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.325110 Oct 11 01:56:57.716287 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2900/5843] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:57 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:56:58.741754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:56:58.742973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:56:58.751240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:58.751964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:58.752656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:58.753542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:56:58.754154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:56:58.754736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:56:58.985544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:56:58.994044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1253f04b-f03d-4cd1-a198-c9a7fc152789 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.256051 Oct 11 01:56:58.994664 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2944/5844] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:56:58 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:57:00.018084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:00.019507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:00.028176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:00.029473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:00.030175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:00.031252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:00.032116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:00.032799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:00.210333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:00.221689 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bee42ede-1d74-4ab5-b89e-b39f6c5b3d3e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.209031 Oct 11 01:57:00.222517 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2901/5845] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:00 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:01.247006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:01.249138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:01.263911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:01.264834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:01.265440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:01.266458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:01.267076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:01.271008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:01.460782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:01.488508 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c578c1de-7a84-416a-886a-3ce71d1aca8e tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.246193 Oct 11 01:57:01.498467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2945/5846] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:01 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:02.514670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:02.515466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:02.533101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:02.534428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:02.534973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:02.535733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:02.536212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:02.536652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:02.774980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:02.777735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:02.785292 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7059075c-4052-4b45-b2e3-49345123943b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.275651 Oct 11 01:57:02.786210 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2902/5847] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:02 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:03.826466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:03.827749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:03.836105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=40 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:03.838119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:03.840645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:03.841586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:03.842503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:03.843125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:03.843853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:04.036715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:04.052735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4311b0e4-7fa2-4cfa-86eb-2dd25906774d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.231883 Oct 11 01:57:04.053974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2946/5848] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:03 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:05.077664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:05.078896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:05.088121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:05.090885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:05.091590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:05.092205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:05.093302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:05.093923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:05.094511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:05.262981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:05.288047 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ccd477e-95db-4fc0-bc8b-bfa65c23aa4c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.214821 Oct 11 01:57:05.289465 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2903/5849] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:05 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:06.313449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:06.314075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:06.337613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:06.338241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:06.339081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:06.339879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:06.340335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:06.341084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:06.530867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:06.540148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21d879f7-b995-4db5-89f6-383045f6ebdc tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.230960 Oct 11 01:57:06.558200 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2947/5850] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:06 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:07.564172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:07.564881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:07.577891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:07.580327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:07.580802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:07.581530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:07.581997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:07.582429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:07.819261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:07.835415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0fa4caed-4cd8-4c6e-baa0-95fc6248ef6d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.274670 Oct 11 01:57:07.836066 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2904/5851] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:07 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:08.863648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:08.864413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:08.871088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:08.871844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:08.872481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:08.873250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:08.873913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:08.874402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:09.101550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:09.110034 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-16d34cb1-7fee-42af-b7d9-2d76db3b4cce tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1506 microversion: 2.1 time: 0.250597 Oct 11 01:57:09.110631 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2948/5852] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:08 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:10.133681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:10.135669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:10.143569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:10.144062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:10.144506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:10.145211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:10.145670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:10.146139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:10.291706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:10.300165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ab37b52-8662-474f-84be-59be74e417ab tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1506 microversion: 2.1 time: 0.170405 Oct 11 01:57:10.301007 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2905/5853] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:10 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:11.181447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c68301-4d7d-4d45-b8b0-d212d2c95e91", "name": "network-vif-unplugged", "status": "completed", "tag": "6680df89-2f32-4463-a91f-6a8370343567"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:11.208663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.209565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.210260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.238263 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] Creating event network-vif-unplugged:6680df89-2f32-4463-a91f-6a8370343567 for instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 on n-h2-772273-9 Oct 11 01:57:11.244566 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b56da35f-ee1a-4968-b104-50942f7108be req-ec7509f6-09ce-4c54-8034-52175c5d26b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068410 Oct 11 01:57:11.245941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2949/5854] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:11.324692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:11.325980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:11.335226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.338974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.339734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.340623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.341222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.341842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.498681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:11.508918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0746e205-6bbf-49c8-b677-85ff59dc5a73 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 200 len: 1509 microversion: 2.1 time: 0.188411 Oct 11 01:57:11.510697 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2906/5855] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:11 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:11.533558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:11.534364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:11.540747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.542067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.542587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.543300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.543794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.544216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.702823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:11.710827 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e39f8472-f85f-4b77-b4fa-4b0f9d2535f3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.181611 Oct 11 01:57:11.711502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2950/5856] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:11 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:11.739007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:11.740048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:11.747152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.747922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.748896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.749847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.750578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.751194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.905966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:11.914652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79647292-3692-4814-ab4e-5359de98d649 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.180581 Oct 11 01:57:11.915236 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2907/5857] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:11 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:11.936621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:11.937239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:11.943331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.943927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.944365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:11.945059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:11.945511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:11.945937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.093661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:12.103595 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-96c414e2-d900-4f05-a337-cefd925061a2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.170806 Oct 11 01:57:12.105042 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2951/5858] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:11 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:12.127580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:12.128277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:12.134278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:12.134853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:12.135956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.136836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:12.137357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:12.138228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.285881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:12.295722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61b09819-c06c-4de8-9abb-6eaceb483844 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.171871 Oct 11 01:57:12.296313 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2908/5859] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:57:12.318005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:12.324905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:12.325649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:12.326081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.349536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Going to try to stop instance {{(pid=120493) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 01:57:12.394244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51bdced8-13f4-4cdc-a5f9-a1dd2006731c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.079946 Oct 11 01:57:12.398145 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2952/5860] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:57:12 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:12.404728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:12.406126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:12.414036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:12.414619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:12.415256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.416012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:12.417038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:12.417459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:12.576722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:12.584831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aee7c0a4-6f5a-48e6-a817-82d2f09b268c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.184729 Oct 11 01:57:12.585498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2909/5861] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:12 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:13.614382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:13.615686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:13.624107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:13.624634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:13.625047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:13.625884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:13.626483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:13.627094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:13.807440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:13.815424 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bff2af34-570a-4ce3-af77-96e720bcdb53 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.209883 Oct 11 01:57:13.816001 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2953/5862] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:13 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:14.838942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:14.839853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:14.847407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:14.848001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:14.848442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:14.849165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:14.849823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:14.850259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:14.996626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:15.005768 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4e3d465-4700-44d7-aca9-81d122ecd5f5 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.170909 Oct 11 01:57:15.016097 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2910/5863] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:14 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:16.036916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:16.042381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:16.059297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:16.060590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:16.061256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:16.062603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:16.067379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:16.070848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:16.221896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:16.230915 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f499aad3-271b-4523-a5d5-fd045dd25865 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.203995 Oct 11 01:57:16.231787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2954/5864] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:16 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:17.267209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:17.434137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:17.442545 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c884d19c-c233-422f-a547-eb87bc5ae246 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.191774 Oct 11 01:57:17.443456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2911/5865] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:17 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:18.466793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:18.467996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:18.474722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:18.475216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:18.475688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:18.476395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:18.476857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:18.477286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:18.909578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:18.926578 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1cd5e9f7-e393-4dde-8964-132d8f68f644 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.463766 Oct 11 01:57:18.936053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2955/5866] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:18 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:19.950848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:19.951506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:19.958441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:19.958933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:19.959404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:19.960104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:19.960566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:19.960999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:20.102509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:20.110542 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59e1ad31-496f-4a89-87b8-a78e12df1b4b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.164105 Oct 11 01:57:20.111672 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2912/5867] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:19 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:21.134140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:21.134737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:21.144507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:21.145164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:21.145578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:21.158582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:21.159202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:21.160869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:21.162289 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 01:57:21.164259 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 01:57:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a (ip 10.222.0.66) !!! Oct 11 01:57:21.381859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:21.390595 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-467ab5be-9d54-4ecf-a976-eea2fd9678cd tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.260275 Oct 11 01:57:21.391199 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2956/5868] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:21 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:22.414247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:22.415294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:22.424109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:22.424695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:22.425387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:22.426185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:22.426739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:22.427244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:22.583494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:22.593380 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7e14455-7d92-4d4e-9020-cf801aba7090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1678 microversion: 2.1 time: 0.182970 Oct 11 01:57:22.595528 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2913/5869] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:22 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:23.617726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:23.619538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:23.629110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:23.629933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:23.630258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:23.631086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:23.631677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:23.632363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:23.785165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:23.793505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f92d91b0-5d04-44d5-a531-49b656f6d4a9 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1655 microversion: 2.1 time: 0.179735 Oct 11 01:57:23.795393 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2957/5870] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:23 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:23.817104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:23.825526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:23.826279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:23.826812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:23.855931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 01:57:23.902457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-048b890e-1424-4169-bf19-d5db1d03a2bb tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.089507 Oct 11 01:57:23.903376 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2914/5871] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:57:23 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:23.911749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:23.912600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:23.919501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:23.920654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:23.921235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:23.922154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:23.922894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:23.923500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:24.164877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:24.173998 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd97ad6b-0dd4-47e0-a425-f4e769bbc57d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1664 microversion: 2.1 time: 0.266322 Oct 11 01:57:24.180132 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2958/5872] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:23 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1664 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:25.204293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:25.205164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:25.213826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:25.214715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:25.215256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:25.216475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:25.216934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:25.217359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:25.417947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:25.426616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e307ca8-ead4-4dbc-9468-16a3f0ca5a7f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1664 microversion: 2.1 time: 0.227862 Oct 11 01:57:25.427412 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2915/5873] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:25 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:26.454855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:26.456170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:26.464847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.465719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.466366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:26.467717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.468448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.469511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:26.476359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:26.639880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:26.648015 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-933aabf2-c05c-49aa-b3ae-a5b9ca87077a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.197386 Oct 11 01:57:26.649046 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2959/5874] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:26 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:26.675134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:26.675915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:26.684583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.685120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.685736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:26.686713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.687232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.687654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:26.847296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:26.857019 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88562256-ec34-4b8e-873a-9edd90dc75fe tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.189360 Oct 11 01:57:26.857844 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2916/5875] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:26 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:26.883473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:26.884097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:26.890190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.890684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.891196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:26.891938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:26.892400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:26.892851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.055815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:27.065515 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08b1fd0a-c652-4d8f-b5be-997cd74a9389 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.186036 Oct 11 01:57:27.066800 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2960/5876] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:26 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:27.096458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:27.097815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:27.106602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.107577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.108207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.109096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.109714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.110487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.292183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:27.301498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48d56047-66f7-4c9a-95f6-07cd73995d2d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.212172 Oct 11 01:57:27.302404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2917/5877] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:27 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:27.326787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:27.327552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:27.333944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.334437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.335065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.335794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.336415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.336841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.503487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:27.518205 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ea783b5-380f-4ceb-883b-df003b48f21b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.195741 Oct 11 01:57:27.519796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2961/5878] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:27 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:27.541641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:27.542175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:27.548115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.548817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.549421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.550577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.551042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.551575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.569007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:27.580806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lazy-loading 'flavor' on Instance uuid ff1937c8-4cae-4a43-8703-505e052a596a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:57:27.662776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1b3ad16-d4b3-4b71-8435-0b910cfd6203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.125162 Oct 11 01:57:27.667044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2918/5879] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:57:27 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:27.672944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:27.673549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:27.698727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.699298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.699808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.700551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:27.701063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:27.701511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:27.857911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:27.868010 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c62dc7b-1234-43cf-bf86-bb5be5cefa87 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1676 microversion: 2.1 time: 0.199194 Oct 11 01:57:27.868730 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2962/5880] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:27 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:28.897130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:28.897130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:28.906382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:28.907156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:28.907805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:28.908734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:28.909347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:28.909938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:29.075553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:29.086071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a994a0e5-faad-417f-ade5-a336395c02be tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1659 microversion: 2.1 time: 0.196511 Oct 11 01:57:29.099997 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2919/5881] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:28 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1659 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:29.113700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:29.114329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:29.124627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:29.125132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:29.125576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:29.126477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:29.127048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:29.127371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:29.255602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de04f28f-da8f-4c85-850b-6458879c9090 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action" status: 202 len: 0 microversion: 2.1 time: 0.143994 Oct 11 01:57:29.257331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2963/5882] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:57:29 2022] POST /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:29.265953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:29.266606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:29.273885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:29.289469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:29.290008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:29.291899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:29.292586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:29.293650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:29.660204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:29.669524 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec605745-7917-43c7-8a6b-8e6eb5cf122d tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1665 microversion: 2.1 time: 0.408362 Oct 11 01:57:29.679969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2920/5883] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:29 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1665 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:30.703399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:30.704127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:30.724911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:30.725867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:30.726316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:30.731991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:30.732631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:30.733283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:30.953855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:30.963843 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24505401-436d-466c-8aed-990fcd93e203 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1665 microversion: 2.1 time: 0.265914 Oct 11 01:57:30.964220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2964/5884] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:30 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1665 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:31.987332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:31.988574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:31.996455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:31.996961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:31.997436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:31.998163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:31.998623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:31.999055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:32.145620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:32.155793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07c57580-d348-4e89-b95c-e78a50c8a64f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.172091 Oct 11 01:57:32.155931 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2921/5885] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:31 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:32.178858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:32.179593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:32.187496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:32.188063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:32.188661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:32.189502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:32.190052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:32.190543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:32.337416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:32.346188 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-68d13115-2ff7-455d-a900-b6e3dff5f3b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1668 microversion: 2.1 time: 0.172166 Oct 11 01:57:32.346947 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2965/5886] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:32 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:32.379180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:32.380101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:32.393350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:32.394252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:32.396063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:32.398367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:32.402813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:32.403464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:32.437469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:32.444415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Working on deleting snapshot 5429ff3a-5903-4ad4-839f-feb219e2b13c from shelved instance... Oct 11 01:57:33.124762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:33.127381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:33.133781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:33.134279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:33.134754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:33.135495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:33.136137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:33.136572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:33.139572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Doing local delete in cell 74b16a17-e49d-48bd-a8bb-b10dbf3ef543(cell1) {{(pid=120494) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 01:57:33.140758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:33.141332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:33.141820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:33.142804 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 01:57:33.147682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] deallocate_for_instance() {{(pid=120494) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 01:57:33.198697 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fad3402f-2e0f-4632-8539-71b56200516c tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "POST /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0/action" status: 200 len: 32639 microversion: 2.1 time: 0.077586 Oct 11 01:57:33.199391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2966/5887] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:57:33 2022] POST /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0/action => generated 32639 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 01:57:33.833372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Updating instance_info_cache with network_info: [] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 01:57:33.856923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c68301-4d7d-4d45-b8b0-d212d2c95e91", "name": "network-vif-deleted", "tag": "6680df89-2f32-4463-a91f-6a8370343567"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:33.868218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=42 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:33.897972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:33.898520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:33.898870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:33.929216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.compute.server_external_events [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] Unable to find a host for instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91. Dropping event network-vif-deleted {{(pid=120493) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 01:57:33.932670 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1b4c794c-645a-4d2d-b90e-4cb557374ed5 req-8a88a3d6-c163-4dc6-b846-93be2506f7cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.081184 Oct 11 01:57:33.936173 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2967/5888] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 01:57:34.127980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2311bde-ba44-4874-9c7b-3f4b10e6311f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 204 len: 0 microversion: 2.1 time: 1.755319 Oct 11 01:57:34.129679 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2922/5889] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:32 2022] DELETE /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 0 bytes in 1759 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:57:34.138069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:34.138866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 57c68301-4d7d-4d45-b8b0-d212d2c95e91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:34.148232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.148873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.149366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.151033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.151836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.152346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.167648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 HTTP/1.1 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '57c68301-4d7d-4d45-b8b0-d212d2c95e91'} Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:34.169570 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. Oct 11 01:57:34.174530 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:34.179950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 404 to user: Instance 57c68301-4d7d-4d45-b8b0-d212d2c95e91 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:34.182252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8713d98a-cecd-495a-b5de-7272516d8b14 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91" status: 404 len: 111 microversion: 2.1 time: 0.047965 Oct 11 01:57:34.183466 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2968/5890] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:34 2022] GET /compute/v2.1/servers/57c68301-4d7d-4d45-b8b0-d212d2c95e91 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:57:34.192203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:34.193959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:34.202660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.203418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.204021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.204851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.205420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.206657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.242703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:34.346925 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d21a04ff-bb0c-4c8f-8abb-c47a639df353 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 204 len: 0 microversion: 2.1 time: 0.159122 Oct 11 01:57:34.348532 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2923/5891] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:34 2022] DELETE /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:57:34.357345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:34.357962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.379249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.522081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:34.530601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7dd13113-83e4-45d7-9070-f24291e16968 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1466 microversion: 2.1 time: 0.177588 Oct 11 01:57:34.532472 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2969/5892] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:34 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1466 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:34.982686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa69f55-5274-43cb-ad0c-cf7139abbed0", "tag": "af6ec7b3-12f6-48ba-8eae-c4e03e7435ce"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:34.983645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:34.984237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:34.995700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.996472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.997228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:34.998208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.998842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.999067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:34.999578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:34.999933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.000057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.013236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] Creating event network-changed:af6ec7b3-12f6-48ba-8eae-c4e03e7435ce for instance faa69f55-5274-43cb-ad0c-cf7139abbed0 on n-h2-772273-9 Oct 11 01:57:35.018661 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b0d4b136-19df-4a83-955d-318842db8eff req-e12c6628-fcb4-443a-b77b-507058afb2b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042309 Oct 11 01:57:35.020149 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2970/5893] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:35.056279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:35.127468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:35.167585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:35.185807 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36781c7d-8f4a-456a-9210-e2f6a3be0784 tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 204 len: 0 microversion: 2.1 time: 0.212046 Oct 11 01:57:35.187450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2924/5894] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:34 2022] DELETE /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:57:35.196841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:35.197643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:35.205686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:35.207615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:35.208528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.209338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:35.209816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:35.210460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.411076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:35.421867 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ba2e526d-6980-4201-be4f-f6e92820e12d tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1670 microversion: 2.1 time: 0.229784 Oct 11 01:57:35.422574 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2971/5895] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:35 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1670 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:35.556100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:35.557521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:35.568379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:35.572229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:35.573275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.574356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:35.576838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:35.577360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:35.710294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:35.719831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e22c425e-2341-44cb-a481-9baaabac2980 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1466 microversion: 2.1 time: 0.167910 Oct 11 01:57:35.721126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2925/5896] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:35 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:36.446622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:36.447932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:36.455374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:36.456138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:36.456819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:36.457745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:36.458615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:36.459771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:36.746571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:36.748892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:36.764142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:36.768661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:36.769320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:36.770227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:36.776939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:36.777643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:37.016763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:37.032286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f55da675-3c38-4712-9936-7f05ae14f991 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1466 microversion: 2.1 time: 0.292764 Oct 11 01:57:37.034854 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2926/5897] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:36 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:37.129910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5e64b7a6bd428ba6daafa356162eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c493ca733d0d493d92e7963c26db4539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:37.150154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32792cc8-1c15-476a-93a2-064536615ddc tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 200 len: 1670 microversion: 2.1 time: 0.707928 Oct 11 01:57:37.152199 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2972/5898] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:36 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 1670 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:37.355443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7240a0-fd41-4ed0-9bd5-c820fea96fc2", "name": "network-vif-deleted", "tag": "5f37f6a1-72f5-4a00-804b-7103cc9987d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:37.389138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:37.390160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:37.392376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:37.441477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] Creating event network-vif-deleted:5f37f6a1-72f5-4a00-804b-7103cc9987d3 for instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 on n-h1-772273-9 Oct 11 01:57:37.447912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0e1bcadf-7763-443e-902f-e28dc24b44d6 req-6f9e1e46-4930-4ac9-8716-4ead27ce3777 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097172 Oct 11 01:57:37.455009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2927/5899] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:37.478184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa69f55-5274-43cb-ad0c-cf7139abbed0", "name": "network-vif-deleted", "tag": "af6ec7b3-12f6-48ba-8eae-c4e03e7435ce"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:37.502562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:37.504092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:37.505221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:37.539108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] Creating event network-vif-deleted:af6ec7b3-12f6-48ba-8eae-c4e03e7435ce for instance faa69f55-5274-43cb-ad0c-cf7139abbed0 on n-h2-772273-9 Oct 11 01:57:37.554561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-46b38498-7ce7-4ca0-b90c-3c2eecceaf04 req-93d7f9dd-6aa2-433d-a252-3200fb776c19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079513 Oct 11 01:57:37.559982 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2973/5900] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:38.063750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:38.066515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:38.094754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:38.095845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:38.097742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:38.100430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:38.101703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:38.104999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:38.178509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:38.179364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] [instance: faa69f55-5274-43cb-ad0c-cf7139abbed0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:38.193973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:38.194209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:38.194494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:38.196101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:38.196570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lazy-loading 'fault' on Instance uuid fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:57:38.198915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:38.199850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:38.201652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:38.206249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:38.207193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:38.238895 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] HTTP exception thrown: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Request method failure captured: Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 HTTP/1.1 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMyfNp8HhBz5L-f1nfZwfusqhacbUxCOxZF1adD-YSWucQscd8WyHx7tKUc_Z3Mainb_DL88kfuLb8C2vymnE2tSsxd-OT9cucxX50GaVBZJFlIkobGEcYRWDL_R5adOSfobrLjQE2yuQBbyzXvg_fiKcfOprfVxlQijnG4OvFy0_Yo Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c493ca733d0d493d92e7963c26db4539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c493ca733d0d493d92e7963c26db4539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: c493ca733d0d493d92e7963c26db4539 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkBasicOps-1552647844 Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: ab5e64b7a6bd428ba6daafa356162eae Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkBasicOps-1552647844-project Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'faa69f55-5274-43cb-ad0c-cf7139abbed0'} Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:38.240687 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Returning 404 to user: Instance faa69f55-5274-43cb-ad0c-cf7139abbed0 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c66b447b-5ec1-497a-844d-b32f755667eb tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0" status: 404 len: 111 microversion: 2.1 time: 0.069403 Oct 11 01:57:38.245711 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2974/5901] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:38 2022] GET /compute/v2.1/servers/faa69f55-5274-43cb-ad0c-cf7139abbed0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:57:38.268225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:38.275539 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-722d4ea6-a1c4-4715-84a8-4e2e86f56799 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 200 len: 1305 microversion: 2.1 time: 0.217399 Oct 11 01:57:38.276056 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2928/5902] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:38 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 1305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:38.438075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65301d55-77f3-443e-9388-d9ccf40f519e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] Calling method '.version_select at 0x7f112ed264c0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:38.460115 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65301d55-77f3-443e-9388-d9ccf40f519e tempest-TestNetworkBasicOps-1552647844 tempest-TestNetworkBasicOps-1552647844-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-144955468" status: 202 len: 0 microversion: 2.1 time: 0.025712 Oct 11 01:57:38.460798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2975/5903] 10.222.0.66 () {58 vars in 1254 bytes} [Tue Oct 11 01:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-144955468 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:39.300474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:39.301179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe7240a0-fd41-4ed0-9bd5-c820fea96fc2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:39.310227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.312700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.313326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.316181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.316654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.317091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.334952 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 HTTP/1.1 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'fe7240a0-fd41-4ed0-9bd5-c820fea96fc2'} Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:39.336958 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. Oct 11 01:57:39.341347 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:39.344326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 404 to user: Instance fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:39.345221 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b77f047f-4a62-4b66-99ee-273d22fc174f tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2" status: 404 len: 111 microversion: 2.1 time: 0.049604 Oct 11 01:57:39.348064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2929/5904] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:39 2022] GET /compute/v2.1/servers/fe7240a0-fd41-4ed0-9bd5-c820fea96fc2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:57:39.361695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:39.362251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:39.389633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.390150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.391803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.397064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.402065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.403208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.506449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:39.685339 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28ce9ed0-5355-454a-a7e7-c2f3f1ae221c tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 204 len: 0 microversion: 2.1 time: 0.332544 Oct 11 01:57:39.686048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2976/5905] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:39 2022] DELETE /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:57:39.694137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:39.695033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:39.708486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.709199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.709804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.710695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:39.711328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:39.711967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:39.935846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:39.944433 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b148183d-cb0e-43e3-83d0-933f5cb3a1f6 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1509 microversion: 2.1 time: 0.254138 Oct 11 01:57:39.945676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2930/5906] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:39 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:40.972138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:40.999495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:41.021324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:41.021833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:41.022279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:41.023001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:41.040554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:41.041190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:41.745534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:41.748008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:57:41.758039 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1668df3-ebe9-4303-bce8-145648276297 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1509 microversion: 2.1 time: 0.791576 Oct 11 01:57:41.772169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2977/5907] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:40 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1509 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:42.397803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8eab78-57fc-4af8-b540-401af0633e2b", "name": "network-vif-deleted", "tag": "79cfa346-cc3b-42dd-9444-fd9133108ea9"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:42.469124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:42.473369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:42.475041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:42.531559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] Creating event network-vif-deleted:79cfa346-cc3b-42dd-9444-fd9133108ea9 for instance fe8eab78-57fc-4af8-b540-401af0633e2b on n-h1-772273-9 Oct 11 01:57:42.553668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-aa27eb90-29f9-4144-8adc-537d5a636d39 req-814f150e-62fb-4cba-ab83-b2fd37886fc6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160318 Oct 11 01:57:42.555877 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2931/5908] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:42.803090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:42.804356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:42.828166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:42.828935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:42.832408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:42.834716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:42.841029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:42.842378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:42.972610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:42.973322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:42.973941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:42.974826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lazy-loading 'fault' on Instance uuid fe8eab78-57fc-4af8-b540-401af0633e2b {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:57:43.055191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:43.104856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a37ad309-4cf9-436a-a2a6-db20e5fa8a7a tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 200 len: 1305 microversion: 2.1 time: 0.307469 Oct 11 01:57:43.105959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2978/5909] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:42 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 1305 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:44.133948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:44.135444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: fe8eab78-57fc-4af8-b540-401af0633e2b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:44.143933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.144844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.145512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:44.146728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.147767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.149267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:44.167599 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b HTTP/1.1 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'fe8eab78-57fc-4af8-b540-401af0633e2b'} Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:44.170060 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. Oct 11 01:57:44.174772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:57:44.176653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 404 to user: Instance fe8eab78-57fc-4af8-b540-401af0633e2b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:44.177668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f18c820d-aa62-4ac9-b382-9e051f3bf8c3 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b" status: 404 len: 111 microversion: 2.1 time: 0.051511 Oct 11 01:57:44.185600 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2932/5910] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:44 2022] GET /compute/v2.1/servers/fe8eab78-57fc-4af8-b540-401af0633e2b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:57:44.190824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:44.191416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:44.201314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.201835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.202360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:44.203136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.203699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.204182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:44.236642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:44.345938 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a23d429-0bc6-4249-a36f-d001d1c925b2 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 204 len: 0 microversion: 2.1 time: 0.159158 Oct 11 01:57:44.350358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2979/5911] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:44 2022] DELETE /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:57:44.357726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:44.360420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:44.369895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.370415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.370892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:44.371627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:44.372077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:44.372638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:45.014549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:45.038086 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9361e400-daff-41ce-a9a1-ecc6c25fbbef tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1496 microversion: 2.1 time: 0.685830 Oct 11 01:57:45.039393 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2933/5912] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:44 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1496 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:46.064315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:46.065024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:46.071549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:46.072305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:46.073039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:46.073945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:46.074658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:46.075614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:46.324491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:46.357085 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b807403d-6550-4f70-80ac-6735ccd53360 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1496 microversion: 2.1 time: 0.297916 Oct 11 01:57:46.367488 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2980/5913] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:46 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1496 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:46.997727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a242ed5-9ef0-420a-9674-4532ebdaff91", "name": "network-vif-deleted", "tag": "c2f8cb4e-17b5-45a8-821d-fc65e4308558"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:47.011962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:47.012989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:47.013649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:47.029967 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] Creating event network-vif-deleted:c2f8cb4e-17b5-45a8-821d-fc65e4308558 for instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 on n-h2-772273-9 Oct 11 01:57:47.063106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-9d97d037-2a8d-47db-80c4-b84091fd1095 req-0cf25987-6449-4e02-b6c3-ec155a3020ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068590 Oct 11 01:57:47.064545 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2934/5914] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:47.391768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:47.392515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:47.410418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:47.410918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:47.411384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:47.414816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:47.417300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:47.418975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:47.475171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:47.485381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:47.488507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:47.491147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lazy-loading 'fault' on Instance uuid 9a242ed5-9ef0-420a-9674-4532ebdaff91 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:57:47.568408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:47.585334 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0774bf5d-9ffc-4d88-9439-b1d74f49a123 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 200 len: 1305 microversion: 2.1 time: 0.201026 Oct 11 01:57:47.588692 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2981/5915] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:47 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 1305 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:48.069186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e415535-443d-4125-b211-6a086309c892 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Action: 'create', calling method: .version_select at 0x7f112f3134c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1705181336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1h3Xu1eJXui7sH7CGeuI0ycKJnQgqsN1mtXzmPQBahQNNx/3GiilAMZ6VYKArCTRAuh3Xw/i0Azg7aIGC/Lc+DSqRICNl0SgUkgfpJ8kSVyBJV/1dkkd/peG6m1as23A=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:48.084992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6e415535-443d-4125-b211-6a086309c892 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for project c8e51a0243084cb1b771a02f3542bfea. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:57:48.090738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6e415535-443d-4125-b211-6a086309c892 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for user 2646444ae86f40a69d1cc7c156cc653b and project c8e51a0243084cb1b771a02f3542bfea. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:57:48.114396 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e415535-443d-4125-b211-6a086309c892 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.215562 Oct 11 01:57:48.115131 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2935/5916] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 01:57:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:57:48.614387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:48.615001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: 9a242ed5-9ef0-420a-9674-4532ebdaff91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:48.628552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.629056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.629498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:48.637404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.637892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.638332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:48.665029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 HTTP/1.1 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9a242ed5-9ef0-420a-9674-4532ebdaff91'} Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:48.674370 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 404 to user: Instance 9a242ed5-9ef0-420a-9674-4532ebdaff91 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-167c348f-5593-4b6c-ad31-7f3c35a453e1 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91" status: 404 len: 111 microversion: 2.1 time: 0.066297 Oct 11 01:57:48.678525 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2982/5917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:48 2022] GET /compute/v2.1/servers/9a242ed5-9ef0-420a-9674-4532ebdaff91 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:57:48.685516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:48.686448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:48.693689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.694412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.695068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:48.696120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.696845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.697501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:48.738666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:57:48.919055 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91aa47e1-a75c-4562-8587-1c245af05d7b tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 204 len: 0 microversion: 2.1 time: 0.237464 Oct 11 01:57:48.920226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2936/5918] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:57:48 2022] DELETE /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:57:48.931416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:48.932587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:48.941131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.942378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.943190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:48.944588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:48.945296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:48.947088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:49.140163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:49.162761 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b085e2e-eac9-4aec-8875-22f636297199 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1674 microversion: 2.1 time: 0.238437 Oct 11 01:57:49.163749 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2983/5919] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:48 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:50.187611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:50.189129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:50.197384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:50.198163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:50.198832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:50.199910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:50.200537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:50.201131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:50.357887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:50.371313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2be6183c-04fc-434c-9b2e-c31a5418a571 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1674 microversion: 2.1 time: 0.188282 Oct 11 01:57:50.384601 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2937/5920] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:50 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:51.394348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:51.394905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:51.404594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:51.406153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:51.406810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:51.407767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:51.408468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:51.409387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:51.575046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b2f03ede2d4d4a8e1d58e8e55cd5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127eef172d854997921cd989f4db5d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:51.594299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7cce8c67-a910-42bf-b525-7affe61e26ac tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 200 len: 1608 microversion: 2.1 time: 0.200665 Oct 11 01:57:51.609626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2984/5921] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:51 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 1608 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:51.863301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1937c8-4cae-4a43-8703-505e052a596a", "name": "network-vif-deleted", "tag": "ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:51.907274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:51.934552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:51.935518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:51.958708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] Creating event network-vif-deleted:ca1a6ab1-798d-47fd-b6ed-35ad2990f6a5 for instance ff1937c8-4cae-4a43-8703-505e052a596a on n-h1-772273-9 Oct 11 01:57:51.967961 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8091bf79-aae8-474e-b2f4-d0415992932b req-af051503-7f9e-4a49-84a7-46cbb47de543 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108363 Oct 11 01:57:51.969469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2938/5922] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:57:52.621994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:52.622585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] [instance: ff1937c8-4cae-4a43-8703-505e052a596a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:52.636046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:52.638727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:52.639203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:52.640204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:52.641847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:52.643729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:52.674564 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] HTTP exception thrown: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Request method failure captured: Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a HTTP/1.1 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRMwD1ojPcSqWB52aLaCr2tOmbPBCEaJsxKLEeIWU4B3ALMbDLg5FQw_ihCJV3rVHZdvlf35QYHabM-VUF3XuXAP9xC7p1Yg2m6QIBBin875-7MC7aQZ3P3nIIHfJ-G-CYvTMmm5G7_dgru26Il3VQxFtnc1yCWiDoGDq65jstvGsQGo Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/127eef172d854997921cd989f4db5d22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_127eef172d854997921cd989f4db5d22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/127eef172d854997921cd989f4db5d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 127eef172d854997921cd989f4db5d22 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-917231504 Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f6b2f03ede2d4d4a8e1d58e8e55cd5cc Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-917231504-project Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ff1937c8-4cae-4a43-8703-505e052a596a'} Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:57:52.681784 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:57:52.686561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Returning 404 to user: Instance ff1937c8-4cae-4a43-8703-505e052a596a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:57:52.687410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41475e37-ed43-4acf-a50e-f47ff52d1494 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a" status: 404 len: 111 microversion: 2.1 time: 0.070417 Oct 11 01:57:52.688219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2985/5923] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:52 2022] GET /compute/v2.1/servers/ff1937c8-4cae-4a43-8703-505e052a596a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:57:52.698556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e68284c-71d2-4a9f-ac3d-1b8ffad14c76 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] Calling method '.version_select at 0x7f11342bc310>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:52.765849 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e68284c-71d2-4a9f-ac3d-1b8ffad14c76 tempest-ServerActionsTestJSON-917231504 tempest-ServerActionsTestJSON-917231504-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115940454" status: 202 len: 0 microversion: 2.1 time: 0.072821 Oct 11 01:57:52.766464 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2939/5924] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 01:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115940454 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:57:55.907867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1262425558-access_point-315871736", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "3aff71af-1a94-48a0-a39e-c92ce8ba2776"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1705181336", "security_groups": [{"name": "tempest-secgroup_access--1299880056"}, {"name": "tempest-secgroup_general--1088130251"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:57:56.234087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] validate_networks() for [('3aff71af-1a94-48a0-a39e-c92ce8ba2776', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:57:57.050618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:57:57.051182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:57:57.051578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:57:57.051992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:57:57.052406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:57:57.062307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:57.062991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:57.063618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:57.064403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:57.064865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:57.065294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:57.093180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for project c8e51a0243084cb1b771a02f3542bfea. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:57:57.099634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for user 2646444ae86f40a69d1cc7c156cc653b and project c8e51a0243084cb1b771a02f3542bfea. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:57:57.113351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:57:57.115478 n-d-772273-9 devstack@n-api.service[120493]: WARNING nova.utils [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1262425558-access_point-315871736 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1262425558-ac Oct 11 01:57:57.116251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:57:57.186673 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9f51058-cd77-45fb-aa68-eb83aba4c984 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.282593 Oct 11 01:57:57.195293 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2986/5925] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:57:55 2022] POST /compute/v2.1/servers => generated 458 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:57:57.204547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7e44dc9-e173-43d1-8314-a5d8ad6e2db3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:57.205296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7e44dc9-e173-43d1-8314-a5d8ad6e2db3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:57.305866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7e44dc9-e173-43d1-8314-a5d8ad6e2db3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:57.320551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7e44dc9-e173-43d1-8314-a5d8ad6e2db3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1294 microversion: 2.1 time: 0.120138 Oct 11 01:57:57.321174 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2940/5926] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:57 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:58.349316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:58.349929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:58.362911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:58.363444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:58.363888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:58.364608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:58.365060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:58.365667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:58.479246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:58.489237 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-953c6385-af4c-49db-b6b5-cf5a595d0e13 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1346 microversion: 2.1 time: 0.145456 Oct 11 01:57:58.504364 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2987/5927] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:58 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:57:59.522017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:57:59.523229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:57:59.573302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:59.580436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:59.580898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:59.587673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:57:59.588201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:57:59.588657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:57:59.768774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:57:59.784014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3612505a-c641-4065-bfd4-4b7f793556a1 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1352 microversion: 2.1 time: 0.273208 Oct 11 01:57:59.795721 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2941/5928] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:57:59 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1352 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:00.811185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:00.812377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:00.824408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:00.825302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:00.825894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:00.826806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:00.827444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:00.828022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:01.007471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d6f988-9a4a-49ae-b0af-a5a85cbd266a", "tag": "004a12be-47e3-4845-9dd6-afefbccb3df4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:01.041856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:01.042339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:01.042778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:01.062953 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] Creating event network-changed:004a12be-47e3-4845-9dd6-afefbccb3df4 for instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a on n-h2-772273-9 Oct 11 01:58:01.068437 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fee176ae-d703-48c2-a9a9-4c0e805d406d req-1c6b927a-7f8a-428b-8254-c961d7c7bfdf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065290 Oct 11 01:58:01.070439 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2942/5929] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:01.101016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:01.112887 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf8ff98c-a5c7-4094-b301-9414d810b168 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.308065 Oct 11 01:58:01.114074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2988/5930] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:00 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:02.138923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:02.139841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:02.147433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:02.148270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:02.148873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:02.150445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:02.151546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:02.152039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:02.325988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:02.333744 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7fea470-651d-49b9-8fac-59b4ac3a71ff tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.199785 Oct 11 01:58:02.334973 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2943/5931] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:02 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:03.359035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:03.359949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:03.368132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:03.368813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:03.369357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:03.370158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:03.370721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:03.371251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:03.540458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:03.548962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bea74e10-d4a7-493e-a76c-add6a1801745 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.193996 Oct 11 01:58:03.549675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2989/5932] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:03 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:04.572338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:04.573630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:04.581410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:04.582208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:04.582819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:04.583769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:04.584424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:04.585023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:04.753862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:04.763347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1319294f-c387-4bb7-bd0a-f09af8f7e36b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.195438 Oct 11 01:58:04.764010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2944/5933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:04 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:05.791078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:05.792472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:05.801350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:05.804114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:05.807541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:05.807541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:05.807541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:05.807541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:05.808271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:06.123083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:06.132003 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ff3f1f0f-1c04-4669-8c52-0b602b707ee7 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.347075 Oct 11 01:58:06.151375 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2990/5934] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:05 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:06.597616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1624178106", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:06.635051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:06.677452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] validate_networks() for [('854dcf1e-c356-45e0-8f1b-bac46e10fa9d', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:58:07.135435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:58:07.135869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:58:07.136348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:58:07.136761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:58:07.137177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:58:07.150435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:07.151980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:07.152625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:07.154591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:07.155085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:07.155563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:07.169404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:07.197677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:07.198534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:07.205308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Getting quotas for project 6890a0e4d4234538a6f3a6cfc357af37. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:58:07.209043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:07.214262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:07.218940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:07.220305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:07.222289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:07.223370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:07.224743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:07.225285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Getting quotas for user e491a4967382439fbb77b3cf924c37a3 and project 6890a0e4d4234538a6f3a6cfc357af37. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:58:07.226300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:07.260758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:58:07.263256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:58:07.334699 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3addb6f4-f962-43d6-980f-67bddaf32fe3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.917185 Oct 11 01:58:07.336671 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2945/5935] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:58:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:58:07.348649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfe9398d-52c4-4c9a-8f2d-5e6aa965e4a0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:07.349715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfe9398d-52c4-4c9a-8f2d-5e6aa965e4a0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:07.493275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dfe9398d-52c4-4c9a-8f2d-5e6aa965e4a0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:07.523131 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dfe9398d-52c4-4c9a-8f2d-5e6aa965e4a0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1214 microversion: 2.1 time: 0.178594 Oct 11 01:58:07.526375 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2946/5936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:07 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:07.544105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d6f988-9a4a-49ae-b0af-a5a85cbd266a", "name": "network-vif-plugged", "status": "completed", "tag": "004a12be-47e3-4845-9dd6-afefbccb3df4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:07.581013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:07.583971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:07.586027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:07.586727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:07.605351 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] Creating event network-vif-plugged:004a12be-47e3-4845-9dd6-afefbccb3df4 for instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a on n-h2-772273-9 Oct 11 01:58:07.605778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63d6e6d3-7488-44e0-8f93-b28d966fdb58 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.422162 Oct 11 01:58:07.606073 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2991/5937] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:07 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:07.640630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fc9472eb-8810-4f7d-a6d2-77a1d58912c3 req-5b4c0ee6-8e15-4fbb-b79e-aa66c08df0bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110996 Oct 11 01:58:07.641260 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2947/5938] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:08.546129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:08.547423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:08.554527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:08.555020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:08.556243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:08.557150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:08.557782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:08.558213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:08.632460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:08.635481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:08.642291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:08.642931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:08.643583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:08.644531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:08.645196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:08.645700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:08.656656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:08.670820 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aa9bcd37-f8d1-400f-b4e4-942b984d0f0a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1266 microversion: 2.1 time: 0.128546 Oct 11 01:58:08.672392 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2992/5939] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:08 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:09.051630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:09.062346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63cd95bb-7876-435e-9c33-cf79b6019262 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1472 microversion: 2.1 time: 0.434990 Oct 11 01:58:09.063265 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2948/5940] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:08 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:09.703115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:09.704321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:09.716644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:09.717331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:09.717924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:09.719284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:09.719958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:09.720400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:09.878836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:09.889167 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cb12060e-7451-41dd-9ccc-5d375a1c3bdb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1272 microversion: 2.1 time: 0.194321 Oct 11 01:58:09.891082 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2993/5941] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:09 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:10.087965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:10.088587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:10.101282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.101802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.102230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.103553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.104016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.104446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.394248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:10.405276 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a53608e2-4f7c-464b-991a-6591ce1de924 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1642 microversion: 2.1 time: 0.322521 Oct 11 01:58:10.406531 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2949/5942] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:10 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1642 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:10.430505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:10.431169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:10.438360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.441027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.441939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.444957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.445856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.447261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.471122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:10.688059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:10.707249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a7a6e45-52f4-45d7-829f-2224ccab4148 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1642 microversion: 2.1 time: 0.280587 Oct 11 01:58:10.708762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2994/5943] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:10 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1642 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:10.737764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:10.738664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:10.748083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.748815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.749428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.750316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.750926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.751556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.914779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:10.915983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:10.931239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.931784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.937816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:10.938584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:10.939372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:10.939933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:11.210420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:11.225255 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-019ea042-4428-4622-a9d9-5cc3baec2c2a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.314775 Oct 11 01:58:11.226759 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2995/5944] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:10 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:11.344098 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a6be232-afac-4d96-a5a1-b8d0bbc08949 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1793 microversion: 2.1 time: 0.610268 Oct 11 01:58:11.345075 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2950/5945] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:10 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1793 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:11.363754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b053887b-cc1d-4d44-abdc-45cec3d429e8", "tag": "1118c16f-ae5c-498c-800e-58e027c9dc16"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:11.381687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:11.382293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:11.383114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:11.398421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] Creating event network-changed:1118c16f-ae5c-498c-800e-58e027c9dc16 for instance b053887b-cc1d-4d44-abdc-45cec3d429e8 on n-h1-772273-9 Oct 11 01:58:11.404085 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5303bdff-bbf7-472a-a6b8-1614829a353e req-f57c6f59-bc54-4c20-8691-7bfce869134b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045041 Oct 11 01:58:11.405475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2996/5946] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:12.249368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:12.259758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:12.267240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:12.267846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:12.268285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:12.268985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:12.269461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:12.269885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:12.431075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:12.442977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b2cd8c5-b179-4ef7-9f37-b472661a13bb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.197302 Oct 11 01:58:12.442977 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2951/5947] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:12 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:13.467813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:13.468615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:13.474959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:13.475640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:13.476153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:13.476925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:13.477985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:13.478420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:13.629024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:13.638695 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-52a26be4-9f26-45fe-93c0-2cccc41c9281 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.176141 Oct 11 01:58:13.652201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2997/5948] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:13 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:13.673671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d6f988-9a4a-49ae-b0af-a5a85cbd266a", "tag": "004a12be-47e3-4845-9dd6-afefbccb3df4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:13.684583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:13.685288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:13.685882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:13.697926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] Creating event network-changed:004a12be-47e3-4845-9dd6-afefbccb3df4 for instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a on n-h2-772273-9 Oct 11 01:58:13.703447 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-87f8e329-0dab-4750-93dd-0c5da8d03d84 req-2921b298-173e-41a0-948b-2b0ca2f48c32 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Oct 11 01:58:13.708080 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2952/5949] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:14.663802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:14.664427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:14.672472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:14.672965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:14.674615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:14.675389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:14.676159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:14.676592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:14.830720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:14.845525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bcfe7a3d-c4c2-4f3e-9b4c-3c37c7669a17 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.185586 Oct 11 01:58:14.861048 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2998/5950] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:14 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:15.871578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:15.872400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:15.878588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:15.879081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:15.879552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:15.880253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:15.880716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:15.881145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:16.021501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:16.031096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df96b805-7493-48fa-9a71-97c41f25139c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.164595 Oct 11 01:58:16.031813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2953/5951] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:15 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:16.884800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b053887b-cc1d-4d44-abdc-45cec3d429e8", "name": "network-vif-plugged", "status": "completed", "tag": "1118c16f-ae5c-498c-800e-58e027c9dc16"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:16.896326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:16.897180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:16.897853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:16.911536 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] Creating event network-vif-plugged:1118c16f-ae5c-498c-800e-58e027c9dc16 for instance b053887b-cc1d-4d44-abdc-45cec3d429e8 on n-h1-772273-9 Oct 11 01:58:16.917367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e052548d-bb1d-41f2-b0b4-598ddacb9851 req-7fc940a1-d4a3-44b2-a2c4-b2b2a6df3371 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 Oct 11 01:58:16.918064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 2999/5952] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:17.054098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:17.054810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:17.061770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:17.062345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:17.063216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:17.064066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:17.064621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:17.065139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:17.170040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:17.202645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:17.210566 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9e398de-73d7-4884-b3eb-45fb3321d698 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1314 microversion: 2.1 time: 0.160394 Oct 11 01:58:17.211142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2954/5953] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:17 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:18.235251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:18.236245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:18.243470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.243961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.244403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.245094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.245548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.245975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.385559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:18.393460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-619a2f36-89b5-4b16-9031-f99106d2cd03 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1501 microversion: 2.1 time: 0.162458 Oct 11 01:58:18.394029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3000/5954] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:18 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:18.417492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:18.419888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:18.421828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:18.428047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.428615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.429142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.429826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.430288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.430717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.455006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lazy-loading 'flavor' on Instance uuid b053887b-cc1d-4d44-abdc-45cec3d429e8 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:58:18.530635 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb195d0b-789a-439c-89fe-de5117cab5a9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "POST /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8/action" status: 200 len: 32 microversion: 2.1 time: 0.118078 Oct 11 01:58:18.531458 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2955/5955] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:58:18 2022] POST /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:58:18.542621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:18.543250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:18.549453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.549953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.550396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.551115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:18.551598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:18.552030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:18.737999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:18.747976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc996cac-8c42-4737-99f3-df37a32dd6ad tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.210692 Oct 11 01:58:18.751390 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3001/5956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:18 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:19.773167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:19.773938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:19.780296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:19.780786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:19.781221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:19.781916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:19.782380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:19.782791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:19.912873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:19.921896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f200f84-6611-4f07-b41f-01ebeb8a84e7 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.153894 Oct 11 01:58:19.922560 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2956/5957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:19 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:20.946613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:20.947239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:20.954246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:20.954774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:20.955270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:20.956171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:20.956679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:20.957058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:21.094220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:21.101962 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad916c3c-af84-4c02-88c0-f4938c500dfd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.160077 Oct 11 01:58:21.103154 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3002/5958] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:20 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:22.125967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:22.126590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:22.133521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:22.134018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:22.134461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:22.135158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:22.135651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:22.136089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:22.283244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:22.291618 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-815f49dc-869f-46f5-98fc-f5092320b6a3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.169422 Oct 11 01:58:22.292583 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2957/5959] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:22 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:23.314318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:23.315122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:23.323216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:23.323747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:23.324202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:23.325066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:23.325545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:23.325970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:23.459754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:23.467833 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88ea398e-32e2-4252-a7b1-c87028cff6ea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.157540 Oct 11 01:58:23.468419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3003/5960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:23 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:24.491380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:24.492592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:24.501550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:24.501952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:24.502360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:24.503119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:24.503536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:24.503962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:24.639324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:24.647249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bdf40d33-3f60-40c2-8667-8a433c5b35fd tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.159928 Oct 11 01:58:24.648142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2958/5961] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:24 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:25.670126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:25.670771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:25.677804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:25.678294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:25.678739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:25.679467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:25.679933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:25.680895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:25.812422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:25.820274 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3a95bb42-8aaf-4720-afc3-dd86500c8f05 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.154112 Oct 11 01:58:25.820859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3004/5962] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:25 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:26.844206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:26.844962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:26.852384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:26.852909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:26.853358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:26.854104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:26.854567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:26.854999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:26.997893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:27.005978 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b29e67b5-1900-42a5-b382-e5e238cf9c9c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.165780 Oct 11 01:58:27.006563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2959/5963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:26 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:28.029843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:28.030688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:28.038441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:28.038906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:28.039365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:28.040056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:28.040541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:28.040963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:28.172905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:28.181433 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6006567e-1d5f-4f48-94a9-fccbaca2c452 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.155615 Oct 11 01:58:28.182010 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3005/5964] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:28 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:29.204395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:29.204904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:29.212348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:29.212836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:29.213371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:29.214073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:29.214528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:29.214958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:29.350151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:29.358012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c695fcd8-e2f7-452f-990e-e193e3e47d6d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.157564 Oct 11 01:58:29.358632 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2960/5965] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:29 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:30.380840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:30.381455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:30.388488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:30.388972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:30.389410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:30.390103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:30.390553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:30.391013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:30.534000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:30.541901 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d30cc52-af23-4daf-8526-5ebacfe06d73 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.164993 Oct 11 01:58:30.542475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3006/5966] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:30 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:31.565341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:31.566273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:31.574296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:31.574890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:31.575432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:31.576249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:31.576895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:31.577328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:31.933967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:31.942140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f671da3-608f-43a1-ab38-c9966b83a9cc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.380652 Oct 11 01:58:31.943114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2961/5967] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:31 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:32.965956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:32.966497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:32.973326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:32.973807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:32.974238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:32.974929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:32.975425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:32.975839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:33.102725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:33.110324 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fa7de3b-0361-4e7e-bbbf-a72f52072689 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.148978 Oct 11 01:58:33.111162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3007/5968] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:32 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:34.134339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:34.134957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:34.142119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:34.142464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:34.142915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:34.143639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:34.144101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:34.144530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:34.282243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:34.285146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:34.293743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01b8714b-d350-4164-b0b4-500cd1378954 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.163827 Oct 11 01:58:34.294457 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2962/5969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:34 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:35.318046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:35.318669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:35.326506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:35.327035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:35.327507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:35.328225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:35.328686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:35.329116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:35.469831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:35.478212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c364e55b-c7b7-4302-aaec-0b591e8819ae tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.163979 Oct 11 01:58:35.478760 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3008/5970] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:35 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:36.502208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:36.502824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:36.511119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:36.511789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:36.512227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:36.512918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:36.513367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:36.513788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:36.652373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:36.659963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be2f3847-2bbb-4440-9ffc-bedf305f111b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.161973 Oct 11 01:58:36.660538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2963/5971] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:36 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:37.684478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:37.684986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:37.687533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=38 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:37.693301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:37.693795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:37.694228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:37.694931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:37.695438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:37.695866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:37.831010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:37.839011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-51f98f54-c6dc-41b0-a8e0-705a02eb69ec tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.159294 Oct 11 01:58:37.839625 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3009/5972] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:37 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:38.862827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:38.863269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:38.865674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:38.871862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:38.872360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:38.872806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:38.873527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:38.874047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:38.874477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:39.008151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:39.017499 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d22a044-af48-43ee-add0-fb27cca57751 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.158971 Oct 11 01:58:39.018950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2964/5973] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:38 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:40.042172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:40.042812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:40.050265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:40.050773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:40.051232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:40.051943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:40.052423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:40.052996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:40.211078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:40.219626 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-88a8160a-d18b-4527-8de4-78131d426d38 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.181326 Oct 11 01:58:40.220209 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3010/5974] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:40 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:41.244328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:41.246323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:41.253803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:41.254371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:41.254887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:41.255720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:41.256418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:41.256951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:41.396645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:41.405173 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d17c3608-c572-4b57-aa7a-8cada0b70e9e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.165789 Oct 11 01:58:41.405764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2965/5975] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:41 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:42.429149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:42.429682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:42.436783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:42.437276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:42.437718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:42.438428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:42.438888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:42.439314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:42.441937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:42.570958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:42.579517 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-df707171-ac47-481d-b656-cc556a4bdb63 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.154370 Oct 11 01:58:42.580108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3011/5976] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:42 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:43.603405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:43.604131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:43.611591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:43.612378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:43.613039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:43.613992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:43.614556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:43.615108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:43.799626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:43.809279 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57fb0000-a118-4033-8457-17bff9e1e483 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.210365 Oct 11 01:58:43.809867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2966/5977] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:43 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:44.832285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:44.832891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:44.839811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:44.840302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:44.840749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:44.841644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:44.842107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:44.842538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:44.983881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:44.991831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8533d795-9b3d-45c0-8a92-8a4041ebb0b8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.163406 Oct 11 01:58:44.992407 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3012/5978] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:44 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:46.015541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:46.016087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:46.022865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:46.023366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:46.023822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:46.025032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:46.025487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:46.025910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:46.160438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:46.169725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dfef187-6bb2-45ef-866d-a00a132e157a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1507 microversion: 2.1 time: 0.158181 Oct 11 01:58:46.170306 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2967/5979] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:46 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:47.192913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:47.193531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:47.200529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:47.201019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:47.201468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:47.202163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:47.202623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:47.203053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:47.333348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:47.341493 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da8f7744-f5ec-47be-875e-36f33210bd07 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1487 microversion: 2.1 time: 0.152521 Oct 11 01:58:47.342070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3013/5980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:47 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1487 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:47.453379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-71969944", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:47.510746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] validate_networks() for [('854dcf1e-c356-45e0-8f1b-bac46e10fa9d', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:58:47.991842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:58:47.992265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:58:47.992735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:58:47.993147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:58:47.993556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:58:48.002562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:48.003062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:48.003561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:48.004419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:48.004906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:48.005579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:48.026022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Getting quotas for project 6890a0e4d4234538a6f3a6cfc357af37. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:58:48.031715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Getting quotas for user e491a4967382439fbb77b3cf924c37a3 and project 6890a0e4d4234538a6f3a6cfc357af37. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:58:48.045797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:58:48.048460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:58:48.096076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-738d43f7-4db0-414a-a7ac-5004681b1583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.646932 Oct 11 01:58:48.096752 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2968/5981] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:58:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:58:48.109022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56fc8994-d58e-4b3b-9da9-9b821cec70af tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:48.109652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-56fc8994-d58e-4b3b-9da9-9b821cec70af tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:48.214994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-56fc8994-d58e-4b3b-9da9-9b821cec70af tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:48.224828 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-56fc8994-d58e-4b3b-9da9-9b821cec70af tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1212 microversion: 2.1 time: 0.120034 Oct 11 01:58:48.225457 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3014/5982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:48 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1212 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:49.248379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:49.248927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:49.256724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:49.257223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:49.257658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:49.258362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:49.259170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:49.259631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:49.326794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:49.334874 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acd70350-ec51-4be5-9bff-ddef166ab062 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1264 microversion: 2.1 time: 0.091557 Oct 11 01:58:49.336781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2969/5983] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:49 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:50.358971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:50.359690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:50.369112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:50.369622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:50.370067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:50.370799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:50.371264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:50.371752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:50.594163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:50.602527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8b286fe-94cc-4641-a969-3e738230dbea tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.247473 Oct 11 01:58:50.604172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3015/5984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:50 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:51.157404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda3a231-8658-4949-96b5-fce1563cc6da", "tag": "b7dcc4e3-e763-4e37-a269-9ee1b4bb489d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:51.173457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:51.174217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:51.174955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:51.190003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] Creating event network-changed:b7dcc4e3-e763-4e37-a269-9ee1b4bb489d for instance bda3a231-8658-4949-96b5-fce1563cc6da on n-h2-772273-9 Oct 11 01:58:51.196589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-382e9557-b68a-435d-a9cf-2f54e610ebc2 req-afb0851a-a126-4175-bf36-ab2f1b9c08b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043040 Oct 11 01:58:51.198221 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2970/5985] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:58:51.627575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:51.628225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:51.635694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:51.636184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:51.636620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:51.637309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:51.637765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:51.638192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:51.770998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:51.779290 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ab9aa1f-b244-43ef-9cf4-a5188b1737f4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.155769 Oct 11 01:58:51.779885 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3016/5986] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:51 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:52.803243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:52.804081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:52.812023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:52.812497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:52.812939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:52.813645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:52.814116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:52.814544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:52.951161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:52.959154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d8d66fc-22db-48fd-af1e-32787f7ba3b9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.160771 Oct 11 01:58:52.959765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2971/5987] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:52 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:53.982925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:53.983620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:53.990809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:53.991294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:53.991775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:53.992473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:53.992929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:53.993387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:54.141091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:54.149918 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-effba06d-ac42-48d2-8f50-47318bf44a15 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.170156 Oct 11 01:58:54.150454 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3017/5988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:53 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:58:55.178981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:55.179637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:55.190393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:55.193419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:55.193929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:55.194772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:55.195422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:55.195876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:55.334153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:55.342479 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6c1e742-b071-4e3d-8747-c54e81635583 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.167471 Oct 11 01:58:55.343064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2972/5989] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:55 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:56.366317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:56.366859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:56.373908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:56.374389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:56.374816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:56.375526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:56.375983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:56.376398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:56.504401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:56.512188 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0884133e-9a32-4780-8cba-ac92431c3925 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.149979 Oct 11 01:58:56.512850 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3018/5990] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:56 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:57.535880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:57.536494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:57.544291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:57.544782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:57.545224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:57.545927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:57.546390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:57.546822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:57.697302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:57.705693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-002e8c19-97a3-4970-a951-4468615d8ccf tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.173576 Oct 11 01:58:57.709202 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2973/5991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:57 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:57.796957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda3a231-8658-4949-96b5-fce1563cc6da", "name": "network-vif-plugged", "status": "completed", "tag": "b7dcc4e3-e763-4e37-a269-9ee1b4bb489d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:58:57.807088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:57.807604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:57.808041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:57.819860 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] Creating event network-vif-plugged:b7dcc4e3-e763-4e37-a269-9ee1b4bb489d for instance bda3a231-8658-4949-96b5-fce1563cc6da on n-h2-772273-9 Oct 11 01:58:57.825161 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ceda12d1-2c22-4962-8963-cc2b13679e76 req-4c2b9826-3114-4335-a0bc-ae7d28204699 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191253 Oct 11 01:58:57.825777 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3019/5992] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:58:58.734150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:58.734772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:58.737381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:58.738256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:58.745440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:58.745942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:58.746389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:58.747116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:58.747606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:58.748047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:58.882327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:58:58.890382 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0c37c7c-adb3-4563-bfdd-fff3457e7eb4 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1312 microversion: 2.1 time: 0.160211 Oct 11 01:58:58.891001 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2974/5993] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:58 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:58:59.911223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:58:59.916314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:58:59.917011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:58:59.923430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:59.923917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:59.924351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:58:59.925041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:58:59.925498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:58:59.925928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:00.061243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:00.069095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-051d8777-7e25-4571-8e44-cf322a5db49c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1498 microversion: 2.1 time: 0.158860 Oct 11 01:59:00.069682 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3020/5994] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:58:59 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:00.092003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:00.094303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:00.101205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:00.101690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:00.102129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:00.102856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:00.103311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:00.103762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:00.127090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lazy-loading 'flavor' on Instance uuid bda3a231-8658-4949-96b5-fce1563cc6da {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:59:00.195553 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cfece9e3-92b6-445e-9dcc-a2e0da60dc88 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "POST /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da/action" status: 200 len: 32 microversion: 2.1 time: 0.107541 Oct 11 01:59:00.196729 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2975/5995] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:59:00 2022] POST /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da/action => generated 32 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 01:59:00.208249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:00.208984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:00.217125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:00.218078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:00.218510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:00.219216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:00.219714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:00.220149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:00.366150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:00.375237 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8d5d6f4-74d4-4b09-b766-438878a8b7c0 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.172098 Oct 11 01:59:00.376298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3021/5996] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:00 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:01.400524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:01.401146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:01.407670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:01.408172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:01.408620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:01.409379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:01.409840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:01.410274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:01.543433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:01.551375 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4983aa84-f9f3-40b3-850f-f1f4a9ce164c tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.156932 Oct 11 01:59:01.551969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2976/5997] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:01 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:02.575034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:02.575832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:02.583102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:02.583626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:02.584065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:02.584760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:02.585213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:02.585638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:02.727939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:02.736375 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ab2fca9-2d49-427a-8db0-de019cd6e29e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.165563 Oct 11 01:59:02.736961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3022/5998] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:02 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:03.760011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:03.760638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:03.767864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:03.768353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:03.768818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:03.769517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:03.769973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:03.770399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:03.904313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:03.912154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7eba6ac8-23ab-4395-a3ef-b98ab1d6c6fb tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.156556 Oct 11 01:59:03.912738 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2977/5999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:03 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:04.936533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:04.937155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:04.944147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:04.944643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:04.945086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:04.945791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:04.946765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:04.947197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:05.097025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:05.105480 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1be3968-5182-4b60-86b1-a5ff4911b848 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.172884 Oct 11 01:59:05.106038 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3023/6000] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:04 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:06.129375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:06.130622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:06.138731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:06.139279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:06.139806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:06.140718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:06.140982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:06.141414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:06.297813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:06.300773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:06.309002 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78783754-ab03-4510-aded-841e4f537767 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.183406 Oct 11 01:59:06.309803 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2978/6001] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:06 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:07.333018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:07.334443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:07.342820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:07.343719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:07.344418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:07.345402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:07.345964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:07.349955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:07.491944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:07.499856 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d206878-c4fa-47e8-96bc-30ec70fbe61d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.171013 Oct 11 01:59:07.500466 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3024/6002] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:07 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:08.525140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:08.525762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:08.533012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:08.533473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:08.533918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:08.534617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:08.535075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:08.535541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:08.666301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:08.674271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c61d02e-a06f-4230-b933-e700703f2acc tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.153891 Oct 11 01:59:08.674848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2979/6003] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:08 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:09.697026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:09.697647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:09.700354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:09.705766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:09.706243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:09.706678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:09.707385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:09.707843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:09.708266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:09.838906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:09.846723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13950674-3062-4f3a-a21b-6620224caf8b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.153600 Oct 11 01:59:09.847386 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3025/6004] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:09 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:10.870406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:10.871065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:10.873970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:10.879542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:10.880036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:10.880481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:10.881184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:10.881650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:10.882086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:11.016449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:11.027174 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22588ec6-00a4-48a2-bf3a-3558d9a0ea92 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.160883 Oct 11 01:59:11.036321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2980/6005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:10 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:12.049946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:12.050707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:12.057875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:12.058360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:12.058795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:12.059513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:12.059967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:12.060550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:12.194639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:12.202495 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39254012-b494-494d-a6e2-fb96ffa34e4d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.156418 Oct 11 01:59:12.203081 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3026/6006] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:12 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:13.226200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:13.226945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:13.234010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:13.234497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:13.234949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:13.235964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:13.236426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:13.236858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:13.372702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:13.380702 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-800f4084-e98e-4572-a086-216ace1ee1d3 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.158455 Oct 11 01:59:13.381284 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2981/6007] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:13 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:14.410008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:14.410623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:14.418830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:14.419403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:14.419850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:14.420609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:14.421066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:14.421495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:14.425704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=86 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:14.833470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:14.841796 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b89c53f3-fb48-402f-b255-d30c51c686df tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.435613 Oct 11 01:59:14.842371 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3027/6008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:14 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:15.865681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:15.866375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:15.873022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:15.873583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:15.874169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:15.874899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:15.875472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:15.875970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:16.015622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:16.025762 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5c3b949-9f29-4d3e-a47b-dddc878e522b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.162184 Oct 11 01:59:16.025762 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2982/6009] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:15 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:17.047843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:17.048459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:17.055895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:17.056392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:17.056838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:17.057541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:17.058025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:17.058441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:17.199109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:17.206965 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d422e8e-1a6e-417e-a9a7-79905addada8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.162955 Oct 11 01:59:17.207559 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3028/6010] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:17 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:18.233970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:18.234623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:18.241725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:18.242222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:18.243266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:18.243993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:18.244458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:18.244889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:18.374268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:18.382446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f28bcdb8-40e6-414f-8249-8c1f7c496402 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.152375 Oct 11 01:59:18.383045 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2983/6011] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:18 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:18.416477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2053845481", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "aa4cb35f-9f44-4f10-9153-9a6f4c8155fb"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:18.470507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] validate_networks() for [('aa4cb35f-9f44-4f10-9153-9a6f4c8155fb', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:59:18.816802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:59:18.817229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:59:18.817706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:59:18.818146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:59:18.818557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:59:18.827975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:18.828457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:18.828892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:18.829685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:18.830096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:18.830518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:18.849685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Getting quotas for project 025f204e94d0430dafeff4331c8b712b. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:59:18.855676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Getting quotas for user 47a42e86c7b742b0b9149f30d38b8185 and project 025f204e94d0430dafeff4331c8b712b. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:59:18.869088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:59:18.871481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:59:18.947762 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6f03a1a8-edd1-4f74-ae4b-89e934567e16 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535626 Oct 11 01:59:18.948423 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3029/6012] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:59:18.959820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a821c3ba-0214-48c8-9b05-cd4351b81a52 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:18.960446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a821c3ba-0214-48c8-9b05-cd4351b81a52 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:19.015867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a821c3ba-0214-48c8-9b05-cd4351b81a52 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:19.025855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a821c3ba-0214-48c8-9b05-cd4351b81a52 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1214 microversion: 2.1 time: 0.069976 Oct 11 01:59:19.041376 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2984/6013] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:18 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:19.406675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:19.408024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:19.414447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:19.414939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:19.415396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:19.416126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:19.416584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:19.417122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:19.558146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:19.566983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d645df1-f95e-40b5-b896-5e808946fb60 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.164246 Oct 11 01:59:19.567586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3030/6014] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:19 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:20.050868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:20.051528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:20.059611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:20.060424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:20.061029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:20.061740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:20.062477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:20.062918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:20.178121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:20.189851 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee44c97b-4d62-4912-b71b-dcb7fbfa7930 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1274 microversion: 2.1 time: 0.144107 Oct 11 01:59:20.203364 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2985/6015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:20 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:20.592271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:20.593727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:20.602030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:20.602775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:20.603952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:20.608453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:20.608979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:20.609428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:20.795013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:20.804445 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d859bdf9-0dbf-4761-9d66-61e75b20c079 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.218217 Oct 11 01:59:20.806056 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3031/6016] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:20 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:21.216450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:21.217002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:21.225509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:21.226012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:21.226460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:21.228430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:21.228906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:21.229351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:21.457273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:21.466867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b40fbc94-dda0-4059-afe1-c60eb0afc436 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.255437 Oct 11 01:59:21.467678 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2986/6017] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:21 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:21.709236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d098cc6-46f3-4a76-9bb2-113d231f7fe2", "tag": "f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:21.724349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:21.724941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:21.727988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:21.741736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] Creating event network-changed:f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8 for instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 on n-h1-772273-9 Oct 11 01:59:21.748057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-03718dad-05c9-44b5-ba8b-66facb1744e9 req-c641e413-32a6-4f0f-b67f-0036fa80884f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051481 Oct 11 01:59:21.749148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3032/6018] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:21.829062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:21.829771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:21.836895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:21.837522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:21.838202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:21.839005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:21.839707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:21.840213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:22.061395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:22.069358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-897e1cc6-d192-4364-ad24-396ad507594a tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.244281 Oct 11 01:59:22.070079 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2987/6019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:21 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:22.491067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:22.491843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:22.499069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:22.499602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:22.500748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:22.501481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:22.501943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:22.502373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:22.964388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:22.974326 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8180e5f-8749-496f-b16e-a63b61174fcf tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.485699 Oct 11 01:59:22.974326 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3033/6020] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:22 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:23.094097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:23.094619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:23.101726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:23.102403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:23.103408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:23.105242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:23.105703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:23.106129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:23.354300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:23.371616 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cc31aa6-d240-4ff5-ad77-fd2e59541b16 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.281447 Oct 11 01:59:23.373319 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2988/6021] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:23 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:24.003948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:24.005313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:24.013343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:24.014128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:24.014942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:24.015877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:24.021943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:24.022638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:24.200228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:24.212202 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7391499-601b-448c-82ec-e2979e089994 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.219249 Oct 11 01:59:24.212809 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3034/6022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:23 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:24.398721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:24.399191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:24.406953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:24.407740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:24.408374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:24.409360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:24.409985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:24.410565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:24.580201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:24.588629 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73861df7-6a17-4931-aff8-a28ca62d4c93 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.195189 Oct 11 01:59:24.589830 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2989/6023] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:24 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:25.234689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:25.236188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:25.244756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:25.245714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:25.246415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:25.247364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:25.248053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:25.249190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:25.439875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:25.448206 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3e58337-d2c7-4a79-bc5c-1fab410d0b4c tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.217686 Oct 11 01:59:25.449044 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3035/6024] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:25 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:25.614024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:25.614691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:25.624663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:25.625630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:25.626440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:25.627462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:25.628115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:25.628782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:25.814125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:25.823133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c82f52ee-6d50-4358-bbbe-99e4e7a525f5 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.214036 Oct 11 01:59:25.824133 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2990/6025] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:25 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:25.857595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2136256992", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "fb465e51-2755-4097-9eca-3b6ae0e21476"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1705181336", "security_groups": []}, "os:scheduler_hints": {"different_host": ["07d6f988-9a4a-49ae-b0af-a5a85cbd266a"]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:25.921473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] validate_networks() for [('fb465e51-2755-4097-9eca-3b6ae0e21476', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:59:26.322194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:59:26.322759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:59:26.323201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:59:26.323643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:59:26.324052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:59:26.333185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.333664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.334093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:26.334810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.335259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.335777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:26.353546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for project c8e51a0243084cb1b771a02f3542bfea. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:59:26.358685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Getting quotas for user 2646444ae86f40a69d1cc7c156cc653b and project c8e51a0243084cb1b771a02f3542bfea. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:59:26.370862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:59:26.373284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:59:26.424994 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19d0dbcf-fe4c-4f63-a9a4-642eb7973769 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.571277 Oct 11 01:59:26.437001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f6dc29e-7ccb-41d4-8c34-388f498cb2cb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:26.437613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f6dc29e-7ccb-41d4-8c34-388f498cb2cb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:26.442557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3036/6026] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:59:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:59:26.472468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:26.473176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:26.480597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.481090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.484965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:26.486098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.486570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.487002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:26.509260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f6dc29e-7ccb-41d4-8c34-388f498cb2cb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:26.519859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f6dc29e-7ccb-41d4-8c34-388f498cb2cb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1242 microversion: 2.1 time: 0.086630 Oct 11 01:59:26.521042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2991/6027] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:26 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:26.699064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:26.712498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54a96935-b2b2-4384-afd8-582cb6d2c6a3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.243399 Oct 11 01:59:26.713438 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3037/6028] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:26 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:26.848848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:26.850422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:26.866041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.866899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.867623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:26.868566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:26.869220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:26.869846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.061920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:27.072655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1db6c6a-aca5-489d-b0ec-5f0ce5a48fc8 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.229068 Oct 11 01:59:27.073853 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2992/6029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:26 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:27.547992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:27.549314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:27.556357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:27.557074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:27.557620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.558217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:27.558672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:27.559478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.635303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:27.644532 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-14770e79-8c69-436e-abc5-226e6fbef24f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1294 microversion: 2.1 time: 0.106100 Oct 11 01:59:27.656452 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3038/6030] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:27 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:27.737883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:27.738750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:27.752746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:27.753321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:27.754055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.755218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:27.755776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:27.756945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.880700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d098cc6-46f3-4a76-9bb2-113d231f7fe2", "name": "network-vif-plugged", "status": "completed", "tag": "f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:27.896580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:27.897070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:27.897506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:27.910059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] Creating event network-vif-plugged:f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8 for instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 on n-h1-772273-9 Oct 11 01:59:27.916418 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a7f1dcc5-760e-47c5-8a97-557d7cb161bb req-5e44b23c-07f5-4f3e-a143-fb88bb4b95b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040210 Oct 11 01:59:27.917143 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3039/6031] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:28.037083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:28.048442 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba05eac7-6b8c-4c8e-aa0b-8432b1e562b7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.316690 Oct 11 01:59:28.049680 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2993/6032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:27 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:28.098298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:28.099080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:28.110796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:28.111683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:28.112374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:28.113889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:28.114564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:28.115647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:28.335223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:28.343914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc2832ec-c861-4540-b101-9775928f9110 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.250479 Oct 11 01:59:28.344702 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3040/6033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:28 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:28.671597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:28.672222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:28.678856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:28.679296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:28.680320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:28.681046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:28.681632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:28.682073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:28.771772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:28.781430 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed590996-3fa9-4a47-913d-e3555c946708 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.113884 Oct 11 01:59:28.795621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2994/6034] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:28 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:29.073241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:29.074063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:29.082341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.083574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.084326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.086883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.087977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.088885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.294656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:29.310127 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5041c8a4-7cbc-4732-9a6e-d2e057afb4c7 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1314 microversion: 2.1 time: 0.241678 Oct 11 01:59:29.310877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3041/6035] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:29 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:29.370679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:29.372025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:29.379106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.379688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.380480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.381559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.382316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.384006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.596524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:29.606642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8c24be6-f7a0-48f0-94c3-ccc71d01b935 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1484 microversion: 2.1 time: 0.240134 Oct 11 01:59:29.607696 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2995/6036] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:29 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1484 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:29.630829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:29.631523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:29.639301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.639830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.640267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.640972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.641428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.645686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.709390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c177534-950e-40d2-82f0-29a3b6dd0610", "tag": "afcee255-f8c1-4529-aadb-eed97e0753d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:29.720293 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8cea080-8e48-4e8f-ac0f-99ada3f1b7c6 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "POST /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da/action" status: 202 len: 0 microversion: 2.1 time: 0.092137 Oct 11 01:59:29.721865 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3042/6037] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 01:59:29 2022] POST /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 01:59:29.723946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.724848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.731187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.732676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:29.734229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:29.745481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.746651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.747395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.748208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.748871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.749436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.753133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] Creating event network-changed:afcee255-f8c1-4529-aadb-eed97e0753d8 for instance 6c177534-950e-40d2-82f0-29a3b6dd0610 on n-h1-772273-9 Oct 11 01:59:29.762155 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-632a7d0d-d322-428b-9913-e452d021dbf4 req-fd49719d-f18b-4015-b642-d68b91fa41ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062972 Oct 11 01:59:29.762992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2996/6038] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:29.807489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:29.808201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:29.816432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.817767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.818425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.819415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:29.820090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:29.820932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:29.996619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:30.009063 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a9035d5-2fe7-4fb0-8064-552ddb4835bb tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.206378 Oct 11 01:59:30.010404 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2997/6039] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:29 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:30.034943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:30.045649 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-79f125c7-d169-4791-a243-d4b31a401f2d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1492 microversion: 2.1 time: 0.318410 Oct 11 01:59:30.062009 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3043/6040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:29 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1492 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:30.333387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:30.334009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:30.340596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.341088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.341533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:30.342232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.342693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.343121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:30.345810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:30.474308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:30.482058 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4676d612-f8ad-43d7-8541-7cebd7c42bda tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1498 microversion: 2.1 time: 0.152627 Oct 11 01:59:30.482633 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2998/6041] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:30 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:30.841688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:30.842220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:30.849002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.849484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.849984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:30.850579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.851024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.851514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:30.877133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:30.900416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:30.956031 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77c21f51-7b19-41a7-a7ee-45d08dd7a920 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 204 len: 0 microversion: 2.1 time: 0.117905 Oct 11 01:59:30.956738 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3044/6042] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:30 2022] DELETE /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:59:30.965292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:30.965908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:30.972132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.972620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.973057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:30.973944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:30.975615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:30.976055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:31.040954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:31.042290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:31.047963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:31.048632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:31.049074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:31.049776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:31.050232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:31.050655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:31.149549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:31.157048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:31.157273 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66abb251-942e-49d5-8792-1f15b5c9fbee tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1504 microversion: 2.1 time: 0.196157 Oct 11 01:59:31.157856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2999/6043] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:30 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:31.166122 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5dccac93-8d19-41ab-845e-c1ccd0508000 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.129853 Oct 11 01:59:31.166879 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3045/6044] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:31 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:31.169543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:31.170165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:31.176191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:31.176667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:31.177098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:31.177783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:31.178239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:31.178661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:31.322380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:31.330100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c71dacc1-b53a-4b3d-a9d2-c23fb35f0036 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1492 microversion: 2.1 time: 0.164728 Oct 11 01:59:31.330691 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3000/6045] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:31 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1492 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:32.189371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:32.190042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:32.196513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:32.197137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:32.197496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.197978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.198411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.199101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.199570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.199994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.203943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.204435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.204881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.205580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.206042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.206474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.364987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:32.376395 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d0ef037-91ba-4524-8313-630fe1a6e91a tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.190853 Oct 11 01:59:32.377085 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3046/6046] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:32 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:32.382174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:32.383666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:32.392470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.393236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.393789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.394600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:32.395132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:32.395683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:32.487456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:32.500265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-978bfca7-c0fe-43bb-a84f-5f0bbaa5670b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1504 microversion: 2.1 time: 0.308009 Oct 11 01:59:32.501628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3001/6047] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:32 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:32.619489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:32.630472 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60641529-b9d2-4b89-9576-172bbe97176b tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1492 microversion: 2.1 time: 0.252131 Oct 11 01:59:32.644094 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3047/6048] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:32 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:33.400297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:33.400917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:33.407965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.408464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.408907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.409621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.410082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.410512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.500054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:33.508195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a3d330f-fade-4321-93e8-0c94a7475cc9 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.111698 Oct 11 01:59:33.508883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3002/6049] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:33 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:33.524624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:33.525251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:33.532470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.532958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.533392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.534118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.534570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.534990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.655070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:33.655932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:33.663145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.664997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.666283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.667230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.668432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.669030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.702333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:33.710734 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-53041dc0-ec27-4b9f-87d7-423b3e158303 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 200 len: 1504 microversion: 2.1 time: 0.190116 Oct 11 01:59:33.712064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3048/6050] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:33 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:33.745032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d098cc6-46f3-4a76-9bb2-113d231f7fe2", "name": "network-vif-deleted", "tag": "f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:33.767942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.768577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.769190 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.784056 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] Creating event network-vif-deleted:f7c4fbbe-cb0f-4b55-8f5b-510e0785e2b8 for instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 on n-h1-772273-9 Oct 11 01:59:33.790360 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c5e7fb8d-2791-4fc3-b77d-33d88a93b94a req-b8204882-304d-4cee-883e-cce7c3e8151a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049202 Oct 11 01:59:33.791193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3049/6051] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:33.827402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:33.835451 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5abaa346-6064-468e-9de2-14ea350b5267 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1498 microversion: 2.1 time: 0.184176 Oct 11 01:59:33.836666 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3003/6052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:33 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:33.866275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:33.866954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:33.873670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.874182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.874635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.875806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:33.875806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:33.876227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:33.902022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:33.986702 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a15d64f-ac08-4783-81e5-283edd50ae68 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 204 len: 0 microversion: 2.1 time: 0.123538 Oct 11 01:59:33.987704 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3050/6053] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:33 2022] DELETE /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:59:33.996532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:33.997232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:34.003447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.003949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.004434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.005144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.005608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.006038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.134137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:34.141875 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a7bd4b5-95ee-4575-b6f7-c226d237f739 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.149783 Oct 11 01:59:34.142457 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3004/6054] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:33 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:34.531497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:34.532196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:34.538878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.540045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.540480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.541165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.541615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.542030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.624094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:34.632356 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-348af452-4349-4769-8163-57275ac858ea tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.105139 Oct 11 01:59:34.632930 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3051/6055] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:34 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:34.734581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:34.735506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: 0d098cc6-46f3-4a76-9bb2-113d231f7fe2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:34.742801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.743276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.743752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.744450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:34.744912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:34.745344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:34.759381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] HTTP exception thrown: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Request method failure captured: Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 HTTP/1.1 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM30n89Nr5NPedGUwdpEFuQuebx-yUwQ8zEXWDCd-aaIg0Oe1ZezRR-p0jZCZo0OVf-DgW5v324ylOFrA7kW6o70l7vQEuNDqTspucAP4bfS-KYIjJY5lcxXuON9Zk3X-jSrZ9crfCISC9iRnetrTM-PqBZ2a0pxGJfPz_eC5ddjQ9s Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 025f204e94d0430dafeff4331c8b712b Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesActionsTest-668418709 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025f204e94d0430dafeff4331c8b712b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-VolumesActionsTest-668418709 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 025f204e94d0430dafeff4331c8b712b Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesActionsTest-668418709 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-VolumesActionsTest-668418709-project Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 47a42e86c7b742b0b9149f30d38b8185 Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-VolumesActionsTest-668418709-project Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0d098cc6-46f3-4a76-9bb2-113d231f7fe2'} Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:34.761025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Returning 404 to user: Instance 0d098cc6-46f3-4a76-9bb2-113d231f7fe2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9081e53c-11e3-410d-8017-ef980e6057b2 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2" status: 404 len: 111 microversion: 2.1 time: 0.031800 Oct 11 01:59:34.766094 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3005/6056] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:34 2022] GET /compute/v2.1/servers/0d098cc6-46f3-4a76-9bb2-113d231f7fe2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:59:34.811616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1279647627", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "aa4cb35f-9f44-4f10-9153-9a6f4c8155fb"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:34.864539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] validate_networks() for [('aa4cb35f-9f44-4f10-9153-9a6f4c8155fb', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:59:35.164535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:35.165229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:35.171669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.172154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.172585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.173471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.173925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.174347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.225631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:59:35.226127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:59:35.227267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:59:35.227764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:59:35.228243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:59:35.237868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.238339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.238774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.239550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.240000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.240445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.252660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:35.263232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Getting quotas for project 025f204e94d0430dafeff4331c8b712b. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:59:35.272908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Getting quotas for user 47a42e86c7b742b0b9149f30d38b8185 and project 025f204e94d0430dafeff4331c8b712b. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:59:35.287086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:59:35.290711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:59:35.322091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:35.330776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-738db6f9-6bec-45e8-80a7-db07bc2c57f9 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.170669 Oct 11 01:59:35.331867 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3006/6057] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:35 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:35.341638 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfabeab5-bbd0-4164-9831-8e91b9189a2d tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533809 Oct 11 01:59:35.348383 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3052/6058] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:59:35.350954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c177534-950e-40d2-82f0-29a3b6dd0610", "name": "network-vif-plugged", "status": "completed", "tag": "afcee255-f8c1-4529-aadb-eed97e0753d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:35.360511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ba0a99b-763b-45f4-bbd7-e4a31afda595 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:35.361543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ba0a99b-763b-45f4-bbd7-e4a31afda595 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:35.361691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.362165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.362600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.374595 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] Creating event network-vif-plugged:afcee255-f8c1-4529-aadb-eed97e0753d8 for instance 6c177534-950e-40d2-82f0-29a3b6dd0610 on n-h1-772273-9 Oct 11 01:59:35.380538 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e70e3d9c-8779-43fa-9e1c-71f15bea6b08 req-d9be55ae-23fc-4f46-8862-cf7b89f16c0f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047291 Oct 11 01:59:35.381264 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3007/6059] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:35.430256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ba0a99b-763b-45f4-bbd7-e4a31afda595 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:35.437953 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ba0a99b-763b-45f4-bbd7-e4a31afda595 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1214 microversion: 2.1 time: 0.087700 Oct 11 01:59:35.439097 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3053/6060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:35 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:35.654823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:35.655677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:35.662110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.662594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.663027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.663769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:35.664758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:35.665209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:35.750224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:35.758087 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0ce5768-1b6b-4784-8088-b5214b00b911 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1300 microversion: 2.1 time: 0.107488 Oct 11 01:59:35.758754 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3008/6061] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:35 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:36.355676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:36.356216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:36.363661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.364151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.364592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.365316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.365772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.366197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.462079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:36.462703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:36.468767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.469255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.469701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.470406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.470866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.471294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.502914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:36.511909 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e0c1f3d-ca0f-4068-b893-b88765f9f589 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1504 microversion: 2.1 time: 0.160390 Oct 11 01:59:36.512503 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3054/6062] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:36 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:36.514918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:36.540399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:36.548192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e8e1309-1c1c-496a-bd35-cac62aa276fa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1218 microversion: 2.1 time: 0.090066 Oct 11 01:59:36.548817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3009/6063] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:36 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:36.783687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:36.784469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:36.790904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.791406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.791839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.792522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.792968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.793388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.872641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:36.880384 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f989b48c-e07a-4ef5-8997-f9e3f3142129 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1473 microversion: 2.1 time: 0.100678 Oct 11 01:59:36.880955 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3055/6064] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:36 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1473 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:36.903000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:36.903650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:36.910393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.910887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.911362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:36.912059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:36.912520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:36.912956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.001040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:37.010529 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ca44e57-e201-49dd-86f7-187359e4d710 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1473 microversion: 2.1 time: 0.111290 Oct 11 01:59:37.011610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3010/6065] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:36 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1473 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:37.037308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:37.038148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:37.049393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.050185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.050388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.051089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.051578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.052012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.140107 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-94efe509-552d-44ae-8fbc-973deb554aa4 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1624 microversion: 2.1 time: 0.106686 Oct 11 01:59:37.140708 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3056/6066] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:37 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:37.161967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:37.162590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:37.169426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.169929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.170428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.171116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.171608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.172126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.317193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63303815-81ee-49e6-8fc3-128254db9726 tempest-TestSecurityGroupsBasicOps-316012119 tempest-TestSecurityGroupsBasicOps-316012119-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1912 microversion: 2.1 time: 0.159266 Oct 11 01:59:37.318850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3011/6067] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:37 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1912 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:37.442942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:37.444684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:37.458677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.462181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.462722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.464862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.465526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.467069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.514539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda3a231-8658-4949-96b5-fce1563cc6da", "name": "network-vif-deleted", "tag": "b7dcc4e3-e763-4e37-a269-9ee1b4bb489d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:37.526254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.526995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.527703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.535066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:37.545592 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] Creating event network-vif-deleted:b7dcc4e3-e763-4e37-a269-9ee1b4bb489d for instance bda3a231-8658-4949-96b5-fce1563cc6da on n-h2-772273-9 Oct 11 01:59:37.554262 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-370f29e0-a30c-46ba-a813-0e16cc0742e1 req-1c6a66a5-1e7e-4789-a34c-53ad6c442fac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043400 Oct 11 01:59:37.557864 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3012/6068] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:37.590563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:37.591694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:37.601421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.602252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.602838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.604511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.605082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.606422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.694907 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7dcd63c5-6763-4688-906e-706b643dcb1b tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 204 len: 0 microversion: 2.1 time: 0.257200 Oct 11 01:59:37.696445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3057/6069] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:37 2022] DELETE /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:59:37.702314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:37.703036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:37.709454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.709948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.710443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:37.711198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:37.711866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:37.712568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:38.067712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:38.087085 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb4f75f4-d107-47c8-ab3d-ce3d125c8109 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 200 len: 1297 microversion: 2.1 time: 0.527087 Oct 11 01:59:38.087812 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3013/6070] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:37 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 1297 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:38.095587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:38.098782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:38.099543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:38.106684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:38.107308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:38.107609 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c3b45c7-8474-484c-8c97-a41e975b33ea tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1272 microversion: 2.1 time: 0.409891 Oct 11 01:59:38.108116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:38.109062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:38.109683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:38.110694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:38.111285 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3058/6071] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:37 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1272 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:38.228089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:38.236526 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f83f974-4b8f-426c-89ee-fbef7e3d9d89 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1479 microversion: 2.1 time: 0.147627 Oct 11 01:59:38.237098 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3014/6072] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:38 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1479 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:39.111008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:39.111881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: bda3a231-8658-4949-96b5-fce1563cc6da] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:39.119739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.120241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.120682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.121388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.121924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.122338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.133273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:39.134417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:39.137197 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] HTTP exception thrown: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Request method failure captured: Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da HTTP/1.1 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM2uyLMGaMY47Is19VZ9Vbk3QVXGs-v1vcyi62oKJRyCNFxXxPHV2eSNRBKnltk9CEnLErTod9lhAFSs9CKjAnbaKUw-Azo_2CQ_UgMo0IWUOKGgvieh3-YgXG_Z-3LOVBas0DjCzmm0_z0jz8zrRxx7VG47AUvJISegK6CCLFAX6vw Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 6890a0e4d4234538a6f3a6cfc357af37 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 6890a0e4d4234538a6f3a6cfc357af37 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueTestJSON-369985910-project Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: e491a4967382439fbb77b3cf924c37a3 Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueTestJSON-369985910-project Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'bda3a231-8658-4949-96b5-fce1563cc6da'} Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:39.139102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. Oct 11 01:59:39.143518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:39.143988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.143988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.143988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.143988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.144293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.144717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.145774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Returning 404 to user: Instance bda3a231-8658-4949-96b5-fce1563cc6da could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:39.146648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a4b87649-af75-42d1-b60e-26eb82649a9d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da" status: 404 len: 111 microversion: 2.1 time: 0.040415 Oct 11 01:59:39.147236 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3059/6073] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:39 2022] GET /compute/v2.1/servers/bda3a231-8658-4949-96b5-fce1563cc6da => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:59:39.155924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:39.156430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:39.162452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.162949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.163423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.164711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.165176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.165876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.182349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:39.196600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:39.292506 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-929057b8-f043-427d-9b3f-79a38e99994d tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 204 len: 0 microversion: 2.1 time: 0.139894 Oct 11 01:59:39.293153 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3060/6074] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:39 2022] DELETE /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 01:59:39.299546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:39.300602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:39.309246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.310387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.310824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.311693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.312152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.312576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.345051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:39.354948 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18af21f6-9133-4187-8905-860cc0b691e9 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.226708 Oct 11 01:59:39.355580 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3015/6075] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:39 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:39.360328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:39.360941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:39.367415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.368142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.368587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.369295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.369756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.370184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.419740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:39.427789 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6bd8680-7e07-438a-b8d9-504a93a2adbc tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1479 microversion: 2.1 time: 0.132973 Oct 11 01:59:39.428399 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3061/6076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:39 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1479 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:39.456492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a368f1c7-4a27-459f-8ff8-39648d66dad0", "tag": "44a3bcb9-9809-485c-a65b-1c0374d16221"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:39.466977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:39.467493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:39.467936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:39.479527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] Creating event network-changed:44a3bcb9-9809-485c-a65b-1c0374d16221 for instance a368f1c7-4a27-459f-8ff8-39648d66dad0 on n-h2-772273-9 Oct 11 01:59:39.484565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a6e148c8-15af-4f4d-8854-a44aefece98c req-114db1ef-6c88-4e53-b596-4bd9e88c8fa9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Oct 11 01:59:39.485742 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3062/6077] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:39.655666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:39.658192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:39.666296 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-562197fb-3500-49f8-9bef-db298b290864 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1493 microversion: 2.1 time: 0.309669 Oct 11 01:59:39.667306 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3016/6078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:39 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1493 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:40.378739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:40.379505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:40.386928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.387438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.387880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.388572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.389024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.389495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.451850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:40.452442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:40.459156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.459684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.460113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.460816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.461269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.461695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.552643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:40.561311 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93a616c4-2902-4a05-a792-37f0008c7212 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.186882 Oct 11 01:59:40.561977 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3063/6079] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:40 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:40.566211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:40.574522 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce6866ca-e76f-4811-a0f9-115362c343f3 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1479 microversion: 2.1 time: 0.127142 Oct 11 01:59:40.575323 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3017/6080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:40 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1479 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:40.689528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:40.689840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:40.696476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.696978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.697424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.698124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:40.698582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:40.699009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:40.833846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:40.842057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c3a68be0-1548-4957-bd47-99cc5bf49d22 tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1493 microversion: 2.1 time: 0.156832 Oct 11 01:59:40.842631 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3064/6081] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:40 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:41.585323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:41.586737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:41.590813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=80 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:41.598327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:41.598952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:41.606180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.606670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.606809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.607106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.607425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.607968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.608084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.608689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.608860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.608952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.609407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.610813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.704272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:41.712891 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83344abd-7c37-463d-b777-2d0f701bf1cd tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 200 len: 1479 microversion: 2.1 time: 0.118510 Oct 11 01:59:41.713488 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3065/6082] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:41 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 1479 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:41.718003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c177534-950e-40d2-82f0-29a3b6dd0610", "name": "network-vif-deleted", "tag": "afcee255-f8c1-4529-aadb-eed97e0753d8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:41.736724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.737210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.737648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.754622 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] Creating event network-vif-deleted:afcee255-f8c1-4529-aadb-eed97e0753d8 for instance 6c177534-950e-40d2-82f0-29a3b6dd0610 on n-h1-772273-9 Oct 11 01:59:41.760745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-49c25c6e-12c9-4b73-9ccf-854c2d228423 req-cb2dafb8-aec2-4233-966d-86857fb719de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045528 Oct 11 01:59:41.762969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3066/6083] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:41.817434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:41.825664 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ebc2a097-d9bc-4b71-b107-cb918440a929 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.244459 Oct 11 01:59:41.826406 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3018/6084] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:41 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:41.865873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:41.866882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:41.873800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.874282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.874717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:41.875432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:41.875892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:41.876316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:42.062050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e491a4967382439fbb77b3cf924c37a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6890a0e4d4234538a6f3a6cfc357af37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:42.070533 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-289af4ce-d931-4efe-b6dc-ded3a911938e tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 200 len: 1493 microversion: 2.1 time: 0.208709 Oct 11 01:59:42.084024 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3067/6085] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:41 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:42.737547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:42.738097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 6c177534-950e-40d2-82f0-29a3b6dd0610] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:42.744790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:42.745271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:42.745712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:42.746405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:42.746861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:42.747287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:42.760630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] HTTP exception thrown: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Request method failure captured: Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 HTTP/1.1 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM2aw6pXkNEEtEuS1mFMyirokWjbAGUXBz3hlYAmn39SbQAHJfZhPeQ9QsySB8EFMjBFow95UpVnKeBPNBgA-KqcSgnrZzIPDDIh1hENjeOnsjZCuqkWD-j_DbnNBCMjXnoU3gLFdU0UJ77FtksmepniwHPEkvuTZCftXvlj1WZ1KC8 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c8e51a0243084cb1b771a02f3542bfea Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c8e51a0243084cb1b771a02f3542bfea Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestSecurityGroupsBasicOps-1262425558-project Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 2646444ae86f40a69d1cc7c156cc653b Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1262425558-project Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '6c177534-950e-40d2-82f0-29a3b6dd0610'} Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:42.762250 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Returning 404 to user: Instance 6c177534-950e-40d2-82f0-29a3b6dd0610 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f86da99-8ae7-4aa4-889a-9016341ab4d2 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610" status: 404 len: 111 microversion: 2.1 time: 0.030380 Oct 11 01:59:42.767450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3019/6086] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:42 2022] GET /compute/v2.1/servers/6c177534-950e-40d2-82f0-29a3b6dd0610 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:59:42.848405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:42.849085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:42.856618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:42.857107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:42.857543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:42.858428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:42.858890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:42.859319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:43.082620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:43.091940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af6a569e-52fc-48c3-b134-a79c6f1ea5d3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.247419 Oct 11 01:59:43.092520 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3068/6087] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:42 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:43.094932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:43.095646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] [instance: b053887b-cc1d-4d44-abdc-45cec3d429e8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:43.102162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:43.102726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:43.103241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:43.104052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:43.104581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:43.105082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:43.119529 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] HTTP exception thrown: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Request method failure captured: Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 HTTP/1.1 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM2uyLMGaMY47Is19VZ9Vbk3QVXGs-v1vcyi62oKJRyCNFxXxPHV2eSNRBKnltk9CEnLErTod9lhAFSs9CKjAnbaKUw-Azo_2CQ_UgMo0IWUOKGgvieh3-YgXG_Z-3LOVBas0DjCzmm0_z0jz8zrRxx7VG47AUvJISegK6CCLFAX6vw Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6890a0e4d4234538a6f3a6cfc357af37 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6890a0e4d4234538a6f3a6cfc357af37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6890a0e4d4234538a6f3a6cfc357af37 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueTestJSON-369985910 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerRescueTestJSON-369985910-project Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e491a4967382439fbb77b3cf924c37a3 Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueTestJSON-369985910-project Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b053887b-cc1d-4d44-abdc-45cec3d429e8'} Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:43.121300 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] Returning 404 to user: Instance b053887b-cc1d-4d44-abdc-45cec3d429e8 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:43.125845 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1c371b2-d28e-4674-8058-b87bc38dd6ac tempest-ServerRescueTestJSON-369985910 tempest-ServerRescueTestJSON-369985910-project] 10.222.0.66 "GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8" status: 404 len: 111 microversion: 2.1 time: 0.034042 Oct 11 01:59:43.129577 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3020/6088] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:43 2022] GET /compute/v2.1/servers/b053887b-cc1d-4d44-abdc-45cec3d429e8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 01:59:43.810426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b053887b-cc1d-4d44-abdc-45cec3d429e8", "name": "network-vif-deleted", "tag": "1118c16f-ae5c-498c-800e-58e027c9dc16"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:43.835303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:43.835914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:43.836353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:43.849889 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] Creating event network-vif-deleted:1118c16f-ae5c-498c-800e-58e027c9dc16 for instance b053887b-cc1d-4d44-abdc-45cec3d429e8 on n-h1-772273-9 Oct 11 01:59:43.857359 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-aa7d1083-3884-4b73-a8f1-868d147d7990 req-44f4388c-5b74-4ef8-a1f1-4ce946668720 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050550 Oct 11 01:59:43.858631 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3069/6089] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:44.116288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:44.118113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:44.125755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:44.126523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:44.126973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:44.127888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:44.128517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:44.129112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:44.330006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:44.340438 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5afe3b1-2ae5-4cc5-a3aa-e79be71053cb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.228340 Oct 11 01:59:44.341140 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3021/6090] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:44 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:45.366100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:45.367534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:45.377443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:45.381114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:45.382043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:45.382869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:45.384239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:45.385048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:45.385644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:45.441592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=20 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:45.629014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:45.642443 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aed5ae2d-c4c5-417a-91a1-2d4ecbb3bc60 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.281490 Oct 11 01:59:45.643241 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3070/6091] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:45 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:45.941546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368f1c7-4a27-459f-8ff8-39648d66dad0", "name": "network-vif-plugged", "status": "completed", "tag": "44a3bcb9-9809-485c-a65b-1c0374d16221"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:45.957926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:45.958672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:45.959294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:45.971584 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] Creating event network-vif-plugged:44a3bcb9-9809-485c-a65b-1c0374d16221 for instance a368f1c7-4a27-459f-8ff8-39648d66dad0 on n-h2-772273-9 Oct 11 01:59:45.983835 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1e7691a9-f5ee-4071-99b7-263bfac0e876 req-cf3c884e-6686-4029-9376-6551d873b103 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045592 Oct 11 01:59:45.985569 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3022/6092] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:46.683399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:46.685177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:46.704847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:46.708820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:46.709738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:46.711076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:46.711617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:46.712869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:46.977486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:46.993090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-22d3fac5-8a26-4cc7-964e-49b959c3dbe3 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1314 microversion: 2.1 time: 0.329975 Oct 11 01:59:46.993719 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3071/6093] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:46 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:47.769825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:47.770411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:47.779002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d6f988-9a4a-49ae-b0af-a5a85cbd266a", "tag": "004a12be-47e3-4845-9dd6-afefbccb3df4"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:47.790978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:47.791509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:47.791954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:47.792864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:47.793116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:47.793541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:47.796286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:47.797198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:47.797889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:47.816541 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] Creating event network-changed:004a12be-47e3-4845-9dd6-afefbccb3df4 for instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a on n-h2-772273-9 Oct 11 01:59:47.821151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:47.825607 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1d384a29-50ff-40af-a474-1ff6d85c5a1c req-555f406c-91de-4cb1-a2c8-bd267d0538cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049856 Oct 11 01:59:47.826583 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3072/6094] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:47.940367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc672dec-9f89-4de8-8e09-4eb18ca38488 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "DELETE /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 204 len: 0 microversion: 2.1 time: 0.175223 Oct 11 01:59:47.941572 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3023/6095] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:47 2022] DELETE /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:59:47.950891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:47.954285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:47.978353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:47.979150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:47.979978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:47.980893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:47.981590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:47.982210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:48.025090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:48.026465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:48.041537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:48.042062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:48.044675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:48.046764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:48.047243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:48.049341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:48.256785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:48.265344 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ff01e7d-0080-40a9-9f7d-ee88da231d25 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1767 microversion: 2.1 time: 0.318862 Oct 11 01:59:48.279758 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3073/6096] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:47 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1767 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:48.285730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:48.295996 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d003c2d-8019-4b3f-acac-e47d3cff1d45 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1498 microversion: 2.1 time: 0.276460 Oct 11 01:59:48.296604 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3024/6097] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:48 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1498 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:48.844101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:48.845270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:48.853220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:48.854051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:48.854439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:48.855160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:48.855648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:48.856086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:48.887060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:59:49.000305 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-26ff0ebf-6743-41c2-80c0-76c922b8bc30 tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 204 len: 0 microversion: 2.1 time: 0.160040 Oct 11 01:59:49.002874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3074/6098] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 01:59:48 2022] DELETE /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:59:49.015181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:49.016616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:49.026710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:49.027703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:49.028368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:49.034060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:49.034919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:49.035377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:49.172090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:49.181585 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caf66d10-8a86-4b7e-a201-dd09a89138eb tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1504 microversion: 2.1 time: 0.174159 Oct 11 01:59:49.182016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3025/6099] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:49 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:49.291266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:49.292038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:49.298360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:49.298854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:49.299294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:49.300020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:49.300478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:49.300905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:49.442416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:49.450610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b1be070-e35f-4351-b0ee-6f9b4d46bdca tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1767 microversion: 2.1 time: 0.164184 Oct 11 01:59:49.451208 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3075/6100] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:49 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1767 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:59:50.204266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:50.205509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:50.212790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:50.213508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:50.214113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:50.214969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:50.215613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:50.216316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:50.443321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:50.455568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18a10a7c-9eaa-40db-bf22-af5d2cb7878f tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1504 microversion: 2.1 time: 0.254893 Oct 11 01:59:50.456431 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3026/6101] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:50 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:50.477951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:50.481864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:50.490596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:50.491535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:50.492779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:50.493704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:50.494356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:50.494974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:50.498449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:50.683473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:50.699192 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-66ae8609-d4b8-43bd-b480-53abe97736b6 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1767 microversion: 2.1 time: 0.225902 Oct 11 01:59:50.699814 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3076/6102] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:50 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1767 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:51.451825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d6f988-9a4a-49ae-b0af-a5a85cbd266a", "name": "network-vif-deleted", "tag": "004a12be-47e3-4845-9dd6-afefbccb3df4"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:51.466604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.467456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.468797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.480057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:51.481299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:51.490592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.491381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.492131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.493124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.493809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.494398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.502884 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] Creating event network-vif-deleted:004a12be-47e3-4845-9dd6-afefbccb3df4 for instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a on n-h2-772273-9 Oct 11 01:59:51.520796 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1c1c267d-9c3f-4a8a-97b2-502b90a4af29 req-c587ae0e-4c79-4651-9aed-3685794b52af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072566 Oct 11 01:59:51.522002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3027/6103] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:51.576220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a42e86c7b742b0b9149f30d38b8185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f204e94d0430dafeff4331c8b712b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:51.587642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f01b0fc-9dd3-4310-b37d-0450c944e7aa tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 200 len: 1462 microversion: 2.1 time: 0.111951 Oct 11 01:59:51.598681 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3077/6104] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:51 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:51.723226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:51.724139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:51.747388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.748124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.749667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.750575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.751730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.752554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.799399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:51.799889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:51.800496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:51.801207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lazy-loading 'fault' on Instance uuid 07d6f988-9a4a-49ae-b0af-a5a85cbd266a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:59:51.877101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2646444ae86f40a69d1cc7c156cc653b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e51a0243084cb1b771a02f3542bfea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:51.888946 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdc9d0d4-eca8-4840-b71c-bdad503b7b32 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 200 len: 1384 microversion: 2.1 time: 0.170374 Oct 11 01:59:51.889851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3028/6105] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:51 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 1384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:52.612610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:52.613316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] [instance: a368f1c7-4a27-459f-8ff8-39648d66dad0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:52.620734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:52.621486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:52.621944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:52.622661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:52.623118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:52.623570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:52.638207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] HTTP exception thrown: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Request method failure captured: Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 HTTP/1.1 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM30n89Nr5NPedGUwdpEFuQuebx-yUwQ8zEXWDCd-aaIg0Oe1ZezRR-p0jZCZo0OVf-DgW5v324ylOFrA7kW6o70l7vQEuNDqTspucAP4bfS-KYIjJY5lcxXuON9Zk3X-jSrZ9crfCISC9iRnetrTM-PqBZ2a0pxGJfPz_eC5ddjQ9s Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 025f204e94d0430dafeff4331c8b712b Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-VolumesActionsTest-668418709 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025f204e94d0430dafeff4331c8b712b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025f204e94d0430dafeff4331c8b712b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-VolumesActionsTest-668418709 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 025f204e94d0430dafeff4331c8b712b Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-VolumesActionsTest-668418709 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-VolumesActionsTest-668418709-project Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 47a42e86c7b742b0b9149f30d38b8185 Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-VolumesActionsTest-668418709-project Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'a368f1c7-4a27-459f-8ff8-39648d66dad0'} Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:52.639936 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] Returning 404 to user: Instance a368f1c7-4a27-459f-8ff8-39648d66dad0 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-145c03f2-b8c3-4171-a6fb-3e30745dcd3b tempest-VolumesActionsTest-668418709 tempest-VolumesActionsTest-668418709-project] 10.222.0.66 "GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0" status: 404 len: 111 microversion: 2.1 time: 0.033214 Oct 11 01:59:52.644783 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3078/6106] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:52 2022] GET /compute/v2.1/servers/a368f1c7-4a27-459f-8ff8-39648d66dad0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:59:52.916534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:52.918022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] [instance: 07d6f988-9a4a-49ae-b0af-a5a85cbd266a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:52.924895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:52.925560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:52.926185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:52.927064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:52.927558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:52.927988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:52.942463 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] HTTP exception thrown: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Request method failure captured: Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a HTTP/1.1 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM2aw6pXkNEEtEuS1mFMyirokWjbAGUXBz3hlYAmn39SbQAHJfZhPeQ9QsySB8EFMjBFow95UpVnKeBPNBgA-KqcSgnrZzIPDDIh1hENjeOnsjZCuqkWD-j_DbnNBCMjXnoU3gLFdU0UJ77FtksmepniwHPEkvuTZCftXvlj1WZ1KC8 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: c8e51a0243084cb1b771a02f3542bfea Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c8e51a0243084cb1b771a02f3542bfea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: c8e51a0243084cb1b771a02f3542bfea Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1262425558 Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestSecurityGroupsBasicOps-1262425558-project Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 2646444ae86f40a69d1cc7c156cc653b Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1262425558-project Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '07d6f988-9a4a-49ae-b0af-a5a85cbd266a'} Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.944225 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. Oct 11 01:59:52.949025 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 01:59:52.951078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Returning 404 to user: Instance 07d6f988-9a4a-49ae-b0af-a5a85cbd266a could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:59:52.952117 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6807672-c0f5-44b8-a89d-22df9403d88f tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a" status: 404 len: 111 microversion: 2.1 time: 0.040236 Oct 11 01:59:52.963522 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3029/6107] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:52 2022] GET /compute/v2.1/servers/07d6f988-9a4a-49ae-b0af-a5a85cbd266a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:59:53.580852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368f1c7-4a27-459f-8ff8-39648d66dad0", "name": "network-vif-deleted", "tag": "44a3bcb9-9809-485c-a65b-1c0374d16221"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:53.592254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-216499413", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:53.597378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:53.597735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:53.598176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:53.619651 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] Creating event network-vif-deleted:44a3bcb9-9809-485c-a65b-1c0374d16221 for instance a368f1c7-4a27-459f-8ff8-39648d66dad0 on n-h2-772273-9 Oct 11 01:59:53.625882 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2fe9b613-5eef-4c69-b593-5c8db25e9b5c req-fdd201b0-094f-4c9c-a688-d6aeda1ec4b3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049067 Oct 11 01:59:53.626572 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3030/6108] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:59:53.671564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] validate_networks() for [('3e6bc0c7-b7d4-4e6c-836c-d9add1e6bb9d', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:59:54.142374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:59:54.142796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:59:54.143442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:59:54.143858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:59:54.144278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:59:54.162073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:54.163260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:54.163894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:54.165462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:54.165937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:54.166375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:54.193464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Getting quotas for project 1c85222668794c05bc021e02e3df4c68. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:59:54.200138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Getting quotas for user cd4a9cd40a194fd3b0bed4d761dc63f9 and project 1c85222668794c05bc021e02e3df4c68. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:59:54.214287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:59:54.217124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:59:54.290798 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-946b63a3-3d73-4a83-9c33-5b301adcfebb tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.850877 Oct 11 01:59:54.294740 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3079/6109] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 01:59:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:59:54.305105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72cb0959-0733-4d3b-b17e-6e7cfbdd4ab7 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:54.307408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72cb0959-0733-4d3b-b17e-6e7cfbdd4ab7 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:54.435917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72cb0959-0733-4d3b-b17e-6e7cfbdd4ab7 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:54.450347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72cb0959-0733-4d3b-b17e-6e7cfbdd4ab7 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1222 microversion: 2.1 time: 0.151070 Oct 11 01:59:54.453981 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3031/6110] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:54 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:55.489333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:55.491946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:55.500959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:59:55.526814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:55.528219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:55.530510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:55.532389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:55.533512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:55.534648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:55.789498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:55.798631 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3594cede-712c-41cc-8bd5-355a40987c88 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1274 microversion: 2.1 time: 0.328856 Oct 11 01:59:55.815374 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3080/6111] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:55 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:56.830892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:56.832729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:56.869888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:56.870653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:56.871288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:56.872214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:56.872830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:56.874062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:57.094261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:57.106989 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9603936-efbe-4185-8cf9-0eed898f6e98 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1280 microversion: 2.1 time: 0.284250 Oct 11 01:59:57.138649 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3032/6112] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:56 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:58.147604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:58.148995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:58.162935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:58.164672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:58.167754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:58.168745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:58.169409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:58.170058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:58.808941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9bc43caf-041c-41e5-9f1e-5428485f8643 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] Calling method '.version_select at 0x7f112f258040>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:58.810288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:59:58.819871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc973980-7cd5-4866-b1e6-694de0062e92 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.677365 Oct 11 01:59:58.835901 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3081/6113] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:58 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:59:58.837965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9bc43caf-041c-41e5-9f1e-5428485f8643 tempest-TestSecurityGroupsBasicOps-1262425558 tempest-TestSecurityGroupsBasicOps-1262425558-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1705181336" status: 202 len: 0 microversion: 2.1 time: 0.032782 Oct 11 01:59:58.838748 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3033/6114] 10.222.0.66 () {58 vars in 1278 bytes} [Tue Oct 11 01:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1705181336 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 01:59:59.094577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:59:59.121054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:59.122938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:59.125206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:59.158342 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] Creating event network-changed:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 01:59:59.179952 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-1c35d095-fc8a-4778-9cbf-f7a4d6f9fa50 req-fa9aff7a-ceb5-4f68-b043-27cd7423af10 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088512 Oct 11 01:59:59.183891 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3082/6115] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 01:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:59:59.844727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:59:59.845353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:59:59.857693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:59.858102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:59.858536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:59:59.859596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:59:59.860475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:59:59.861089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:00.035848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:00.044209 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcb839c4-ebe4-4339-b71b-811d2ce94d5e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.204198 Oct 11 02:00:00.059230 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3034/6116] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 01:59:59 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:01.067513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:01.068222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:01.078510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:01.081000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:01.081653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:01.083029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:01.084173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:01.084615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:01.273120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:01.283187 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61b61af2-091a-4128-a8be-37749a36d501 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.219532 Oct 11 02:00:01.299727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3083/6117] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:01 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:02.306510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:02.307718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:02.331004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:02.331548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:02.331989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:02.332716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:02.333180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:02.333615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:02.528930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:02.540734 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a603a95c-a104-4221-8994-f936b8fcc263 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.238494 Oct 11 02:00:02.551793 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3035/6118] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:02 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:03.570896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:03.572216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:03.583429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:03.591025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:03.591727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:03.592713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:03.593334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:03.597216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:04.149516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "name": "network-vif-plugged", "status": "completed", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:04.163319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:04.164759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:04.165429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:04.179652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:04.205775 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] Creating event network-vif-plugged:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:04.208391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:04.216470 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-37a425c5-4dd4-401a-9fa7-7dbfeff2bb7b req-0b121a22-ed33-4b0b-b1b8-76bd08837c31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072882 Oct 11 02:00:04.217799 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3036/6119] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:04.264430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:04.273673 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62b60c8a-5223-4085-8a45-e853d7f65ada tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.706925 Oct 11 02:00:04.288366 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3084/6120] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:03 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:05.295633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:05.304217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:05.305168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:05.325941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:05.328832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:05.329998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:05.332699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:05.333401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:05.334043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:05.611801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:05.622065 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b20f918f-1721-4b4b-b716-c6f3ca98f208 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1322 microversion: 2.1 time: 0.327205 Oct 11 02:00:05.636038 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3037/6121] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:05 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:06.646237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:06.646903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:06.666218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:06.666654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:06.675139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:06.676200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:06.681843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:06.682584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:07.098474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:07.113623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc69e91e-8098-4365-bba1-b0e96c766073 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1518 microversion: 2.1 time: 0.471317 Oct 11 02:00:07.114243 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3085/6122] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:06 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1518 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:07.143295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:07.147739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:07.162065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:07.164883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:07.166000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:07.167011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:07.167879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:07.169562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:07.176275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:07.259719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lazy-loading 'flavor' on Instance uuid 6786add4-0653-4039-8ec5-132dfc1bb7a2 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:00:07.431936 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73ca347a-01e6-40bd-aa60-68325c262d2b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action" status: 200 len: 32 microversion: 2.1 time: 0.295602 Oct 11 02:00:07.433264 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3038/6123] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:00:07 2022] POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:00:07.442465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:07.443532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:07.454801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:07.455600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:07.456251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:07.457148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:07.457787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:07.463797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:08.089060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:08.098888 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5df2394c-7012-420f-a423-2d39015b15cd tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.660430 Oct 11 02:00:08.104203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3086/6124] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:07 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:09.130412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:09.131124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:09.152999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:09.153501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:09.153939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:09.154660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:09.155113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:09.155565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:09.509040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:09.517987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f97e1908-afdf-4fb2-be9d-b01bf5ad130f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.393109 Oct 11 02:00:09.526017 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3039/6125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:09 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:10.549119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:10.549744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:10.561218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:10.561652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:10.562097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:10.566501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:10.567200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:10.570345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:10.793719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:10.815936 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db23789c-cdc7-4244-8e55-a7ced305d80a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.270671 Oct 11 02:00:10.817189 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3087/6126] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:10 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:11.845606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:11.850213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:11.864420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:11.885859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:11.889229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:11.893287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:11.895309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:11.897951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:11.902269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:12.142540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:12.155739 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b3c76a3-ebf3-477a-9b13-03d888de3ee4 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.318311 Oct 11 02:00:12.169085 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3040/6127] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:11 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:13.182874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:13.184293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:13.196169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:13.199377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:13.199377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:13.199864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:13.205355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:13.205784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:13.580041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:13.595099 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6925c0a4-a64f-49f6-a506-6b74cf8239f3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.417222 Oct 11 02:00:13.596874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3088/6128] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:13 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:14.630611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:14.631236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:14.651144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:14.651681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:14.652130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:14.652862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:14.653330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:14.653792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:15.080231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:15.091936 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-696a493c-fd2f-4023-b8b7-cf21de715f09 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.473786 Oct 11 02:00:15.107724 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3041/6129] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:14 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:16.120989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:16.121652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:16.139303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:16.141155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:16.142319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:16.143521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:16.144407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:16.145108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:16.779697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:16.797148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c6de7f9-2494-4270-8c25-7cdbe1eeca63 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.682835 Oct 11 02:00:16.804720 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3089/6130] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:16 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:17.832951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:17.833745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:17.851246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:17.853152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:17.854796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:17.856246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:17.857305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:17.858874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:18.131066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:18.141891 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40428216-224d-4e4a-b729-8a79f51a77b3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.313121 Oct 11 02:00:18.147999 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3042/6131] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:17 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:18.513533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Action: 'create', calling method: .version_select at 0x7f112efe7790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-488425571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6R5ZI9piFT+zzKQj4PHzlfu9Qcy1ZQp9deJRg89I5YLtZcgNLpxLFTCUiGbL7k6AjpM1Yq0PPbjwo4zvTo2dk/cRwVtTN/iQ1+QRjZ9F9QMUpGAHBgZRmspS5gL+lbsA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:18.541720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for project 980494f6ea024d6ba1d05ca56eee53cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:00:18.548928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for user f8d1c69fcdab4cef818ca8d2585d34b1 and project 980494f6ea024d6ba1d05ca56eee53cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:00:18.571154 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [75a3c8cc-c55d-4764-a5f9-be303381d842] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:00:19.169318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:19.170202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:19.190639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:19.191147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:19.192080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:19.192887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:19.193411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:19.194629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:19.438905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:19.449350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93ad22f6-212d-4f5b-9a94-85b4e16a25e3 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.287183 Oct 11 02:00:19.451943 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3043/6132] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:19 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:19.582657 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [75a3c8cc-c55d-4764-a5f9-be303381d842] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 60896. Oct 11 02:00:19.613778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b52f51ba-b8ca-4223-b62e-aa7f13ba969c tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.349167 Oct 11 02:00:19.614518 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3090/6133] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:00:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:20.475251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:20.476518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:20.484620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:20.485429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:20.485966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:20.487055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:20.487663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:20.488230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:20.706630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:20.717836 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-577df5d6-9b5c-4340-91fb-d4673ea6d2c2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.247068 Oct 11 02:00:20.719479 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3044/6134] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:20 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:20.893723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-314922985", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-488425571", "security_groups": [{"name": "tempest-secgroup-smoke-355261767"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "dcf89d74-9973-4699-88c6-811b4b7f59f3"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:21.005015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] validate_networks() for [('dcf89d74-9973-4699-88c6-811b4b7f59f3', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:00:21.465456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for project 980494f6ea024d6ba1d05ca56eee53cb. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:00:21.471827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for user f8d1c69fcdab4cef818ca8d2585d34b1 and project 980494f6ea024d6ba1d05ca56eee53cb. Resources: dict_keys(['metadata_items']) {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:00:21.487402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:00:21.487980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:00:21.488923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:00:21.489580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:00:21.490097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:00:21.500779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:21.501267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:21.501892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:21.502624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:21.503244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:21.503873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:21.513215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=72 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:21.527045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for project 980494f6ea024d6ba1d05ca56eee53cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:00:21.533787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Getting quotas for user f8d1c69fcdab4cef818ca8d2585d34b1 and project 980494f6ea024d6ba1d05ca56eee53cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:00:21.546956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:00:21.549341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:00:21.596767 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58839419-25ab-4277-9409-4819104389d5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.707916 Oct 11 02:00:21.597791 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3091/6135] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:00:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:00:21.609013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42eb9020-2d6a-4951-b640-5a7f9cb17efb tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:21.609631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42eb9020-2d6a-4951-b640-5a7f9cb17efb tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:21.682705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-42eb9020-2d6a-4951-b640-5a7f9cb17efb tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:21.691270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42eb9020-2d6a-4951-b640-5a7f9cb17efb tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1301 microversion: 2.1 time: 0.086010 Oct 11 02:00:21.692655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3045/6136] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:21 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:21.746460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:21.747249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:21.755797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:21.756554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:21.757162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:21.757998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:21.759106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:21.759875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:21.947968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:21.957288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af928c8e-cc6c-449d-838f-4490c66a3348 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.218642 Oct 11 02:00:21.976530 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3092/6137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:21 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:22.714495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:22.715099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:22.726742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:22.727760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:22.728386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:22.729377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:22.730092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:22.730772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:22.860170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:22.873646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16e6c264-df2f-416d-ae83-f3073f0b0ea0 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1353 microversion: 2.1 time: 0.162503 Oct 11 02:00:22.875418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3046/6138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:22 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:22.981540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:22.982566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:22.993533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:22.998675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:22.999446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:23.000459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:23.001032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:23.002585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:23.242795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:23.257750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d56b1dc-22d4-4a74-b47c-0b73dd4343a5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.279359 Oct 11 02:00:23.260852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3093/6139] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:22 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:23.901409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:23.902440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:23.909914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:23.910565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:23.911118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:23.912008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:23.912594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:23.913643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:24.282179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:24.282803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:24.293788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:24.294652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:24.295892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:24.298919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:24.300160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:24.302702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:24.363236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:24.374972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-893027e5-4d74-4991-8c2d-34bdafb2233b tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.477347 Oct 11 02:00:24.376244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3047/6140] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:23 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:24.495175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:24.504166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5405ac92-a26f-4624-ae0d-798a7e0fe91a tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.225890 Oct 11 02:00:24.504756 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3094/6141] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:24 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:24.577107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c85b627-bd26-41e4-8f29-705034855358", "tag": "03318ee1-65df-4b52-8cbd-4e81b88032c8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:24.603779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:24.604369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:24.605043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:24.619536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] Creating event network-changed:03318ee1-65df-4b52-8cbd-4e81b88032c8 for instance 6c85b627-bd26-41e4-8f29-705034855358 on n-h1-772273-9 Oct 11 02:00:24.625267 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cd903bec-dc1e-4633-889d-350a3c987eb5 req-365e3a1e-85ac-46ec-ad0a-5fcf58490e64 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062185 Oct 11 02:00:24.626536 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3048/6142] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:25.401707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:25.402344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:25.414801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:25.415577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:25.416024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:25.416775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:25.417292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:25.417679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:25.529105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:25.529966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:25.536215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:25.536708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:25.537363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:25.538957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:25.539455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:25.540174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:25.556319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:25.564806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58599e93-f810-4819-868a-09cc0de2aacc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.169127 Oct 11 02:00:25.565607 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3095/6143] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:25 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:25.679808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:25.687678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61d039fc-b5de-46d0-ae3a-071ccf8e1f18 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.163970 Oct 11 02:00:25.688252 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3049/6144] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:25 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:26.589343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:26.591128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:26.594823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:26.601496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:26.602523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:26.602993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:26.603847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:26.604485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:26.605603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:26.713330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:26.714076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:26.723261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:26.724336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:26.725072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:26.726188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:26.726857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:26.727391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:26.778035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:26.788700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81e8c743-8ad3-49da-831a-8d2f9a477a89 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.204491 Oct 11 02:00:26.789387 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3096/6145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:26 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:26.862762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:26.870584 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6f048c5-65c1-4d34-a1dc-87edac65378e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.162583 Oct 11 02:00:26.871156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3050/6146] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:26 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:27.811606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:27.812231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:27.819754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:27.820253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:27.820696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:27.821406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:27.821870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:27.822303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:27.894043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:27.895368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:27.903542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:27.904298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:27.904917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:27.905815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:27.906276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:27.906881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:28.027000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:28.042350 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a2370ba8-1159-4aff-9b2f-e8e0e4d6a1cc tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.234579 Oct 11 02:00:28.043818 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3097/6147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:27 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:28.102779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:28.111157 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cccb1163-2f62-4abd-aa26-b3f62e2e820b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.220944 Oct 11 02:00:28.111848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3051/6148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:27 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:29.066219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:29.066842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:29.074318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:29.074848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:29.075320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:29.076089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:29.076549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:29.076974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:29.135231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:29.135883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:29.142542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:29.143040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:29.143538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:29.144259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:29.144726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:29.145164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:29.262181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:29.270969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0717ca94-ddf4-473b-9d40-7dff7026c6c8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.208751 Oct 11 02:00:29.272463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3098/6149] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:29 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:29.309404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:29.318049 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa459c2c-a864-419c-bb80-f9e6bcfa23b1 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.186687 Oct 11 02:00:29.318624 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3052/6150] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:29 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:29.528827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c85b627-bd26-41e4-8f29-705034855358", "name": "network-vif-plugged", "status": "completed", "tag": "03318ee1-65df-4b52-8cbd-4e81b88032c8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:29.539761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:29.540278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:29.540886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:29.552542 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] Creating event network-vif-plugged:03318ee1-65df-4b52-8cbd-4e81b88032c8 for instance 6c85b627-bd26-41e4-8f29-705034855358 on n-h1-772273-9 Oct 11 02:00:29.558024 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-687539a8-6e1f-4543-8987-650180b405c8 req-4db81aea-8fd2-4749-a313-c164a66f0db5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Oct 11 02:00:29.558977 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3099/6151] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:30.294909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:30.295525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:30.302403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:30.302906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:30.303380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:30.304102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:30.304571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:30.305011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:30.345124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:30.345848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:30.353560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:30.354063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:30.354508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:30.355227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:30.355722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:30.356158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:30.502330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:30.511419 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcc6bb39-6416-4c57-a72f-8743a93415f5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1426 microversion: 2.1 time: 0.220425 Oct 11 02:00:30.512005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3053/6152] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:30 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1426 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:30.540092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:30.548001 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e45c390-94cf-45cd-9e36-556667ac35ed tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.210217 Oct 11 02:00:30.548530 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3100/6153] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:30 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:31.534365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:31.535026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:31.542893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.543434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.543886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.544607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.545073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.545508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.561411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:31.572973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:31.573961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:31.577294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:31.578113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:31.584210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.585049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.585562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.586349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.586885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.587428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.690328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:31.745481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:31.753536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21f54924-acb3-4c91-813e-5323660824b2 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1605 microversion: 2.1 time: 0.223249 Oct 11 02:00:31.754856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3054/6154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:31 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:31.768251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:31.776954 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99c6b2c6-c6db-4754-a005-79c8c44d57f2 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.208725 Oct 11 02:00:31.777532 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3101/6155] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:31 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:31.778270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:31.778898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:31.785187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.785597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.786037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.786741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.787200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.787791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.924118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:31.931926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38c1e437-fdb3-4ef6-8609-371682e03da8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1605 microversion: 2.1 time: 0.157567 Oct 11 02:00:31.932496 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3055/6156] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:31 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:31.954148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:31.954899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:31.961361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.961856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.962295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:31.962985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:31.963464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:31.963887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:32.113953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:32.122219 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82ae58c8-0d9e-4889-8e8b-fc4e5582b93f tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1605 microversion: 2.1 time: 0.171853 Oct 11 02:00:32.122825 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3102/6157] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:31 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:32.800011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:32.801275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:32.809284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:32.809955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:32.810406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:32.811118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:32.811603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:32.812238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:32.964253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:32.974708 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-074b6013-91b6-4324-b69b-6a092c7e0d9f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.178778 Oct 11 02:00:32.976577 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3056/6158] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:32 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:34.000737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:34.003614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:34.029033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:34.032039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:34.032730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:34.033620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:34.035670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:34.036254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:34.190360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:34.199928 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70859186-e2fa-4fe8-be31-ac8bd49c4a33 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.204885 Oct 11 02:00:34.215735 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3103/6159] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:33 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:34.599827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c85b627-bd26-41e4-8f29-705034855358", "tag": "03318ee1-65df-4b52-8cbd-4e81b88032c8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:34.611523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:34.612333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:34.612933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:34.626952 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] Creating event network-changed:03318ee1-65df-4b52-8cbd-4e81b88032c8 for instance 6c85b627-bd26-41e4-8f29-705034855358 on n-h1-772273-9 Oct 11 02:00:34.633972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3201809b-c142-4533-88cb-7420a4fa4cf9 req-264cdedd-ada1-4d1a-8f4a-ecabef12fe83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037746 Oct 11 02:00:34.635304 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3057/6160] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:00:35.226817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:35.228180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:35.252865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:35.253857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:35.254483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:35.255530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:35.256010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:35.256633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:35.461607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:35.473436 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5ff50e26-52d2-4847-844c-1781c6815887 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.253182 Oct 11 02:00:35.477325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3104/6161] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:35 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:36.511081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:36.511997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:36.519253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:36.520068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:36.520545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:36.521252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:36.521717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:36.522701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:36.680690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:36.689048 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d58b7896-3bd4-49f7-a979-17af6291f74d tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1524 microversion: 2.1 time: 0.184066 Oct 11 02:00:36.689810 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3058/6162] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:36 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1524 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:37.713983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:37.714520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:37.721318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:37.721801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:37.722244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:37.722931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:37.723411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:37.723837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:37.855640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:37.863558 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8fac679-53d9-4f23-8df1-f249521389aa tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1504 microversion: 2.1 time: 0.153628 Oct 11 02:00:37.864140 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3105/6163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:37 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:00:37.887113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd2214b8-1556-4b93-b644-ab26f98ee420 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'create', calling method: .version_select at 0x7f112f2689d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-847513485", "description": "tempest-description-1341522989"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:38.045707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fd2214b8-1556-4b93-b644-ab26f98ee420 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.162298 Oct 11 02:00:38.046503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3059/6164] 10.222.0.66 () {60 vars in 1180 bytes} [Tue Oct 11 02:00:37 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:38.060826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-847513485"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:38.061362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:38.067400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:38.067887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:38.068326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:38.069046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:38.069503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:38.069930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:38.200059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Adding security group 510bec76-1d9e-4a2b-8ad8-8d430d14953d to port f5a9d551-5aed-49de-af8e-716627710904 Oct 11 02:00:38.516063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe5b3c46-11d8-4a51-9552-bb0c362b6a24 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action" status: 202 len: 0 microversion: 2.1 time: 0.459115 Oct 11 02:00:38.517799 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3106/6165] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:00:38 2022] POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:00:38.534318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-847513485"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:38.535152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:38.540265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:38.545646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:38.546408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:38.547123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:38.548218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:38.549573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:38.551095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:38.552067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:38.552841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:38.553852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:38.592774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] Creating event network-changed:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:38.625104 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9944b637-8ffe-4f3b-a426-6924ee7bfc8a req-7134094d-cab7-40dd-b5e9-d615bad8a217 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097075 Oct 11 02:00:38.643856 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3107/6166] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:38.837996 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Removing security group 510bec76-1d9e-4a2b-8ad8-8d430d14953d from port f5a9d551-5aed-49de-af8e-716627710904 Oct 11 02:00:39.204468 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-795c0ff7-f525-42fb-9e02-bf259c277889 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action" status: 202 len: 0 microversion: 2.1 time: 0.682184 Oct 11 02:00:39.211882 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3060/6167] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:00:38 2022] POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:00:39.218316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95ae2fbb-d3b2-46c8-a96c-86d4e68c100b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'create', calling method: .version_select at 0x7f112efd34c0>, body: {"pool": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:40.586737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95ae2fbb-d3b2-46c8-a96c-86d4e68c100b tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.373219 Oct 11 02:00:40.587680 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3108/6168] 10.222.0.66 () {60 vars in 1170 bytes} [Tue Oct 11 02:00:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:00:40.600741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.235"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:40.603299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:40.609343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:40.610126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:40.610566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:40.611252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:40.611775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:40.612187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:40.637646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 02:00:40.638052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquired lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 02:00:40.682999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:40.697805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:40.698330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:40.698780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:40.711363 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] Creating event network-changed:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:40.716562 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-334edf81-4e40-4041-ba27-e2c2a3d3be8f req-5c4f6c7d-ff8c-49c4-a3d3-1c223088b26f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037176 Oct 11 02:00:40.717174 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3109/6169] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:00:42.244542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Building network info cache for instance {{(pid=120494) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 02:00:42.734865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:42.749778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:42.750271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:42.750934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:42.763875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] Creating event network-changed:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:42.772198 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-26476463-e64f-481b-8dbb-45e1e99d5229 req-d9d88232-573c-4869-a43a-7c53c5ae157e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042739 Oct 11 02:00:42.776537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3110/6170] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:00:42.925783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Updating instance_info_cache with network_info: [{"id": "f5a9d551-5aed-49de-af8e-716627710904", "address": "fa:16:3e:20:25:ad", "network": {"id": "3e6bc0c7-b7d4-4e6c-836c-d9add1e6bb9d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1532034828-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c85222668794c05bc021e02e3df4c68", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5a9d551-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120494) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 02:00:42.945869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Releasing lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 02:00:42.950686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b4ec157-6581-411c-91e1-f57a9d07bc2e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action" status: 202 len: 0 microversion: 2.1 time: 2.351458 Oct 11 02:00:42.951943 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3061/6171] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:00:40 2022] POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action => generated 0 bytes in 2357 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 02:00:42.961021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.235"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:43.157446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:43.164424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:43.164919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:43.165364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:43.166376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:43.166678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:43.166951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:43.503639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 02:00:43.512013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquired lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 02:00:45.250182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Building network info cache for instance {{(pid=120493) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 02:00:45.404346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:45.410326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=44 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:45.419767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:45.420474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:45.421066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:45.436801 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] Creating event network-changed:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:45.442260 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c813a3eb-6562-4f50-ae7d-db543724f2a7 req-c363d363-fbe1-457d-bba4-6663f529d255 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192454 Oct 11 02:00:45.443182 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3062/6172] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:00:45.964796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Updating instance_info_cache with network_info: [{"id": "f5a9d551-5aed-49de-af8e-716627710904", "address": "fa:16:3e:20:25:ad", "network": {"id": "3e6bc0c7-b7d4-4e6c-836c-d9add1e6bb9d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1532034828-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c85222668794c05bc021e02e3df4c68", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5a9d551-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120493) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 02:00:45.972968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:SAVEPOINT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:00:45.984193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Releasing lock "refresh_cache-6786add4-0653-4039-8ec5-132dfc1bb7a2" {{(pid=120493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 02:00:45.985419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0c331f33-f1e6-4ff9-8201-d80b3067008f tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action" status: 202 len: 0 microversion: 2.1 time: 3.028899 Oct 11 02:00:45.989818 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3111/6173] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:00:42 2022] POST /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2/action => generated 0 bytes in 3034 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 02:00:45.995686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8a07f11-61d9-40bf-a5a5-efdf24ee0360 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '.version_select at 0x7f112f6eb8b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:46.923253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8a07f11-61d9-40bf-a5a5-efdf24ee0360 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/9d3aee2e-a339-4240-811b-67e96d058d9b" status: 202 len: 0 microversion: 2.1 time: 0.931810 Oct 11 02:00:46.923946 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3063/6174] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 02:00:45 2022] DELETE /compute/v2.1/os-floating-ips/9d3aee2e-a339-4240-811b-67e96d058d9b => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:00:46.933295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-605a9ff8-9965-4fff-9c5c-66842fbd98e5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '.version_select at 0x7f112eff9f70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:47.116494 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-605a9ff8-9965-4fff-9c5c-66842fbd98e5 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/510bec76-1d9e-4a2b-8ad8-8d430d14953d" status: 202 len: 0 microversion: 2.1 time: 0.187466 Oct 11 02:00:47.121557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3112/6175] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 02:00:46 2022] DELETE /compute/v2.1/os-security-groups/510bec76-1d9e-4a2b-8ad8-8d430d14953d => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:00:47.126773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:47.127428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:47.134329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:47.134823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:47.135469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:47.136359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:47.136820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:47.137251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:47.163641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:00:47.241662 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-100631b9-2aa0-46b4-89a5-d66459ae237e tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 204 len: 0 microversion: 2.1 time: 0.118842 Oct 11 02:00:47.242262 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3064/6176] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:00:47 2022] DELETE /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 02:00:47.250111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:47.250859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:47.258744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:47.260799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:47.261711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:47.262485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:47.263031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:47.263562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:47.396735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:47.404666 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-73d88557-79ff-41ed-8f46-f47aa2412a45 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1510 microversion: 2.1 time: 0.158358 Oct 11 02:00:47.405231 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3113/6177] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:47 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:48.427894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:48.428592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:48.435246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:48.435764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:48.436199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:48.436895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:48.437334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:48.437758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:48.569058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:48.576815 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47161d8e-8ac4-42f3-94e5-ee3a69affe15 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1510 microversion: 2.1 time: 0.153303 Oct 11 02:00:48.577388 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3065/6178] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:48 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:49.601260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:49.601876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:49.608705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:49.609200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:49.609911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:49.610626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:49.611083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:49.611560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:49.751257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd4a9cd40a194fd3b0bed4d761dc63f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85222668794c05bc021e02e3df4c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:00:49.759685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71770f57-0779-46c9-990e-37cc44a97482 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 200 len: 1510 microversion: 2.1 time: 0.162885 Oct 11 02:00:49.760419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3114/6179] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:49 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:00:50.193351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6786add4-0653-4039-8ec5-132dfc1bb7a2", "name": "network-vif-deleted", "tag": "f5a9d551-5aed-49de-af8e-716627710904"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:00:50.204555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:50.205537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:50.210931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:50.231263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] Creating event network-vif-deleted:f5a9d551-5aed-49de-af8e-716627710904 for instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 on n-h2-772273-9 Oct 11 02:00:50.238170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a903f6b1-adc5-46d7-9652-271a5c676b04 req-24e21051-835a-4c3c-8ac2-775071cac63f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123896 Oct 11 02:00:50.238872 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3066/6180] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:00:50.783934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:00:50.784505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] [instance: 6786add4-0653-4039-8ec5-132dfc1bb7a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:00:50.791976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:50.792464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:50.792904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:50.793599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:00:50.794058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:00:50.794489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:00:50.808421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] HTTP exception thrown: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Request method failure captured: Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 HTTP/1.1 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM4ZwmAUVDlumHbftQjz8IPiwHRCZyeDxvZxfPIxgdmxq-hUO1AVHrsxLIxOdJ4vQxgzHb5xsJT7Psd3vdlgOOguVIl1rhyKQI8dy8mlbOkJbVZUxg-_Bk6mnTOc88HiOHNq5LSnJNU-1vALG1Olgg9d2Qjr9fCK9rSUT1dYG87061k Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 1c85222668794c05bc021e02e3df4c68 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-394593209 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1c85222668794c05bc021e02e3df4c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1c85222668794c05bc021e02e3df4c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c85222668794c05bc021e02e3df4c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c85222668794c05bc021e02e3df4c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-394593209 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 1c85222668794c05bc021e02e3df4c68 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-394593209 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerRescueTestJSONUnderV235-394593209-project Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: cd4a9cd40a194fd3b0bed4d761dc63f9 Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-394593209-project Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6786add4-0653-4039-8ec5-132dfc1bb7a2'} Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:00:50.810085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] Returning 404 to user: Instance 6786add4-0653-4039-8ec5-132dfc1bb7a2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c58a31b9-8e9c-4c2f-af7c-1260c729d682 tempest-ServerRescueTestJSONUnderV235-394593209 tempest-ServerRescueTestJSONUnderV235-394593209-project] 10.222.0.66 "GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2" status: 404 len: 111 microversion: 2.1 time: 0.031832 Oct 11 02:00:50.814716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3115/6181] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:00:50 2022] GET /compute/v2.1/servers/6786add4-0653-4039-8ec5-132dfc1bb7a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:01:00.201701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:00.219467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=59,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:00.270075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1085011468", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:00.331289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:00.753485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:00.753954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:00.754472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:00.754891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:00.755313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:00.765123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:00.765981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:00.766465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:00.767305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:00.767831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:00.768285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:00.787574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:00.793691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:00.809700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:00.812191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:00.858374 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75be2091-8a73-456d-b353-53499eaee897 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740774 Oct 11 02:01:00.859226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3067/6182] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:01:00.871290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27db41e5-9234-47a6-bd6f-1eeb5a382a0e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:00.872172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27db41e5-9234-47a6-bd6f-1eeb5a382a0e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:00.875687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=35 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:00.876332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:00.947428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-27db41e5-9234-47a6-bd6f-1eeb5a382a0e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:00.972184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27db41e5-9234-47a6-bd6f-1eeb5a382a0e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1193 microversion: 2.1 time: 0.104215 Oct 11 02:01:00.974121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3116/6183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:00 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:01.996594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:01.997796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:02.005412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:02.006723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:02.007578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:02.008826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:02.009507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:02.015927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:02.156769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:02.180164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9aba4a33-50a8-4acd-91b6-7f9a71f49228 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1253 microversion: 2.1 time: 0.187229 Oct 11 02:01:02.182628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3068/6184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:01 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1253 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:03.206100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:03.206719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:03.221751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:03.222262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:03.222707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:03.223449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:03.223911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:03.224403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:03.455410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:03.466896 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-946f69bb-0211-41c2-bc0d-b02c4a9532fc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.264622 Oct 11 02:01:03.467837 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3117/6185] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:03 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:03.800145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b4ff9d-b012-4f1a-a9ee-c223af1da782", "tag": "5362c704-b52d-4b42-9929-1fa7f45d46a0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:03.818094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:03.818863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:03.819935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:03.835212 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] Creating event network-changed:5362c704-b52d-4b42-9929-1fa7f45d46a0 for instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 on n-h2-772273-9 Oct 11 02:01:03.841130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-935f5eaf-037e-494e-ac57-8e4955912d79 req-03974978-01aa-4fc2-846e-8a5ef75cffeb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047560 Oct 11 02:01:03.842232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3069/6186] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:04.493688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:04.494305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:04.502231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:04.503374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:04.503999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:04.504866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:04.505494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:04.506115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:04.660115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:04.668260 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d91590b0-dac1-48a5-aa61-8fb37c9e4b38 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.179263 Oct 11 02:01:04.668916 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3118/6187] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:04 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:05.692124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:05.692832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:05.700812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:05.701308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:05.701747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:05.702447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:05.702902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:05.703332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:05.838031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:05.845761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e60da582-bbaf-455a-94bd-fd06ad025096 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.158051 Oct 11 02:01:05.846350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3070/6188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:05 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:06.869343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:06.870710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:06.877509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:06.878646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:06.879368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:06.880287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:06.880998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:06.881652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:07.031616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:07.044405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d7ae4b5-8551-448a-84d1-f826adf7e596 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.179362 Oct 11 02:01:07.060439 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3119/6189] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:06 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:08.069451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:08.070092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:08.076988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:08.077490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:08.077922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:08.078622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:08.079085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:08.079550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:08.220587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:08.229654 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-260e0ace-15c5-478d-a835-0abf44b9e471 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.164697 Oct 11 02:01:08.230358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3071/6190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:08 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:09.252820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:09.253352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:09.260064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:09.260574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:09.261017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:09.261735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:09.262193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:09.262624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:09.395730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:09.404046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6931f043-d551-4dec-8ed1-6f945c4ea921 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.155398 Oct 11 02:01:09.404626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3120/6191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:09 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:10.300784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b4ff9d-b012-4f1a-a9ee-c223af1da782", "name": "network-vif-plugged", "status": "completed", "tag": "5362c704-b52d-4b42-9929-1fa7f45d46a0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:10.312782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:10.313413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:10.313958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:10.325920 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] Creating event network-vif-plugged:5362c704-b52d-4b42-9929-1fa7f45d46a0 for instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 on n-h2-772273-9 Oct 11 02:01:10.331656 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-85922a55-7632-418a-80a1-cfc4d281b1b5 req-6644aa08-02fd-4af6-b32e-56daef091f18 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Oct 11 02:01:10.332630 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3072/6192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:10.428373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:10.429752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:10.437040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:10.437545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:10.437985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:10.438849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:10.439314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:10.439811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:10.579551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:10.588410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0be64ab1-0822-4d05-aa78-eb6c34139419 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.164847 Oct 11 02:01:10.599801 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3121/6193] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:10 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:11.332890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:11.334265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:11.340430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:11.341097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:11.348644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:11.349828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:11.350333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:11.351031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:11.351517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:11.351943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:11.376941 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9be98ba6-9c91-4120-bad9-2e810a0850db tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.045004 Oct 11 02:01:11.377568 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3073/6194] 10.222.0.66 () {58 vars in 1293 bytes} [Tue Oct 11 02:01:11 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:11.611235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:11.611825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:11.613733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:11.620095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:11.620591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:11.621027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:11.621724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:11.622180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:11.622605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:11.763272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:11.772089 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a70be79-c354-463e-84dd-7a08582c1229 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1293 microversion: 2.1 time: 0.164932 Oct 11 02:01:11.772770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3122/6195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:11 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:12.795122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:12.795776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:12.803298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:12.803845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:12.804290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:12.805001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:12.805462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:12.805893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:12.939646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:12.948525 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99bd180f-0cbb-4b99-82e3-2496e8d0ba73 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1474 microversion: 2.1 time: 0.157352 Oct 11 02:01:12.949135 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3074/6196] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:12 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:13.015482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-478292870", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:13.070002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:13.441255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:13.441715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:13.442195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:13.442610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:13.443029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:13.451889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:13.452320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:13.452760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:13.453496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:13.453957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:13.454390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:13.470889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:13.476681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:13.488991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:13.491943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:13.537557 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49401123-dd73-4486-918a-3d778cb919c0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525802 Oct 11 02:01:13.538220 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3123/6197] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:01:13.549871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:13.550368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:13.567847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:01:13.819286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.scheduler.client.report [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Deleted allocations for instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 Oct 11 02:01:13.832312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Instance Mapping does not exist while attempting local delete cleanup. Oct 11 02:01:13.833126 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fed7013c-2064-41dd-82d1-0ebb2d3337e5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5" status: 204 len: 0 microversion: 2.1 time: 0.287345 Oct 11 02:01:13.837275 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3075/6198] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:01:13 2022] DELETE /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:01:13.844006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:13.844857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:13.851312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 HTTP/1.1 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5'} Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:13.853116 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5700a4c4-5f53-4a8b-af3f-e1ee23ea474a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5" status: 404 len: 111 microversion: 2.1 time: 0.017412 Oct 11 02:01:13.858896 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3124/6199] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:13 2022] GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:01:13.917954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-280186051", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:13.977742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:14.389103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:14.389540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:14.390050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:14.390464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:14.390879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:14.399789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:14.400277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:14.400714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:14.401451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:14.401936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:14.402365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:14.420270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:14.425905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:14.438765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:14.441016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:14.487220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e1fa2ed-b0ca-4473-9d28-d68221cc0345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573203 Oct 11 02:01:14.487839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3076/6200] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:01:14.501368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1655c686-9382-4cbb-8a2d-c63d0ce172b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:14.502202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1655c686-9382-4cbb-8a2d-c63d0ce172b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:14.572393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1655c686-9382-4cbb-8a2d-c63d0ce172b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:14.579529 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1655c686-9382-4cbb-8a2d-c63d0ce172b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1220 microversion: 2.1 time: 0.083975 Oct 11 02:01:14.580116 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3125/6201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:14 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:15.603761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:15.605001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:15.612100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:15.612838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:15.614574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:15.615878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:15.616582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:15.617017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:15.711324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:15.719580 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20f5e0b2-ed24-40f3-8a30-2cf61286027d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1290 microversion: 2.1 time: 0.120994 Oct 11 02:01:15.731418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3077/6202] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:15 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:16.744742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:16.745365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:16.752476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:16.753194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:16.753730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:16.754352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:16.754962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:16.757560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:16.911587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:16.919441 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-62f6f522-0796-4ae8-8380-d61ea5180086 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.178572 Oct 11 02:01:16.920265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3126/6203] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:16 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:16.983480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f28338-3da8-41ea-84a9-055fc717d5c1", "tag": "69dc9018-f804-4a78-9caf-38e194cca13c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:17.007744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:17.008263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:17.008690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:17.034931 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] Creating event network-changed:69dc9018-f804-4a78-9caf-38e194cca13c for instance 00f28338-3da8-41ea-84a9-055fc717d5c1 on n-h1-772273-9 Oct 11 02:01:17.040006 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-01ed2694-6adc-4196-a3f4-2523b3006bd9 req-50270329-f623-4018-a686-eed336b7b104 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063334 Oct 11 02:01:17.040820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3078/6204] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:17.942270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:17.943099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:17.950324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:17.950879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:17.951455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:17.952303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:17.952864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:17.953396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:18.088713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:18.097143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d3169b6f-67ff-4436-a667-21a9d0f871b0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.158849 Oct 11 02:01:18.097748 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3127/6205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:17 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:19.123311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:19.124379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:19.131413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:19.131985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:19.132501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:19.133282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:19.133882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:19.134383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:19.270440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:19.278389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-19a84ecb-ad1e-4cf0-83dd-9eb6a004235f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.160280 Oct 11 02:01:19.278969 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3079/6206] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:19 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:20.303206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:20.304583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:20.311966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:20.313490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:20.313953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:20.314691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:20.315155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:20.315614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:20.476302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:20.486368 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59b05780-14ff-434a-b044-b6610c367b1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.187948 Oct 11 02:01:20.487805 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3128/6207] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:20 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:21.510354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:21.510870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:21.517924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:21.518422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:21.518871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:21.519602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:21.520063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:21.520529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:21.655966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:21.664604 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3143ef2b-72c2-47a6-abff-88f56f4e85da tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.158335 Oct 11 02:01:21.665458 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3080/6208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:21 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:21.827674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f28338-3da8-41ea-84a9-055fc717d5c1", "name": "network-vif-plugged", "status": "completed", "tag": "69dc9018-f804-4a78-9caf-38e194cca13c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:21.839273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:21.839822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:21.840350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:21.854309 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] Creating event network-vif-plugged:69dc9018-f804-4a78-9caf-38e194cca13c for instance 00f28338-3da8-41ea-84a9-055fc717d5c1 on n-h1-772273-9 Oct 11 02:01:21.860451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-68ffe7ea-57db-4f9d-824c-ebc76ec24570 req-817d4495-0ed2-4bf0-8bdc-9c4ab1c27720 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036358 Oct 11 02:01:21.861086 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3129/6209] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:01:22.690016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:22.691661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:22.699908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:22.700695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:22.701623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:22.702561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:22.703475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:22.704107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:22.871983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:22.883738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-681f75ce-a80b-4c58-a127-f7e542754987 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1320 microversion: 2.1 time: 0.197754 Oct 11 02:01:22.884352 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3081/6210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:22 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:23.907972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:23.908684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:23.911976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:23.917577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:23.918061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:23.918496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:23.919189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:23.919676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:23.920108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.051222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:24.059071 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-087eda2c-47eb-404e-a21a-bda7682431cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1500 microversion: 2.1 time: 0.155457 Oct 11 02:01:24.059690 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3130/6211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:23 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:24.081039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:24.081651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:24.089218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.089697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.090130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.090823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.091275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.091727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.223680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:24.232316 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-742d6b10-e920-4bc9-871b-0b3eab85d603 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1500 microversion: 2.1 time: 0.155140 Oct 11 02:01:24.232897 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3082/6212] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:24 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:24.255419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:24.255915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:24.261850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.262324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.262764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.263477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.263927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.264370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.293279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:01:24.369953 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99834d66-d434-4a2c-bd06-d5bc6aa1efab tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 204 len: 0 microversion: 2.1 time: 0.118196 Oct 11 02:01:24.370773 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3131/6213] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:01:24 2022] DELETE /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:01:24.379603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:24.380738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:24.386840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.387375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.387819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.388519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:24.388983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:24.389418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:24.407617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:24.432609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:24.516775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:24.525203 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-212ce484-26ce-4289-a066-e814a8f58b29 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1506 microversion: 2.1 time: 0.149931 Oct 11 02:01:24.525776 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3083/6214] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:24 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:25.549068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:25.549777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:25.551729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:25.558219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:25.558708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:25.559156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:25.559882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:25.560340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:25.560769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:25.691470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:25.699935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cda3dfc6-7dbb-490f-ad0c-cd677c2b8f1a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 200 len: 1506 microversion: 2.1 time: 0.155165 Oct 11 02:01:25.700521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3132/6215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:25 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:26.145998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f28338-3da8-41ea-84a9-055fc717d5c1", "name": "network-vif-deleted", "tag": "69dc9018-f804-4a78-9caf-38e194cca13c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:26.160748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:26.161301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:26.162493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:26.177149 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] Creating event network-vif-deleted:69dc9018-f804-4a78-9caf-38e194cca13c for instance 00f28338-3da8-41ea-84a9-055fc717d5c1 on n-h1-772273-9 Oct 11 02:01:26.185923 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-50754b61-13f6-44eb-8675-099bf52df137 req-b5f4c095-d6d0-488d-88d3-19e436730957 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043022 Oct 11 02:01:26.186794 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3084/6216] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:26.722198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:26.722816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:26.729651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:26.730138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:26.730579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:26.731272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:26.731752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:26.732180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:26.745616 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 HTTP/1.1 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '00f28338-3da8-41ea-84a9-055fc717d5c1'} Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:26.747265 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2760ed02-d788-4bae-b8f6-9ec2f088f15b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 404 len: 111 microversion: 2.1 time: 0.030450 Oct 11 02:01:26.751731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3133/6217] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:26 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:01:26.762846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06c1df87-d99a-43bc-a4df-086bfdd127ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: .version_select at 0x7f112f6ebee0>, body: {"keypair": {"name": "tempest-key-796587955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeXJg+GQc+9Gh90YixToeqtadpe3d2PRoQXorXQgIJSFU1GDJLEXvK1zWfoQdx5INecCWjx4BqUr8pAXal988qPsQLdL/l9FCzwiGOBOg0iQWwLb194BORBlsTKauSfEw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:26.779138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-06c1df87-d99a-43bc-a4df-086bfdd127ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:26.784305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-06c1df87-d99a-43bc-a4df-086bfdd127ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:26.807947 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06c1df87-d99a-43bc-a4df-086bfdd127ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.049461 Oct 11 02:01:26.808552 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3085/6218] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:01:26 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:26.819590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c938d03-ade0-40a2-8446-be06be4bb239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '.version_select at 0x7f112f6ad040>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:26.823608 n-d-772273-9 devstack@n-api.service[120493]: WARNING oslo_db.sqlalchemy.utils [None req-1c938d03-ade0-40a2-8446-be06be4bb239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 02:01:26.828635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c938d03-ade0-40a2-8446-be06be4bb239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.013541 Oct 11 02:01:26.829176 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3134/6219] 10.222.0.66 () {58 vars in 1137 bytes} [Tue Oct 11 02:01:26 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:26.928592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1267721889", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-key-796587955", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:26.981848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:27.614202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:27.614770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:27.615769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:27.616192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:27.616641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:27.625539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:27.626033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:27.626473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:27.627215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:27.627703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:27.628138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:27.645212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:27.650424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:27.652817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:27.665960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:27.668443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:27.715860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0662e87c-f97e-4246-b440-df83b9c34f41 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791161 Oct 11 02:01:27.716525 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3086/6220] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 02:01:27.728073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec6c58c9-fc03-4671-884f-03e96544b008 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:27.728813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec6c58c9-fc03-4671-884f-03e96544b008 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:27.785043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec6c58c9-fc03-4671-884f-03e96544b008 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:27.792746 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec6c58c9-fc03-4671-884f-03e96544b008 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1228 microversion: 2.1 time: 0.069195 Oct 11 02:01:27.793328 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3135/6221] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:27 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1228 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:28.815509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:28.816287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:28.824686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:28.825253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:28.825767 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:28.826545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:28.827079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:28.827604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:28.891177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:28.899036 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6509dbdf-f108-4f4b-9eda-b19433237bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1298 microversion: 2.1 time: 0.087512 Oct 11 02:01:28.899653 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3087/6222] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:28 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:29.922150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:29.922875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:29.930392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:29.930879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:29.931321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:29.932045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:29.932509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:29.932943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:30.062084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab924fe-930c-4b70-8926-6817fc300d99", "tag": "611edcb6-748a-460c-8f38-0f7a8d42ed7a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:30.071998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:30.077864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:30.078223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:30.078881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:30.091069 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] Creating event network-changed:611edcb6-748a-460c-8f38-0f7a8d42ed7a for instance dab924fe-930c-4b70-8926-6817fc300d99 on n-h1-772273-9 Oct 11 02:01:30.093165 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32dff104-3d71-4faa-ac80-d79b0e6755a2 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.174858 Oct 11 02:01:30.104299 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3136/6223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:29 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:30.110327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c1c4372a-af6d-4daa-82ea-8ed90bce88ba req-6d12d490-99ab-470d-ac1f-677666dd59ce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056723 Oct 11 02:01:30.110949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3088/6224] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:31.118131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:31.118743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:31.121429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:31.126650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:31.127134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:31.127603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:31.128300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:31.128752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:31.129178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:31.134398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:31.263678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:31.271493 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbd79572-c878-42bf-bb1b-257812bdb96e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.157618 Oct 11 02:01:31.271966 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3137/6225] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:31 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:32.295678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:32.296388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:32.302513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:32.302998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:32.303465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:32.304160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:32.304617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:32.305042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:32.307686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=87 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:32.443734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:32.451783 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-97e00c6f-61e6-4035-9749-5a8eaed5dab9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.161304 Oct 11 02:01:32.452366 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3089/6226] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:32 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:33.474089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:33.475222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:33.482098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:33.482592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:33.483036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:33.483761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:33.484484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:33.484917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:33.611089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:33.619419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21f2095c-cd0c-4f8d-bcfa-d97206db3f56 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.149242 Oct 11 02:01:33.620300 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3138/6227] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:33 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:34.642290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:34.642954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:34.650592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:34.651291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:34.651799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:34.652538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:34.653003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:34.653439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:34.785965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:34.793590 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffe194ea-e231-4d93-bc9b-c159b787e2aa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.155389 Oct 11 02:01:34.794198 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3090/6228] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:34 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:35.816371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:35.817111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:35.824692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:35.825180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:35.825636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:35.826317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:35.826799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:35.827227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:35.866838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab924fe-930c-4b70-8926-6817fc300d99", "name": "network-vif-plugged", "status": "completed", "tag": "611edcb6-748a-460c-8f38-0f7a8d42ed7a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:35.877404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:35.877893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:35.878288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:35.890629 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] Creating event network-vif-plugged:611edcb6-748a-460c-8f38-0f7a8d42ed7a for instance dab924fe-930c-4b70-8926-6817fc300d99 on n-h1-772273-9 Oct 11 02:01:35.895486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-18f36560-a368-4538-83cc-45d1027b4d1f req-774d868e-8c50-4e5c-828e-2bb25a42f673 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032297 Oct 11 02:01:35.896876 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3091/6229] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:01:35.978167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:35.986347 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-284ac71f-918e-4584-bf04-80ce81c8423c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.174079 Oct 11 02:01:35.987041 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3139/6230] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:35 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:37.012045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:37.012565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:37.019027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:37.019563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:37.020009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:37.020713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:37.021172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:37.021599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:37.156000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:37.165493 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5552e286-57f3-410c-bf24-447870cc2345 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1328 microversion: 2.1 time: 0.158755 Oct 11 02:01:37.166089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3092/6231] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:37 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:38.189476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:38.190095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:38.192455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:38.198481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.198971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.199446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.200140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.200601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.201032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.333024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:38.340700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38a58bf3-7ec3-491c-8793-b89cb56960ca tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1508 microversion: 2.1 time: 0.155339 Oct 11 02:01:38.341327 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3140/6232] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:38 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:38.363085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:38.363769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:38.366275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:38.366939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:38.373516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.374031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.374470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.375171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.375660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.376090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.502038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:38.510403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-558d8567-38f6-410b-ba41-fc9322536171 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1508 microversion: 2.1 time: 0.151566 Oct 11 02:01:38.510987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3093/6233] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:38 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:38.532176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:38.532675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:38.538541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.539008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.539461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.540146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.540594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.541016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.565468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:01:38.638150 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7af07dea-4bec-4d54-90a9-dacb44b6994c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 204 len: 0 microversion: 2.1 time: 0.109537 Oct 11 02:01:38.638731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3141/6234] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:01:38 2022] DELETE /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:01:38.647240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:38.647925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:38.653905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.654403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.654850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.655583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:38.656052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:38.656488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:38.785649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:38.793925 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7649abf-a172-437a-bdb0-b66a1766dcf4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1514 microversion: 2.1 time: 0.150597 Oct 11 02:01:38.794506 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3094/6235] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:38 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:01:39.819206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:39.819940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:39.826757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:39.827244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:39.827713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:39.828410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:39.828867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:39.829297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:39.955898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:39.963833 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b226f3b-c1cc-4314-8c5d-78983713c58c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 200 len: 1514 microversion: 2.1 time: 0.149659 Oct 11 02:01:39.964422 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3142/6236] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:39 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:40.419164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab924fe-930c-4b70-8926-6817fc300d99", "name": "network-vif-deleted", "tag": "611edcb6-748a-460c-8f38-0f7a8d42ed7a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:40.434904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:40.435409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:40.436182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:40.450347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] Creating event network-vif-deleted:611edcb6-748a-460c-8f38-0f7a8d42ed7a for instance dab924fe-930c-4b70-8926-6817fc300d99 on n-h1-772273-9 Oct 11 02:01:40.455750 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8805a20c-6733-4d42-87d7-7b2c20139bb5 req-5837d135-3880-4034-acac-692b5b1d3e6b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041195 Oct 11 02:01:40.461088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3095/6237] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:40.988566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:40.989302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:40.997408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:40.997955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:40.998465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:40.999329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:41.000502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:41.000943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:41.015155 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 HTTP/1.1 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'dab924fe-930c-4b70-8926-6817fc300d99'} Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:41.016927 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d0b4612-2c02-4aca-848c-47f256a66eb8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 404 len: 111 microversion: 2.1 time: 0.034014 Oct 11 02:01:41.021628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3143/6238] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:40 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:01:41.031901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd39a8df-604e-443b-a4cc-ba67e124ed5b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '.version_select at 0x7f112f552820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:41.051917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd39a8df-604e-443b-a4cc-ba67e124ed5b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-key-796587955" status: 202 len: 0 microversion: 2.1 time: 0.024324 Oct 11 02:01:41.053183 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3096/6239] 10.222.0.66 () {58 vars in 1206 bytes} [Tue Oct 11 02:01:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-796587955 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:01:41.104027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-31587158", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:41.158884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:41.529350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:41.529784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:41.530257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:41.530667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:41.531078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:41.540499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:41.540980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:41.541416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:41.542143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:41.542598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:41.543024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:41.559626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:41.564805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:41.576899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:41.579191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:41.624181 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-392844ea-0aee-4acf-aab2-1af8f8bc9eb0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524680 Oct 11 02:01:41.624835 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3144/6240] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:01:41.637485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b36ab06c-efdc-4448-b9da-20d5ea6b8289 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:41.638225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b36ab06c-efdc-4448-b9da-20d5ea6b8289 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:41.695420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b36ab06c-efdc-4448-b9da-20d5ea6b8289 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:41.702446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b36ab06c-efdc-4448-b9da-20d5ea6b8289 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1207 microversion: 2.1 time: 0.069787 Oct 11 02:01:41.703041 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3097/6241] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:41 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:42.726650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:42.727451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:42.735331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:42.735836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:42.736273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:42.736966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:42.737415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:42.737833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:42.804017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:42.811801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cad33c96-a5e8-4172-93a4-0a4708b94206 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1265 microversion: 2.1 time: 0.089923 Oct 11 02:01:42.812384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3145/6242] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:42 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:43.835387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:43.836018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:43.843168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:43.843694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:43.844146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:43.844865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:43.845333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:43.845772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:43.983415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9afa9b24-c585-4d94-8936-55f42714cc74", "tag": "11db46ae-ceb9-4de6-8072-14210c2d9719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:43.986086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:44.001241 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b687bacd-0ee2-4cb5-80de-be02768e1239 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.168271 Oct 11 02:01:44.002847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3098/6243] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:43 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:44.004402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:44.023874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:44.024626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:44.039133 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] Creating event network-changed:11db46ae-ceb9-4de6-8072-14210c2d9719 for instance 9afa9b24-c585-4d94-8936-55f42714cc74 on n-h1-772273-9 Oct 11 02:01:44.044421 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6d04fb82-2964-4dc4-b1c7-29f57e76bef5 req-3b363aee-1f0a-4167-addd-15f0989c05c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066077 Oct 11 02:01:44.045675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3146/6244] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:45.024353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:45.025019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:45.031948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:45.032434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:45.032872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:45.033565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:45.034017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:45.034443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:45.161841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:45.169576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca4d3e7d-56e6-4712-bde2-ff325f9f5f37 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.149109 Oct 11 02:01:45.170162 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3099/6245] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:45 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:46.195925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:46.196628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:46.202764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:46.203246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:46.203707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:46.204397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:46.204852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:46.205278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:46.341160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:46.348861 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-80c6098a-033e-4838-a18d-7ef5a528bf80 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.158130 Oct 11 02:01:46.350350 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3147/6246] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:46 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:47.373634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:47.374258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:47.381757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:47.382250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:47.382696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:47.383425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:47.383892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:47.384326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:47.512577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:47.520313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f42488cc-d7cc-40f6-af23-f3539688efbd tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.150626 Oct 11 02:01:47.520889 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3100/6247] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:47 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:48.543670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:48.544287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:48.551197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:48.551717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:48.552157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:48.553436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:48.553896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:48.554325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:48.685847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:48.693472 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29d99207-2f23-4218-a18e-facb25bf27c9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.153778 Oct 11 02:01:48.694045 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3148/6248] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:48 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:49.716201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:49.716831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:49.723742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:49.724235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:49.724681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:49.725381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:49.725842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:49.726276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:49.857127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:49.865751 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bf18dd7a-edd7-4a19-a5df-2751493da6f9 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.153471 Oct 11 02:01:49.866338 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3101/6249] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:49 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:49.911257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afa9b24-c585-4d94-8936-55f42714cc74", "name": "network-vif-plugged", "status": "completed", "tag": "11db46ae-ceb9-4de6-8072-14210c2d9719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:49.923797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:49.924293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:49.924891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:49.937021 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] Creating event network-vif-plugged:11db46ae-ceb9-4de6-8072-14210c2d9719 for instance 9afa9b24-c585-4d94-8936-55f42714cc74 on n-h1-772273-9 Oct 11 02:01:49.942093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fcfa6ab5-3665-4c55-abf1-c3fe6f94f484 req-465b7ff2-59f6-4473-adb2-76a51b5c83b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Oct 11 02:01:49.943089 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3149/6250] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:01:50.888664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:50.889286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:50.896077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:50.896568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:50.897039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:50.897733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:50.898195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:50.898626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:51.030915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:51.039001 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3921b6c2-35dd-4467-a486-08ea50011dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1307 microversion: 2.1 time: 0.154276 Oct 11 02:01:51.039802 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3102/6251] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:50 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:52.062665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:52.063388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:52.066207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:52.066945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:52.073769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:52.074248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:52.074680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:52.075385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:52.075838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:52.076262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:52.209608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:52.217314 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-421efbae-d6db-4336-9804-e3ffbe4a79b6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1488 microversion: 2.1 time: 0.159060 Oct 11 02:01:52.217922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3150/6252] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:52 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1488 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:52.281610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-31587158", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:52.290708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:52.339393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:01:52.713095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:01:52.713525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:01:52.714035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:01:52.714444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:01:52.714861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:01:52.724166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:52.724662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:52.725144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:52.725888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:52.726379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:52.726815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:52.744157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:01:52.749447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:01:52.762122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:01:52.764460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:01:52.809064 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4008b52e-9875-46b5-890d-2d8573461a17 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531295 Oct 11 02:01:52.809652 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3103/6253] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:01:52.821313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1d79f6dc-404e-4b3b-909a-bf3a56cb3716 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:52.821946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1d79f6dc-404e-4b3b-909a-bf3a56cb3716 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:52.877150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1d79f6dc-404e-4b3b-909a-bf3a56cb3716 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:52.884942 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1d79f6dc-404e-4b3b-909a-bf3a56cb3716 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1207 microversion: 2.1 time: 0.068100 Oct 11 02:01:52.885527 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3151/6254] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:52 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:53.908353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:53.909692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:53.916648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:53.917376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:53.917990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:53.918874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:53.919580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:53.920034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:53.992530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:54.000344 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9be2919f-1e37-4555-9da3-76e2035c4319 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1265 microversion: 2.1 time: 0.096952 Oct 11 02:01:54.000937 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3104/6255] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:53 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:55.029414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:55.030045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:55.036813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:55.037307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:55.037753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:55.038456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:55.038913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:55.039364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:55.173986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:55.183980 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7814f29c-288e-4768-b3a5-f614183a39fb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.164357 Oct 11 02:01:55.188628 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3152/6256] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:55 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:55.204176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c774db5d-8a03-4451-a69a-1657271a8755", "tag": "8bf91b48-c500-4878-a41a-dff4cca60bdc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:01:55.217130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:55.218046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:55.218771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:55.231675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] Creating event network-changed:8bf91b48-c500-4878-a41a-dff4cca60bdc for instance c774db5d-8a03-4451-a69a-1657271a8755 on n-h2-772273-9 Oct 11 02:01:55.236911 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-648d358c-2f94-44c1-a74a-ed4610e87fdb req-7e43a842-789b-4abc-b1e0-f23b65fc6378 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036530 Oct 11 02:01:55.237952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3105/6257] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:01:56.206699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:56.207306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:56.214169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:56.214651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:56.215091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:56.215807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:56.216264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:56.216687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:56.344367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:56.352771 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f344bf32-39df-4510-bd20-221466345bb7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.150008 Oct 11 02:01:56.353353 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3153/6258] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:56 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:57.376546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:57.377187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:57.385432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:57.385921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:57.386368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:57.387073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:57.387570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:57.388005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:57.520321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:57.528028 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6c684ab-cf60-421a-ba72-f1ad9c2600d0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.155873 Oct 11 02:01:57.528608 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3106/6259] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:57 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:58.551771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:58.552407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:58.559279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:58.559807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:58.560256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:58.560950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:58.561412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:58.561841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:58.692026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:58.699742 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f95e7834-fb7f-4045-9b77-e4ebf2cb6964 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.152012 Oct 11 02:01:58.700323 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3154/6260] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:58 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:01:59.722343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:01:59.722985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:01:59.726047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:01:59.731428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:59.731914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:59.732352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:59.733039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:01:59.733492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:01:59.734187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:01:59.865529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:01:59.873299 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cc67f0d3-a5ae-481d-bdc6-84a6f55aba20 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.154880 Oct 11 02:01:59.873881 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3107/6261] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:01:59 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:00.896010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:00.896626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:00.903445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:00.903939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:00.904384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:00.905079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:00.905543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:00.905977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:01.035768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:01.038811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:01.046177 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ca44b4d-95e1-4c3d-9f34-2552b0f594fe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.154044 Oct 11 02:02:01.046715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3155/6262] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:00 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:02.068874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:02.069497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:02.076348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:02.076835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:02.077279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:02.077970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:02.078427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:02.078856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:02.206773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:02.214461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50b41715-f6a3-4d7a-a84f-59a762e89ccc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.149555 Oct 11 02:02:02.215029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3108/6263] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:02 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:02.430859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c774db5d-8a03-4451-a69a-1657271a8755", "name": "network-vif-plugged", "status": "completed", "tag": "8bf91b48-c500-4878-a41a-dff4cca60bdc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:02.436903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:02.443230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:02.443739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:02.444168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:02.457508 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] Creating event network-vif-plugged:8bf91b48-c500-4878-a41a-dff4cca60bdc for instance c774db5d-8a03-4451-a69a-1657271a8755 on n-h2-772273-9 Oct 11 02:02:02.465392 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bb3149c7-c894-47e0-ba00-47af9d9f41bc req-0e3bc642-e75e-4fdf-bd6e-5bf7c725a622 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038081 Oct 11 02:02:02.466172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3156/6264] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:02:03.238463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:03.239086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:03.240972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:03.241644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:03.248327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:03.248824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:03.249269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:03.249977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:03.250438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:03.250874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:03.254296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=92 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:03.385711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:03.394012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e168309f-88ca-419c-8584-a049569734a5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1307 microversion: 2.1 time: 0.159505 Oct 11 02:02:03.394596 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3109/6265] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:03 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:04.415088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:04.420570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:04.421265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:04.428685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.429165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.429596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.430280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.430730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.431155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.563764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:04.571632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1818adda-32b8-4441-b7fc-1d4a8fef2cbf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1487 microversion: 2.1 time: 0.157557 Oct 11 02:02:04.572235 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3157/6266] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:04 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1487 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:04.594060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:04.594673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:04.602107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.602589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.603031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.603754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.604210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.604638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.736815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:04.744512 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-770891d6-6e5c-478d-b466-b8e5d4a0a03d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1488 microversion: 2.1 time: 0.154302 Oct 11 02:02:04.745089 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3110/6267] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:04 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1488 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:02:04.766060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:04.766707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:04.773196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.773679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.774118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.774804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.775258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.775708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.903003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:04.910695 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0d106b20-6cd6-4c71-9e8c-39b5bef69caa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1487 microversion: 2.1 time: 0.148486 Oct 11 02:02:04.911973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3158/6268] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:04 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1487 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:04.933841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:04.934273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:04.940086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.940569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.941003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.941691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:04.942156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:04.942563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:04.969435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:02:05.046827 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95428494-3990-4a8a-a22a-20ffb3f16a2c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 204 len: 0 microversion: 2.1 time: 0.116562 Oct 11 02:02:05.047642 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3111/6269] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:02:04 2022] DELETE /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:02:05.057102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:05.057724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:05.063720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:05.064212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:05.064652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:05.065351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:05.065835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:05.066270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:05.200585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:05.208464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a4db4fc-b4e1-43c2-b219-5818b8f4ed13 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1493 microversion: 2.1 time: 0.155260 Oct 11 02:02:05.209075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3159/6270] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:05 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1493 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:06.234307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:06.235023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:06.242252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:06.242749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:06.243194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:06.243983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:06.244428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:06.244868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:06.378145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:06.386531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-87d3cdcf-fc65-4e4a-879d-9d8f4653f244 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1493 microversion: 2.1 time: 0.158148 Oct 11 02:02:06.399513 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3112/6271] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:06 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:02:06.941345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c774db5d-8a03-4451-a69a-1657271a8755", "name": "network-vif-deleted", "tag": "8bf91b48-c500-4878-a41a-dff4cca60bdc"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:06.956952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:06.957452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:06.957898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:06.972899 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] Creating event network-vif-deleted:8bf91b48-c500-4878-a41a-dff4cca60bdc for instance c774db5d-8a03-4451-a69a-1657271a8755 on n-h2-772273-9 Oct 11 02:02:06.981534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-00755f4b-6a06-4751-8fe8-61e01c0bdd96 req-cb76240e-fbbc-43e2-abdb-a044ed4edee4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044869 Oct 11 02:02:06.982421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3160/6272] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:07.410474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:07.411024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:07.418862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:07.419391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:07.419845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:07.420569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:07.421036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:07.421480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:07.455490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:07.455994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:07.456443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:07.456900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lazy-loading 'fault' on Instance uuid c774db5d-8a03-4451-a69a-1657271a8755 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:02:07.501509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:07.510210 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2b8eb01-4061-4b88-ac5c-8cbc96db4c54 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 200 len: 1297 microversion: 2.1 time: 0.103719 Oct 11 02:02:07.510789 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3113/6273] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:07 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:08.535709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:08.537026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:08.543191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.543703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.544144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.544837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.545295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.545726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.559064 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 HTTP/1.1 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c774db5d-8a03-4451-a69a-1657271a8755'} Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:08.560772 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8fe2706-9eb3-4113-8a5c-2ff31f296da5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 404 len: 111 microversion: 2.1 time: 0.031737 Oct 11 02:02:08.566408 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3161/6274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:08 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:02:08.571085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:08.571645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:08.579100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.579634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.580083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.580790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.581253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.581726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.607737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:02:08.681281 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e5325a3-e8de-4bec-8f57-be07313a0082 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 204 len: 0 microversion: 2.1 time: 0.113874 Oct 11 02:02:08.682129 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3114/6275] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:02:08 2022] DELETE /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:02:08.690706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:08.691360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:08.697935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.698422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.698861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.699580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:08.700038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:08.700471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:08.832839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:08.841136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3defe99-ad34-4542-b051-7e4f01547397 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1494 microversion: 2.1 time: 0.154419 Oct 11 02:02:08.841707 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3162/6276] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:08 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1494 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:09.864980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:09.865693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:09.872871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:09.873365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:09.874074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:09.874782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:09.875251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:09.875716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:10.004858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:10.012793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3335bb2-86b0-47df-a362-f2b1233ea696 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1494 microversion: 2.1 time: 0.152200 Oct 11 02:02:10.013383 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3115/6277] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:09 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1494 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:10.614992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afa9b24-c585-4d94-8936-55f42714cc74", "name": "network-vif-deleted", "tag": "11db46ae-ceb9-4de6-8072-14210c2d9719"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:10.627073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:10.627606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:10.628040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:10.642969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] Creating event network-vif-deleted:11db46ae-ceb9-4de6-8072-14210c2d9719 for instance 9afa9b24-c585-4d94-8936-55f42714cc74 on n-h1-772273-9 Oct 11 02:02:10.651544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f3c6b3c8-f51c-4399-8c65-4e7d99d698f7 req-4624e034-5b26-4b15-8b74-a61ab666a204 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045970 Oct 11 02:02:10.652310 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3163/6278] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:11.037760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:11.038621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:11.045437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:11.045941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:11.046388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:11.047106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:11.047595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:11.048033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:11.083630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:11.084120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:11.084557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:11.085001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lazy-loading 'fault' on Instance uuid 9afa9b24-c585-4d94-8936-55f42714cc74 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:02:11.128836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:11.137252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-647afd43-b53e-4968-be9b-944f2609e8e6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 200 len: 1297 microversion: 2.1 time: 0.103867 Oct 11 02:02:11.137847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3116/6279] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:11 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:12.162251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:12.162913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:12.169975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:12.170457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:12.170896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:12.171614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:12.172073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:12.172498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:12.186510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 HTTP/1.1 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9afa9b24-c585-4d94-8936-55f42714cc74'} Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:12.188161 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32cc7a5b-0c96-47a4-962b-95b62ef31623 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 404 len: 111 microversion: 2.1 time: 0.031722 Oct 11 02:02:12.194013 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3164/6280] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:12 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:02:12.241202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2139898854", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:12.293645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:02:12.655203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:02:12.655679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:02:12.656166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:02:12.656582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:02:12.657032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:02:12.666427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:12.666914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:12.667385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:12.668131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:12.668640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:12.669026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:12.687497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:02:12.692966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:02:12.707973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:02:12.710295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:02:12.756544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4460935c-0056-4f76-af5f-178c41d74c27 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519826 Oct 11 02:02:12.757527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3117/6281] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:02:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:02:12.768448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fa1f3d84-a508-4425-911e-beb65603889e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:12.769057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fa1f3d84-a508-4425-911e-beb65603889e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:12.827851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fa1f3d84-a508-4425-911e-beb65603889e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:12.835448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fa1f3d84-a508-4425-911e-beb65603889e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1209 microversion: 2.1 time: 0.070937 Oct 11 02:02:12.836055 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3165/6282] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:12 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:02:13.858295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:13.859284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:13.867689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:13.868182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:13.868623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:13.869350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:13.869808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:13.870238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:13.940520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:13.948594 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-146bd627-b16f-4f00-a96c-e048e1753dcc tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1267 microversion: 2.1 time: 0.094382 Oct 11 02:02:13.949176 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3118/6283] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:13 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:14.972177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:14.972760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:14.980702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:14.981196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:14.981636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:14.982333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:14.982798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:14.983230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:15.121807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:15.129568 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d9c8e92-fa74-459b-9fd9-f60071ed3b98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.161429 Oct 11 02:02:15.130148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3166/6284] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:14 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:15.407353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e925b6e0-466a-4d78-a223-db8ee76e9d91", "tag": "3c0fccc3-e4fd-451d-b4c2-ca49e5973db6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:15.421829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:15.422318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:15.422968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:15.436237 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] Creating event network-changed:3c0fccc3-e4fd-451d-b4c2-ca49e5973db6 for instance e925b6e0-466a-4d78-a223-db8ee76e9d91 on n-h1-772273-9 Oct 11 02:02:15.441279 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-74d5f06c-f0d9-4c8f-aa33-390718a2d8c5 req-00eb084e-abd8-470d-bc2e-698559e336ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039691 Oct 11 02:02:15.442253 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3119/6285] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:16.153100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:16.153652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:16.160696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:16.161175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:16.161612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:16.162790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:16.163251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:16.163697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:16.296231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:16.304524 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3496dc2-edc8-4d80-b6f7-dc7c720b5ece tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.155437 Oct 11 02:02:16.305098 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3167/6286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:16 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:17.327556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:17.328286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:17.335779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:17.336259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:17.336700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:17.337387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:17.337836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:17.338260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:17.466432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:17.474297 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef35d417-4e34-42bd-a737-6bf19401c839 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.151109 Oct 11 02:02:17.475531 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3120/6287] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:17 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:18.498493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:18.499105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:18.506666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:18.507155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:18.507622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:18.508315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:18.508792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:18.509221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:18.805902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:18.813587 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21090e21-f695-44a3-abb0-be2e08ff3336 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.319659 Oct 11 02:02:18.814163 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3168/6288] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:18 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:19.837059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:19.837686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:19.844636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:19.845125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:19.845565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:19.846259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:19.846822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:19.847154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:19.985613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:19.993566 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3034ea4-80fd-4246-80f0-84c4ca48fbaa tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.161085 Oct 11 02:02:19.994150 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3121/6289] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:19 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:20.082632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e925b6e0-466a-4d78-a223-db8ee76e9d91", "name": "network-vif-plugged", "status": "completed", "tag": "3c0fccc3-e4fd-451d-b4c2-ca49e5973db6"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:20.095107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:20.095728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:20.096181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:20.107690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] Creating event network-vif-plugged:3c0fccc3-e4fd-451d-b4c2-ca49e5973db6 for instance e925b6e0-466a-4d78-a223-db8ee76e9d91 on n-h1-772273-9 Oct 11 02:02:20.112932 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d867b2e1-3fe6-4ca2-ab95-bf9c2b2affe0 req-6d563fbd-aa36-4961-b861-61002b7ea9e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034192 Oct 11 02:02:20.113547 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3169/6290] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:21.017082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:21.017724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:21.025187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:21.025667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:21.026103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:21.026795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:21.027246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:21.027698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:21.157347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:21.165942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e91b894d-2f40-43cc-8229-8fa0f7160046 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1309 microversion: 2.1 time: 0.152723 Oct 11 02:02:21.166538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3122/6291] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:21 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:22.189693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:22.190413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.197193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.197681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.198125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.198823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.199284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.199741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.332735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:22.340770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f6fa5bcb-84af-4a89-b943-0b2ef07674ef tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1489 microversion: 2.1 time: 0.155577 Oct 11 02:02:22.341350 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3170/6292] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:22 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1489 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:22.364198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:22.367452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.374207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.374686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.375122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.375838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.376289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.376713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.379930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:22.445240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3108b5be-5540-457f-b2ef-350eb87b73e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "PUT /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1084 microversion: 2.1 time: 0.084985 Oct 11 02:02:22.445880 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3123/6293] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 02:02:22 2022] PUT /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1084 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:22.464885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:22.465504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.471386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.471869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.472302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.472983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.473431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.473852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.607373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:22.615561 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d02227a-6c74-4155-96f4-f954303edcc4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1510 microversion: 2.1 time: 0.154507 Oct 11 02:02:22.616160 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3171/6294] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:22 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:22.637753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:22.638452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.645032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.645527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.645969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.647197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.647696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.648130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.679396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:22.701671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:22.788712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:22.796638 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c09c066a-e710-43e5-a13f-eeb017cb365b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1510 microversion: 2.1 time: 0.162875 Oct 11 02:02:22.797408 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3124/6295] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:22 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:22.819157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:22.819600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.826638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.827125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.827588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.828282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.828767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.829192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.835082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:22.859541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:02:22.938813 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b2fe7aa-d37b-4927-8267-6eeb81c8ee2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 204 len: 0 microversion: 2.1 time: 0.123982 Oct 11 02:02:22.939820 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3172/6296] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:02:22 2022] DELETE /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:02:22.948348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:22.949578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:22.955805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.956373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.956886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:22.957654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:22.958182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:22.958677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:23.091256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:23.099722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c93abc1b-00db-4a14-afc0-8f50c489fa4b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1516 microversion: 2.1 time: 0.155809 Oct 11 02:02:23.100320 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3125/6297] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:22 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:24.123558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:24.124277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:24.131761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:24.132255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:24.132699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:24.133393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:24.133856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:24.134296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:24.264670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:24.272665 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6dbc16b1-e4a9-488c-b6c3-9229d761ae5a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 200 len: 1516 microversion: 2.1 time: 0.153411 Oct 11 02:02:24.273245 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3173/6298] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:24 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:24.714730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e925b6e0-466a-4d78-a223-db8ee76e9d91", "name": "network-vif-deleted", "tag": "3c0fccc3-e4fd-451d-b4c2-ca49e5973db6"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:24.729127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:24.730074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:24.730074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:24.749544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] Creating event network-vif-deleted:3c0fccc3-e4fd-451d-b4c2-ca49e5973db6 for instance e925b6e0-466a-4d78-a223-db8ee76e9d91 on n-h1-772273-9 Oct 11 02:02:24.756012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-aa196f14-ce08-40bd-98d9-a65ec9e7e48b req-46226011-a266-479f-8269-fa98209d741d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044507 Oct 11 02:02:24.756952 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3126/6299] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:25.295533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:25.296260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:25.303782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:25.304265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:25.304708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:25.305395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:25.305851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:25.306276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:25.319456 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 HTTP/1.1 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e925b6e0-466a-4d78-a223-db8ee76e9d91'} Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:25.321128 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c22fd557-666b-499f-8489-af2a40b85dd8 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 404 len: 111 microversion: 2.1 time: 0.031071 Oct 11 02:02:25.326195 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3174/6300] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:25 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:02:25.374145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1233453484", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "14d9676a-db91-4f20-87a3-d7cea9d606bf"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:25.426646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] validate_networks() for [('14d9676a-db91-4f20-87a3-d7cea9d606bf', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:02:25.793324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:02:25.793930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:02:25.794288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:02:25.794709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:02:25.795127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:02:25.804759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:25.805250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:25.805696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:25.806438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:25.806909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:25.807362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:25.824674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:02:25.829949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Getting quotas for user 7f882ea546f441ba987d5fb8b88cbadb and project 93f8a7a1c5334640b4a0282f76ce7ced. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:02:25.842306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:02:25.844741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:02:25.890395 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37a5f4d4-1655-429f-8d3c-7192b92f6822 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520939 Oct 11 02:02:25.891057 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3127/6301] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:02:25.902158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b17130ce-224c-41a2-8589-8d0e9ab538cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:25.902867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b17130ce-224c-41a2-8589-8d0e9ab538cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:25.956946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b17130ce-224c-41a2-8589-8d0e9ab538cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:25.964398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b17130ce-224c-41a2-8589-8d0e9ab538cb tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1209 microversion: 2.1 time: 0.065986 Oct 11 02:02:25.965368 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3175/6302] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:25 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1209 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:26.990142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:26.990553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:26.998051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:26.998694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:26.999289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:27.000038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:27.000722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:27.001319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:27.065133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:27.073519 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-655d510a-ac24-4366-8be0-fd8c9f5e68a6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1267 microversion: 2.1 time: 0.089053 Oct 11 02:02:27.074095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3128/6303] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:26 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:28.096369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:28.097106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:28.105217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:28.105713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:28.106164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:28.106867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:28.107331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:28.107789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:28.239729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:28.249040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10789bb-abf3-4a7e-9b2e-743db71820a0", "tag": "ab516c3c-3625-461b-9dd3-99d0466ca42c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:28.249751 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-879fc072-d8a4-4811-bfa9-4dfdb3b3ce98 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.157038 Oct 11 02:02:28.250431 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3176/6304] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:28 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:28.263670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:28.264759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:28.265523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:28.279193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] Creating event network-changed:ab516c3c-3625-461b-9dd3-99d0466ca42c for instance b10789bb-abf3-4a7e-9b2e-743db71820a0 on n-h1-772273-9 Oct 11 02:02:28.285107 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f85623ac-ae5c-400f-85d8-b8a0b55bc286 req-7b911a6f-a28d-460d-95e8-d522724e0665 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044773 Oct 11 02:02:28.285983 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3129/6305] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:02:29.273526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:29.274145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:29.281306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:29.281739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:29.282181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:29.282882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:29.283367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:29.283803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:29.299325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:29.418206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:29.425939 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0c7c3b0a-4236-41d2-9f90-a43456541605 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.156961 Oct 11 02:02:29.426520 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3177/6306] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:29 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:02:30.450009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:30.450727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:30.453374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:30.459156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:30.459687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:30.460212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:30.461219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:30.461889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:30.462492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:30.592941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:30.601103 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae5a1943-cecb-46a2-ac1d-058ab4885600 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.155395 Oct 11 02:02:30.601682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3130/6307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:30 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:31.624293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:31.624901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:31.631793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:31.632288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:31.632729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:31.633453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:31.633895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:31.634328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:31.764713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:31.772979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6679d9ca-6ca5-4ff4-8a12-e2f4fde374e7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.152638 Oct 11 02:02:31.773556 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3178/6308] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:31 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:32.795621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:32.796251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:32.803182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:32.803710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:32.804157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:32.804860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:32.805326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:32.805759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:32.934929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:32.942682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01c42d7e-45a4-4a02-a430-453633cce4e1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.151112 Oct 11 02:02:32.943265 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3131/6309] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:32 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:33.966124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:33.966721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:33.973770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:33.974261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:33.974705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:33.975425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:33.975886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:33.976319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:34.112971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:34.121392 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9f43ba22-ef2f-40c4-b10a-a00053b4de79 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.159281 Oct 11 02:02:34.121978 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3179/6310] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:33 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:34.222797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10789bb-abf3-4a7e-9b2e-743db71820a0", "name": "network-vif-plugged", "status": "completed", "tag": "ab516c3c-3625-461b-9dd3-99d0466ca42c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:34.235537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:34.236106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:34.236622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:34.248752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] Creating event network-vif-plugged:ab516c3c-3625-461b-9dd3-99d0466ca42c for instance b10789bb-abf3-4a7e-9b2e-743db71820a0 on n-h1-772273-9 Oct 11 02:02:34.253588 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fac9c0a7-c9dd-4a3b-b96e-ffe964600efc req-6f501f5b-0067-4bc2-bfad-a974c3cc743b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034656 Oct 11 02:02:34.254188 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3132/6311] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:02:35.144384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:35.145018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:35.147708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:35.153766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:35.154266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:35.154767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:35.155437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:35.155902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:35.156438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:35.291275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:35.299270 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-665a9889-b5ed-426a-940e-48e0482d3e6d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1309 microversion: 2.1 time: 0.158873 Oct 11 02:02:35.299880 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3180/6312] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:35 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:36.321693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:36.322477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:36.326837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:36.327573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:36.334627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.335117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.335588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.336287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.336744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.337175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.465750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:36.473485 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1efaab2d-abb4-45f0-90c1-fd712fd89734 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1489 microversion: 2.1 time: 0.153701 Oct 11 02:02:36.474070 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3133/6313] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:36 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1489 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:36.496806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1138546294"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:36.499395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:36.501405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:36.507754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.508240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.508681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.509373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.509832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.510267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.584680 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-132a4b15-88ef-4c52-af2a-1ede2810bf3d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "PUT /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1074 microversion: 2.1 time: 0.091491 Oct 11 02:02:36.585575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3181/6314] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 02:02:36 2022] PUT /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1074 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:36.604309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:36.604938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:36.611464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.611983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.612432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.613132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.613622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.614056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.749262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:36.757417 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9af48c4-7939-465c-82e6-48b108536e2d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1500 microversion: 2.1 time: 0.157457 Oct 11 02:02:36.757992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3134/6315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:36 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:36.779589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:36.780212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:36.786236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.786734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.787176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.788445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.788913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.789345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.916533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:36.924251 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5f75d403-38f6-49d4-8374-cd2c36f9dc61 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1500 microversion: 2.1 time: 0.148613 Oct 11 02:02:36.924836 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3182/6316] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:36 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1500 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:36.947117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:02:36.953083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:36.953568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:36.954002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:36.975900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 02:02:37.020597 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73740c75-2b34-4b46-8f14-90884e524691 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "POST /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077732 Oct 11 02:02:37.021213 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3135/6317] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:02:36 2022] POST /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:02:37.029456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:37.030951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:37.036964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:37.037483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:37.037917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:37.038614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:37.039093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:37.039519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:37.172507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:37.180893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71c77fe0-9c57-4e06-bde3-2b4dad1b7bff tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.155362 Oct 11 02:02:37.181455 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3183/6318] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:37 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:38.205409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:38.206121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:38.212989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:38.213481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:38.213930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:38.214629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:38.215090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:38.215558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:38.343971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:38.351678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41556da2-5b52-4e20-adcf-9c2571abcc0f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.151441 Oct 11 02:02:38.352272 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3136/6319] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:38 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:39.375852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:39.376514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:39.382982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:39.383505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:39.383944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:39.384634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:39.385095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:39.385525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:39.512652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:39.520353 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9b5ece4-9ae8-42c0-9f94-30b2f4abdedf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.148656 Oct 11 02:02:39.520968 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3184/6320] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:39 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:02:40.543556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:40.544181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:40.551003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:40.551531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:40.551977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:40.552670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:40.553129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:40.553560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:40.684136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:40.692170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e085ef9-d899-40ef-8712-6ea4372e8c4f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152853 Oct 11 02:02:40.692744 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3137/6321] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:40 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:41.716102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:41.716724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:41.723631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:41.724116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:41.724556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:41.725245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:41.725701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:41.726130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:41.856431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:41.864557 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d363e858-d8a2-49e2-bfc2-0351fbb29b40 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152346 Oct 11 02:02:41.865142 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3185/6322] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:41 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:42.888240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:42.888842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:42.895833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:42.896322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:42.896805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:42.897487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:42.897948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:42.898385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:43.032499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:43.040293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91fb4375-c349-4a88-9ffe-d35a5d31736c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.155946 Oct 11 02:02:43.040879 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3138/6323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:42 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:44.063176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:44.063824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:44.070941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:44.071464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:44.071908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:44.072603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:44.073063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:44.073494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:44.201089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:44.208861 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2caa4c7-c4be-499d-8513-35d973dd4b1e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.149642 Oct 11 02:02:44.209953 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3186/6324] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:44 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:45.232493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:45.233117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:45.240053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:45.240545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:45.240991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:45.241686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:45.242149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:45.242583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:45.431213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:45.439019 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c9f8b82-b7a5-4212-9d77-2f1a0b3af291 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.210523 Oct 11 02:02:45.439620 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3139/6325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:45 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:46.461600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:46.462225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:46.469259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:46.469750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:46.470196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:46.470897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:46.471383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:46.471826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:46.598956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:46.606615 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc0c6ccf-9c00-4fd3-96ce-41f4c6fd941a tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.149007 Oct 11 02:02:46.607189 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3187/6326] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:46 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:47.630581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:47.631759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:47.638873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:47.639358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:47.639812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:47.640505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:47.640966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:47.641398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:47.769114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:47.771474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:02:47.779323 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18e790a3-0d18-4346-aa61-78ae182d9c63 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152683 Oct 11 02:02:47.779961 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3140/6327] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:47 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:48.802582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:48.803228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:48.810169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:48.810654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:48.811095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:48.811815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:48.812273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:48.812698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:48.944757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:48.952690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8f9959df-4e70-4c39-b9f8-033a804b788b tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.154052 Oct 11 02:02:48.953274 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3188/6328] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:48 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:49.977004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:49.977656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:49.985711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:49.986197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:49.986638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:49.987356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:49.987816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:49.988244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:50.116505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:50.124190 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a58b2634-43b6-4f4b-8608-087f4b04938f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152035 Oct 11 02:02:50.124766 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3141/6329] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:49 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:51.147058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:51.147707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:51.154277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:51.154768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:51.155214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:51.155934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:51.156396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:51.156828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:51.290633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:51.298479 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70dfca66-58f9-4a78-95be-b7d9e24d140f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.155537 Oct 11 02:02:51.299056 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3189/6330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:51 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:52.322484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:52.323060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:52.329944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:52.330462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:52.330908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:52.331635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:52.332097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:52.332527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:52.460275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:52.468000 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-290a8054-2aa1-43e7-bb25-01ccef154d16 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.150065 Oct 11 02:02:52.468581 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3142/6331] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:52 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:53.491604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:53.492225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:53.499258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:53.499787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:53.500233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:53.500927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:53.501388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:53.501818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:53.628867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:53.637093 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-228f7e71-10bb-4be6-8f64-9963276d5fd0 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.149500 Oct 11 02:02:53.637663 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3190/6332] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:53 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:54.660841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:54.661486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:54.668299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:54.668791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:54.669237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:54.669937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:54.670397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:54.670836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:54.808845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:54.816718 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3e988e5-e049-4901-bc99-6cbaf1985503 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.160010 Oct 11 02:02:54.817298 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3143/6333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:54 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:55.840303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:55.840921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:55.847872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:55.848358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:55.848797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:55.849489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:55.850453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:55.850880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:55.980434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:55.988429 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d6abdae-e558-4a2c-ac3a-bcdf32641785 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152138 Oct 11 02:02:55.989009 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3191/6334] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:55 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:57.011998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:57.012532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:57.019553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:57.020043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:57.020490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:57.021195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:57.022166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:57.022604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:57.418166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:57.425944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27f79341-b4b2-4959-b0a1-76dc5bd2a930 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.418201 Oct 11 02:02:57.426526 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3144/6335] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:57 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:58.450174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:58.450874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:58.457772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:58.458257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:58.458701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:58.459453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:58.459913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:58.460346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:58.587051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:58.595706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-084f46c6-8bdf-4f33-8faf-256abff848bf tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.149396 Oct 11 02:02:58.596295 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3192/6336] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:58 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:02:59.618221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:02:59.618837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:02:59.625429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:59.625910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:59.626349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:59.627041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:02:59.627529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:02:59.627961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:02:59.759309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:02:59.767014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24795dd8-257f-4797-8c30-efbac5b9be1d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.152913 Oct 11 02:02:59.767641 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3145/6337] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:02:59 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:00.790059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:00.790680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:00.797450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:00.797934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:00.798439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:00.799134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:00.799615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:00.800043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:00.804496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:00.929738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:00.937623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b36a7392-e8e9-4522-aeee-5313ce191d9d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.151529 Oct 11 02:03:00.938204 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3193/6338] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:00 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:01.961307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:01.961905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:01.964629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=32 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:01.970009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:01.970501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:01.970945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:01.971671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:01.972132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:01.972562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:02.103231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:02.111229 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e8b85ba-ed2d-437e-a567-bc39bc689135 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1510 microversion: 2.1 time: 0.153943 Oct 11 02:03:02.111839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3146/6339] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:01 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:03.134516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:03.135151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.142291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.142787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.143260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.143990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.144454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.144890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.273995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:03.281836 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-510a2bf9-8ce7-4100-b214-ac719fb20bbe tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1487 microversion: 2.1 time: 0.151248 Oct 11 02:03:03.282352 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3194/6340] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:03 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1487 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:03.304758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1156357392"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:03:03.307234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.314127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.314617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.315063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.315785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.316248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.316681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.379852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93210a22-b4ba-4c0a-966f-7ad196177c5d tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "PUT /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1060 microversion: 2.1 time: 0.078903 Oct 11 02:03:03.380530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3147/6341] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 02:03:03 2022] PUT /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1060 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:03.401283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:03.401896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.407785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.408263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.408690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.409370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.409817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.410241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.536785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:03.544601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a86862c2-4e7e-42b0-8c14-3e55936a256f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1487 microversion: 2.1 time: 0.149427 Oct 11 02:03:03.545175 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3195/6342] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:03 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1487 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:03.566282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:03.566902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.573461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.573952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.574399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.575101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.575617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.576056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.707124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:03.715009 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-746f4a54-060e-4281-b352-9a14bb2e6554 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1487 microversion: 2.1 time: 0.152651 Oct 11 02:03:03.715611 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3148/6343] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:03 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1487 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:03.737233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:03.737724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.744132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.744612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.745043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.745721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.746177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.746598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.771315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:03:03.844213 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97d30b57-661b-4e96-b1a3-b6999e9cf136 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 204 len: 0 microversion: 2.1 time: 0.110837 Oct 11 02:03:03.844832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3196/6344] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:03 2022] DELETE /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:03:03.853852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:03.854579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:03.860866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.861358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.861807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.862510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:03.862972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:03.863458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:03.991226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:03.998932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75179b12-9531-4a4c-8224-2b3a4ff3ec8f tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1493 microversion: 2.1 time: 0.149127 Oct 11 02:03:03.999541 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3149/6345] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:03 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1493 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:03:05.023460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:05.024183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:05.031056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:05.031586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:05.032033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:05.032733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:05.033192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:05.033624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:05.173154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:05.181430 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-423e665f-eb40-4f53-af9d-ac5302cb21e3 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1493 microversion: 2.1 time: 0.162316 Oct 11 02:03:05.182008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3197/6346] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:05 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1493 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:05.847556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10789bb-abf3-4a7e-9b2e-743db71820a0", "name": "network-vif-deleted", "tag": "ab516c3c-3625-461b-9dd3-99d0466ca42c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:03:05.859603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:05.860100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:05.860545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:05.874593 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] Creating event network-vif-deleted:ab516c3c-3625-461b-9dd3-99d0466ca42c for instance b10789bb-abf3-4a7e-9b2e-743db71820a0 on n-h1-772273-9 Oct 11 02:03:05.879987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d22a6379-7769-4eeb-b42d-5534f954c67e req-16cf0ea2-ce8f-4ac3-a40e-993a4a1976fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036123 Oct 11 02:03:05.880642 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3150/6347] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:03:06.205638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:06.206263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:06.209655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:06.215257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:06.215815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:06.216264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:06.216967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:06.217426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:06.217858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:06.251394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:06.251950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:06.252405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:06.252858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lazy-loading 'fault' on Instance uuid b10789bb-abf3-4a7e-9b2e-743db71820a0 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:03:06.295953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:06.304077 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b7452a7-21a9-42bc-856a-337c1f8591ad tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 200 len: 1310 microversion: 2.1 time: 0.102376 Oct 11 02:03:06.304658 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3198/6348] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:06 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:07.329914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.330538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.337183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.337672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.338111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.338818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.339271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.339723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.354615 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 HTTP/1.1 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b10789bb-abf3-4a7e-9b2e-743db71820a0'} Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.356359 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8ee1512-2d37-4f53-bba7-a6a93e897488 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 404 len: 111 microversion: 2.1 time: 0.033141 Oct 11 02:03:07.366016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3151/6349] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.374059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.374633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.382072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.382578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.383025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.383772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.384235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.384667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.398991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 HTTP/1.1 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b10789bb-abf3-4a7e-9b2e-743db71820a0'} Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.400766 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cde43ff6-8f41-454d-86d4-9bf19577d463 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 404 len: 111 microversion: 2.1 time: 0.032138 Oct 11 02:03:07.405887 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3199/6350] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.410748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.411460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: b10789bb-abf3-4a7e-9b2e-743db71820a0] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.417979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.418459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.418896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.419604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.420056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.420484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.434218 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 HTTP/1.1 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'b10789bb-abf3-4a7e-9b2e-743db71820a0'} Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.435781 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance b10789bb-abf3-4a7e-9b2e-743db71820a0 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a0c9ad0-1be1-49cc-bf2d-f2d5da3fd856 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0" status: 404 len: 111 microversion: 2.1 time: 0.030337 Oct 11 02:03:07.441020 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3152/6351] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/b10789bb-abf3-4a7e-9b2e-743db71820a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.445637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.446131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.452092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.452569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.453001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.453677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.454125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.454545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.468749 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 HTTP/1.1 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e925b6e0-466a-4d78-a223-db8ee76e9d91'} Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.470320 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aa341de0-fe4a-41b3-a2ad-b3062ebc2684 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 404 len: 111 microversion: 2.1 time: 0.029973 Oct 11 02:03:07.480707 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3200/6352] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.481811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.481811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: e925b6e0-466a-4d78-a223-db8ee76e9d91] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.487784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.488267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.488703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.489391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.489869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.490296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.505956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 HTTP/1.1 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e925b6e0-466a-4d78-a223-db8ee76e9d91'} Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.507504 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance e925b6e0-466a-4d78-a223-db8ee76e9d91 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7fe65dd8-3c18-41a7-9244-529ce9ae689c tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91" status: 404 len: 111 microversion: 2.1 time: 0.031876 Oct 11 02:03:07.512780 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3153/6353] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/e925b6e0-466a-4d78-a223-db8ee76e9d91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:03:07.517347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.517954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.524363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.524845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.525280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.525960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.526412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.526834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.540925 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 HTTP/1.1 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c774db5d-8a03-4451-a69a-1657271a8755'} Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.542467 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a597796-1c1b-4b6b-a9e3-9eec8f711354 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 404 len: 111 microversion: 2.1 time: 0.030418 Oct 11 02:03:07.547963 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3201/6354] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.552321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.552973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: c774db5d-8a03-4451-a69a-1657271a8755] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.558936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.559469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.559918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.560614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.561068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.561503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.574810 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 HTTP/1.1 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c774db5d-8a03-4451-a69a-1657271a8755'} Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.576363 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance c774db5d-8a03-4451-a69a-1657271a8755 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78e2d4d7-fb0d-489a-91bb-ad8a6e03d356 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755" status: 404 len: 111 microversion: 2.1 time: 0.029353 Oct 11 02:03:07.582109 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3154/6355] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/c774db5d-8a03-4451-a69a-1657271a8755 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:03:07.586512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.587015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.592833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.593320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.593759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.594449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.594912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.595359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.609519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 HTTP/1.1 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '9afa9b24-c585-4d94-8936-55f42714cc74'} Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.611066 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-061f1e06-941f-4558-a4d1-105623a9d8c1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 404 len: 111 microversion: 2.1 time: 0.030311 Oct 11 02:03:07.616367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3202/6356] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.620734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.621351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 9afa9b24-c585-4d94-8936-55f42714cc74] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.627268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.627791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.628239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.628934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.629396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.629832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.643322 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 HTTP/1.1 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '9afa9b24-c585-4d94-8936-55f42714cc74'} Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.644820 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 9afa9b24-c585-4d94-8936-55f42714cc74 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d23d65b5-0797-4c78-9898-0691ee5201d6 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74" status: 404 len: 111 microversion: 2.1 time: 0.029257 Oct 11 02:03:07.650418 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3155/6357] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/9afa9b24-c585-4d94-8936-55f42714cc74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.655875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.656370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.662841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.663317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.663771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.664447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.664898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.665318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.678495 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 HTTP/1.1 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'dab924fe-930c-4b70-8926-6817fc300d99'} Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.680127 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f490d70f-657d-4fe5-b5c2-87e319d90f8e tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 404 len: 111 microversion: 2.1 time: 0.029521 Oct 11 02:03:07.685269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3203/6358] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:03:07.689975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.690598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: dab924fe-930c-4b70-8926-6817fc300d99] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.696687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.697179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.697628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.698324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.698785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.699216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.712904 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 HTTP/1.1 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'dab924fe-930c-4b70-8926-6817fc300d99'} Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.714428 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance dab924fe-930c-4b70-8926-6817fc300d99 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0c2e070-8501-48c7-8990-af3ac7cd4741 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99" status: 404 len: 111 microversion: 2.1 time: 0.029846 Oct 11 02:03:07.720010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3156/6359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/dab924fe-930c-4b70-8926-6817fc300d99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.724110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.725169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.731002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.731528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.731970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.732682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.733403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.733825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.747072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 HTTP/1.1 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '00f28338-3da8-41ea-84a9-055fc717d5c1'} Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.748670 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e654512-a3d8-4c17-a556-c3ac0f9f5bda tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 404 len: 111 microversion: 2.1 time: 0.029698 Oct 11 02:03:07.754017 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3204/6360] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.758188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.758845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 00f28338-3da8-41ea-84a9-055fc717d5c1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.764892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.765384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.765831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.766525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.766987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.767446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.781212 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 HTTP/1.1 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '00f28338-3da8-41ea-84a9-055fc717d5c1'} Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.782744 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 00f28338-3da8-41ea-84a9-055fc717d5c1 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8c45942-eefa-4ef9-b3e5-1126e5df2373 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1" status: 404 len: 111 microversion: 2.1 time: 0.029853 Oct 11 02:03:07.788469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3157/6361] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/00f28338-3da8-41ea-84a9-055fc717d5c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.793492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.793990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.799406 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 HTTP/1.1 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5'} Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.800901 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db6553b8-a1d0-4d1f-9a55-baf4387e1b25 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5" status: 404 len: 111 microversion: 2.1 time: 0.012592 Oct 11 02:03:07.806258 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3205/6362] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:07.810359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.810967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.816308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 HTTP/1.1 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5'} Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:07.817775 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance 552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9500536c-bd70-4f13-b44a-131a512792b1 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5" status: 404 len: 111 microversion: 2.1 time: 0.013229 Oct 11 02:03:07.824029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3158/6363] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/552d19d3-c3e9-4699-8ed4-8e7e6a15a7b5 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:03:07.828187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.828691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.836120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.836552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.836995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.837693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.838153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.838585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.863023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:03:07.936382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b68cb35-a493-4d23-9190-09f228a7cce7 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 204 len: 0 microversion: 2.1 time: 0.111586 Oct 11 02:03:07.936931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3206/6364] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:03:07 2022] DELETE /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:03:07.945696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:07.946310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:07.953106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.953592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.954029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:07.954714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:07.955165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:07.955649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:08.085497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:08.093269 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-549a1467-17ce-407c-93d1-d457dafd8d67 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1480 microversion: 2.1 time: 0.151835 Oct 11 02:03:08.093781 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3159/6365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:07 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1480 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:09.116954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:09.117721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:09.124565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:09.125046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:09.125483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:09.126170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:09.126625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:09.127049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:09.265316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:09.273607 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1a13ca1-d731-4049-b5b5-57943af933e4 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1480 microversion: 2.1 time: 0.161060 Oct 11 02:03:09.274181 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3207/6366] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:09 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1480 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:09.885011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b4ff9d-b012-4f1a-a9ee-c223af1da782", "name": "network-vif-deleted", "tag": "5362c704-b52d-4b42-9929-1fa7f45d46a0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:03:09.895610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:09.896602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:09.897040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:09.908566 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] Creating event network-vif-deleted:5362c704-b52d-4b42-9929-1fa7f45d46a0 for instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 on n-h2-772273-9 Oct 11 02:03:09.913868 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6ab64a96-d2ed-4cea-ab6e-32dcbdaefef9 req-b7d80ee7-4877-4b55-be2d-e626d66bfc81 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Oct 11 02:03:09.914464 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3160/6367] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:03:10.296697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:10.297313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:10.304530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:10.305127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:10.305567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:10.306274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:10.306724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:10.307435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:10.343100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:10.343605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:10.344619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:10.345074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lazy-loading 'fault' on Instance uuid d9b4ff9d-b012-4f1a-a9ee-c223af1da782 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:03:10.387172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f882ea546f441ba987d5fb8b88cbadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8a7a1c5334640b4a0282f76ce7ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:10.395646 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a120b3c-26ae-4a9e-add9-577a964967d5 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 200 len: 1283 microversion: 2.1 time: 0.102621 Oct 11 02:03:10.395974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3208/6368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:10 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:03:11.421603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:11.422266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] [instance: d9b4ff9d-b012-4f1a-a9ee-c223af1da782] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:11.428497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:11.428988 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:11.429438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:11.430133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:11.430595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:11.431029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:11.444286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] HTTP exception thrown: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Request method failure captured: Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 HTTP/1.1 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM5bfhI_UcE5X8GsVE6RZui-7lMERrH1L82I3bmQ99fld5XodDXbYFSPtdxFJdkNM-rYEprrThHnzEB344kw_iWbjClB9RpD5QJAEwJMmEGlpwhIffY-gXIPNNlszq7dIWCtlqdBKdOskH2-p-HfMwN-xgn_lFkJqkxY1tsCPw5lkU8 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/93f8a7a1c5334640b4a0282f76ce7ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersTestJSON-391993045 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 93f8a7a1c5334640b4a0282f76ce7ced Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersTestJSON-391993045 Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersTestJSON-391993045-project Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 7f882ea546f441ba987d5fb8b88cbadb Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersTestJSON-391993045-project Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd9b4ff9d-b012-4f1a-a9ee-c223af1da782'} Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:11.445927 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] Returning 404 to user: Instance d9b4ff9d-b012-4f1a-a9ee-c223af1da782 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d56703a7-56c3-447b-a722-34f37be95702 tempest-ServersTestJSON-391993045 tempest-ServersTestJSON-391993045-project] 10.222.0.66 "GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782" status: 404 len: 111 microversion: 2.1 time: 0.031018 Oct 11 02:03:11.451568 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3161/6369] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:03:11 2022] GET /compute/v2.1/servers/d9b4ff9d-b012-4f1a-a9ee-c223af1da782 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:03:15.591295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1196888681", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": "none"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:03:15.645002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:03:15.645436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:03:15.645918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:03:15.646337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:03:15.646804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:03:15.655537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:15.656025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:15.656474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:15.657207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:15.657666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:15.658094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:15.675040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Getting quotas for project 1346431bad364b3486654310fef9fa72. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:03:15.680917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Getting quotas for user 60196f6fd7e24726a74f41aa8696fba5 and project 1346431bad364b3486654310fef9fa72. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:03:15.693129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:03:15.695425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:03:15.740448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-72a3415d-ca97-4433-ac0c-b14066495f88 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.274020 Oct 11 02:03:15.741395 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3209/6370] 10.222.0.66 () {62 vars in 1188 bytes} [Tue Oct 11 02:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 02:03:15.752182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:15.752892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:15.809143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:15.816723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:15.818812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:15.820160 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-952dc3d4-a15c-4e93-a894-f339e5af4680 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1278 microversion: 2.57 time: 0.071978 Oct 11 02:03:15.820818 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3162/6371] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:15 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1278 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:16.846878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:16.847520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:16.855175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:16.855688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:16.856129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:16.856824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:16.857281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:16.857947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:16.921700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:16.930701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:16.932251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:16.933398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-903fd62d-ec23-42c8-98f3-57b2cc0f6038 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1336 microversion: 2.57 time: 0.091832 Oct 11 02:03:16.933964 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3210/6372] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:16 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:17.959791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:17.960467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:17.968444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:17.968938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:17.969383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:17.970086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:17.970551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:17.970987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:18.036430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:18.044652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:18.046120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:18.047274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afb80c7c-e663-4148-85f7-52e9d5f470a7 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1336 microversion: 2.57 time: 0.091602 Oct 11 02:03:18.047866 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3163/6373] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:17 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:19.073554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:19.074175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:19.081193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:19.081681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:19.082128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:19.082821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:19.083971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:19.084422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:19.100127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:19.151250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:19.159505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:19.160971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:19.162117 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b04d240d-e2e4-4a05-81a5-7e6f2ea6b3fe tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1336 microversion: 2.57 time: 0.092660 Oct 11 02:03:19.162683 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3211/6374] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:19 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:20.188289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:20.188914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:20.195915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:20.196406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:20.196857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:20.197558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:20.198021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:20.198454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:20.202623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:20.267106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:20.275843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:20.277305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:20.278451 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82a661eb-0248-4b6d-b85d-c105b578c88c tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1336 microversion: 2.57 time: 0.094738 Oct 11 02:03:20.279081 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3164/6375] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:20 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:21.305959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:21.306503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:21.313224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.313710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.314148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.314842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.315297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.315746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.380143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.388386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.389842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.391023 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9d7cd78b-fb20-4bfa-98cd-a0a8d480adb9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1357 microversion: 2.57 time: 0.089714 Oct 11 02:03:21.391634 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3212/6376] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:21 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1357 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:21.416392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:03:21.419305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:21.426129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.426606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.427675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.428366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.428817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.429237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.504794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:03:21.505208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:03:21.505684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:03:21.506096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:03:21.506507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:03:21.565597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:21.571197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.571998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.572827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.573241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.573703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.574138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.603208 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f553fbd-247e-42b5-bcee-d1a34844c456 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "POST /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93/action" status: 202 len: 1138 microversion: 2.57 time: 0.190729 Oct 11 02:03:21.603870 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3165/6377] 10.222.0.66 () {62 vars in 1320 bytes} [Tue Oct 11 02:03:21 2022] POST /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93/action => generated 1138 bytes in 193 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 02:03:21.625823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:21.626593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:21.632784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.633531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.633980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.634890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:21.635366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:21.635811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:21.709836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.718097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.719581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:21.720769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6577313b-62c0-4c89-86e2-9137c58b93f9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.099363 Oct 11 02:03:21.721344 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3213/6378] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:21 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:22.747302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:22.747931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:22.755766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:22.755962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:22.756438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:22.757096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:22.757567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:22.757986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:22.822232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:22.830393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:22.831883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:22.833077 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7baad24-3ce6-4a48-9a6e-7b93b15fc4f2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.089842 Oct 11 02:03:22.833944 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3166/6379] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:22 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 02:03:23.860051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:23.860668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:23.867491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:23.867978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:23.868416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:23.869104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:23.869559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:23.869984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:23.933450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:23.941450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:23.943572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:23.944746 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2251b33-f666-4297-822d-1a002a7d654d tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.089019 Oct 11 02:03:23.945313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3214/6380] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:23 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:24.970074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:24.970653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:24.977454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:24.977942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:24.978381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:24.979078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:24.979564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:24.979997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:25.042686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:25.050821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:25.052803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:25.053986 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-86418134-5c51-4917-abe4-e52f58417e5a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.087957 Oct 11 02:03:25.054550 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3167/6381] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:24 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:26.080205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:26.080826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:26.084161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:26.085005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:26.090858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:26.091328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:26.091791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:26.092486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:26.092945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:26.093370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:26.160274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:26.168485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:26.169932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:26.171106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e9c2f4b2-0e8a-418b-8884-6eee4b854a35 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.094920 Oct 11 02:03:26.171715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3215/6382] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:26 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:27.197675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:27.198299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:27.200195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:27.206470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:27.206960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:27.207427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:27.208170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:27.208599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:27.209034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:27.271857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:27.281263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:27.282663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:27.283928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-269b46f1-f903-4cc8-8792-b6e64bb3bb66 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.090213 Oct 11 02:03:27.284501 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3168/6383] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:27 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:28.310295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:28.310847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:28.317914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:28.318408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:28.318851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:28.319650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:28.320116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:28.320548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:28.385728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:28.394054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:28.395571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:28.396769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5442b300-aa45-4cc2-86b5-aad01d1ca39f tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.090554 Oct 11 02:03:28.397351 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3216/6384] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:28 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:29.423647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:29.424221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:29.430995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:29.431530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:29.431977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:29.432678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:29.433139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:29.433572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:29.500311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:29.508440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:29.509900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:29.511081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db62a272-b197-41d9-89d3-a238f5361beb tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.091512 Oct 11 02:03:29.511694 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3169/6385] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:29 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:30.537713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:30.538338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:30.545196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:30.545695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:30.546138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:30.546832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:30.547294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:30.547748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:30.613862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:30.622644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:30.624130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:30.625307 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-626fd191-5311-4d4d-ad3b-f3057e041e47 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.092134 Oct 11 02:03:30.625890 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3217/6386] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:30 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:31.651268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:31.651918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:31.659021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:31.659543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:31.659989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:31.660682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:31.661180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:31.661647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:31.726990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:31.735396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:31.736851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:31.738061 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-225db6e0-36c8-437d-80c4-ba8bba7745b9 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.090765 Oct 11 02:03:31.738624 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3170/6387] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:31 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:32.765193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:32.765852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:32.772746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:32.773238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:32.773677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:32.774371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:32.774828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:32.775289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:32.840443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:32.848503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:32.850526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:32.851740 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbbbc598-dcb6-4188-9f6a-153f3770b263 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.091695 Oct 11 02:03:32.852310 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3218/6388] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:32 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:33.879749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:33.880950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:33.883742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=56 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:33.889460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:33.889960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:33.890405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:33.891146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:33.891707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:33.892143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:33.959149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:33.967763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:33.969228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:33.970413 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ba0002b-7ae3-42af-83d7-e33079de5412 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.094707 Oct 11 02:03:33.970978 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3171/6389] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:33 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:34.996364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:34.996981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:35.003874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:35.004361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:35.005300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:35.006020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:35.006477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:35.006903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:35.076749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:35.086941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:35.088403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:35.089588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b871fb6a-2b1e-4d11-b55e-d43fd5ad9cf2 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.097229 Oct 11 02:03:35.090165 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3219/6390] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:34 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:36.114462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:36.115197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:36.122594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:36.123084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:36.123562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:36.124267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:36.124727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:36.125162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:36.191687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:36.200135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:36.201595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:36.202785 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2ea66ab2-05fe-48d1-9297-f41eaa1fdf84 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.092425 Oct 11 02:03:36.203385 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3172/6391] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:36 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:37.229263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:37.229925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:37.233045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:37.238675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:37.239174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:37.239656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:37.240378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:37.240842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:37.241276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:37.306892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:37.315100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:37.316599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:37.318318 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46b5b5e7-2175-40ff-987a-4e9434e36749 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.093039 Oct 11 02:03:37.318893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3220/6392] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:37 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:38.344349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:38.344876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:38.351838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:38.352329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:38.352769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:38.353464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:38.353923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:38.354355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:38.417864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:38.426075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:38.428075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:38.429251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-559e7f7c-6ec5-490b-af7f-c8d04a76dd27 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.088950 Oct 11 02:03:38.429827 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3173/6393] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:38 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:39.455049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:39.455620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:39.462445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:39.462939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:39.463407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:39.464108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:39.464567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:39.464993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:39.531285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:39.539986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:39.541440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:39.542629 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21edae6d-657f-408d-bb60-3efa970dfc71 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.091690 Oct 11 02:03:39.543208 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3221/6394] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:39 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:40.569411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:40.570026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:40.576801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:40.577277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:40.577709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:40.578393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:40.578845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:40.579267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:40.641945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:40.649965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:40.651428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:40.652621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-64b3d400-2bc4-44fb-8a16-402b68a053c8 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.087822 Oct 11 02:03:40.653185 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3174/6395] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:40 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:41.677491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:41.678116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:41.684898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:41.685381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:41.685814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:41.686497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:41.686947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:41.687386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:41.749640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:41.758049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:41.759589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:41.760744 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-285f98c6-fbbf-41dd-bf63-6c497a21134b tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.087240 Oct 11 02:03:41.761304 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3222/6396] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:41 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:42.788201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:42.788813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:42.795794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:42.796357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:42.796803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:42.797500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:42.798168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:42.798393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:42.865443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:42.873536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:42.874989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:42.876207 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06530d41-40ed-42c8-82b7-d6eb1d9a2dd1 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.092695 Oct 11 02:03:42.876790 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3175/6397] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:42 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:43.902569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:43.903223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:43.910136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:43.910629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:43.911076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:43.911810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:43.912278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:43.912714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:43.979210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:43.987767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:43.989263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:43.990447 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-627d9323-8cdc-40a3-b883-6bb25ef131f0 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.091903 Oct 11 02:03:43.991017 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3223/6398] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:43 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:45.016462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:45.017012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:45.024280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:45.024762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:45.025198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:45.025894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:45.026347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:45.026772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:45.092503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:45.101561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:45.103002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:45.104731 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-731b7ce1-e8ee-423f-9de2-8af267ca3aea tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.092298 Oct 11 02:03:45.105304 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3176/6399] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:45 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:46.130083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:46.130659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:46.137547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:46.138038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:46.138483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:46.139180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:46.139671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:46.140102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:46.204734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:46.213506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:46.215003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:46.216249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-279bdd57-b01b-42ab-816f-cd400d205ded tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.090258 Oct 11 02:03:46.216823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3224/6400] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:46 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:47.243585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:47.244203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:47.251012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:47.251534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:47.251977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:47.252673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:47.253131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:47.253561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:47.317245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:47.325452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:47.326905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:47.328120 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-560d64fc-ac6f-4e4d-8623-b8441b54ffe6 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1366 microversion: 2.57 time: 0.088563 Oct 11 02:03:47.328682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3177/6401] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:47 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:48.354167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:48.354722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:48.361901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:48.362419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:48.362863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:48.363622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:48.364079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:48.364507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:48.433536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:48.441606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:48.443602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:48.444778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-71ed1dd2-e18c-46c8-8ed4-e3e6f6592503 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1372 microversion: 2.57 time: 0.094718 Oct 11 02:03:48.445347 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3225/6402] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:48 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:49.471385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:49.472031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:49.479556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:49.480038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:49.480476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:49.481164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:49.481613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:49.482038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:49.544765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:49.546973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:49.554212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:49.555698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:49.556888 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55e4eb6d-abc2-4683-a986-dd054c16de87 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1372 microversion: 2.57 time: 0.089516 Oct 11 02:03:49.557472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3178/6403] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:49 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:50.582136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:50.582761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:50.589582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:50.589926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:50.590369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:50.591068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:50.591560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:50.591991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:50.596806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=88 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:03:50.657276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:50.666171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:50.667668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:50.668883 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-301808e5-1644-4b37-9681-c5e43f2ddeef tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1372 microversion: 2.57 time: 0.090922 Oct 11 02:03:50.669456 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3226/6404] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:50 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:51.694914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:51.695563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:51.703910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:51.704397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:51.704840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:51.705536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:51.705997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:51.706430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:51.772224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:51.780266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:51.781726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:51.782914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-816a1a55-d21b-4946-9926-4f4ff83775e5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1372 microversion: 2.57 time: 0.092074 Oct 11 02:03:51.783518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3179/6405] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:51 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:52.809555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:52.810177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:52.817244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:52.818232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:52.818674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:52.819393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:52.819860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:52.820290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:52.888696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:52.897682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:52.899131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:52.900346 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e82ade9b-93c0-4fe6-b402-68802c9ac322 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1357 microversion: 2.57 time: 0.095041 Oct 11 02:03:52.900914 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3227/6406] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:52 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:52.931144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:52.931741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:52.938566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:52.939055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:52.939529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:52.940229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:52.940688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:52.941116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:52.966441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:03:53.045621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2bfd3e18-5115-4075-bf06-93bd36137009 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 204 len: 0 microversion: 2.57 time: 0.118136 Oct 11 02:03:53.046303 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3180/6407] 10.222.0.66 () {60 vars in 1280 bytes} [Tue Oct 11 02:03:52 2022] DELETE /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 02:03:53.055489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:53.056115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:53.063095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:53.063631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:53.064076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:53.064778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:53.065235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:53.065659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:53.133012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:53.141205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:53.142653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:53.143858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-654537b1-2da3-4df5-93a3-425f08bad738 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1363 microversion: 2.57 time: 0.093023 Oct 11 02:03:53.144422 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3228/6408] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:53 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:54.170620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:54.171379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:54.178712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:54.179203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:54.179670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:54.180376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:54.180832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:54.181260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:54.247094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:54.255884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:54.257351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60196f6fd7e24726a74f41aa8696fba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1346431bad364b3486654310fef9fa72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:03:54.258534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5c4f7d1-26e0-4d83-b881-507b035a44b5 tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 200 len: 1363 microversion: 2.57 time: 0.092280 Oct 11 02:03:54.259101 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3181/6409] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:54 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 02:03:55.284063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:55.284596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] [instance: f20ce331-c8b1-4c6a-9961-126ed72a8a93] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:03:55.291431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:55.291922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:55.292364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:55.293051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:03:55.293506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:03:55.293932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:03:55.307280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] HTTP exception thrown: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Request method failure captured: Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 HTTP/1.1 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM7jo5uSuX4chnGMwHpxXcWNEOxieFpbZzkSYKNZDYDMTObSN1v_OpVvOlrRfWvGZLhfHh2FDVWXdhPaLh5y08fehY-wJzRjknPMSTsOzy10gNTbtNZg1SUEQuHF9tKMZ4odKrVYsdwySGc9wC8dqSIr_YJkXT7y4TjdRDedl9Ix58Q Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Openstack-Nova-Api-Version: 2.57 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 1346431bad364b3486654310fef9fa72 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerShowV257Test-1639220624 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1346431bad364b3486654310fef9fa72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1346431bad364b3486654310fef9fa72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1346431bad364b3486654310fef9fa72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1346431bad364b3486654310fef9fa72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerShowV257Test-1639220624 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 1346431bad364b3486654310fef9fa72 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerShowV257Test-1639220624 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerShowV257Test-1639220624-project Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 60196f6fd7e24726a74f41aa8696fba5 Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerShowV257Test-1639220624-project Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'f20ce331-c8b1-4c6a-9961-126ed72a8a93'} Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:03:55.308943 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] Returning 404 to user: Instance f20ce331-c8b1-4c6a-9961-126ed72a8a93 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-25c7ecd6-da3e-4a69-b28d-e4c24d45e41a tempest-ServerShowV257Test-1639220624 tempest-ServerShowV257Test-1639220624-project] 10.222.0.66 "GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93" status: 404 len: 111 microversion: 2.57 time: 0.030282 Oct 11 02:03:55.314896 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3229/6410] 10.222.0.66 () {60 vars in 1277 bytes} [Tue Oct 11 02:03:55 2022] GET /compute/v2.1/servers/f20ce331-c8b1-4c6a-9961-126ed72a8a93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 02:03:57.992331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fbeb21b9-9f27-4e98-8eff-352ee37d495d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f9c8d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:58.041138 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fbeb21b9-9f27-4e98-8eff-352ee37d495d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dd100885-54e0-4970-a0d7-22d7e87ab223" status: 200 len: 350 microversion: 2.1 time: 0.052614 Oct 11 02:03:58.041764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3182/6411] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 02:03:57 2022] GET /compute/v2.1/os-volumes/dd100885-54e0-4970-a0d7-22d7e87ab223 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:03:59.373306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c1d2d7a-c0d7-4215-9b43-4476a406a91b tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f8f6160>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:03:59.419875 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c1d2d7a-c0d7-4215-9b43-4476a406a91b tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/f945aa7d-104d-495c-9c6f-ea030965c18b" status: 200 len: 350 microversion: 2.1 time: 0.050317 Oct 11 02:03:59.420455 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3230/6412] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 02:03:59 2022] GET /compute/v2.1/os-volumes/f945aa7d-104d-495c-9c6f-ea030965c18b => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:00.757039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6861c2f0-adb4-4824-b769-93f950b6d709 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f113876f820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:00.803450 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6861c2f0-adb4-4824-b769-93f950b6d709 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6d372c27-b176-4edb-80a2-c47b4cceeba6" status: 200 len: 349 microversion: 2.1 time: 0.051297 Oct 11 02:04:00.804083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3183/6413] 10.222.0.66 () {58 vars in 1245 bytes} [Tue Oct 11 02:04:00 2022] GET /compute/v2.1/os-volumes/6d372c27-b176-4edb-80a2-c47b4cceeba6 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:00.817727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-42bad6f0-d175-4bdd-89cb-ec47b9fe3133 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f89b3a0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:00.902584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-42bad6f0-d175-4bdd-89cb-ec47b9fe3133 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.089399 Oct 11 02:04:00.903171 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3231/6414] 10.222.0.66 () {58 vars in 1134 bytes} [Tue Oct 11 02:04:00 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:04:00.917081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f7eb8d3-d0b2-4336-9434-a9b9aa7cfb2d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f6eb940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:00.998261 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f7eb8d3-d0b2-4336-9434-a9b9aa7cfb2d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.084911 Oct 11 02:04:00.998851 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3184/6415] 10.222.0.66 () {58 vars in 1149 bytes} [Tue Oct 11 02:04:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:01.013143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-026c516e-611b-40cf-9915-492c18b8408d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f11388d0ca0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.093029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-026c516e-611b-40cf-9915-492c18b8408d tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083598 Oct 11 02:04:01.093620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3232/6416] 10.222.0.66 () {58 vars in 1134 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:04:01.107296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e58340ba-e8c4-420b-a0c2-e105f92a63b6 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f9c8d30>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.189560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e58340ba-e8c4-420b-a0c2-e105f92a63b6 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086105 Oct 11 02:04:01.190146 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3185/6417] 10.222.0.66 () {58 vars in 1167 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:01.203743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c63b57d-f74f-4cd4-bbd8-11da71b62d12 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f88bf70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.283787 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c63b57d-f74f-4cd4-bbd8-11da71b62d12 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083631 Oct 11 02:04:01.284375 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3233/6418] 10.222.0.66 () {58 vars in 1170 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:01.298818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3e47e35-ba48-43ff-9ff3-4f7d66b75dd3 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f59ba60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.379583 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3e47e35-ba48-43ff-9ff3-4f7d66b75dd3 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.084524 Oct 11 02:04:01.380251 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3186/6419] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:04:01.393550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af3ead5e-9734-4dd3-8517-376cdb3baa73 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f112f821790>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.475961 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af3ead5e-9734-4dd3-8517-376cdb3baa73 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086107 Oct 11 02:04:01.476575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3234/6420] 10.222.0.66 () {58 vars in 1188 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:04:01.490571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-232fd21a-e49e-40f3-a81c-5d244f9dda94 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] Calling method '.version_select at 0x7f11342fa550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:04:01.570714 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-232fd21a-e49e-40f3-a81c-5d244f9dda94 tempest-VolumesTestJSON-1895827961 tempest-VolumesTestJSON-1895827961-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.084398 Oct 11 02:04:01.571307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3187/6421] 10.222.0.66 () {58 vars in 1155 bytes} [Tue Oct 11 02:04:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:14.857728 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:05:14.858755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=19 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:14.859693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=19 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:14.865427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:14.865919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:14.872757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:14.873244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:14.873682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:14.874364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:14.874820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:14.875249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:14.900995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:05:14.978408 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5472b894-9a59-4237-a088-a30a317092c5 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 204 len: 0 microversion: 2.1 time: 0.122945 Oct 11 02:05:14.979014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3235/6422] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:05:14 2022] DELETE /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:05:14.985914 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:05:14.987098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:14.988134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:14.990103 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:05:14.990255 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 (ip 10.222.0.66) !!! Oct 11 02:05:14.998750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:14.999390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:15.009394 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:15.009891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:15.010338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:15.011163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:15.011714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:15.012160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:15.151454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:15.158181 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ec970c4-734d-433a-9756-ddf612e87e45 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1730 microversion: 2.1 time: 0.174503 Oct 11 02:05:15.158820 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3188/6423] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:14 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:16.184639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:16.185355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:16.200362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:16.201004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:16.201726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:16.202859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:16.203323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:16.204059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:16.204811 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 35180. Oct 11 02:05:16.344357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:16.352774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3007296d-63a3-4229-818f-8be5e3320713 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1730 microversion: 2.1 time: 0.173266 Oct 11 02:05:16.353367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3236/6424] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:16 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:17.377353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:17.379147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:17.388336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:17.389356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:17.389837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:17.390561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:17.391019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:17.391480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:17.413012 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 35218. Oct 11 02:05:17.464014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d1c69fcdab4cef818ca8d2585d34b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980494f6ea024d6ba1d05ca56eee53cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:17.472600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9923698-d66f-49a2-bdd2-c5db276e58a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 200 len: 1663 microversion: 2.1 time: 0.099666 Oct 11 02:05:17.473198 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3189/6425] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:17 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 1663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:17.641165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c85b627-bd26-41e4-8f29-705034855358", "name": "network-vif-deleted", "tag": "03318ee1-65df-4b52-8cbd-4e81b88032c8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:05:17.654488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:17.654971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:17.655826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:17.668855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] Creating event network-vif-deleted:03318ee1-65df-4b52-8cbd-4e81b88032c8 for instance 6c85b627-bd26-41e4-8f29-705034855358 on n-h1-772273-9 Oct 11 02:05:17.690254 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bc837544-84c9-40ac-a8a5-2f10dc02b2bb req-d0bf38e8-e114-4ae7-b708-65b07dc69df8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051365 Oct 11 02:05:17.694384 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3237/6426] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:05:18.761242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:18.762716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:18.771260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:18.771904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:18.772226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:18.772973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:18.773436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:18.773871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:18.788344 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] HTTP exception thrown: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Request method failure captured: Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 HTTP/1.1 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM4pOtYuQLQwYjwb5kVapLOXqFBQDgK14honzkwv7Lz8hdbng-5eS40-zzHX3DyjqcBj72SLPaqASXx3100u-e99Lq6dRkaRA3_mZebqLL4EQdyjwlVLxq04eX7-G8jJ5jzug_NsBs_PsprHyMTXH5m4mOeV2PVbdks_uudzh1vF32o Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f8d1c69fcdab4cef818ca8d2585d34b1 Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '6c85b627-bd26-41e4-8f29-705034855358'} Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:18.789974 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Returning 404 to user: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bcc8ddea-779d-406e-a686-4968b72f3e17 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 404 len: 111 microversion: 2.1 time: 0.298548 Oct 11 02:05:18.799328 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3190/6427] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:18 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:05:19.288561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:19.289324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:19.295751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:19.296177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:19.296666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:19.297389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:19.297974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:19.298418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:19.313667 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] HTTP exception thrown: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Request method failure captured: Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 HTTP/1.1 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM4pOtYuQLQwYjwb5kVapLOXqFBQDgK14honzkwv7Lz8hdbng-5eS40-zzHX3DyjqcBj72SLPaqASXx3100u-e99Lq6dRkaRA3_mZebqLL4EQdyjwlVLxq04eX7-G8jJ5jzug_NsBs_PsprHyMTXH5m4mOeV2PVbdks_uudzh1vF32o Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: f8d1c69fcdab4cef818ca8d2585d34b1 Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '6c85b627-bd26-41e4-8f29-705034855358'} Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:05:19.315697 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Returning 404 to user: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32d39efb-b50c-4a05-b49e-0b9b4e782880 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 404 len: 111 microversion: 2.1 time: 0.034765 Oct 11 02:05:19.321469 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3238/6428] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:05:19 2022] DELETE /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:05:19.326430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:19.329941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] [instance: 6c85b627-bd26-41e4-8f29-705034855358] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:19.333382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:19.333876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:19.334327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:19.335030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:19.335522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:19.335956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:19.350152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] HTTP exception thrown: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Request method failure captured: Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 HTTP/1.1 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM4pOtYuQLQwYjwb5kVapLOXqFBQDgK14honzkwv7Lz8hdbng-5eS40-zzHX3DyjqcBj72SLPaqASXx3100u-e99Lq6dRkaRA3_mZebqLL4EQdyjwlVLxq04eX7-G8jJ5jzug_NsBs_PsprHyMTXH5m4mOeV2PVbdks_uudzh1vF32o Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/980494f6ea024d6ba1d05ca56eee53cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 980494f6ea024d6ba1d05ca56eee53cb Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestServerBasicOps-1155928421 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: f8d1c69fcdab4cef818ca8d2585d34b1 Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestServerBasicOps-1155928421-project Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '6c85b627-bd26-41e4-8f29-705034855358'} Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:05:19.351754 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Returning 404 to user: Instance 6c85b627-bd26-41e4-8f29-705034855358 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89b683e3-991d-4756-a5c1-5cc45c8afa2a tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358" status: 404 len: 111 microversion: 2.1 time: 0.030562 Oct 11 02:05:19.357413 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3191/6429] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:19 2022] GET /compute/v2.1/servers/6c85b627-bd26-41e4-8f29-705034855358 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:05:19.528603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c01f5c4-1426-4e2e-a7ec-bb1fafaf22a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] Calling method '.version_select at 0x7f112f9ddf70>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:19.552299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c01f5c4-1426-4e2e-a7ec-bb1fafaf22a8 tempest-TestServerBasicOps-1155928421 tempest-TestServerBasicOps-1155928421-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-488425571" status: 202 len: 0 microversion: 2.1 time: 0.027390 Oct 11 02:05:19.552915 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3239/6430] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 02:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-488425571 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:05:54.840744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-959304925", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "13d859b6-2c51-46a7-b95f-16dde1c25038", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:05:54.851104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:54.851761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:54.904795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:05:55.696718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:05:55.697147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:05:55.697627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:05:55.698216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:05:55.698637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:05:55.708486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:55.708983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:55.709445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:55.710165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:55.710620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:55.711047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:55.728458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:05:55.734463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:05:55.793249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:05:55.795269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13d859b6-2c51-46a7-b95f-16dde1c25038',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:05:55.963037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11806a39-ed77-4c37-b144-6572530e107a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125947 Oct 11 02:05:55.964794 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3192/6431] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:05:55.976836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ecb5c98-bcc9-4ee1-9fed-1938d26ae402 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:55.977526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ecb5c98-bcc9-4ee1-9fed-1938d26ae402 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:55.985494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:55.988823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:05:56.052724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6ecb5c98-bcc9-4ee1-9fed-1938d26ae402 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:56.061745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ecb5c98-bcc9-4ee1-9fed-1938d26ae402 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1056 microversion: 2.1 time: 0.089503 Oct 11 02:05:56.062319 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3240/6432] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:55 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1056 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:57.085558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:57.086101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:57.092285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:57.092801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:57.093274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:57.093978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:57.094438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:57.094859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:57.168804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:57.178520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f2aaac5-a930-4097-80a8-5b7a714eeff4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1154 microversion: 2.1 time: 0.097901 Oct 11 02:05:57.197300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3193/6433] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:57 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1154 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:58.203864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:58.205505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:58.223684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:58.224378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:58.225017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:58.225933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:58.229972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:58.230669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:58.467710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:58.479964 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d4c6e2c-45a2-4bba-b6e0-8e73c5f78ff1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1214 microversion: 2.1 time: 0.281365 Oct 11 02:05:58.482851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3241/6434] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:58 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:05:58.964630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1046230b-1183-4e26-90c8-1535fbb2c98c", "tag": "a17ca54a-ffa4-4432-8766-58a1532f5835"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:05:58.974532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:58.975020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:58.975485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:58.987070 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] Creating event network-changed:a17ca54a-ffa4-4432-8766-58a1532f5835 for instance 1046230b-1183-4e26-90c8-1535fbb2c98c on n-h1-772273-9 Oct 11 02:05:58.992778 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-83e1b9b8-7e1e-4628-908a-55862df213d2 req-78d4b4df-2395-4d6d-9b5d-d1df43a0ef4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216989 Oct 11 02:05:58.993398 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3194/6435] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:05:59.507237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:05:59.507941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:05:59.515986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:59.516625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:59.517615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:59.518504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:05:59.519591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:05:59.520290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:05:59.667384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:05:59.675607 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9b804df-2b67-4bbd-bc90-3bbaafb0eaeb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1214 microversion: 2.1 time: 0.172668 Oct 11 02:05:59.682414 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3242/6436] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:05:59 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:00.698725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:00.699447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:00.706572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:00.707062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:00.707536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:00.708243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:00.708704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:00.709137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:00.841420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:00.849913 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e64d2d27-d783-4339-ad70-52da48c6f274 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1214 microversion: 2.1 time: 0.155614 Oct 11 02:06:00.850495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3195/6437] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:00 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:01.873843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:01.874451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:01.881909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:01.882393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:01.882857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:01.883584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:01.884042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:01.884461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:02.018101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:02.026544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33290990-a337-405e-8679-47655020ee4e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1214 microversion: 2.1 time: 0.156511 Oct 11 02:06:02.027377 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3243/6438] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:01 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:03.050253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:03.051452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:03.058292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:03.058779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:03.059221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:03.059939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:03.060400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:03.060831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:03.192179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:03.200404 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c4f6ac6-4ec9-43e3-8c66-7d429ec8b94f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.154233 Oct 11 02:06:03.201054 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3196/6439] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:03 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:04.224067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:04.224644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:04.231737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:04.232227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:04.232670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:04.233367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:04.233828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:04.234260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:04.363944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:04.371673 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4db7a710-b1e8-466f-818e-1136ead9eef1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.152245 Oct 11 02:06:04.372272 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3244/6440] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:04 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:05.395014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:05.395600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:05.402347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:05.402834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:05.403276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:05.403997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:05.404453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:05.404885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:05.543831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:05.552023 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffb292df-aed8-4c41-8d3b-6637fed99b9d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.161559 Oct 11 02:06:05.552598 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3197/6441] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:05 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:06.574768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:06.576088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:06.578827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:06.585272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:06.585869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:06.586308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:06.587011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:06.587496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:06.587920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:06.719829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:06.727801 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-474ae6a3-6bb9-4f51-bde3-7aed7b929a42 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.157382 Oct 11 02:06:06.743020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3245/6442] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:06 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:07.750857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:07.751443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:07.753433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:07.754247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:07.761214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:07.761708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:07.762154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:07.762853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:07.763313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:07.763771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:07.893569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:07.902081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5a13603-2d7c-4695-936c-28b93475e144 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.155211 Oct 11 02:06:07.902665 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3198/6443] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:07 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:08.924774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:08.925398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:08.932263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:08.932753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:08.933197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:08.933891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:08.934350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:08.934777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:09.068503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:09.076578 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-36415328-5b94-47a8-ace8-4afca0d98eda tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.155782 Oct 11 02:06:09.077179 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3246/6444] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:08 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:10.100980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:10.101610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:10.108763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:10.109255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:10.109703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:10.110409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:10.110872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:10.111307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:10.242213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:10.250024 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0bf6530-3417-4dc1-9870-84d965fda93c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.153569 Oct 11 02:06:10.250616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3199/6445] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:10 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:11.188958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1046230b-1183-4e26-90c8-1535fbb2c98c", "name": "network-vif-plugged", "status": "completed", "tag": "a17ca54a-ffa4-4432-8766-58a1532f5835"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:11.198475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:11.198948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:11.199547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:11.210710 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] Creating event network-vif-plugged:a17ca54a-ffa4-4432-8766-58a1532f5835 for instance 1046230b-1183-4e26-90c8-1535fbb2c98c on n-h1-772273-9 Oct 11 02:06:11.215770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-79452163-1841-495a-beab-aa3965dcb2e0 req-735bce2d-9ea0-45e7-99ab-089fba0c3c44 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099411 Oct 11 02:06:11.216301 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3247/6446] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:06:11.273190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:11.273788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:11.280773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:11.281266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:11.281712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:11.282413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:11.282875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:11.283306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:11.418399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:11.426341 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9dff0358-20b1-4abc-8d70-ee58546c845c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1202 microversion: 2.1 time: 0.157542 Oct 11 02:06:11.426931 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3200/6447] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:11 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:12.450385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:12.451018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:12.457199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.457688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.458130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.459172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.459664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.460100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.588111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:12.595852 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c9ed9839-6eb6-41a5-9413-e3a28c6cc859 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1389 microversion: 2.1 time: 0.150721 Oct 11 02:06:12.596424 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3248/6448] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:12 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:12.619181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:12.619847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:12.626568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.627067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.627545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.628249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.628737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.629173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.762390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:12.770678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce5726ec-6d3b-45f6-85d1-e5b0a3e89302 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1389 microversion: 2.1 time: 0.155404 Oct 11 02:06:12.771255 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3201/6449] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:12 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:12.793160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:12.793780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:12.799728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.800215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.800657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.801346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.801803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.802233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.931011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:12.938837 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d8dc0db4-872d-46ef-9c50-528c31195710 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1389 microversion: 2.1 time: 0.149602 Oct 11 02:06:12.939437 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3249/6450] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:12 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:12.961376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:12.961808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:12.967783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.968269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.968712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.969404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:12.969863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:12.970288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:12.994739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:06:13.069082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e99b3647-2daf-4207-99ba-4bfd84cd1722 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 204 len: 0 microversion: 2.1 time: 0.111909 Oct 11 02:06:13.069763 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3202/6451] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:06:12 2022] DELETE /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:06:13.078352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:13.078974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:13.085634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:13.086136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:13.086642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:13.087360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:13.087838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:13.088274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:13.217060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:13.225407 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4215851b-bf10-4526-ad14-33b79957bb01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1395 microversion: 2.1 time: 0.151112 Oct 11 02:06:13.225989 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3250/6452] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:13 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1395 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:06:14.249919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:14.250548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:14.257374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:14.257870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:14.258319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:14.259025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:14.259514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:14.259951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:14.401567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:14.409444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94b07fec-f9ca-402e-afee-ab38b58d64ec tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1395 microversion: 2.1 time: 0.163960 Oct 11 02:06:14.410684 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3203/6453] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:14 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:15.069998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1046230b-1183-4e26-90c8-1535fbb2c98c", "name": "network-vif-deleted", "tag": "a17ca54a-ffa4-4432-8766-58a1532f5835"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:15.082130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:15.082715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:15.083390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:15.096245 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] Creating event network-vif-deleted:a17ca54a-ffa4-4432-8766-58a1532f5835 for instance 1046230b-1183-4e26-90c8-1535fbb2c98c on n-h1-772273-9 Oct 11 02:06:15.102080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-27776019-fd35-4474-9b4c-cd9b7f9ca9e6 req-5be283fa-5297-4af0-a93f-cb64dd644833 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036356 Oct 11 02:06:15.102951 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3251/6454] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:06:15.433296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:15.433897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:15.440821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:15.441831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:15.442280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:15.442984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:15.443477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:15.443917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:15.505601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:15.520461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0d2fa17-ee94-4348-85aa-46d65120be01 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1187 microversion: 2.1 time: 0.090413 Oct 11 02:06:15.521294 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3204/6455] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:15 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:06:16.545227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:16.545936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:16.552810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:16.553303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:16.553741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:16.554438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:16.554900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:16.555324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:16.620663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:16.629534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-74e8317c-6dae-4906-a0cd-94fa45bdba75 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1187 microversion: 2.1 time: 0.089200 Oct 11 02:06:16.630171 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3252/6456] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:16 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:17.652383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:17.653001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:17.659682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:17.660675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:17.661108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:17.661833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:17.662284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:17.662704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:17.727278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:17.735304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31646d4c-d04f-4541-8ec0-cb3cfb745eea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1187 microversion: 2.1 time: 0.087056 Oct 11 02:06:17.736088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3205/6457] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:17 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:18.758838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:18.759412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:18.766172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:18.766661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:18.767110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:18.767848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:18.768313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:18.768746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:18.830255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:18.838730 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b78e0b07-44ed-4236-af41-ee2e5e8d8d96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 200 len: 1187 microversion: 2.1 time: 0.083966 Oct 11 02:06:18.839310 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3253/6458] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:18 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:19.862590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:19.863811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 1046230b-1183-4e26-90c8-1535fbb2c98c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:19.870729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:19.871217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:19.871688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:19.872383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:19.872836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:19.873260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:19.889327 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c HTTP/1.1 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '1046230b-1183-4e26-90c8-1535fbb2c98c'} Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:06:19.890957 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance 1046230b-1183-4e26-90c8-1535fbb2c98c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5eb339af-ecb9-4ef4-8c14-2136b72289f5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c" status: 404 len: 111 microversion: 2.1 time: 0.033724 Oct 11 02:06:19.896916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3206/6459] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:19 2022] GET /compute/v2.1/servers/1046230b-1183-4e26-90c8-1535fbb2c98c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:06:24.979259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2103949843", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ee3ecd9-1ed4-4e68-87f0-1bf99e028f52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:25.040139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:06:25.470839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:06:25.471268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:06:25.471787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:06:25.472205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:06:25.472624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:06:25.481873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:25.482360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:25.482804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:25.483581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:25.484044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:25.484474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:25.501437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:06:25.507404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:06:25.563000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:06:25.565403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ee3ecd9-1ed4-4e68-87f0-1bf99e028f52',volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:06:25.695089 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [868c7c36-9197-472d-8681-aa00ed5326a0] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:06:26.701790 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [868c7c36-9197-472d-8681-aa00ed5326a0] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 35846. Oct 11 02:06:26.705773 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4176e533-a0dc-4edf-b4cf-206c744f8326 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730742 Oct 11 02:06:26.706442 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3254/6460] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:06:26.718226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbcb5659-e661-4c46-a86f-9bbd9f574399 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:26.718851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbcb5659-e661-4c46-a86f-9bbd9f574399 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:26.725197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:26.778006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbcb5659-e661-4c46-a86f-9bbd9f574399 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:26.785448 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbcb5659-e661-4c46-a86f-9bbd9f574399 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1057 microversion: 2.1 time: 0.070994 Oct 11 02:06:26.786022 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3207/6461] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:26 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1057 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:27.809446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:27.811082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:27.814165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:27.820500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:27.821000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:27.821445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:27.822156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:27.822623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:27.823053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:27.829375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=73 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:27.890753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:27.899782 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cb65d562-df01-4ee5-877c-159380197d8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1173 microversion: 2.1 time: 0.094723 Oct 11 02:06:27.900763 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3255/6462] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:27 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1173 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:28.925263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:28.926696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:28.934311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:28.934941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:28.935930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:28.936777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:28.937659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:28.938275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:28.942802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:29.088878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:29.097220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6b0f599-6dfe-49fc-b7a4-f01dac87381e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1215 microversion: 2.1 time: 0.176831 Oct 11 02:06:29.098526 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3208/6463] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:28 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:29.145857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed23906a-f63e-44f4-8165-8cc16cdf3e9d", "tag": "d340239f-6671-41c0-88be-4aaf76dbee6c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:29.163816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:29.164461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:29.165003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:29.179037 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] Creating event network-changed:d340239f-6671-41c0-88be-4aaf76dbee6c for instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d on n-h1-772273-9 Oct 11 02:06:29.185074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ad321da4-5dfa-47ca-882e-cadff0cb3edb req-7c61eb69-fb43-4a40-981f-73bae044ec94 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Oct 11 02:06:29.186191 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3256/6464] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:06:30.121501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:30.122251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:30.130361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:30.130951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:30.131492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:30.132278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:30.132806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:30.133430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:30.266022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:30.274150 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4da2d82b-7e31-4b03-b431-1f530e277343 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1215 microversion: 2.1 time: 0.157275 Oct 11 02:06:30.274734 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3209/6465] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:30 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:31.298447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:31.299133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:31.305368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:31.305855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:31.306293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:31.306991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:31.307473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:31.307901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:31.440264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:31.448638 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2748dcce-23dd-40cc-b608-edf95e1e51d1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1215 microversion: 2.1 time: 0.155418 Oct 11 02:06:31.449355 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3257/6466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:31 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:32.471751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:32.472433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:32.480249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:32.480745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:32.481446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:32.482158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:32.482757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:32.483187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:32.619046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:32.627117 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-685416bd-b531-4176-a24e-e787b8b51c55 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1215 microversion: 2.1 time: 0.159509 Oct 11 02:06:32.627822 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3210/6467] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:32 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:33.650886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:33.651542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:33.658585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:33.659084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:33.659572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:33.660552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:33.661006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:33.661433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:33.791022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:33.799436 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b6d5cc5-6d32-4c78-90ef-a99a189c9931 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.151820 Oct 11 02:06:33.800070 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3258/6468] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:33 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:34.822729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:34.823352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:34.830175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:34.830667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:34.831115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:34.831852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:34.832872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:34.833312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:34.963659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:34.971563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b13cf9c6-fcd8-4080-a740-aca0c4918d39 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.152689 Oct 11 02:06:34.972154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3211/6469] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:34 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:35.994583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:35.995206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:35.998083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:35.998784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:36.004796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:36.005283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:36.005723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:36.006415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:36.006877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:36.007303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:36.133242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:36.140981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a78535cb-4e59-44e9-8901-f5a2930987c5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.150332 Oct 11 02:06:36.141565 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3259/6470] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:35 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:37.164831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:37.165486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:37.168187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:06:37.173686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:37.174207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:37.174715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:37.175455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:37.175928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:37.176364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:37.309073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:37.317377 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-834c6fab-420c-4cae-ab99-cf874b4b8d43 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.156640 Oct 11 02:06:37.317953 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3212/6471] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:37 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:38.341594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:38.342135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:38.348745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:38.349235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:38.349679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:38.350370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:38.350826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:38.351256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:38.478713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:38.486739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08c80cae-192c-4671-9fa7-8a44e118d3ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.150069 Oct 11 02:06:38.487317 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3260/6472] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:38 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:39.510219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:39.510833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:39.517780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:39.518255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:39.518697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:39.519414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:39.520532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:39.520956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:39.652057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:39.659856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7f6b1ea-ea10-4710-84dd-a5ce6afd1575 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.153566 Oct 11 02:06:39.660437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3213/6473] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:39 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:40.682083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:40.682683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:40.689444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:40.689925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:40.690363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:40.691042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:40.691520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:40.691943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:40.824147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:40.831792 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dd58e4c1-afb3-4b4c-b63b-23b5dfa52cf7 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.153592 Oct 11 02:06:40.832941 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3261/6474] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:40 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:41.230153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed23906a-f63e-44f4-8165-8cc16cdf3e9d", "name": "network-vif-plugged", "status": "completed", "tag": "d340239f-6671-41c0-88be-4aaf76dbee6c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:41.242439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:41.242996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:41.243470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:41.256115 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] Creating event network-vif-plugged:d340239f-6671-41c0-88be-4aaf76dbee6c for instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d on n-h1-772273-9 Oct 11 02:06:41.261198 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-400bf29b-fc60-41bc-9425-3cdfcf40513a req-becf89df-a79d-43b8-be0e-7f7280ae1064 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Oct 11 02:06:41.262012 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3214/6475] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:06:41.855210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:41.856106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:41.862953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:41.864154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:41.864592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:41.865283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:41.865741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:41.866171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:41.992247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:41.999915 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-59071f70-c276-4de9-b24b-4b8d2689d287 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1203 microversion: 2.1 time: 0.148665 Oct 11 02:06:42.000495 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3262/6476] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:41 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:43.023785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:43.024500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:43.030872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.031383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.031831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.032530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.032987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.033413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.168745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:43.177099 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9220a6c2-1f59-4aa3-b785-74fde256cef0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1391 microversion: 2.1 time: 0.158414 Oct 11 02:06:43.177677 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3215/6477] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:43 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:43.198595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:43.199223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:43.207066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.207594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.208070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.208822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.209285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.209724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.337153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:43.345338 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-834aa475-92cf-4624-b28b-ddff6b5db249 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1391 microversion: 2.1 time: 0.150634 Oct 11 02:06:43.346121 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3263/6478] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:43 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:43.368535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:43.369158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:43.375060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.375585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.376030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.376731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.377190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.377621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.507433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:43.515224 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d593ae66-6155-4b87-a8af-ac67e33d44db tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1391 microversion: 2.1 time: 0.150721 Oct 11 02:06:43.515834 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3216/6479] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:43 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:43.537961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:43.538402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:43.544465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.544953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.545396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.546095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.546554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.546988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.570956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:06:43.654446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db3c730a-a326-4c9c-94a2-48de0a152de1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 204 len: 0 microversion: 2.1 time: 0.120891 Oct 11 02:06:43.655044 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3264/6480] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:06:43 2022] DELETE /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:06:43.664350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:43.664973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:43.671071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.671626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.672071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.672771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:43.673229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:43.673660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:43.800933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:43.808671 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-700cdaef-7cb8-4a16-a887-126f77afeae8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1397 microversion: 2.1 time: 0.149185 Oct 11 02:06:43.809256 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3217/6481] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:43 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1397 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:44.831375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:44.832725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:44.839563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:44.840057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:44.840504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:44.841198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:44.841662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:44.842095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:44.970908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:44.978942 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d181317d-059a-4719-bda9-5063e7ecbc85 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1397 microversion: 2.1 time: 0.151843 Oct 11 02:06:44.979564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3265/6482] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:44 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1397 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:45.559797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed23906a-f63e-44f4-8165-8cc16cdf3e9d", "name": "network-vif-deleted", "tag": "d340239f-6671-41c0-88be-4aaf76dbee6c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:06:45.571422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:45.571933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:45.572376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:45.588376 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] Creating event network-vif-deleted:d340239f-6671-41c0-88be-4aaf76dbee6c for instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d on n-h1-772273-9 Oct 11 02:06:45.599409 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5bf81d27-bb97-479a-b847-570503924efa req-48a0ab0e-a3e8-4e61-b37e-9ee55e5e53da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043422 Oct 11 02:06:45.600215 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3218/6483] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:06:46.005631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:46.006214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:46.013400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:46.013901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:46.014345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:46.015058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:46.015552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:46.015988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:46.081318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:46.089708 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5bf87ebf-7897-47b9-b511-a6feabbc040f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1188 microversion: 2.1 time: 0.088225 Oct 11 02:06:46.090296 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3266/6484] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:46 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:47.114648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:47.115364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:47.121674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:47.122165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:47.122607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:47.123308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:47.123796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:47.124228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:47.190613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:47.199808 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92d8f15f-5b55-4d95-851f-10878e8f2df1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1188 microversion: 2.1 time: 0.090716 Oct 11 02:06:47.200443 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3219/6485] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:47 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:48.222484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:48.223158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:48.229718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:48.230214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:48.230658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:48.231667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:48.232131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:48.232562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:48.293459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:48.301657 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48e633b4-1c34-4674-836f-11e8f8d40826 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1188 microversion: 2.1 time: 0.083362 Oct 11 02:06:48.302284 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3267/6486] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:48 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:49.325875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:49.326618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:49.333894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:49.334464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:49.334917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:49.335656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:49.336119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:49.336553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:49.397727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:06:49.406443 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44e237ab-a475-4f9e-bbc4-685cbb5aa6c2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 200 len: 1188 microversion: 2.1 time: 0.084716 Oct 11 02:06:49.407035 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3220/6487] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:49 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:06:50.430644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:06:50.431255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ed23906a-f63e-44f4-8165-8cc16cdf3e9d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:06:50.437947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:50.438435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:50.438878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:50.439596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:06:50.440055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:06:50.440485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:06:50.453749 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d HTTP/1.1 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ed23906a-f63e-44f4-8165-8cc16cdf3e9d'} Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:06:50.455415 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance ed23906a-f63e-44f4-8165-8cc16cdf3e9d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c662edf6-b471-4200-83bb-129b46436e7e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d" status: 404 len: 111 microversion: 2.1 time: 0.030142 Oct 11 02:06:50.461929 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3268/6488] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:06:50 2022] GET /compute/v2.1/servers/ed23906a-f63e-44f4-8165-8cc16cdf3e9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:07:11.456662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-979042254", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ad2eedd1-248b-49da-9a0e-2baa4c37776d", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:07:11.467934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=29 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:11.468601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=69 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:11.547050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:07:11.912638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:07:11.913066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:07:11.913543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:07:11.913953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:07:11.914371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:07:11.923401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:11.923890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:11.924327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:11.925087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:11.925543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:11.925970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:11.942658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:07:11.947910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:07:11.960695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:07:11.962702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ad2eedd1-248b-49da-9a0e-2baa4c37776d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:07:12.036288 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a5f810e4-0984-4baf-beee-85b8824514a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583501 Oct 11 02:07:12.036957 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3221/6489] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:07:12.047241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:12.048180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:12.053972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3018d893-eeb4-4789-a644-07558ca47403 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:12.054602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3018d893-eeb4-4789-a644-07558ca47403 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:12.120390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3018d893-eeb4-4789-a644-07558ca47403 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:12.127555 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3018d893-eeb4-4789-a644-07558ca47403 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1056 microversion: 2.1 time: 0.083320 Oct 11 02:07:12.128686 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3269/6490] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:12 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1056 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:07:13.150606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:13.151231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:13.159739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:13.160299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:13.161237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:13.161994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:13.162596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:13.162891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:13.236234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:13.246100 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7a3e4b8-cfda-4d66-9471-f882cc54669a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1126 microversion: 2.1 time: 0.099374 Oct 11 02:07:13.247683 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3222/6491] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:13 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1126 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:14.268748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:14.270692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:14.277775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:14.278636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:14.279157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:14.280031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:14.280562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:14.281222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:14.427186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:14.436698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3905e22-df2a-493b-ada6-9de7ce54a190 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.171808 Oct 11 02:07:14.437581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3270/6492] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:14 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:14.444461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69c4285-d734-4d09-8c35-d6509b05ab1c", "tag": "89a07359-4763-4a59-b103-cfa5730c8e8a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:07:14.457102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:14.457562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:14.458049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:14.471132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] Creating event network-changed:89a07359-4763-4a59-b103-cfa5730c8e8a for instance f69c4285-d734-4d09-8c35-d6509b05ab1c on n-h1-772273-9 Oct 11 02:07:14.479372 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0d128973-d692-4edb-b4d7-92dbd1610841 req-97de6d28-a57e-4797-9f00-a67e11766a42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038622 Oct 11 02:07:14.479990 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3223/6493] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:07:15.460956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:15.461570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:15.468611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:15.469100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:15.469532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:15.470234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:15.470883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:15.471176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:15.604210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:15.612163 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7250505c-aae6-43c1-85c2-d7f462f85adb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.155207 Oct 11 02:07:15.612745 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3271/6494] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:15 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:16.637513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:16.638244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:16.646615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:16.647226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:16.647820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:16.648536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:16.648984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:16.649415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:16.865820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:16.880018 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-637e2750-8f09-4c6d-8249-4e67e36341ba tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.247865 Oct 11 02:07:16.881120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3224/6495] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:16 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:17.905345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:17.906159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:17.913085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:17.913906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:17.915287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:17.916180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:17.916647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:17.917083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:18.098963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:18.115166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad9e8cde-53b3-440b-9d56-50ab4d9d68a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.214278 Oct 11 02:07:18.117499 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3272/6496] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:17 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:07:19.141311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:19.142636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:19.149917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:19.150422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:19.150887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:19.151620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:19.152098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:19.152512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:19.313023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:19.321251 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-218d4c7e-9a25-4a6b-b94f-f259eeea4a96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.184083 Oct 11 02:07:19.321839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3225/6497] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:19 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:20.345783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:20.346340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:20.356646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:20.357165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:20.358695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:20.358695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:20.358695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:20.360052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:20.569632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:20.577883 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ee430f7-9dcf-44af-840f-b1322161cdfc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.236657 Oct 11 02:07:20.578724 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3273/6498] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:20 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:21.600559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:21.601173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:21.608363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:21.608849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:21.609284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:21.609969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:21.610419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:21.610841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:21.742997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:21.750628 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a509946c-88f0-488c-8f2f-aed1d2891f7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.153956 Oct 11 02:07:21.751200 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3226/6499] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:21 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:22.774764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:22.775422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:22.778163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:22.783810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:22.784323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:22.784769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:22.785480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:22.785942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:22.786372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:22.920533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:22.929479 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-713bf6d6-5f92-469c-b232-b6c5284bccd3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.159192 Oct 11 02:07:22.930400 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3274/6500] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:22 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:23.952836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:23.953455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:23.955573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:23.956435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:23.963733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:23.964200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:23.964643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:23.965385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:23.965845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:23.966276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:24.099260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:24.107330 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2da4b81a-f953-4d92-bfa1-2b2eac819afd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.158399 Oct 11 02:07:24.108187 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3227/6501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:23 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:25.130009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:25.130626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:25.137595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:25.138088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:25.138532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:25.139241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:25.139743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:25.140173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:25.274496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:25.282446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cad46fc7-3059-43bf-8ba1-0242011e8844 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.156443 Oct 11 02:07:25.282982 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3275/6502] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:25 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:26.306685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:26.307414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:26.314626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:26.315153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:26.315625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:26.316652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:26.317119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:26.317556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:26.451298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:26.459239 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be8a6af0-99e8-427f-89fe-cb1e00a3401c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1168 microversion: 2.1 time: 0.156640 Oct 11 02:07:26.459859 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3228/6503] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:26 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:27.484716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:27.485332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:27.493879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:27.494366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:27.494805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:27.495531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:27.495985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:27.496647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:27.641672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:27.649551 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-58711f28-3a53-4f2d-8d4a-cef7374d6b48 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1214 microversion: 2.1 time: 0.169024 Oct 11 02:07:27.650313 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3276/6504] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:27 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:28.672201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:28.672826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:28.680121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:28.680616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:28.681061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:28.681763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:28.682224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:28.682663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:28.810440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:28.818674 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0cb2fa9-be2c-4fb8-b602-aea2f7f89b4b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.150404 Oct 11 02:07:28.819255 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3229/6505] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:28 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:29.842228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:29.842875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:29.849767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:29.850257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:29.850701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:29.851421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:29.851885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:29.852321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:29.982476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:29.990824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ecd0a4d0-3f2a-429a-a54a-c943b6616687 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.152572 Oct 11 02:07:29.991425 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3277/6506] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:29 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:31.013423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:31.014074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:31.021678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:31.022160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:31.022596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:31.023297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:31.023776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:31.024233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:31.152434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:31.160595 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-731b01ff-ff92-4859-86e6-507a33e9b93d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.151155 Oct 11 02:07:31.161216 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3230/6507] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:31 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:32.183177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:32.183812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:32.190558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:32.191038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:32.192022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:32.192710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:32.193164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:32.193586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:32.323593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:32.331208 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-415da61b-d3ba-4bc1-9582-46c89bb7dd00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.152035 Oct 11 02:07:32.331824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3278/6508] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:32 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:33.354668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:33.355594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:33.362674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:33.363168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:33.363657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:33.364363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:33.364820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:33.365250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:33.503668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:33.511443 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48e5d7b5-8286-4db3-a08c-b5ce0b57cc11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.160732 Oct 11 02:07:33.512029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3231/6509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:33 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:34.535102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:34.535889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:34.542773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:34.543260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:34.543731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:34.544424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:34.544877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:34.545302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:34.674473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:34.682253 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b646754-3bde-4ce0-8255-2e21822a2a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.151081 Oct 11 02:07:34.682826 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3279/6510] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:34 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:35.704680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:35.705298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:35.713000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:35.713493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:35.713940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:35.714649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:35.715105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:35.715574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:35.853226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:35.861653 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba745a54-aa7a-454a-b715-a6bba3d0a096 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.160988 Oct 11 02:07:35.862232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3232/6511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:35 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:36.884276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:36.884922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:36.891729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:36.892214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:36.892649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:36.893333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:36.893785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:36.894207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:37.019971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:37.027770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cfce9f49-b78d-4abd-a16d-312c855c71c3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.147387 Oct 11 02:07:37.028346 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3280/6512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:36 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:37.492943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69c4285-d734-4d09-8c35-d6509b05ab1c", "name": "network-vif-plugged", "status": "completed", "tag": "89a07359-4763-4a59-b103-cfa5730c8e8a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:07:37.505562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:37.506055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:37.506494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:37.517614 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] Creating event network-vif-plugged:89a07359-4763-4a59-b103-cfa5730c8e8a for instance f69c4285-d734-4d09-8c35-d6509b05ab1c on n-h1-772273-9 Oct 11 02:07:37.523079 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-898bb052-68ae-4cc4-9ac3-8ed094b3a62c req-5745ffbb-259a-4d03-926a-65b2dbb1d797 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Oct 11 02:07:37.523873 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3233/6513] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:07:38.050704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:38.051434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:38.058214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:38.058732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:38.059170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:38.059891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:38.060346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:38.060776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:38.190544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:38.198855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8a36199-cd6c-4d05-b70e-88337283dc0a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1202 microversion: 2.1 time: 0.152198 Oct 11 02:07:38.199474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3281/6514] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:38 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:39.224491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:39.225192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:39.231593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.232072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.232505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.233189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.233640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.234062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.361125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:39.369416 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7f31700-fcc8-41d4-906f-963db50d92eb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1389 microversion: 2.1 time: 0.150556 Oct 11 02:07:39.370000 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3234/6515] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:39 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:39.391804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:39.392420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:39.399158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.399673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.400108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.400798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.401252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.401672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.528637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:39.536621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6bb29988-1664-4e4d-87f6-932aaedceca1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1389 microversion: 2.1 time: 0.148768 Oct 11 02:07:39.537206 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3282/6516] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:39 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:39.559046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:39.559748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:39.567183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.567655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.568122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.568952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.569412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.569872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.703515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:39.711272 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a46c4bd6-bcc2-4795-a360-6e2fc525af26 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1389 microversion: 2.1 time: 0.156558 Oct 11 02:07:39.711919 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3235/6517] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:39 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:39.792162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:39.792664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:39.798596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.799090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.799572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.800266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.801339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.801770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.826133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:07:39.900443 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a60cb9e7-b830-4fcb-a5d2-071c7fa903bc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 204 len: 0 microversion: 2.1 time: 0.111860 Oct 11 02:07:39.901062 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3283/6518] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:07:39 2022] DELETE /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:07:39.909079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:39.909696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:39.916192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.916681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.917152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:39.917853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:39.918313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:39.918743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:40.046306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:40.054722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf68e505-d771-477e-855d-5acaa6d60454 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1395 microversion: 2.1 time: 0.149591 Oct 11 02:07:40.055297 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3236/6519] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:39 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1395 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:07:41.078418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:41.079129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:41.086502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:41.086999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:41.087546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:41.088254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:41.088719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:41.089149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:41.226500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:41.230355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:41.235513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35cdf223-6f16-436d-b3f3-d8c7eba83771 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1395 microversion: 2.1 time: 0.161750 Oct 11 02:07:41.236095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3284/6520] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:41 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:41.902899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69c4285-d734-4d09-8c35-d6509b05ab1c", "name": "network-vif-deleted", "tag": "89a07359-4763-4a59-b103-cfa5730c8e8a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:07:41.908893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:41.916495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:41.917194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:41.917421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:41.921946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=85 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:41.939152 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] Creating event network-vif-deleted:89a07359-4763-4a59-b103-cfa5730c8e8a for instance f69c4285-d734-4d09-8c35-d6509b05ab1c on n-h1-772273-9 Oct 11 02:07:41.944304 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-577b59c0-d4e3-4fd1-99fc-762688884c3d req-2cda440d-8580-4192-a945-8a8df3366665 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045095 Oct 11 02:07:41.945066 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3237/6521] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:07:42.258328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:42.258960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:42.262158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:07:42.267981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:42.268474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:42.269043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:42.269756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:42.270224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:42.270655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:42.334763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:42.342862 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9100420d-1921-46aa-91bd-7230942b4b96 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1187 microversion: 2.1 time: 0.088670 Oct 11 02:07:42.343467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3285/6522] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:42 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:43.367949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:43.368580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:43.374944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:43.375554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:43.376070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:43.376777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:43.377278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:43.377717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:43.441496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:43.450274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d57645e8-c798-4c14-b443-3e0e06f900aa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1187 microversion: 2.1 time: 0.087568 Oct 11 02:07:43.450857 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3238/6523] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:43 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:44.474446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:44.475070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:44.482243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:44.482732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:44.483172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:44.483895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:44.484356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:44.484788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:44.545309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:44.553861 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63d0eb89-4568-4292-9a5e-c2f53a82e01b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1187 microversion: 2.1 time: 0.083870 Oct 11 02:07:44.554445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3286/6524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:44 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:45.575960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:45.576580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:45.584379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:45.584879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:45.585326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:45.586033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:45.586605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:45.587047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:45.711224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:07:45.720056 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92bd65bf-0054-4706-a8f9-ff579f3a7325 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 200 len: 1187 microversion: 2.1 time: 0.148065 Oct 11 02:07:45.721003 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3239/6525] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:45 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 1187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:07:46.742812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:46.743475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:46.750571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:46.751079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:46.751557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:46.752281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:46.752751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:46.753189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:46.768549 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c HTTP/1.1 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'f69c4285-d734-4d09-8c35-d6509b05ab1c'} Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:46.770334 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c3008566-faf1-41f3-a01e-ec73f83bf01d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 404 len: 111 microversion: 2.1 time: 0.033654 Oct 11 02:07:46.775973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3287/6526] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:46 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:07:48.924074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:48.924580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:48.931189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:48.931707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:48.932146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:48.932841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:48.933293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:48.933715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:48.947556 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c HTTP/1.1 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'f69c4285-d734-4d09-8c35-d6509b05ab1c'} Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:07:48.949224 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7153e013-21d2-46a4-8267-88b3e66518dc tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 404 len: 111 microversion: 2.1 time: 0.030433 Oct 11 02:07:48.954592 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3240/6527] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:07:48 2022] DELETE /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:07:48.961338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:07:48.961963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: f69c4285-d734-4d09-8c35-d6509b05ab1c] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:07:48.968867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:48.969363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:48.969808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:48.970537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:07:48.970999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:07:48.971509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:07:48.985306 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c HTTP/1.1 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'f69c4285-d734-4d09-8c35-d6509b05ab1c'} Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:07:48.986906 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance f69c4285-d734-4d09-8c35-d6509b05ab1c could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a03401c5-c5c7-41ce-bb8c-bb463cd1f145 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c" status: 404 len: 111 microversion: 2.1 time: 0.031478 Oct 11 02:07:48.995410 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3288/6528] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:07:48 2022] GET /compute/v2.1/servers/f69c4285-d734-4d09-8c35-d6509b05ab1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:08:08.653559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1333700846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "92ec240d-8f7c-4211-a939-4d390ec2c06c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:08.664181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:08.664837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=15 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:08.716736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:08:09.077956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:08:09.078425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:08:09.078909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:08:09.079356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:08:09.079782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:08:09.088865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:09.089352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:09.089793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:09.090526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:09.090982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:09.091435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:09.108782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:08:09.113994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:08:09.171724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:08:09.173813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92ec240d-8f7c-4211-a939-4d390ec2c06c',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:08:09.300764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9514b92e-b79f-4750-93a9-565de6fc2d9c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651026 Oct 11 02:08:09.301429 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3241/6529] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:08:09.312952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5265fc8e-26f2-4d5c-a05e-0580c1d2004e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:09.314173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5265fc8e-26f2-4d5c-a05e-0580c1d2004e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:09.318866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=7 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:09.319543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:09.371297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5265fc8e-26f2-4d5c-a05e-0580c1d2004e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:09.378571 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5265fc8e-26f2-4d5c-a05e-0580c1d2004e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1071 microversion: 2.1 time: 0.069632 Oct 11 02:08:09.379152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3289/6530] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:09 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1071 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:10.404050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:10.405417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:10.413404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:10.414245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:10.415005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:10.415751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:10.416521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:10.417189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:10.482733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:10.492364 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24a7c62d-9819-491f-b6ac-4dc2391202e1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1187 microversion: 2.1 time: 0.094738 Oct 11 02:08:10.492992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3242/6531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:10 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:11.516189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:11.517068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:11.526400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:11.527524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:11.528587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:11.529428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:11.530085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:11.530526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:11.634234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4", "tag": "322ecf44-a431-48aa-8419-aa7d2f90a5f8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:11.666346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:11.667089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:11.667780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:11.684283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] Creating event network-changed:322ecf44-a431-48aa-8419-aa7d2f90a5f8 for instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 on n-h1-772273-9 Oct 11 02:08:11.691472 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-583ccc8a-76b0-4976-bd69-00c76c2f3597 req-2793b444-2829-4184-9806-1ca0f1c7293a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072118 Oct 11 02:08:11.693434 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3243/6532] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:08:11.698896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:11.707298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2cdddb62-530e-416a-b9f7-86be9539e37e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1229 microversion: 2.1 time: 0.195041 Oct 11 02:08:11.711731 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3290/6533] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:11 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1229 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:12.730861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:12.731591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:12.738571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:12.739059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:12.739524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:12.740257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:12.740708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:12.741134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:12.873128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:12.881543 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e2918a1-c1bd-44f2-8ad7-94e492ac088d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1229 microversion: 2.1 time: 0.155147 Oct 11 02:08:12.882134 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3244/6534] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:12 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:13.905006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:13.905619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:13.913056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:13.913541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:13.913973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:13.914664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:13.915115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:13.915564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:14.046344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:14.054270 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8273c98-e86e-4603-a572-dc3c10e63500 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1229 microversion: 2.1 time: 0.153205 Oct 11 02:08:14.054855 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3291/6535] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:13 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1229 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:15.076615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:15.077235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:15.085151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:15.085883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:15.086325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:15.087032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:15.087575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:15.087955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:15.231805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:15.240076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09706d08-2d5f-4255-83f2-fb49b5f6c123 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1229 microversion: 2.1 time: 0.167530 Oct 11 02:08:15.240658 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3245/6536] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:15 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:16.262424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:16.263041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:16.269715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:16.270203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:16.270643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:16.271867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:16.272328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:16.272758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:16.402180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:16.410047 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9e663ff0-6dc2-43e6-9cd4-47648ef030ed tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.151524 Oct 11 02:08:16.410644 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3292/6537] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:16 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:17.433513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:17.434047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:17.440606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:17.441096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:17.441545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:17.442249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:17.443252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:17.443715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:17.575164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:17.582918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd34c3d7-4fe5-4711-944e-9ea6facc7242 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.153595 Oct 11 02:08:17.584034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3246/6538] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:17 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:18.606473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:18.607093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:18.613891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:18.614879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:18.615639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:18.616335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:18.616793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:18.617229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:18.745201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:18.753046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b11f89bb-83cf-481e-be12-60485d97fea9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.150873 Oct 11 02:08:18.753627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3293/6539] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:18 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:19.775967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:19.776584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:19.779371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:19.780038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:19.785605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:19.786095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:19.786535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:19.787227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:19.787755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:19.788188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:19.920084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:19.927805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee1880be-c63d-41c7-958c-f71253b19231 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.155864 Oct 11 02:08:19.928403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3247/6540] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:19 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:20.951012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:20.951666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:20.953822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:20.959932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:20.960449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:20.960892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:20.961603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:20.962053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:20.962485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:21.090131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:21.097834 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-670a61b9-b552-4549-b248-8e2ab9ba1cb6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.150803 Oct 11 02:08:21.098461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3294/6541] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:20 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:22.121917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:22.122486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:22.129332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:22.129820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:22.130267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:22.130961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:22.132095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:22.132535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:22.259009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:22.266746 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4215f98f-80b1-458f-809a-31b90527e281 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.148854 Oct 11 02:08:22.267324 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3248/6542] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:22 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:23.289199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:23.289812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:23.296799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:23.297282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:23.297719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:23.298402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:23.298852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:23.299277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:23.431840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:23.439438 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb6eba84-d69f-4709-b20c-70f964861424 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.154191 Oct 11 02:08:23.440015 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3295/6543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:23 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:23.708034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4", "name": "network-vif-plugged", "status": "completed", "tag": "322ecf44-a431-48aa-8419-aa7d2f90a5f8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:23.718573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:23.719147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:23.719621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:23.731424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] Creating event network-vif-plugged:322ecf44-a431-48aa-8419-aa7d2f90a5f8 for instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 on n-h1-772273-9 Oct 11 02:08:23.736424 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-26b65916-b9a3-4a6b-add3-0c25c1c6246d req-6a4adb23-db4f-4cb4-9d06-aa28307b2fca service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Oct 11 02:08:23.737029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3249/6544] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:08:24.463062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:24.463709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:24.470583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:24.471077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:24.471559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:24.472262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:24.472724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:24.473157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:24.600054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:24.608956 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a1e38bf3-3834-43e0-9749-404cd25ae788 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1217 microversion: 2.1 time: 0.150307 Oct 11 02:08:24.609542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3296/6545] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:24 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:08:25.633396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:25.634103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:25.640364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.640850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.641294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:25.641992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.642447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.642875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:25.775817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:25.783534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66dfe72d-a88e-4cd9-a483-7f9f022d5375 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1404 microversion: 2.1 time: 0.155408 Oct 11 02:08:25.784113 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3250/6546] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:25 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:25.806097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:25.806718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:25.813593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.814082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.814524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:25.815225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.815709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.816147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:25.941512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:25.949300 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db519193-7fcc-4d89-bbb8-4ef42e6c30f8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1404 microversion: 2.1 time: 0.147392 Oct 11 02:08:25.949884 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3297/6547] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:25 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:25.971922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-582810166"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:25.974243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:25.980495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.980985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.981434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:25.982164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:25.982643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:25.983055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:26.074717 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Attempting to quiesce instance before volume snapshot. Oct 11 02:08:26.134545 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 11 02:08:26.202207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Creating snapshot from volume 92ec240d-8f7c-4211-a939-4d390ec2c06c. {{(pid=120494) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 11 02:08:27.107532 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-861ceae5-44eb-4560-90c8-5a8503ad7f4c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4/action" status: 202 len: 0 microversion: 2.1 time: 1.139409 Oct 11 02:08:27.108450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3251/6548] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:08:25 2022] POST /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 02:08:28.262303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2107065518", "imageRef": "2533e92d-56b1-4d3f-bd63-7283c1da7f04", "flavorRef": "452", "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:28.317789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:08:28.982441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:08:28.982859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:08:28.983329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:08:28.983757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:08:28.984166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:08:28.993166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:28.993659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:28.994123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:28.994856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:28.995318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:28.995766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:29.012295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:08:29.017585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:08:29.030889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:08:29.032911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7db64912-b3ed-4a23-88be-3c16b8e6844b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:08:29.112334 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32942c12-1d74-47aa-9233-f93c2445a17e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853961 Oct 11 02:08:29.113020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3298/6549] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:08:29.125606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12988902-482f-45aa-a07b-752a73dbc7b6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:29.126357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12988902-482f-45aa-a07b-752a73dbc7b6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:29.183785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-12988902-482f-45aa-a07b-752a73dbc7b6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:29.190782 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12988902-482f-45aa-a07b-752a73dbc7b6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1230 microversion: 2.1 time: 0.070245 Oct 11 02:08:29.191422 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3252/6550] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:29 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:30.216034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:30.216659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:30.223520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:30.224261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:30.224837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:30.225617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:30.226083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:30.226519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:30.291101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:30.299004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4217c1f7-5ef3-44bc-89a5-d7402ca31bb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1300 microversion: 2.1 time: 0.088947 Oct 11 02:08:30.315008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3299/6551] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:30 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:31.322619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:31.323899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:31.340312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:31.340832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:31.341500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:31.342250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:31.342727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:31.343172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:31.488741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:31.497231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-525bbf95-7d65-4bac-8ad3-f1c589013c11 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.178571 Oct 11 02:08:31.498159 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3253/6552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:31 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:31.566467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbea71ea-921c-46d1-aadc-41573c959c63", "tag": "45cc0d95-ba50-48dd-9920-1747d1d1cd4e"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:31.579116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:31.579987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:31.581206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:31.594889 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] Creating event network-changed:45cc0d95-ba50-48dd-9920-1747d1d1cd4e for instance bbea71ea-921c-46d1-aadc-41573c959c63 on n-h2-772273-9 Oct 11 02:08:31.600080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c2ec9fcd-daa4-4f96-aa42-ab2876babfca req-c1d33a92-fba5-4f49-acdd-77aa111cc3c5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038331 Oct 11 02:08:31.601323 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3300/6553] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:08:32.520813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:32.521449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:32.528680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:32.529444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:32.529902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:32.530638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:32.531108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:32.531595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:32.672190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:32.680939 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b321e40-b9eb-41f9-aafc-f262d1ff407e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.164057 Oct 11 02:08:32.691427 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3254/6554] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:32 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:33.706314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:33.707067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:33.724205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:33.724946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:33.728886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:33.730282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:33.732966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:33.733983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:33.912227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:33.920771 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edbb7d62-bfb4-48da-9312-bfe3cc2762e9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.220400 Oct 11 02:08:33.921354 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3301/6555] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:33 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:34.949383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:34.950102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:34.959186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:34.959805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:34.960274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:34.960966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:34.961901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:34.962336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:35.172355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:35.186116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3df81b2-2792-458a-bb5c-15c639432540 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.241146 Oct 11 02:08:35.187115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3255/6556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:34 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:36.212884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:36.213503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:36.224131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:36.224869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:36.226901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:36.230502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:36.231196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:36.232249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:36.441177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:36.450525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e3970f40-3d53-47ea-9e82-3b339a04244a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.242790 Oct 11 02:08:36.451218 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3302/6557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:36 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:37.476779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:37.478069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:37.486214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:37.486730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:37.487192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:37.488057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:37.488713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:37.489384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:37.623429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:37.631698 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-587fd3d3-91f1-4f41-99d1-bc01172e5a61 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.159554 Oct 11 02:08:37.643542 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3256/6558] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:37 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:38.654767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:38.655367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:38.662156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:38.662643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:38.663082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:38.663816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:38.664275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:38.664701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:38.794220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:38.801785 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-955cbc5e-73dd-4b50-94bc-431f31170ed1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.151421 Oct 11 02:08:38.802363 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3303/6559] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:38 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:39.825341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:39.825970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:39.828853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:39.829529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:39.836162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:39.836667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:39.837119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:39.837833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:39.838297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:39.838735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:39.842566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:39.973018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:39.981134 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1617d43-e350-40b7-a6fc-87dcacf45935 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.159660 Oct 11 02:08:39.981629 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3257/6560] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:39 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:41.003839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:41.004388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:41.006417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:41.007100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:41.009384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:41.021739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:41.022224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:41.022664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:41.023400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:41.023867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:41.024304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:41.027700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=77 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:08:41.167761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:41.176140 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-415436bd-864b-4e30-90a3-1cf64911ae97 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.176292 Oct 11 02:08:41.186666 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3304/6561] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:40 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:42.199652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:42.200331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:42.207256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:42.207786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:42.208237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:42.208937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:42.209403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:42.209839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:42.342093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:42.349812 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3b52509-3b9c-416e-bebc-f7854bd2dcfb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.154665 Oct 11 02:08:42.350391 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3258/6562] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:42 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:43.373334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:43.374104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:43.381437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:43.381937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:43.382382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:43.383644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:43.384106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:43.384540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:43.520358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:43.528806 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edf39bc7-782f-4c0e-9149-7b24b924db68 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1342 microversion: 2.1 time: 0.159871 Oct 11 02:08:43.529516 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3305/6563] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:43 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:44.551935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:44.552598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:44.559295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:44.559941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:44.560421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:44.561306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:44.561813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:44.562437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:44.700974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:44.710082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a46b308-954a-4f2d-ac3a-298bfc2ddf8a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1388 microversion: 2.1 time: 0.161996 Oct 11 02:08:44.727461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3259/6564] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:44 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1388 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:45.734356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:45.734970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:45.741796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:45.742836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:45.743277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:45.743992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:45.744449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:45.744876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:45.872163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:45.879914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8c8a1af-3464-4435-ae66-005f33340666 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.149487 Oct 11 02:08:45.880493 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3306/6565] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:45 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:46.902840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:46.903507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:46.910308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:46.910809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:46.911261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:46.912079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:46.912610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:46.912994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:47.045592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:47.053384 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65b40df0-2ad3-42eb-9839-599274f79930 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.154552 Oct 11 02:08:47.053963 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3260/6566] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:46 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:48.077061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:48.077674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:48.084261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:48.084738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:48.085240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:48.085876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:48.086977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:48.087421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:48.230816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:48.238795 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-baff432d-0842-456a-b862-a8d4e6954d10 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.166014 Oct 11 02:08:48.239398 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3307/6567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:48 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:49.262215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:49.262856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:49.269813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:49.270318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:49.270772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:49.271531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:49.272036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:49.272485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:49.414902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:49.423266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66fe3e09-ac39-4dae-9ffc-a462f795bc94 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.165136 Oct 11 02:08:49.423915 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3261/6568] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:49 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:50.446267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:50.447008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:50.455031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:50.455568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:50.456139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:50.456850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:50.457353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:50.457781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:50.605146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:50.613603 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04898b5a-0dfc-4278-84a6-92dd5a938a7c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.171349 Oct 11 02:08:50.614196 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3308/6569] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:50 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:51.636871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:51.637488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:51.640707 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:08:51.640851 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 (ip 10.222.0.66) !!! Oct 11 02:08:51.648692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:51.649188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:51.649635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:51.650369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:51.650830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:51.651293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:51.782436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:51.790240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f62a3b6-80bc-4e7c-9fe2-7df41159a803 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.157371 Oct 11 02:08:51.790841 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3262/6570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:51 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:52.814747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:52.815446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:52.818665 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:08:52.818831 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 (ip 10.222.0.66) !!! Oct 11 02:08:52.826808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:52.827331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:52.827895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:52.828747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:52.829244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:52.829670 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:52.974487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:52.984183 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13b8f84a-6f92-4902-ac20-965a4bc1d709 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.173880 Oct 11 02:08:52.984743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3309/6571] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:52 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:08:54.006726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:54.007363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:54.014578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:54.015142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:54.015631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:54.016347 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:54.016819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:54.017263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:54.154731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:54.163529 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-431d3221-a78e-4f7c-bc09-7e84f9164a2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.160812 Oct 11 02:08:54.164174 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3263/6572] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:54 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:55.186894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:55.188055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:55.200066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:55.200965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:55.201796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:55.202788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:55.203594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:55.204027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:55.353200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:55.361600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6cb69148-ef37-49c6-9226-a7d92652a0be tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.179380 Oct 11 02:08:55.362172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3310/6573] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:55 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:56.221148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbea71ea-921c-46d1-aadc-41573c959c63", "name": "network-vif-plugged", "status": "completed", "tag": "45cc0d95-ba50-48dd-9920-1747d1d1cd4e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:08:56.232415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:56.232911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:56.233364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:56.245164 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] Creating event network-vif-plugged:45cc0d95-ba50-48dd-9920-1747d1d1cd4e for instance bbea71ea-921c-46d1-aadc-41573c959c63 on n-h2-772273-9 Oct 11 02:08:56.250796 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a90d288b-539b-4b12-aa8e-a94c9b1a1c93 req-efa7286a-0858-4cec-8fe6-b3c9546b36dc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033992 Oct 11 02:08:56.251435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3264/6574] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:08:56.384639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:56.385257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:56.392557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:56.393046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:56.393485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:56.394181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:56.394664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:56.395087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:56.530846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:56.538699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3059c3b3-3148-419a-a91b-3d3b587fd4fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.158054 Oct 11 02:08:56.539290 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3311/6575] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:56 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:57.564203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:57.565177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:57.571412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:57.571921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:57.572380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:57.573095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:57.573569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:57.574555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:57.705912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:57.713855 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0df0db0d-a748-45bc-b53e-23af7fff8f33 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1376 microversion: 2.1 time: 0.155288 Oct 11 02:08:57.714432 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3265/6576] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:57 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:58.737616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:58.738176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:58.745048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:58.745536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:58.745974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:58.746664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:58.747120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:58.747582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:58.879868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:58.887908 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b0bdfdb-1245-44ef-87c1-dbd7f8184b1c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1564 microversion: 2.1 time: 0.154329 Oct 11 02:08:58.888496 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3312/6577] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:58 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:58.910590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:58.911283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:58.917890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:58.918406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:58.918864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:58.920250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:58.920726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:58.921182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:59.050395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:59.058236 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e1a1dd2-1b11-4211-9016-5fb2668a0c1a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1564 microversion: 2.1 time: 0.151793 Oct 11 02:08:59.058813 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3266/6578] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:58 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:08:59.138896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:59.139427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:59.145452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:59.145944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:59.146388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:59.147089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:59.147580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:59.148012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:59.175272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:08:59.252560 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6295c7f0-8fbd-4602-af3e-ca12b847d4a5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 204 len: 0 microversion: 2.1 time: 0.117718 Oct 11 02:08:59.253183 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3313/6579] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:08:59 2022] DELETE /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:08:59.262447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:08:59.263612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:08:59.270317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:59.270823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:59.271283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:59.272029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:08:59.272507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:08:59.272955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:08:59.407682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:08:59.416290 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-da586530-13bf-44f6-a18f-5fbccf2c767b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1570 microversion: 2.1 time: 0.157757 Oct 11 02:08:59.416878 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3267/6580] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:08:59 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:00.441664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:00.442298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:00.449441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:00.449958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:00.450928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:00.451677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:00.452139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:00.452696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:00.586897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:00.595491 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c09aea0-ad78-4b35-9444-472f5a5875ce tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1570 microversion: 2.1 time: 0.159015 Oct 11 02:09:00.596075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3314/6581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:00 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:01.287515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbea71ea-921c-46d1-aadc-41573c959c63", "name": "network-vif-deleted", "tag": "45cc0d95-ba50-48dd-9920-1747d1d1cd4e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:01.301467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:01.302316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:01.302774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:01.320272 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] Creating event network-vif-deleted:45cc0d95-ba50-48dd-9920-1747d1d1cd4e for instance bbea71ea-921c-46d1-aadc-41573c959c63 on n-h2-772273-9 Oct 11 02:09:01.327367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-feaa7b76-e4d3-4af4-8824-0cd79d7f17e8 req-088cf63b-d142-4fc9-8816-fe06af5bbb87 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044312 Oct 11 02:09:01.328204 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3268/6582] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:09:01.618980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:01.619676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:01.627131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:01.627653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:01.628099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:01.628796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:01.629255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:01.629683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:01.692607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:01.701362 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c8622dad-6784-4f51-8496-17d522fb65b4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1361 microversion: 2.1 time: 0.085739 Oct 11 02:09:01.701961 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3315/6583] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:01 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:02.725037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:02.725824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:02.734579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:02.735083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:02.735570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:02.736281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:02.736745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:02.737182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:02.805796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:02.813958 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce874b0b-8a9f-4165-8068-8319c06bf08a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1361 microversion: 2.1 time: 0.093754 Oct 11 02:09:02.814545 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3269/6584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:02 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:03.837830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:03.838461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:03.845870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:03.846413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:03.846853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:03.847645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:03.848105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:03.848534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:03.915213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:03.923212 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6db68b9-3d18-4381-ac06-087522a71dc0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1361 microversion: 2.1 time: 0.089469 Oct 11 02:09:03.923832 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3316/6585] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:03 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:04.948635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:04.949302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:04.957164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:04.957668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:04.958125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:04.958856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:04.959358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:04.959805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:05.025495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:05.034582 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa44aa2a-4da7-4b95-b234-268684b15483 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 200 len: 1361 microversion: 2.1 time: 0.090001 Oct 11 02:09:05.035177 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3270/6586] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:04 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:06.057901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:06.058808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:06.069887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:06.071310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:06.072024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:06.073211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:06.074074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:06.074595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:06.096268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 HTTP/1.1 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'bbea71ea-921c-46d1-aadc-41573c959c63'} Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:06.098306 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:06.104374 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9401104-6d3f-4dfb-bf9d-0faaf921c9f3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 404 len: 111 microversion: 2.1 time: 0.047178 Oct 11 02:09:06.107502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3317/6587] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:06 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:11.443776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:11.444299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:11.447182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:11.453189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:11.453703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:11.454164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:11.454887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:11.455386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:11.455838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:11.460198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=76 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:11.483018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:09:11.558610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bae5428e-99ad-46a1-864e-50934b07f30a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 204 len: 0 microversion: 2.1 time: 0.118394 Oct 11 02:09:11.559409 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3271/6588] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:09:11 2022] DELETE /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 02:09:11.569216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:11.569876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:11.572829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:11.578563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:11.579056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:11.579537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:11.580240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:11.580704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:11.581132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:11.585636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:11.712597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:11.720914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-624efbc6-7920-4d9e-af2b-eb26e1fd653e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1410 microversion: 2.1 time: 0.156448 Oct 11 02:09:11.721485 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3318/6589] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:11 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:12.744884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:12.746806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:12.753316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:12.753828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:12.754287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:12.754999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:12.755509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:12.755956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:12.886606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:12.894478 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75e4bb4e-f1b3-4f45-a2f1-623f89726062 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1410 microversion: 2.1 time: 0.153952 Oct 11 02:09:12.895064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3272/6590] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:12 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:13.558793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4", "name": "network-vif-deleted", "tag": "322ecf44-a431-48aa-8419-aa7d2f90a5f8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:13.569835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:13.570244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:13.570669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:13.582635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] Creating event network-vif-deleted:322ecf44-a431-48aa-8419-aa7d2f90a5f8 for instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 on n-h1-772273-9 Oct 11 02:09:13.587525 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9b78979a-4842-4084-90e0-9993b9fecc04 req-0196cc4d-1af3-4510-9acf-cc93764fbe78 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Oct 11 02:09:13.588127 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3319/6591] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:09:13.918418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:13.919683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:13.930833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:13.931369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:13.931824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:13.932880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:13.933359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:13.933807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:14.000005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:14.008035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-656ef006-5303-4124-b650-6efa339d1fa1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1202 microversion: 2.1 time: 0.093848 Oct 11 02:09:14.008621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3273/6592] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:13 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:15.032815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:15.033551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:15.039971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:15.040459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:15.040896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:15.041587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:15.042042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:15.042471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:15.106367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:15.114580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ed2a71d3-7da7-4c88-b097-6095771d98bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1202 microversion: 2.1 time: 0.087678 Oct 11 02:09:15.115177 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3320/6593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:15 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:16.139812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:16.140445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:16.147478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:16.147984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:16.148441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:16.149153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:16.149626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:16.150073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:16.219383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:16.227261 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-157574ed-0152-4a60-9240-6f700a03fc00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1202 microversion: 2.1 time: 0.092057 Oct 11 02:09:16.227984 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3274/6594] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:16 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:17.250308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:17.250934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:17.257412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:17.257903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:17.258346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:17.259041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:17.259540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:17.259973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:17.322744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:17.331085 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3ed41cbe-343f-43f9-8591-9c7a1d4e2ec1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 200 len: 1202 microversion: 2.1 time: 0.084929 Oct 11 02:09:17.331691 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3321/6595] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:17 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 1202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:18.354548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:18.355449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:18.362585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:18.363089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:18.363582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:18.364298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:18.364770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:18.365238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:18.378777 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 HTTP/1.1 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4'} Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:18.380567 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f4e0f36-ac1d-432e-ab3f-a65dbafbd7c6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 404 len: 111 microversion: 2.1 time: 0.031859 Oct 11 02:09:18.383673 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3275/6596] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:18 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:20.526825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:20.527415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:20.534007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:20.534522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:20.535023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:20.535835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:20.536363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:20.536855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:20.550203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 HTTP/1.1 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'bbea71ea-921c-46d1-aadc-41573c959c63'} Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:20.552025 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67878362-a8c1-479d-919a-7815791957df tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 404 len: 111 microversion: 2.1 time: 0.030847 Oct 11 02:09:20.554845 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3322/6597] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:09:20 2022] DELETE /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:20.562847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:20.563604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: bbea71ea-921c-46d1-aadc-41573c959c63] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:20.571934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:20.572442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:20.573411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:20.574291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:20.575629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:20.576075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:20.589976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 HTTP/1.1 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'bbea71ea-921c-46d1-aadc-41573c959c63'} Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:20.591607 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance bbea71ea-921c-46d1-aadc-41573c959c63 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-274d607f-0234-4430-964c-1b367931bbb4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63" status: 404 len: 111 microversion: 2.1 time: 0.034643 Oct 11 02:09:20.594657 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3276/6598] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:20 2022] GET /compute/v2.1/servers/bbea71ea-921c-46d1-aadc-41573c959c63 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:21.106768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:21.107272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:21.113422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:21.113909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:21.114346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:21.115057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:21.115531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:21.115959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:21.129462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 HTTP/1.1 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4'} Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:21.131058 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ed8c80a-402e-43ba-aab8-09418ab60a40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 404 len: 111 microversion: 2.1 time: 0.030633 Oct 11 02:09:21.134556 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3323/6599] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:09:21 2022] DELETE /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:21.141668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:21.142307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:21.148699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:21.149300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:21.149788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:21.150509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:21.151016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:21.151496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:21.165586 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 HTTP/1.1 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4'} Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:09:21.167143 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:09:21.171564 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-265c5837-3c5d-46b3-872e-4190a4ebab00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4" status: 404 len: 111 microversion: 2.1 time: 0.030939 Oct 11 02:09:21.172461 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3277/6600] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:21 2022] GET /compute/v2.1/servers/ac67b4e1-d8ae-4615-abd8-8fa7816fdcf4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:09:21.240859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7aff7609-38c7-4fe1-9626-f0293ea7d7b2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: .version_select at 0x7f11341b3700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1214713168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG8EBdBFgUGdKh23diUBWMCieelTF0g7RtlQ769HtWLC2lLL/yh/eT8Z3sFXehM50CrduQeDk2N5XyEbwGIVMdUvq+mYqRPYcYfrRkM6zBLAgBpvomRk3WYojmaRpkFXQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:21.256328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7aff7609-38c7-4fe1-9626-f0293ea7d7b2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:09:21.261531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-7aff7609-38c7-4fe1-9626-f0293ea7d7b2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:09:21.289175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7aff7609-38c7-4fe1-9626-f0293ea7d7b2 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052340 Oct 11 02:09:21.289798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3324/6601] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:09:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:09:37.493460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965351232", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214713168", "security_groups": [{"name": "tempest-secgroup-smoke-1756223"}], "block_device_mapping_v2": [{"uuid": "0959d579-7300-4614-8a0b-b216b8db8b8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:37.505161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:37.505837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:37.609964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:09:37.974638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:09:37.975059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:09:37.975591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:09:37.976014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:09:37.976441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:09:37.986152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:37.986645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:37.987098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:37.987876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:37.988343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:37.988780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:38.005805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:09:38.011002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:09:38.076760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:09:38.078904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0959d579-7300-4614-8a0b-b216b8db8b8d',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:09:38.206617 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16032e26-f602-49e6-ba5c-0243ed4a7053 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.716959 Oct 11 02:09:38.207268 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3278/6602] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:09:37 2022] POST /compute/v2.1/servers => generated 403 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:09:38.217312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=23 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:38.217882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:38.218809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:38.223129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8b850cd-0b23-4c24-8f55-a31333be4a25 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:38.223872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8b850cd-0b23-4c24-8f55-a31333be4a25 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:38.287450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8b850cd-0b23-4c24-8f55-a31333be4a25 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:38.295080 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8b850cd-0b23-4c24-8f55-a31333be4a25 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1095 microversion: 2.1 time: 0.080630 Oct 11 02:09:38.295693 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3325/6603] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:38 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:09:39.317796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:39.318546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:39.326600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:39.327141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:39.327633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:39.328356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:39.328837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:39.329292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:39.394526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:39.411822 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11d5f374-df36-4355-a02d-a24d6b86de17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1211 microversion: 2.1 time: 0.097824 Oct 11 02:09:39.412419 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3279/6604] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:39 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:40.435556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:40.436751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:40.450554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:40.451053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:40.451707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:40.452571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:40.453026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:40.453454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:40.608791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:40.619635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-901a3b6e-71d2-45cb-b502-b3d85342f0d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1276 microversion: 2.1 time: 0.188132 Oct 11 02:09:40.620294 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3326/6605] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:40 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:40.882025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16206638-d445-48eb-b506-e37528e6766a", "tag": "83dbda41-effd-4413-a3e5-43f1aa0512c5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:40.897534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:40.898039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:40.898660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:40.911942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] Creating event network-changed:83dbda41-effd-4413-a3e5-43f1aa0512c5 for instance 16206638-d445-48eb-b506-e37528e6766a on n-h2-772273-9 Oct 11 02:09:40.917125 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8012b59d-84a2-4d55-8815-baacace288f0 req-076986c7-26bb-4ff8-b829-5e1fa3746b29 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049164 Oct 11 02:09:40.918710 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3280/6606] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:09:41.643133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:41.644124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:41.651609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:41.652300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:41.653372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:41.654240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:41.654805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:41.655377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:41.798249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:41.806562 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6417210a-4808-4f0d-b93e-6110063a04a6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1276 microversion: 2.1 time: 0.167299 Oct 11 02:09:41.807715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3327/6607] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:41 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:42.832196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:42.832928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:42.839259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:42.839798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:42.840257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:42.840972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:42.841453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:42.841899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:42.975728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:42.984521 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7864acdb-76fb-40ee-a9b8-11e15f231b62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1276 microversion: 2.1 time: 0.157555 Oct 11 02:09:42.985228 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3281/6608] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:42 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:44.007579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:44.008263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:44.016000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:44.016508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:44.016963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:44.017682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:44.018149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:44.018589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:44.160872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:44.169706 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cde99600-836b-4769-ad22-1fd4ca4c58b3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1276 microversion: 2.1 time: 0.166273 Oct 11 02:09:44.170487 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3328/6609] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:44 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:45.193462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:45.194093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:45.201432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:45.202125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:45.202638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:45.203459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:45.204088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:45.204586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:45.337687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:45.346130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0df6426-cbcc-44e4-9982-73bf65fab80c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.156756 Oct 11 02:09:45.346732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3282/6610] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:45 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:46.369634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:46.370170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:46.376803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:46.377297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:46.377748 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:46.378844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:46.378953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:46.379362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:46.511211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:46.518970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af79a271-0b67-4f31-bd3d-c6022a7db632 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.153540 Oct 11 02:09:46.519588 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3329/6611] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:46 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:47.541498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:47.542046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:47.549381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:47.549871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:47.550321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:47.551046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:47.551552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:47.551987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:47.686227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:47.693932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1da6220b-a5a5-40b9-8a16-254f0f4083d6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.156444 Oct 11 02:09:47.694516 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3283/6612] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:47 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:48.716624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:48.717239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:48.719976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:48.725826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:48.726313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:48.726746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:48.727449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:48.727916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:48.728324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:48.857933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:48.865519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2f1d299-bf12-4652-bff4-2518c7ff856f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.152978 Oct 11 02:09:48.866090 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3330/6613] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:48 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:09:49.890317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:49.890956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:49.892993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:49.893676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:09:49.900357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:49.900864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:49.901327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:49.902043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:49.902520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:49.902971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:50.037385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:50.045381 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08809844-8c19-45e0-bf0c-a597d4f6881f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.159545 Oct 11 02:09:50.045987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3284/6614] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:49 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:51.068513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:51.069135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:51.076231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:51.076720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:51.077157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:51.077848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:51.078310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:51.078737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:51.206904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:51.214602 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2d7726a-dcda-427d-af3a-f4c2c4214f1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.149980 Oct 11 02:09:51.215181 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3331/6615] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:51 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:52.238148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:52.238709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:52.245511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:52.246012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:52.246472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:52.247701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:52.248182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:52.248625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:52.388275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:52.396229 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bdff3d41-407b-4c2f-9d44-608d362498de tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.162041 Oct 11 02:09:52.396860 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3285/6616] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:52 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:53.418982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:53.420133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:53.427153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:53.427679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:53.428124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:53.428822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:53.429280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:53.429716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:53.562730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:53.570440 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2660c9bb-f944-4f02-84cc-f8aa28b23175 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.155510 Oct 11 02:09:53.571011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3332/6617] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:53 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:54.466708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16206638-d445-48eb-b506-e37528e6766a", "name": "network-vif-plugged", "status": "completed", "tag": "83dbda41-effd-4413-a3e5-43f1aa0512c5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:54.477971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:54.478478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:54.479194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:54.490634 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] Creating event network-vif-plugged:83dbda41-effd-4413-a3e5-43f1aa0512c5 for instance 16206638-d445-48eb-b506-e37528e6766a on n-h2-772273-9 Oct 11 02:09:54.495772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ee9a97e6-2bae-42fc-8f26-b7cde2eb4896 req-e45dfe27-5886-4fd8-9be4-c7cdc9a13870 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Oct 11 02:09:54.496554 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3286/6618] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:09:54.593055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:54.593583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:54.600307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:54.600794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:54.601230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:54.601925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:54.602378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:54.602813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:54.732877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:54.740761 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4ba4fe94-7c58-4980-8bfc-6f2c7d54fbfa tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.151871 Oct 11 02:09:54.741341 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3333/6619] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:54 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:55.765826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:55.766492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:55.772644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:55.773141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:55.773601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:55.774304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:55.774774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:55.775214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:55.912485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:55.920347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-45718234-40a7-4172-b5f3-c9a6e2bc0b06 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1264 microversion: 2.1 time: 0.160241 Oct 11 02:09:55.920930 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3287/6620] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:55 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:56.942487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:56.943104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:56.949956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:56.951091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:56.951564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:56.952278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:56.952722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:56.953154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:57.083026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:57.091300 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3b86e6b1-efec-434a-8c8f-8b34c2403485 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1451 microversion: 2.1 time: 0.152325 Oct 11 02:09:57.091910 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3334/6621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:56 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:57.113778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:09:57.114418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:09:57.121279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:57.121786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:57.122828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:57.123569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:57.124046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:57.124497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:57.257770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:09:57.265631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-992030dc-eff9-48e7-b2d6-6100eb1ddb62 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1451 microversion: 2.1 time: 0.155834 Oct 11 02:09:57.266212 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3288/6622] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:09:57 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:09:59.185887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16206638-d445-48eb-b506-e37528e6766a", "tag": "83dbda41-effd-4413-a3e5-43f1aa0512c5"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:09:59.195451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:09:59.195940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:09:59.196377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:09:59.207269 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] Creating event network-changed:83dbda41-effd-4413-a3e5-43f1aa0512c5 for instance 16206638-d445-48eb-b506-e37528e6766a on n-h2-772273-9 Oct 11 02:09:59.212896 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9c3a96af-f329-41e1-98e7-eeeb4df98c8a req-79ae5d13-961b-46fd-9cd1-5b4b0236b0cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093653 Oct 11 02:09:59.213563 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3335/6623] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:11:54.394667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:11:54.395482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=54 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:11:54.397898 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:11:54.398052 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a (ip 10.222.0.66) !!! Oct 11 02:11:54.453018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:54.453534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:54.459496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:54.460004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:54.460453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:54.461158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:54.461629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:54.462067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:54.490589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:11:54.563403 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42f4ac4a-1a7d-4c99-a18c-d45ea859e3ea tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 204 len: 0 microversion: 2.1 time: 0.170617 Oct 11 02:11:54.564348 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3289/6624] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:11:54 2022] DELETE /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:11:54.573691 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:11:54.575477 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:11:54.576101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=24 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:11:54.576850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=56 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:11:54.577719 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:11:54.578011 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a (ip 10.222.0.66) !!! Oct 11 02:11:54.580835 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:11:54.580959 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a (ip 10.222.0.66) !!! Oct 11 02:11:54.598199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:54.599563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:54.606919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:54.607442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:54.607885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:54.608579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:54.609141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:54.609573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:54.744232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:11:54.752057 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5779c130-c1db-4b50-9104-1e1fe224b513 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1575 microversion: 2.1 time: 0.182468 Oct 11 02:11:54.752638 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3336/6625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:11:54 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:11:55.778617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:55.779733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:55.787280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:55.787810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:55.788259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:55.788969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:55.789435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:55.789873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:55.920759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:11:55.928578 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd7683dd-973c-4a22-9e2a-98cbe1e6c84c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1575 microversion: 2.1 time: 0.155020 Oct 11 02:11:55.929156 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3290/6626] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:11:55 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:11:56.952113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:56.952845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:56.965880 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 36930. Oct 11 02:11:56.973925 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 36928. Oct 11 02:11:56.976874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:56.977338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:56.977741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:56.978551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:56.979843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:56.980635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:57.067219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:11:57.077268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2b5db6e-4ab8-4ff3-9569-f50d5fcfb134 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1510 microversion: 2.1 time: 0.128974 Oct 11 02:11:57.078216 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3337/6627] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:11:56 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1510 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:11:57.356087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16206638-d445-48eb-b506-e37528e6766a", "name": "network-vif-deleted", "tag": "83dbda41-effd-4413-a3e5-43f1aa0512c5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:11:57.377675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:57.378133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:57.378591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:57.391175 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] Creating event network-vif-deleted:83dbda41-effd-4413-a3e5-43f1aa0512c5 for instance 16206638-d445-48eb-b506-e37528e6766a on n-h2-772273-9 Oct 11 02:11:57.397333 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ef1cab5f-aab0-40cd-8b9a-3abd7be5bf14 req-ba1861f5-127b-4f17-ad9b-473eef4eedb4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113471 Oct 11 02:11:57.397832 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3291/6628] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:11:58.101887 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:58.102785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:58.109796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:58.110293 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:58.110738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:58.111549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:58.112016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:58.112445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:58.180917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:11:58.188961 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41638cda-d0b7-4a58-9ea6-ce8257d0e4c0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1226 microversion: 2.1 time: 0.091084 Oct 11 02:11:58.189537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3338/6629] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:11:58 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:11:59.213810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:11:59.214452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:11:59.220924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:59.221453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:59.221904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:59.222609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:11:59.223069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:11:59.223536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:11:59.286532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:11:59.294454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffacd243-403d-4c56-9942-2d438412fb2a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1226 microversion: 2.1 time: 0.085915 Oct 11 02:11:59.295026 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3292/6630] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:11:59 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:00.318155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:00.318707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:00.325895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:00.326390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:00.326834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:00.327562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:00.328026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:00.328455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:00.390774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:00.399175 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24e1350b-10d3-4917-8c7d-51621d1b5615 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1226 microversion: 2.1 time: 0.085593 Oct 11 02:12:00.399787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3339/6631] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:00 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:01.421628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:01.422268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:01.429802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:01.430311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:01.430768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:01.431523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:01.432001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:01.432615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:01.464563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:01.465079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:01.465537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:01.466002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lazy-loading 'fault' on Instance uuid 16206638-d445-48eb-b506-e37528e6766a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:12:01.510772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:01.518659 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e614b871-f56d-4143-a1c9-05f28cb1c712 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 200 len: 1231 microversion: 2.1 time: 0.101021 Oct 11 02:12:01.519243 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3293/6632] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:01 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:02.541329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:02.541958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:02.548893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:02.549380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:02.549823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:02.550514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:02.550973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:02.551432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:02.564669 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a HTTP/1.1 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '16206638-d445-48eb-b506-e37528e6766a'} Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:12:02.566325 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b30783db-fbe9-4552-93b3-292306fb5e4a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 404 len: 111 microversion: 2.1 time: 0.031227 Oct 11 02:12:02.571271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3340/6633] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:02 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:12:02.615373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1395476447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214713168", "security_groups": [{"name": "tempest-secgroup-smoke-1756223"}], "block_device_mapping_v2": [{"uuid": "0959d579-7300-4614-8a0b-b216b8db8b8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:12:02.728236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:12:03.150251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:12:03.150700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:12:03.151196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:12:03.151651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:12:03.152086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:12:03.160895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:03.162001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:03.162458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:03.163212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:03.163716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:03.164165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:03.180904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:12:03.186127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:12:03.245012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:12:03.247164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0959d579-7300-4614-8a0b-b216b8db8b8d',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:12:03.374195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-429002a6-db7e-4b9f-bff1-982c18688c9e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.762669 Oct 11 02:12:03.374857 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3294/6634] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:12:02 2022] POST /compute/v2.1/servers => generated 403 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:12:03.386495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ffeaa537-3c4d-4a58-ab67-f864720afb23 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:03.387116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ffeaa537-3c4d-4a58-ab67-f864720afb23 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:03.442025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ffeaa537-3c4d-4a58-ab67-f864720afb23 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:03.449513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ffeaa537-3c4d-4a58-ab67-f864720afb23 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1095 microversion: 2.1 time: 0.066865 Oct 11 02:12:03.450093 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3341/6635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:03 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:04.472682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:04.473291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:04.492944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:04.493533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:04.493984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:04.494711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:04.495183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:04.495646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:04.564387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:04.573283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f59ce2a8-42a4-470c-aca2-03ed1a67462c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1211 microversion: 2.1 time: 0.104632 Oct 11 02:12:04.573877 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3295/6636] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:04 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:05.596698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:05.597427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:05.606314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:05.606827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:05.607360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:05.608163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:05.608698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:05.609204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:05.752639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:05.760878 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-84da8a4e-f491-4790-af18-8deeb7131b17 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1276 microversion: 2.1 time: 0.168038 Oct 11 02:12:05.761461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3342/6637] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:05 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:05.847582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c5a777-9257-4453-9dc6-130338277f8b", "tag": "0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:12:05.864341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:05.864902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:05.865415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:05.877490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] Creating event network-changed:0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f for instance b1c5a777-9257-4453-9dc6-130338277f8b on n-h1-772273-9 Oct 11 02:12:05.883038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6c97361c-5a31-4c8e-9497-83a4d85a7ec4 req-264b0851-bce4-4825-bd28-16b7a64ce0fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044077 Oct 11 02:12:05.883917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3296/6638] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:12:06.785614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:06.786319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:06.800393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:06.801001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:06.801506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:06.802844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:06.803310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:06.803810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:06.947217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:06.955216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dee9f308-8b0e-4cd6-9678-e2c66a806ed0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1276 microversion: 2.1 time: 0.174844 Oct 11 02:12:06.955846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3343/6639] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:06 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:07.980628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:07.981245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:07.987585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:07.988092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:07.988556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:07.989947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:07.990520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:07.990965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:08.126033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:08.134180 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f246aaee-1b19-48fa-9aaf-a18b6cd39d22 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1276 microversion: 2.1 time: 0.159045 Oct 11 02:12:08.134918 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3297/6640] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:07 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:09.157354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:09.157970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:09.165703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:09.166196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:09.166633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:09.167349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:09.167814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:09.168245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:09.305192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:09.312839 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d45e78b7-1d18-4ab0-bc03-b379bd4c4763 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1276 microversion: 2.1 time: 0.159432 Oct 11 02:12:09.313418 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3344/6641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:09 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:10.336233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:10.336790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:10.343622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:10.344391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:10.344857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:10.345560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:10.346028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:10.346467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:10.476431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:10.484591 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d74a3be0-9bb5-44be-b444-00546bfc7e00 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.152417 Oct 11 02:12:10.485226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3298/6642] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:10 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:11.508473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:11.509089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:11.515821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:11.516304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:11.516737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:11.517419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:11.517869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:11.518292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:11.650335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:11.657983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e927bf6-a321-4c2c-b1ce-731df6e66340 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.153431 Oct 11 02:12:11.658562 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3345/6643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:11 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:12.680739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:12.681373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:12.688384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:12.688891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:12.689355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:12.690075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:12.690550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:12.691002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:12.820518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:12.828231 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55efb51d-98df-4572-b926-a604029a7895 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.151939 Oct 11 02:12:12.828811 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3299/6644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:12 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:13.851248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:13.852301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:13.854991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:13.860383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:13.860879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:13.861327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:13.862037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:13.862529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:13.862966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:13.999101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:14.007419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6d0bbfb-35f9-4459-b505-45aff70f3265 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.160128 Oct 11 02:12:14.008018 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3346/6645] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:13 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:15.030769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:15.031150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:15.032985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:15.033670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:15.041095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:15.041596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:15.042046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:15.042757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:15.043233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:15.043710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:15.175624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:15.183691 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8788d724-1741-4054-ba75-c4bb055d9ca4 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.157218 Oct 11 02:12:15.184289 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3300/6646] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:15 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:16.206884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:16.207529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:16.214899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:16.215408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:16.215847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:16.216531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:16.216982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:16.217402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:16.347318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:16.357062 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-931d8097-df10-490b-85ce-cbfdfef4727c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.154133 Oct 11 02:12:16.357668 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3347/6647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:16 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:17.379564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:17.380197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:17.387089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:17.387629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:17.388085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:17.388791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:17.389260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:17.389725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:17.523557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:17.531245 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a186368d-8e2f-4c3f-824c-ebdc0276285d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.155663 Oct 11 02:12:17.531905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3301/6648] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:17 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:18.553329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:18.553951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:18.560866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:18.561354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:18.561824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:18.562518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:18.562979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:18.563438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:18.691563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:18.699284 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-26ac4797-a6fa-4450-a393-2fa1daa1ae40 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.149899 Oct 11 02:12:18.699899 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3348/6649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:18 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:19.722177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:19.722766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:19.729884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:19.730385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:19.730877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:19.731606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:19.732079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:19.732520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:19.866543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:19.874243 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e8bac7f-fda1-45ea-98b2-2a14f96f0bbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.156080 Oct 11 02:12:19.874830 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3302/6650] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:19 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:20.897618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:20.898234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:20.906057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:20.906949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:20.907465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:20.908250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:20.909183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:20.909633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:20.930807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c5a777-9257-4453-9dc6-130338277f8b", "name": "network-vif-plugged", "status": "completed", "tag": "0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:12:20.940215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:20.940771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:20.941299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:20.952455 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] Creating event network-vif-plugged:0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f for instance b1c5a777-9257-4453-9dc6-130338277f8b on n-h1-772273-9 Oct 11 02:12:20.955974 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] [6a0dba5f-81d4-4db0-9ba5-dbfd85ea334f] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:12:21.045708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:21.053525 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66de2100-10cf-4ae4-aaf3-8e565fc4d7f6 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.160293 Oct 11 02:12:21.054100 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3303/6651] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:20 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:12:21.962644 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] [6a0dba5f-81d4-4db0-9ba5-dbfd85ea334f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37016. Oct 11 02:12:21.966392 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-bb646c30-fef3-4a24-b379-d22a0e8cad37 req-269c0ffc-a524-4f64-8d95-977608ae8639 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.113693 Oct 11 02:12:21.967058 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3349/6652] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:12:22.077186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:22.077825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:22.084736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:22.085255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:22.085714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:22.086437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:22.086917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:22.087393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:22.223124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:22.232256 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b27bc92-75e3-4ab1-ae7c-733b93d2fec3 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1264 microversion: 2.1 time: 0.159120 Oct 11 02:12:22.232836 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3304/6653] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:22 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:23.257788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:23.258413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:23.264625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:23.265112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:23.265552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:23.266285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:23.266814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:23.267245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:23.446877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:23.454802 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d4dfc12a-c02e-4a81-86db-a9532925ec8d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1451 microversion: 2.1 time: 0.202894 Oct 11 02:12:23.455402 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3350/6654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:23 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:23.477319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:12:23.477946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:12:23.484723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:23.485220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:23.485674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:23.486382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:23.487147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:23.487690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:23.506298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:23.618698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:12:23.626435 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c922202-7c99-4a26-a314-9d5eec8aa69d tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1451 microversion: 2.1 time: 0.153739 Oct 11 02:12:23.627009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3305/6655] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:12:23 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:12:25.253131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c5a777-9257-4453-9dc6-130338277f8b", "tag": "0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:12:25.260193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=33 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:25.266353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:12:25.266815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:12:25.267437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:12:25.272004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=77 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:12:25.279925 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] Creating event network-changed:0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f for instance b1c5a777-9257-4453-9dc6-130338277f8b on n-h1-772273-9 Oct 11 02:12:25.285224 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2d4975d6-1e5b-4dd3-85b9-d9b33bd9efeb req-65cfb369-0a58-4d2b-a724-561c96f7f5d7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Oct 11 02:12:25.286093 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3351/6656] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:14:03.624407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:03.625167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:03.630499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1000861932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214713168", "security_groups": [{"name": "tempest-secgroup-smoke-1756223"}], "block_device_mapping_v2": [{"uuid": "395e736b-f005-4845-bfc8-52e5864412f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:14:03.853981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] validate_networks() for [('61c7aea9-ecd9-4a88-8ee8-8a8a806f81c6', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:14:04.230628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:14:04.231075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:14:04.231608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:14:04.232629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:14:04.233098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:14:04.242286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:04.242790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:04.243245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:04.244031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:04.244506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:04.244951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:04.261504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:14:04.266703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Getting quotas for user 128e26b1d8294eeebd659afcd552f7bb and project 4e41c50554774289a6f0f5d25e6588c1. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:14:04.325723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:14:04.327996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='395e736b-f005-4845-bfc8-52e5864412f5',volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:14:04.454359 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7103efe3-8612-4d6e-b7ea-dd008b153cdf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.832584 Oct 11 02:14:04.455024 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3306/6657] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:14:03 2022] POST /compute/v2.1/servers => generated 403 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:14:04.465691 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:14:04.468311 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:14:04.469155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:04.470054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:04.478340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f42d831-0dd7-4482-9ac3-4bb5e112db9b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:04.479099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f42d831-0dd7-4482-9ac3-4bb5e112db9b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:04.533797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f42d831-0dd7-4482-9ac3-4bb5e112db9b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:04.541739 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f42d831-0dd7-4482-9ac3-4bb5e112db9b tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1095 microversion: 2.1 time: 0.079269 Oct 11 02:14:04.542224 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3352/6658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:04 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:05.565470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:05.566114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:05.572288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:05.572796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:05.573265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:05.573979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:05.574635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:05.575083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:05.642646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:05.651142 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88295a77-3f56-4cab-8150-c8f43215b66a tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1211 microversion: 2.1 time: 0.091173 Oct 11 02:14:05.651800 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3307/6659] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:05 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:06.677770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:06.679328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:06.692713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:06.693383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:06.694064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:06.696920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:06.700496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:06.701205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:06.725984 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37144. Oct 11 02:14:06.730577 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37146. Oct 11 02:14:06.874897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:06.883859 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d5bd093e-9e8e-4868-973c-28ce3d9f69da tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1276 microversion: 2.1 time: 0.213350 Oct 11 02:14:06.884473 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3353/6660] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:06 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:07.225071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14962bf-ce68-45d1-bae7-2e3e8e0d0c08", "tag": "329c9887-742c-420f-9ad4-8346e8789710"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:14:07.244650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:07.245897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:07.247020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:07.269586 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] Creating event network-changed:329c9887-742c-420f-9ad4-8346e8789710 for instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 on n-h2-772273-9 Oct 11 02:14:07.278668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-08cf5246-f9bd-4d6b-a4f0-62a358f4f12f req-60fc39c8-9314-4b0d-8228-1626389694a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057360 Oct 11 02:14:07.280478 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3308/6661] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:14:07.908961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:07.909743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:07.917030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:07.917609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:07.918272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:07.919071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:07.919681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:07.920182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:08.063735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:08.072623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29e617ca-817d-427b-8b6a-3ea094671d24 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1276 microversion: 2.1 time: 0.170336 Oct 11 02:14:08.073228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3354/6662] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:07 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:09.096709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:09.097419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:09.104696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:09.105197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:09.105646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:09.106344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:09.106811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:09.107247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:09.239893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:09.247787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55277d40-0d5c-4780-a475-efc407621967 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1276 microversion: 2.1 time: 0.155339 Oct 11 02:14:09.248374 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3309/6663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:09 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:10.270676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:10.271524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:10.278694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:10.279261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:10.279732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:10.280489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:10.280911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:10.281470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:10.420209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:10.428810 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a6085dc5-6562-4f19-b506-b288c84a57a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1276 microversion: 2.1 time: 0.162036 Oct 11 02:14:10.429569 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3355/6664] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:10 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:11.452389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:11.453047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:11.460045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:11.460546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:11.461001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:11.461712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:11.462191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:11.462636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:11.597054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:11.605999 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b91ec8f-e87a-405c-a5a3-71542d473872 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.157520 Oct 11 02:14:11.606741 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3310/6665] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:11 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:14:12.631805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:12.632427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:12.639766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:12.640255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:12.640690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:12.641379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:12.641838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:12.642267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:12.782125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:12.791249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-acbdd393-124e-4aba-8d4a-9199abc301bf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.163393 Oct 11 02:14:12.791986 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3356/6666] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:12 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:13.815415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:13.816083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:13.822923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:13.823446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:13.823907 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:13.824618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:13.825089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:13.825533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:13.959135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:13.966922 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eca76217-fceb-429b-9421-1158def05d71 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.156054 Oct 11 02:14:13.967533 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3311/6667] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:13 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:14.990131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:14.990755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:14.993596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:14.999618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:15.000108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:15.000548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:15.001247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:15.001707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:15.002145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:15.130704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:15.138772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e34c56e5-78fd-4bd0-b23e-23560ffca469 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.152320 Oct 11 02:14:15.142562 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3357/6668] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:14 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:16.162409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:16.163014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:16.165051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:16.165734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:14:16.173122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:16.173632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:16.174085 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:16.174796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:16.175264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:16.175733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:16.308208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:16.315943 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6c2b074-bc1b-4893-b8e4-ac82cc8d3887 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.157649 Oct 11 02:14:16.316524 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3312/6669] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:16 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:17.338160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:17.338798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:17.346235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:17.346722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:17.347158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:17.347879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:17.348336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:17.348766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:17.478752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:17.486467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ed8fbb3-5934-49d4-82f1-7b2196c559fe tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.152308 Oct 11 02:14:17.487049 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3358/6670] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:17 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:18.509749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:18.510303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:18.516782 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:18.517280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:18.517763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:18.518474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:18.518944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:18.519408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:18.650176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:18.658567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e552d7a5-fe07-427e-ba95-9cd5b224b926 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.153017 Oct 11 02:14:18.659149 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3313/6671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:18 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:19.681167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:19.681796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:19.689215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:19.689714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:19.690168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:19.690878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:19.691365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:19.691805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:19.833516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:19.841422 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e045d23-10d4-4d05-b56a-541374372dbf tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.164171 Oct 11 02:14:19.842029 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3359/6672] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:19 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:20.864796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:20.865420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:20.872346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:20.872844 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:20.873293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:20.874610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:20.875075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:20.875539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:21.008960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:21.016812 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79258e0d-e0cb-4572-b1dd-85464a14f1cd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.155906 Oct 11 02:14:21.017399 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3314/6673] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:20 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:21.747612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14962bf-ce68-45d1-bae7-2e3e8e0d0c08", "name": "network-vif-plugged", "status": "completed", "tag": "329c9887-742c-420f-9ad4-8346e8789710"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:14:21.757818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:21.758300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:21.758732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:21.770412 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] Creating event network-vif-plugged:329c9887-742c-420f-9ad4-8346e8789710 for instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 on n-h2-772273-9 Oct 11 02:14:21.775845 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a99e2243-c9ea-40da-abb8-9a45922b582e req-46563c84-623d-4e1a-83de-02ca1ed51243 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Oct 11 02:14:21.776485 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3360/6674] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:14:22.039398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:22.040041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:22.046865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:22.047404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:22.047869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:22.048585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:22.049058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:22.049504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:22.177521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:22.185293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a87669b9-8391-4cdb-81b3-c52e08fdfc5f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.149815 Oct 11 02:14:22.185881 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3315/6675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:22 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:23.210260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:23.211041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:23.218724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:23.219225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:23.219716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:23.220404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:23.220869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:23.221358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:23.357763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:23.365623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81bfcc90-c525-455b-a586-3b1ecc463897 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1264 microversion: 2.1 time: 0.160577 Oct 11 02:14:23.366203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3361/6676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:23 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:24.388467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:24.389025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:24.396696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:24.397206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:24.397663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:24.398374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:24.398846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:24.399291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:24.529806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:24.537823 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2366d2bc-89ca-490f-889b-55e3ba4d1cbd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1451 microversion: 2.1 time: 0.153421 Oct 11 02:14:24.538411 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3316/6677] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:24 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:24.559591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:14:24.560217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:14:24.567725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:24.568217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:24.568661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:24.569357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:24.569819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:24.570251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:24.699656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:14:24.707292 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6fd0cec6-3cbe-40c4-9a99-b67f2043dc15 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1451 microversion: 2.1 time: 0.151622 Oct 11 02:14:24.707892 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3362/6678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:14:24 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:14:26.566494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14962bf-ce68-45d1-bae7-2e3e8e0d0c08", "tag": "329c9887-742c-420f-9ad4-8346e8789710"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:14:26.577574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:14:26.578069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:14:26.578526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:14:26.589617 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] Creating event network-changed:329c9887-742c-420f-9ad4-8346e8789710 for instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 on n-h2-772273-9 Oct 11 02:14:26.594697 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-394a0cbb-1976-4403-9168-de2a392b0627 req-81424f62-b18a-4fb5-822a-327da59fb892 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 Oct 11 02:14:26.595300 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3317/6679] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:15:54.791920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=24 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:15:54.792726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=56 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:15:54.793691 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:15:54.794043 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 (ip 10.222.0.66) !!! Oct 11 02:15:54.796010 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:15:54.796335 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 (ip 10.222.0.66) !!! Oct 11 02:15:54.801338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:54.802126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:54.810613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:54.811428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:54.812075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:54.812929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:54.813232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:54.813702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:54.844551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:15:54.891911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:15:54.893273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=60 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:15:54.895811 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:15:54.896172 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.66) !!! Oct 11 02:15:54.939853 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d5ef129-b163-47e7-a9b8-7c9c31d1e438 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 204 len: 0 microversion: 2.1 time: 0.150276 Oct 11 02:15:54.940529 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3363/6680] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:15:54 2022] DELETE /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:15:54.952078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:54.952802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:54.959118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:54.959638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:54.960078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:54.960777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:54.961243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:54.961669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:55.008097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14962bf-ce68-45d1-bae7-2e3e8e0d0c08", "tag": "329c9887-742c-420f-9ad4-8346e8789710"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:15:55.021143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:55.021717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:55.022232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:55.033624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] Creating event network-changed:329c9887-742c-420f-9ad4-8346e8789710 for instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 on n-h2-772273-9 Oct 11 02:15:55.038792 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7eedf6b5-dc76-4b79-a419-749e8eb5c868 req-80410639-ec1d-49d3-8bf9-d7d1137dc097 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149465 Oct 11 02:15:55.039638 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3318/6681] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:15:55.237291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:15:55.246252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98d7b3cf-2ff2-40be-8e1f-f3324779631c tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1576 microversion: 2.1 time: 0.299855 Oct 11 02:15:55.247038 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3364/6682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:15:54 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1576 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:15:56.271762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:56.272480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:56.278579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:56.279074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:56.279557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:56.280256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:56.280717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:56.281149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:56.549349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:15:56.557932 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c51438b-e51a-49e8-920e-b7e86300da1e tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1576 microversion: 2.1 time: 0.291332 Oct 11 02:15:56.559069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3319/6683] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:15:56 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1576 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:15:57.055969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14962bf-ce68-45d1-bae7-2e3e8e0d0c08", "name": "network-vif-deleted", "tag": "329c9887-742c-420f-9ad4-8346e8789710"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:15:57.066645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:57.067125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:57.067595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:57.078923 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] Creating event network-vif-deleted:329c9887-742c-420f-9ad4-8346e8789710 for instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 on n-h2-772273-9 Oct 11 02:15:57.083619 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6840bed3-24b9-477d-81bd-7dae7cd61bb6 req-9c10dd0a-7a12-4820-9cd3-9180ae02aabf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Oct 11 02:15:57.084234 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3365/6684] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:15:57.581769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:57.582311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:57.589289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:57.589796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:57.590260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:57.590986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:57.591492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:57.591940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:57.654685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:15:57.662513 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00433eb1-85e8-4876-bf78-aa99add9f2b5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1226 microversion: 2.1 time: 0.084979 Oct 11 02:15:57.663091 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3320/6685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:15:57 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:15:58.686759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:58.687502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:58.693720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:58.694210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:58.694651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:58.695422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:58.695823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:58.696250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:58.766673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:15:58.774629 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24ca9a58-d1f0-42b8-bb8b-e43e6203a4d5 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1226 microversion: 2.1 time: 0.093085 Oct 11 02:15:58.775871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3366/6686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:15:58 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:15:59.798867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:15:59.799529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:15:59.806092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:59.807090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:59.807557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:59.808260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:15:59.808723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:15:59.809158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:15:59.873613 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:15:59.881787 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9991c752-ae8d-4e7b-b3a0-37c57d4f26a1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1226 microversion: 2.1 time: 0.087057 Oct 11 02:15:59.882390 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3321/6687] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:15:59 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:00.905646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:00.906273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:00.913177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:00.913655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:00.914101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:00.914804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:00.915271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:00.915729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:00.980790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:00.988971 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e652b2a2-3256-4c78-af2b-1671defd0873 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 200 len: 1226 microversion: 2.1 time: 0.087291 Oct 11 02:16:00.989582 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3367/6688] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:00 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:02.012230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:02.012857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: d14962bf-ce68-45d1-bae7-2e3e8e0d0c08] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:02.019789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:02.020286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:02.020734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:02.021443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:02.021908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:02.022345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:02.036014 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 HTTP/1.1 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd14962bf-ce68-45d1-bae7-2e3e8e0d0c08'} Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:02.037699 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f5a0aa0-0934-4726-82d8-1aa53801e0f0 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08" status: 404 len: 111 microversion: 2.1 time: 0.030867 Oct 11 02:16:02.042104 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3322/6689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:02 2022] GET /compute/v2.1/servers/d14962bf-ce68-45d1-bae7-2e3e8e0d0c08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:08.248530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:08.249041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:08.250639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c5a777-9257-4453-9dc6-130338277f8b", "tag": "0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:08.255645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:08.256398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:08.256906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:08.257683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:08.258213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:08.258731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:08.262137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:08.262641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:08.263278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:08.276078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] Creating event network-changed:0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f for instance b1c5a777-9257-4453-9dc6-130338277f8b on n-h1-772273-9 Oct 11 02:16:08.281477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-308bd288-9a51-4b93-aece-42924761e923 req-433585e7-bc6d-4bb0-8186-6a57a3d06612 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034583 Oct 11 02:16:08.282616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3323/6690] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:08.287373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:16:08.377059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a45c7a56-e452-494c-8094-35fbfdc2c433 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 204 len: 0 microversion: 2.1 time: 0.132375 Oct 11 02:16:08.377913 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3368/6691] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:16:08 2022] DELETE /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:16:08.388555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:08.389313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:08.398963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:08.399499 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:08.399958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:08.401249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:08.401719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:08.402166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:08.542559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:08.550446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd850d76-766f-4001-8253-97996041224f tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1574 microversion: 2.1 time: 0.167540 Oct 11 02:16:08.551291 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3324/6692] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:08 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:09.575154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:09.575905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:09.582681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:09.583175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:09.583660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:09.584364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:09.584827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:09.585263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:09.719852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:09.727991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1826fac-b0d3-4b52-82f6-f8dda3dce299 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1574 microversion: 2.1 time: 0.157230 Oct 11 02:16:09.728577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3369/6693] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:09 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:10.634005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c5a777-9257-4453-9dc6-130338277f8b", "name": "network-vif-deleted", "tag": "0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:10.643544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:10.644042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:10.644497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:10.655578 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] Creating event network-vif-deleted:0dac4a52-6d7f-4aa8-a2f6-aae69fb1996f for instance b1c5a777-9257-4453-9dc6-130338277f8b on n-h1-772273-9 Oct 11 02:16:10.661338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7209cf14-ee10-4e8e-a9c4-8b6801d51dae req-647714d4-5769-4590-8256-a45e8441e750 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153893 Oct 11 02:16:10.661980 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3325/6694] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:10.751517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:10.752064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:10.759067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:10.759626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:10.760070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:10.760979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:10.761444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:10.761875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:10.841510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:10.849690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b747939-a1db-4fce-ac1e-444d27c33397 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1226 microversion: 2.1 time: 0.102505 Oct 11 02:16:10.850269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3370/6695] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:10 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:11.874661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:11.875425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:11.882014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:11.882523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:11.882981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:11.883726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:11.884202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:11.884648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:11.948589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:11.956852 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e109dcd8-e4f0-466c-b674-09c44c31b3c1 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1226 microversion: 2.1 time: 0.087585 Oct 11 02:16:11.957430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3326/6696] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:11 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:12.981009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:12.981646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:12.988499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:12.988986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:12.989426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:12.990120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:12.990572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:12.990997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:13.057272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:13.065044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6d4a025-411e-4203-b7a3-54e770c482bb tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1226 microversion: 2.1 time: 0.088043 Oct 11 02:16:13.065616 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3371/6697] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:12 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:14.089512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:14.090075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:14.097052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:14.097558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:14.098013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:14.098727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:14.099494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:14.099940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:14.163184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128e26b1d8294eeebd659afcd552f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e41c50554774289a6f0f5d25e6588c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:14.171882 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d6314a4-7e41-42db-8df4-620524469cf8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 200 len: 1226 microversion: 2.1 time: 0.086940 Oct 11 02:16:14.172468 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3327/6698] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:14 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:15.193983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:15.194626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: b1c5a777-9257-4453-9dc6-130338277f8b] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:15.201435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.201917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.202349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.203036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.203522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.203949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.219622 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b HTTP/1.1 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b1c5a777-9257-4453-9dc6-130338277f8b'} Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.221256 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance b1c5a777-9257-4453-9dc6-130338277f8b could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7dc6638e-9908-4f24-add1-4f6af964a3b9 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b" status: 404 len: 111 microversion: 2.1 time: 0.032550 Oct 11 02:16:15.225315 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3372/6699] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:15 2022] GET /compute/v2.1/servers/b1c5a777-9257-4453-9dc6-130338277f8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:15.672441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:15.672948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:15.679840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.680342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.680797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.681538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.682012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.682455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.701551 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a HTTP/1.1 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '16206638-d445-48eb-b506-e37528e6766a'} Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:16:15.703260 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e2a1f9d-7d81-4e5d-8e1c-1bedfc329331 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 404 len: 111 microversion: 2.1 time: 0.036270 Oct 11 02:16:15.707277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3328/6700] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:16:15 2022] DELETE /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:15.714114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:15.714721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] [instance: 16206638-d445-48eb-b506-e37528e6766a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:15.720673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.721153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.721586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.722264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:15.722716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:15.723133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:15.736585 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] HTTP exception thrown: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Request method failure captured: Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a HTTP/1.1 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRM97fijhJYfgnV8S8pX0ImqwXlCAnI5qgllj1RDuJ7dsAAEnSZaXOrceU7_zlt812QnhRnR4hRJrR3fAVXcFLaA6XreXamHOK85uA0dMfw1sTnJFCfGtnuxTRcEfaq9QRsnbEp9xc5uG5hIX6JUAOgmL8Rl5fIVjUFLice9pRr9bd3U Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4e41c50554774289a6f0f5d25e6588c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 4e41c50554774289a6f0f5d25e6588c1 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1837912507 Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 128e26b1d8294eeebd659afcd552f7bb Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestVolumeBootPattern-1837912507-project Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '16206638-d445-48eb-b506-e37528e6766a'} Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:15.738085 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Returning 404 to user: Instance 16206638-d445-48eb-b506-e37528e6766a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-032d0411-3e68-4037-853a-9d734f033fcd tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a" status: 404 len: 111 microversion: 2.1 time: 0.029803 Oct 11 02:16:15.742075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3373/6701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:15 2022] GET /compute/v2.1/servers/16206638-d445-48eb-b506-e37528e6766a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:19.161174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35298256-47e9-45f7-a1e8-833b2c6bf1c8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] Calling method '.version_select at 0x7f112f652160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:19.187965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35298256-47e9-45f7-a1e8-833b2c6bf1c8 tempest-TestVolumeBootPattern-1837912507 tempest-TestVolumeBootPattern-1837912507-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1214713168" status: 202 len: 0 microversion: 2.1 time: 0.030662 Oct 11 02:16:19.188865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3329/6702] 10.222.0.66 () {58 vars in 1263 bytes} [Tue Oct 11 02:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1214713168 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:16:37.274393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:37.275132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:37.381928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-321559747", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:37.432544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] validate_networks() for None {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:16:37.698246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:16:37.698776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:16:37.699254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:16:37.699719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:16:37.700130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:16:37.713319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:37.713810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:37.714256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:37.714992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:37.715479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:37.715928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:37.739385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Getting quotas for project 6b36186de8b544f6bb113ab9e985d489. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:16:37.745257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Getting quotas for user 1d25113afef847ccb4c83efc0a5072ca and project 6b36186de8b544f6bb113ab9e985d489. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:16:37.757351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:16:37.759741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:16:37.805030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-46b2167b-2e2f-4ff8-8989-fb501097f574 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535649 Oct 11 02:16:37.806490 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3374/6703] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:16:37.816588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=46 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:37.818153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:37.825227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb62882f-03f5-4ab3-8666-8b1ff46ab436 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:37.826061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb62882f-03f5-4ab3-8666-8b1ff46ab436 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:37.884208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb62882f-03f5-4ab3-8666-8b1ff46ab436 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:37.894528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb62882f-03f5-4ab3-8666-8b1ff46ab436 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1221 microversion: 2.1 time: 0.079624 Oct 11 02:16:37.895160 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3330/6704] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:37 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:38.921237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a91aabef-0ac9-4df3-9a9a-c88fe58d59fe tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:38.921613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a91aabef-0ac9-4df3-9a9a-c88fe58d59fe tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:38.975091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a91aabef-0ac9-4df3-9a9a-c88fe58d59fe tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:38.983728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a91aabef-0ac9-4df3-9a9a-c88fe58d59fe tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1221 microversion: 2.1 time: 0.070484 Oct 11 02:16:38.984305 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3375/6705] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:38 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:40.007687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cc061b4-4e07-4244-857c-6edd854232a3 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:40.008320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cc061b4-4e07-4244-857c-6edd854232a3 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:40.061658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2cc061b4-4e07-4244-857c-6edd854232a3 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:40.068515 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cc061b4-4e07-4244-857c-6edd854232a3 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1221 microversion: 2.1 time: 0.064821 Oct 11 02:16:40.069095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3331/6706] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:40 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:41.092455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:41.093106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:41.100249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:41.100744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:41.101192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:41.101889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:41.102352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:41.102783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:41.163082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:41.171135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3df225f2-1fe5-4f45-8119-197cb5b67880 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1225 microversion: 2.1 time: 0.082641 Oct 11 02:16:41.171743 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3376/6707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:41 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:42.194218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:42.194850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:42.205280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:42.205786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:42.206240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:42.206989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:42.207495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:42.207942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:42.276519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:42.284451 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-edccf3b1-edf5-48f1-8767-711dfdc43604 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1279 microversion: 2.1 time: 0.094241 Oct 11 02:16:42.285059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3332/6708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:42 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:43.307974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:43.308597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:43.315801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:43.316220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:43.316668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:43.317387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:43.317851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:43.318285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:43.449007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:43.456765 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60efed80-5fc0-4474-ad32-d66ce37d5530 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.152754 Oct 11 02:16:43.457340 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3377/6709] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:43 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:43.598434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda27016-4082-4205-9fa2-3729e3fe65d8", "tag": "652281f6-eb3e-40e4-9fdc-441def39a09a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:43.612211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:43.612713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:43.613324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:43.625569 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] Creating event network-changed:652281f6-eb3e-40e4-9fdc-441def39a09a for instance fda27016-4082-4205-9fa2-3729e3fe65d8 on n-h1-772273-9 Oct 11 02:16:43.631412 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a21b3a18-c059-484d-9779-96bbbf2eb9df req-a63b43ff-0430-4a4f-8776-4ce9598a1c31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037360 Oct 11 02:16:43.632062 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3333/6710] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:16:44.480407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:44.481028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:44.487828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:44.488325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:44.488771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:44.489470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:44.489933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:44.490369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:44.620302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:44.627931 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e7f37364-32bc-463a-bcba-5f2994b8f72b tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.152023 Oct 11 02:16:44.628514 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3378/6711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:44 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:45.651096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:45.651842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:45.659239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:45.659766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:45.660214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:45.660915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:45.661378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:45.661823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:45.790225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:45.798524 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ad88d56-f74f-4a72-8cd5-272c2a982009 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.152080 Oct 11 02:16:45.799119 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3334/6712] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:45 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:46.820717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:46.821341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:46.828490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:46.829012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:46.829461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:46.830161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:46.830624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:46.831054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:46.959943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:46.968300 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edec59f2-5263-4dae-897d-fb50d7967d75 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.151530 Oct 11 02:16:46.968922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3379/6713] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:46 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:47.993969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:47.995534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:48.003890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:48.004413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:48.004926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:48.006212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:48.006369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:48.007141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:48.144082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:48.162308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:48.175914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-def15773-6aa2-4c90-a1ae-70da7b18e33d tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.187608 Oct 11 02:16:48.176520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3335/6714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:47 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:48.196026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda27016-4082-4205-9fa2-3729e3fe65d8", "name": "network-vif-plugged", "status": "completed", "tag": "652281f6-eb3e-40e4-9fdc-441def39a09a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:48.205812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:48.206298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:48.206741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:48.220268 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] Creating event network-vif-plugged:652281f6-eb3e-40e4-9fdc-441def39a09a for instance fda27016-4082-4205-9fa2-3729e3fe65d8 on n-h1-772273-9 Oct 11 02:16:48.225750 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4e04789f-4bb8-44f7-b0db-9aae715ef730 req-9bd200b6-c6b9-4e66-bfbe-096f91b5c2df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087264 Oct 11 02:16:48.226453 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3380/6715] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:16:49.199912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:49.200541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:49.207408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:49.207860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:49.208314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:49.209019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:49.209489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:49.209927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:49.336482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:49.344663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54a357bf-84a5-459d-a59b-e5831baed0f0 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1321 microversion: 2.1 time: 0.149306 Oct 11 02:16:49.345450 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3336/6716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:49 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:50.365497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:50.370495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:50.371200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:50.377622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.378107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.378544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.379233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.379715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.380144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.511674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:50.519320 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e3c5fdf-b2ad-4c30-81e5-65b6daee7df2 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1471 microversion: 2.1 time: 0.154814 Oct 11 02:16:50.519935 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3381/6717] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:50 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:50.546743 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:16:50.596687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91b4adec-b993-42ef-93b8-0fb02202d4f2 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '.version_select at 0x7f112f849ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:50.660192 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91b4adec-b993-42ef-93b8-0fb02202d4f2 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/be9610c58f24494c975eef1029b2ce00" status: 200 len: 371 microversion: 2.1 time: 0.118425 Oct 11 02:16:50.660774 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3337/6718] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 02:16:50 2022] GET /compute/v2.1/os-quota-sets/be9610c58f24494c975eef1029b2ce00 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:50.672917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c913f783-be55-463d-bbf5-842d0e52c86e tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1387571322", "id": 1507906851, "os-flavor-access:is_public": "True"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:50.691298 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c913f783-be55-463d-bbf5-842d0e52c86e tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022179 Oct 11 02:16:50.692066 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3382/6719] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:16:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:50.705055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1507906851"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:50.707351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:50.713402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.713845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.714298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.715001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.715509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.715960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.935067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd2496ea2b2648af884a49f963297303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9610c58f24494c975eef1029b2ce00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:50.941210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1387571322 {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:16:50.947811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.948309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.948761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.949505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:50.949972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:50.950411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:50.974454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Getting quotas for project 6b36186de8b544f6bb113ab9e985d489. Resources: {'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:16:50.979900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Getting quotas for user 1d25113afef847ccb4c83efc0a5072ca and project 6b36186de8b544f6bb113ab9e985d489. Resources: {'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:16:50.994050 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] ram quota exceeded for be9610c58f24494c975eef1029b2ce00, tried to resize instance. Oct 11 02:16:50.995215 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Request method failure captured: Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action HTTP/1.1 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 39 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNIFL1AiKaM-PXOfj2fUmeJM868HZJyqdHBEJQOc-FLslztmSNN6f7R_-RHiYwJ1NArZUJ10XHn-ul2gcaV-K8K7UuK-noOKEiwS1df_zAdvrI9WtMoE2_TFKXEHQ-CTWm4sKp-mjyoJsETvnE8HybUCXnNXJXVQqU-LqL50kdvGG5k Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: be9610c58f24494c975eef1029b2ce00 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Role: admin,reader,member Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: admin,reader,member Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_be9610c58f24494c975eef1029b2ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: be9610c58f24494c975eef1029b2ce00 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-572095569-project-admin Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: dd2496ea2b2648af884a49f963297303 Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-572095569-project-admin Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: {"resize": {"flavorRef": "1507906851"}} Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'fda27016-4082-4205-9fa2-3729e3fe65d8', 'body': {'resize': {'flavorRef': '1507906851'}}} Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:50.997345 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e05d484-9113-4609-bb81-5a0590cc08a7 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action" status: 403 len: 118 microversion: 2.1 time: 0.297642 Oct 11 02:16:51.001349 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3338/6720] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:16:50 2022] POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action => generated 118 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:51.007775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3d727ed-1d08-42da-a46a-55428c20aa61 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.024636 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3d727ed-1d08-42da-a46a-55428c20aa61 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1507906851" status: 202 len: 0 microversion: 2.1 time: 0.020489 Oct 11 02:16:51.025228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3383/6721] 10.222.0.66 () {58 vars in 1161 bytes} [Tue Oct 11 02:16:51 2022] DELETE /compute/v2.1/flavors/1507906851 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 02:16:51.033388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b76d317-bae3-4706-9e2c-2cbf9cc7c55e tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.053444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b76d317-bae3-4706-9e2c-2cbf9cc7c55e tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023770 Oct 11 02:16:51.053998 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3339/6722] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 02:16:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:51.075401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-56f79425-3767-4264-a322-575e13b1d30c tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '.version_select at 0x7f11387b2670>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.144898 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-56f79425-3767-4264-a322-575e13b1d30c tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/be9610c58f24494c975eef1029b2ce00" status: 200 len: 371 microversion: 2.1 time: 0.073235 Oct 11 02:16:51.145501 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3384/6723] 10.222.0.66 () {58 vars in 1242 bytes} [Tue Oct 11 02:16:51 2022] GET /compute/v2.1/os-quota-sets/be9610c58f24494c975eef1029b2ce00 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:51.157825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20953b69-f4ae-423a-bc6c-b682e8c4ac46 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-731867076", "id": 565611492, "os-flavor-access:is_public": "True"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:51.176709 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20953b69-f4ae-423a-bc6c-b682e8c4ac46 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022669 Oct 11 02:16:51.177302 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3340/6724] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:16:51 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:16:51.190257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "565611492"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:51.192733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:51.198923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.199467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.199908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.200643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.201053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.201478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.364744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd2496ea2b2648af884a49f963297303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9610c58f24494c975eef1029b2ce00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:51.371538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-731867076 {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:16:51.378298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.379080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.379560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.380304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.380766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.381199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.403210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Getting quotas for project 6b36186de8b544f6bb113ab9e985d489. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:16:51.408348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Getting quotas for user 1d25113afef847ccb4c83efc0a5072ca and project 6b36186de8b544f6bb113ab9e985d489. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:16:51.421219 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.compute.api [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] cores quota exceeded for be9610c58f24494c975eef1029b2ce00, tried to resize instance. Oct 11 02:16:51.421768 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Request method failure captured: Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action HTTP/1.1 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 38 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNIFL1AiKaM-PXOfj2fUmeJM868HZJyqdHBEJQOc-FLslztmSNN6f7R_-RHiYwJ1NArZUJ10XHn-ul2gcaV-K8K7UuK-noOKEiwS1df_zAdvrI9WtMoE2_TFKXEHQ-CTWm4sKp-mjyoJsETvnE8HybUCXnNXJXVQqU-LqL50kdvGG5k Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: be9610c58f24494c975eef1029b2ce00 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Role: admin,reader,member Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: admin,reader,member Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_be9610c58f24494c975eef1029b2ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/be9610c58f24494c975eef1029b2ce00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: be9610c58f24494c975eef1029b2ce00 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-572095569 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersAdminNegativeTestJSON-572095569-project-admin Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: dd2496ea2b2648af884a49f963297303 Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersAdminNegativeTestJSON-572095569-project-admin Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: {"resize": {"flavorRef": "565611492"}} Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'fda27016-4082-4205-9fa2-3729e3fe65d8', 'body': {'resize': {'flavorRef': '565611492'}}} Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:51.423949 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-780f8cc0-caa9-4a71-8977-919a71ad2501 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action" status: 403 len: 113 microversion: 2.1 time: 0.239151 Oct 11 02:16:51.428042 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3385/6725] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:16:51 2022] POST /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8/action => generated 113 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:16:51.434154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5157f937-9200-4545-946a-ce7869cd5e83 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.451406 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5157f937-9200-4545-946a-ce7869cd5e83 tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/565611492" status: 202 len: 0 microversion: 2.1 time: 0.020860 Oct 11 02:16:51.452342 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3341/6726] 10.222.0.66 () {58 vars in 1158 bytes} [Tue Oct 11 02:16:51 2022] DELETE /compute/v2.1/flavors/565611492 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:16:51.460258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea2f76fe-7c1a-43ee-b1a8-c7881fefbdca tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.481657 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea2f76fe-7c1a-43ee-b1a8-c7881fefbdca tempest-ServersAdminNegativeTestJSON-572095569 tempest-ServersAdminNegativeTestJSON-572095569-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024953 Oct 11 02:16:51.482251 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3386/6727] 10.222.0.66 () {58 vars in 1146 bytes} [Tue Oct 11 02:16:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:16:51.502876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.503428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:51.509383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.509892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.510432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.511156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.511709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.512107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.537694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:16:51.618840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0d7ff87-9d26-41af-946a-1fd81a7e5f86 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 204 len: 0 microversion: 2.1 time: 0.119092 Oct 11 02:16:51.620320 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3342/6728] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:16:51 2022] DELETE /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:16:51.628445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:51.629193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:51.635728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.636505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.637028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.637786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:51.638310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:51.638821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:51.766364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:51.774084 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ab1ec83-e726-48a8-8d8d-1f67c50ac8e1 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1477 microversion: 2.1 time: 0.149632 Oct 11 02:16:51.774656 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3387/6729] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:51 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:16:52.799351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:52.800079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:52.806916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:52.807454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:52.807911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:52.808616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:52.809084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:52.809524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:52.943599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25113afef847ccb4c83efc0a5072ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36186de8b544f6bb113ab9e985d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:16:52.951704 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ab4f932-4675-4939-887f-93c099b70761 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 200 len: 1477 microversion: 2.1 time: 0.156651 Oct 11 02:16:52.952489 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3343/6730] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:52 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:16:53.389855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda27016-4082-4205-9fa2-3729e3fe65d8", "name": "network-vif-deleted", "tag": "652281f6-eb3e-40e4-9fdc-441def39a09a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:16:53.402240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:53.402648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:53.403077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:53.429475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] Creating event network-vif-deleted:652281f6-eb3e-40e4-9fdc-441def39a09a for instance fda27016-4082-4205-9fa2-3729e3fe65d8 on n-h1-772273-9 Oct 11 02:16:53.434633 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-edf07676-c708-4844-a260-c4da28082d3b req-d5a98efd-950c-454d-9f7a-af28de2bc421 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049758 Oct 11 02:16:53.436138 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3388/6731] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:16:53.974379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:16:53.975006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] [instance: fda27016-4082-4205-9fa2-3729e3fe65d8] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:16:53.982336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:53.982835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:53.983293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:53.984033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:16:53.984502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:16:53.984942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:16:53.999072 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] HTTP exception thrown: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Request method failure captured: Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 HTTP/1.1 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNIEamdNb-A1ZmEXqJQNp_MuOlznEBFkJ0xdry_PGkXAJzpt4fmVYwflEYzCD8pSVba_y5v5zFtT_M9qPcnpRWPlxKMhxRwi_c3AkyUJ_u4oM-fzboTQ87TInHTZPl0SNeEdEMpRtK4yVSDBFc7doP1EPH4iSCcCVD3Sky2VE3oz7I0 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 6b36186de8b544f6bb113ab9e985d489 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1390965935 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6b36186de8b544f6bb113ab9e985d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6b36186de8b544f6bb113ab9e985d489"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6b36186de8b544f6bb113ab9e985d489"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6b36186de8b544f6bb113ab9e985d489"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1390965935 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 6b36186de8b544f6bb113ab9e985d489 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1390965935 Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersAdminNegativeTestJSON-1390965935-project Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 1d25113afef847ccb4c83efc0a5072ca Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1390965935-project Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'fda27016-4082-4205-9fa2-3729e3fe65d8'} Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:54.000751 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] Returning 404 to user: Instance fda27016-4082-4205-9fa2-3729e3fe65d8 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5bffb72a-ef2b-44d8-adce-06c077ddc154 tempest-ServersAdminNegativeTestJSON-1390965935 tempest-ServersAdminNegativeTestJSON-1390965935-project] 10.222.0.66 "GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8" status: 404 len: 111 microversion: 2.1 time: 0.032142 Oct 11 02:16:54.005346 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3344/6732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:16:53 2022] GET /compute/v2.1/servers/fda27016-4082-4205-9fa2-3729e3fe65d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:17:00.151213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-417155646", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "548e0c27-4c04-4ebf-be3a-3f32a542e910"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:00.204579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] validate_networks() for [('548e0c27-4c04-4ebf-be3a-3f32a542e910', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:17:00.596384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:17:00.596815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:17:00.597297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:17:00.597709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:17:00.598140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:17:00.608265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:00.608759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:00.609199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:00.609942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:00.610404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:00.610841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:00.627676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Getting quotas for project aa0fc6ed45724d5a8222b0191aeeb0db. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:17:00.633133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Getting quotas for user 07ced7fc463547f295e85fc7b4d67e25 and project aa0fc6ed45724d5a8222b0191aeeb0db. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:17:00.646573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:17:00.649045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:17:00.694452 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85da7bdc-ae6c-4b9f-af44-e1cbb12f62b6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659048 Oct 11 02:17:00.699031 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3389/6733] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:17:00.707690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-895b7c3a-3601-4cec-8044-d6996862c73e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:00.708349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-895b7c3a-3601-4cec-8044-d6996862c73e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:00.711550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:00.765602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-895b7c3a-3601-4cec-8044-d6996862c73e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:00.772774 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-895b7c3a-3601-4cec-8044-d6996862c73e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1214 microversion: 2.1 time: 0.069509 Oct 11 02:17:00.773441 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3345/6734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:00 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:01.797462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-823209cc-6e26-4245-9060-f6bb4537beba tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:01.798093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-823209cc-6e26-4245-9060-f6bb4537beba tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:01.867958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-823209cc-6e26-4245-9060-f6bb4537beba tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:01.875929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-823209cc-6e26-4245-9060-f6bb4537beba tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1214 microversion: 2.1 time: 0.083758 Oct 11 02:17:01.876727 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3390/6735] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:01 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:02.898108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-04532bac-7b99-41bf-947d-896497bcbd6b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:02.898746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-04532bac-7b99-41bf-947d-896497bcbd6b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:02.900698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:02.963714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-04532bac-7b99-41bf-947d-896497bcbd6b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:02.971879 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-04532bac-7b99-41bf-947d-896497bcbd6b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1214 microversion: 2.1 time: 0.077547 Oct 11 02:17:02.972488 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3346/6736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:02 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:17:03.996048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-815bdbfe-d6ae-4479-901c-36076a87270e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:03.996664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-815bdbfe-d6ae-4479-901c-36076a87270e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:04.052646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-815bdbfe-d6ae-4479-901c-36076a87270e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:04.060437 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-815bdbfe-d6ae-4479-901c-36076a87270e tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1214 microversion: 2.1 time: 0.068874 Oct 11 02:17:04.061072 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3391/6737] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:03 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:05.084076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:05.084727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:05.087740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:05.099156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:05.099815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:05.100280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:05.101007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:05.101485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:05.101934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:05.167224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:05.174993 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93c985c7-ad83-45a4-8876-50136ba1ccca tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1218 microversion: 2.1 time: 0.094794 Oct 11 02:17:05.175618 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3347/6738] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:05 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:06.197727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:06.198860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:06.206520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:06.207017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:06.207489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:06.208196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:06.208851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:06.209287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:06.273082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:06.281540 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7445e4a7-72e1-4ec9-ae86-2b06ec67054d tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1272 microversion: 2.1 time: 0.087720 Oct 11 02:17:06.282284 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3392/6739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:06 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:07.188906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:07.207944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:07.208489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:07.209172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:07.222956 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] Creating event network-changed:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h1-772273-9 Oct 11 02:17:07.229444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-251ba02e-d898-4d9e-8a03-4aa724f25159 req-c81f8af7-da64-4dd4-9ecd-82880b385ad9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046384 Oct 11 02:17:07.231269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3348/6740] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:17:07.304713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:07.305332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:07.307715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:07.313241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:07.313739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:07.314221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:07.314926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:07.315407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:07.315844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:07.320955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=64 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:07.463043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:07.471460 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-540f4b6f-8604-4f66-97c5-e7e347d16d86 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.170693 Oct 11 02:17:07.472044 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3393/6741] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:07 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:08.496082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:08.496837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:08.498802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:08.504766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:08.505269 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:08.505718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:08.506476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:08.506942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:08.507433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:08.643138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:08.650906 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9f989bb0-ef85-4958-afc7-7ab256ca053c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.160523 Oct 11 02:17:08.652362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3349/6742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:08 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:09.673513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:09.674132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:09.680986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:09.681471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:09.681905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:09.682598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:09.683050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:09.683512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:09.809965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:09.817643 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b19c729e-0a03-42ef-96e3-4b0d414a3cf3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.148031 Oct 11 02:17:09.818217 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3394/6743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:09 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:10.841304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:10.841941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:10.848944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:10.849444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:10.849899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:10.850604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:10.851073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:10.851544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:10.984434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:10.992141 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03849e28-657c-4f46-89bb-43987e4ef023 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.155331 Oct 11 02:17:10.992716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3350/6744] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:10 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:12.014646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:12.015251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:12.017199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:12.023441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:12.023936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:12.024380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:12.025085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:12.025551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:12.025978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:12.159236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:12.167280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bfd688be-c3a3-4147-9fef-1c4641dacdfd tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.157050 Oct 11 02:17:12.167900 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3395/6745] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:12 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:12.193516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "name": "network-vif-plugged", "status": "completed", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:12.209160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:12.209798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:12.210242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:12.222027 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] Creating event network-vif-plugged:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h1-772273-9 Oct 11 02:17:12.227658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1bb4951f-0c9a-4fd6-8bbb-20b1430f6cb4 req-b2441a2b-9237-49d2-a1a6-6983ca1dd8df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037791 Oct 11 02:17:12.228369 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3351/6746] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:17:13.190075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:13.190616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:13.197419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:13.197938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:13.198931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:13.199662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:13.200122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:13.200552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:13.335989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:13.343769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e615a84-9c3f-4dc9-b85b-40265c489b0c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1314 microversion: 2.1 time: 0.157550 Oct 11 02:17:13.344324 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3396/6747] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:13 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:14.364874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:14.369854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:14.370596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:14.377050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.377531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.377980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.378685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.379155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.379626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.507662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:14.516044 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca88ac6b-92d4-4d6d-962f-d027cf004ec3 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1500 microversion: 2.1 time: 0.152313 Oct 11 02:17:14.516620 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3352/6748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:14 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:14.538258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:14.540631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:14.542474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=12 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:14.548641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.549131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.549580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.550278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.550737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.551171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.624850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:14.630141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Old instance type m1.heat2, new instance type m1.heat {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:17:14.637255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:17:14.637692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:17:14.638198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:17:14.638611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:17:14.639023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:17:14.744735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7be6fa63-20f1-4d27-8bbb-99a3786b45e6 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "POST /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284/action" status: 202 len: 0 microversion: 2.1 time: 0.210362 Oct 11 02:17:14.745757 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3397/6749] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:17:14 2022] POST /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:17:14.754057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:14.754697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:14.760639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.761088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.761543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.762258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:14.762728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:14.763168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:14.899819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:14.908358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-490aca7d-0b94-40d1-9c42-86fc4aaecced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1509 microversion: 2.1 time: 0.158313 Oct 11 02:17:14.908950 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3353/6750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:14 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:15.932618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:15.933142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:15.939837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:15.940449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:15.940885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:15.941572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:15.942021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:15.942441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:16.080134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:16.087841 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a54f2a8-f1b4-4820-86da-b69d09be399c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1509 microversion: 2.1 time: 0.161019 Oct 11 02:17:16.088421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3398/6751] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:15 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:17.111139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:17.111819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:17.118608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:17.119096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:17.119576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:17.120298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:17.120759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:17.121192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:17.250832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:17.258771 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01205d5d-0566-4924-8c2c-380cd4aa777f tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.151510 Oct 11 02:17:17.259368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3354/6752] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:17 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:18.282265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:18.282811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:18.289593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:18.290085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:18.290525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:18.291221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:18.291707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:18.292133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:18.429996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:18.438249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-478546c5-f8e3-4395-b82a-75cedfff94ea tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.159994 Oct 11 02:17:18.438829 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3399/6753] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:18 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:19.462095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:19.462728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:19.469234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:19.469739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:19.470224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:19.470942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:19.471446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:19.471893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:19.599781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:19.608003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ea167a4f-7a1b-40e0-aede-8d31fd9bd6e4 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.150037 Oct 11 02:17:19.608588 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3355/6754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:19 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:20.632280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:20.632906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:20.640321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:20.640815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:20.641257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:20.641955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:20.642412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:20.642840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:20.771294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:20.778869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-231ae2dc-23d5-4655-a7fb-0c813a243f73 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.150548 Oct 11 02:17:20.779461 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3400/6755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:20 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:21.801643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:21.802274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:21.809909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:21.810411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:21.810891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:21.811674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:21.812148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:21.812588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:21.942806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:21.950509 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4e1028c-7228-46bd-82e6-a2bab4e80796 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.152868 Oct 11 02:17:21.951083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3356/6756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:21 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:22.974035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:22.974650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:22.981511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:22.981997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:22.982429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:22.983117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:22.983599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:22.984024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:23.111175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:23.118824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d0e92b9-25e9-41af-a6fb-5f4ac56b5c53 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.148983 Oct 11 02:17:23.119421 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3401/6757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:22 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:24.142867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:24.143537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:24.150275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:24.150779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:24.151871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:24.152585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:24.153066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:24.153509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:24.284167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:24.291955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7fb6f5a-08d7-4884-a663-65fa06028d19 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.153097 Oct 11 02:17:24.292543 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3357/6758] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:24 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:25.314744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:25.315289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:25.322214 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:25.322797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:25.323904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:25.324601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:25.325062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:25.325492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:25.453411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:25.461193 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b2d703f2-8fa4-43a8-b427-c265d8e01ced tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.150535 Oct 11 02:17:25.461762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3402/6759] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:25 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:26.485139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:26.485777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:26.492789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:26.493296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:26.493753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:26.494467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:26.495114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:26.495598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:26.628088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:26.635805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5db2f89-609d-4cd8-8206-056ec8706891 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.154571 Oct 11 02:17:26.636374 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3358/6760] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:26 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:27.658265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:27.658882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:27.667829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:27.668324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:27.668764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:27.669459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:27.669920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:27.670349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:27.799426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:27.807191 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-799992d5-7b3a-4f30-86eb-0dde0013f20c tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.152831 Oct 11 02:17:27.809085 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3403/6761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:27 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:28.830776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:28.831426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:28.837990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:28.838486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:28.839459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:28.840162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:28.840629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:28.841064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:28.966960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:28.974937 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a6a87c8-e6f4-4e99-b59f-58f4bd01de62 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.148093 Oct 11 02:17:28.975534 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3359/6762] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:28 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:29.998447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:29.999069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:30.005864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:30.006349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:30.006785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:30.007513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:30.007971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:30.008397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:30.141029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:30.148687 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83d15d44-a2d2-4005-a291-e2933386ccad tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.154109 Oct 11 02:17:30.149271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3404/6763] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:29 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:31.172897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:31.173467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:31.180321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:31.180829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:31.181290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:31.182005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:31.182985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:31.183460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:31.314643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:31.322465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89ff39df-cdce-4486-9903-f6d9736c10bc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.153549 Oct 11 02:17:31.323704 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3360/6764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:31 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:32.345727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:32.346275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:32.353314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:32.353797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:32.354233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:32.354924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:32.355405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:32.355831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:32.486406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:32.494061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-74ac3703-17db-4ab4-8d4b-c1b0e08e91ff tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.152360 Oct 11 02:17:32.495138 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3405/6765] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:32 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:33.517592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:33.518231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:33.525161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:33.525664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:33.526684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:33.527428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:33.527910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:33.528356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:33.660221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:33.667950 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c759f8e5-298d-41da-b15b-facbe2197dce tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.154287 Oct 11 02:17:33.668533 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3361/6766] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:33 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:34.690967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:34.691614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:34.698960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:34.699469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:34.699906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:34.700590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:34.701046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:34.701469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:34.830340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:34.838910 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af3fdada-7e22-4e2e-9cd8-bc336291f686 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.151318 Oct 11 02:17:34.839548 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3406/6767] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:34 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:35.862797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:35.863458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:35.866265 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:17:35.866394 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:17:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 (ip 10.222.0.66) !!! Oct 11 02:17:35.877038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:35.877550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:35.878008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:35.878726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:35.879198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:35.879668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:35.884305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=83 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:36.012173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:36.020091 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d910254-6456-4411-9082-aa2a248e2fe0 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.161162 Oct 11 02:17:36.020676 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3362/6768] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:35 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:37.044030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:37.044644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:37.050916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:37.051431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:37.051864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:37.052547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:37.053006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:37.053424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:37.178535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:37.187600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-99efc037-d739-4571-80dd-75553bf89825 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.147694 Oct 11 02:17:37.188186 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3407/6769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:37 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:38.210051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:38.210683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:38.218261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:38.218766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:38.219221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:38.219955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:38.220431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:38.220875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:38.649914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:38.657736 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7dce692e-1aa0-4a74-95fd-3f58496260b1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.451556 Oct 11 02:17:38.658321 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3363/6770] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:38 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:39.680644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:39.681260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:39.684270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:39.689648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:39.690138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:39.690581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:39.691274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:39.691764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:39.692195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:39.694899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:39.821564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:39.829799 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a640c129-f787-46ea-a472-e29eb9fc5847 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.153117 Oct 11 02:17:39.830380 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3408/6771] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:39 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:40.852895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:40.853518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:40.856207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=30 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:17:40.861516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:40.862012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:40.862458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:40.863154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:40.863654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:40.864098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:40.994175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:41.002008 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-51119df1-b8ba-418a-9ae3-f9989c89dc35 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.153112 Oct 11 02:17:41.002591 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3364/6772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:40 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:42.024964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:42.026364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:42.033270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:42.033762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:42.034212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:42.034914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:42.035404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:42.035839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:42.164377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:42.172197 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-78400c8e-c579-4eb5-bfa3-942a0a18afdc tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.151178 Oct 11 02:17:42.172787 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3409/6773] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:42 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:43.195634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:43.196276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:43.203706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:43.204212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:43.204676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:43.205390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:43.205866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:43.206311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:43.336019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:43.343733 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f0b3bd8-d996-4e7a-81b1-d00533052633 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1514 microversion: 2.1 time: 0.152030 Oct 11 02:17:43.344319 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3365/6774] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:43 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:44.266030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "name": "network-vif-unplugged", "status": "completed", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:44.275388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:44.276447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:44.276876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:44.289680 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Creating event network-vif-unplugged:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h2-772273-9 Oct 11 02:17:44.295183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:17:44.306685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-54f41b0f-a8e8-4711-b2b1-b526a0a92d70 req-d39fc18b-f5a3-41d9-bc22-da13c2383b34 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045347 Oct 11 02:17:44.307348 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3410/6775] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:17:44.367445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:44.368083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:44.375037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:44.375595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:44.376055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:44.376780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:44.377260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:44.377708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:44.575449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:44.583264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-923d6022-c424-4ae1-a261-12c6df431419 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1513 microversion: 2.1 time: 0.219830 Oct 11 02:17:44.584076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3366/6776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:44 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:45.608884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:45.609588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:45.616077 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:45.616565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:45.617000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:45.617693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:45.618150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:45.618576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:45.752125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:45.760520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6381832f-dd83-4f34-bf74-8e71c1b217f1 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1511 microversion: 2.1 time: 0.156899 Oct 11 02:17:45.761099 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3411/6777] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:45 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:46.336151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:46.346234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:46.346753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:46.347203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:46.359420 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Creating event network-changed:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h2-772273-9 Oct 11 02:17:46.364839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:17:46.376101 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-67c49f7b-d6fd-4cae-b5a5-8a8b316fdf53 req-d3430ea9-af39-4222-92bc-7e0faebcf809 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044014 Oct 11 02:17:46.376780 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3367/6778] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:17:46.784353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:46.785026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:46.792695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:46.793222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:46.793743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:46.794562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:46.795097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:46.795565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:46.928043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:46.936068 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2c0a262-2b96-4387-a07a-e11d8edec49a tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1511 microversion: 2.1 time: 0.155567 Oct 11 02:17:46.936671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3412/6779] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:46 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:47.960063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:47.961107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:47.967936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:47.968446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:47.968906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:47.969624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:47.970098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:47.970541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:48.185400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:48.193756 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0faee5e5-a812-4f25-9dd4-7eb95e15a1a2 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1508 microversion: 2.1 time: 0.239010 Oct 11 02:17:48.194343 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3368/6780] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:47 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:48.216351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:48.216928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:48.224093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:48.224585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:48.225027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:48.225722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:48.226183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:48.226611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:48.253315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:17:48.310809 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.compute.api [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Found an unconfirmed migration during delete, id: 16, status: finished Oct 11 02:17:49.710072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1cdf8c77-ec9c-4551-8830-ca0a0dca082b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "DELETE /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 204 len: 0 microversion: 2.1 time: 1.497919 Oct 11 02:17:49.710802 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3413/6781] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:17:48 2022] DELETE /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:17:49.719642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:49.720301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:49.727624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:49.728133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:49.728598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:49.729948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:49.730427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:49.730876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:49.863719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:49.871611 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d28d3084-3714-479a-8afa-e61e59ebde79 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1500 microversion: 2.1 time: 0.155902 Oct 11 02:17:49.872196 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3369/6782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:49 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:17:50.629285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "name": "network-vif-plugged", "status": "completed", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:50.639259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:50.639792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:50.640408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:50.652684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] Creating event network-vif-plugged:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h2-772273-9 Oct 11 02:17:50.657471 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-63ce9e90-2796-4e24-ad78-7d40a4906de1 req-e3d004e7-9a2e-4fc5-b165-7629e0c7dfc8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Oct 11 02:17:50.658075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3414/6783] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:17:50.894007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:50.894641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:50.902219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:50.902720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:50.903200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:50.903937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:50.904428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:50.904865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:51.032477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ced7fc463547f295e85fc7b4d67e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0fc6ed45724d5a8222b0191aeeb0db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:17:51.040338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41f592c1-a4cd-44b9-8a86-f86518de4787 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 200 len: 1500 microversion: 2.1 time: 0.150237 Oct 11 02:17:51.040912 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3370/6784] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:50 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:17:51.540025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d42f3a-6f44-4d7a-b888-f669eee20284", "name": "network-vif-deleted", "tag": "4efbcbab-0411-4dd6-915f-ea1589e3d53b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:17:51.551672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:51.552731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:51.553222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:51.566557 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] Creating event network-vif-deleted:4efbcbab-0411-4dd6-915f-ea1589e3d53b for instance 45d42f3a-6f44-4d7a-b888-f669eee20284 on n-h2-772273-9 Oct 11 02:17:51.571816 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3547de3a-fc9a-427a-b755-68b99976f72b req-3d5efe76-7a08-44d7-b658-7951b9db6d1f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036582 Oct 11 02:17:51.573104 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3415/6785] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:17:52.062665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:52.063533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:52.071127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.071707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.072509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.073289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.073770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.074235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.087822 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] HTTP exception thrown: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Request method failure captured: Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 HTTP/1.1 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNIbsHRd90A_U34KIhDG4F-1suH8hdV_ZOfWptcZRyhUX6NaaQfQDa-gqphXJe5eDczFQaSL_ndRX9Dc7vpVlAaHdwfDn3mLd7bPn0aRKcR2G_fU_4zaddLo4qKcvf79s0OgvMa6OvGMw_mTE8iqxww_n-YgVZuZ2UcVEgqAguLBbxQ Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 07ced7fc463547f295e85fc7b4d67e25 Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '45d42f3a-6f44-4d7a-b888-f669eee20284'} Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.090015 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Returning 404 to user: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e49c0620-d13a-45f6-9432-9da31bb3ab5b tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 404 len: 111 microversion: 2.1 time: 0.032730 Oct 11 02:17:52.094682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3371/6786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:52 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:17:52.111075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:52.111699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:52.117733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.118216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.118655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.119384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.119838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.120267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.133338 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] HTTP exception thrown: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Request method failure captured: Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 HTTP/1.1 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNIbsHRd90A_U34KIhDG4F-1suH8hdV_ZOfWptcZRyhUX6NaaQfQDa-gqphXJe5eDczFQaSL_ndRX9Dc7vpVlAaHdwfDn3mLd7bPn0aRKcR2G_fU_4zaddLo4qKcvf79s0OgvMa6OvGMw_mTE8iqxww_n-YgVZuZ2UcVEgqAguLBbxQ Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 07ced7fc463547f295e85fc7b4d67e25 Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '45d42f3a-6f44-4d7a-b888-f669eee20284'} Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:17:52.134958 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Returning 404 to user: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6db4d55-0ffe-4bd5-b692-91c271db9566 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "DELETE /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 404 len: 111 microversion: 2.1 time: 0.030513 Oct 11 02:17:52.139419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3416/6787] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:17:52 2022] DELETE /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:17:52.144819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:17:52.145451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] [instance: 45d42f3a-6f44-4d7a-b888-f669eee20284] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:17:52.152072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.152584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.153080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.153795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:17:52.154368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:17:52.154792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:17:52.168504 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] HTTP exception thrown: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Request method failure captured: Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 HTTP/1.1 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNIbsHRd90A_U34KIhDG4F-1suH8hdV_ZOfWptcZRyhUX6NaaQfQDa-gqphXJe5eDczFQaSL_ndRX9Dc7vpVlAaHdwfDn3mLd7bPn0aRKcR2G_fU_4zaddLo4qKcvf79s0OgvMa6OvGMw_mTE8iqxww_n-YgVZuZ2UcVEgqAguLBbxQ Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/aa0fc6ed45724d5a8222b0191aeeb0db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: aa0fc6ed45724d5a8222b0191aeeb0db Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-574877810 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 07ced7fc463547f295e85fc7b4d67e25 Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-574877810-project Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '45d42f3a-6f44-4d7a-b888-f669eee20284'} Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:17:52.170026 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] Returning 404 to user: Instance 45d42f3a-6f44-4d7a-b888-f669eee20284 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0711f239-bfdc-4cb4-b597-3e68ddf69df5 tempest-DeleteServersTestJSON-574877810 tempest-DeleteServersTestJSON-574877810-project] 10.222.0.66 "GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284" status: 404 len: 111 microversion: 2.1 time: 0.030493 Oct 11 02:17:52.174198 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3372/6788] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:17:52 2022] GET /compute/v2.1/servers/45d42f3a-6f44-4d7a-b888-f669eee20284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:18:00.641399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1499052809", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "7f4ac701-113b-4e04-97b0-6d2c312df453"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:00.698711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] validate_networks() for [('7f4ac701-113b-4e04-97b0-6d2c312df453', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:18:01.106785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:18:01.107217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:18:01.107741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:18:01.108153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:18:01.108570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:18:01.117890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:01.118382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:01.118820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:01.120122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:01.120587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:01.121017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:01.139442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:18:01.144920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for user af73aba30e3a4d77a0182784bae675e4 and project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:18:01.157526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:18:01.159880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:18:01.207818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04011947-e5b1-4dc2-8d30-b4bea4addb62 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706197 Oct 11 02:18:01.208396 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3417/6789] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:18:01.219936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e23bfe75-5f84-4ba1-8899-0f8724e110b9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:01.220573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e23bfe75-5f84-4ba1-8899-0f8724e110b9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:01.277695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e23bfe75-5f84-4ba1-8899-0f8724e110b9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:01.285498 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e23bfe75-5f84-4ba1-8899-0f8724e110b9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1218 microversion: 2.1 time: 0.069368 Oct 11 02:18:01.286154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3373/6790] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:01 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:02.308594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:02.309216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:02.317974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:02.318710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:02.319364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:02.320441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:02.321065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:02.322880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:02.405889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:02.416668 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-163f517b-3f2f-40bc-a157-390f756a55af tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1278 microversion: 2.1 time: 0.111916 Oct 11 02:18:02.418244 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3418/6791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:02 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:03.440490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:03.441120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:03.443301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=55 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:03.452408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:03.452913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:03.453538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:03.454579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:03.455053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:03.455555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:03.673356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:03.682479 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3f564ed-5871-4709-ac1d-0ba59fa10f8d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.245846 Oct 11 02:18:03.683979 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3374/6792] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:03 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:03.841459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:03.854832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:03.855317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:03.855986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:03.870855 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] Creating event network-changed:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h2-772273-9 Oct 11 02:18:03.877235 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e1ac5169-ecd9-40f3-a1fc-26cfef48821f req-5ccd1fd4-b12c-44e7-a19e-4ffba97ebc7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047764 Oct 11 02:18:03.878694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3419/6793] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:04.706222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:04.706946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:04.714931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:04.715518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:04.716169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:04.716991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:04.717465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:04.717908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:04.854324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:04.862091 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3969a6a0-0c54-4833-949c-dd5349dbc24e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.159899 Oct 11 02:18:04.862691 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3375/6794] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:04 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:05.886806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:05.887557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:05.893673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:05.894157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:05.894596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:05.895286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:05.895770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:05.896196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:06.023657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:06.031983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2078b36d-3505-474d-a3ed-172ec03fec87 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.150763 Oct 11 02:18:06.032564 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3420/6795] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:05 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:07.054173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:07.054786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:07.062008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:07.063320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:07.064171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:07.064910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:07.065391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:07.065857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:07.207677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:07.215846 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2fed6fc-afcb-47f4-9f3c-efece2b38dbe tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.165608 Oct 11 02:18:07.216437 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3376/6796] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:07 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:08.239147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:08.239787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:08.246328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:08.246812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:08.247249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:08.247962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:08.248416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:08.248840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:08.375930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:08.383459 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ae176ff7-6c6e-4000-846c-675eaa9e39aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.148238 Oct 11 02:18:08.384055 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3421/6797] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:08 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:08.762028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "name": "network-vif-plugged", "status": "completed", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:08.772886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:08.773637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:08.774145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:08.789056 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] Creating event network-vif-plugged:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h2-772273-9 Oct 11 02:18:08.794861 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b9e146af-a11e-4132-bf25-eeb7aebc4a8f req-2d5d8627-e1ad-435b-812a-d7024bb6f700 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036668 Oct 11 02:18:08.795495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3377/6798] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:09.406650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:09.407270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:09.414115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:09.414603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:09.415039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:09.415762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:09.416222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:09.416649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:09.545048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:09.552796 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b6bac7f-ba8f-417b-9e4f-a9b8a2405cfc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1318 microversion: 2.1 time: 0.150168 Oct 11 02:18:09.553370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3422/6799] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:09 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:10.576259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:10.576985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:10.583938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.584433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.584879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.585577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.586054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.586473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.720496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:10.729133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a85effc-bc55-4d22-8169-34be53b3b764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1506 microversion: 2.1 time: 0.156845 Oct 11 02:18:10.729715 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3378/6800] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:10 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:10.750872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:10.751524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:10.754317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:10.759650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.760137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.760576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.761266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.761724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.762148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.766892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:10.893880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:10.902137 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b497c464-97c9-4107-8a5e-54db5c51099a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1506 microversion: 2.1 time: 0.155142 Oct 11 02:18:10.902715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3423/6801] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:10 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:10.926298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:10.928775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:10.930734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=32 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:10.936077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.936587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.937045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.937756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:10.938235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:10.938677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:10.999926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7297711c-29ea-4621-8972-ec6d1a5a48ee tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "PUT /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1078 microversion: 2.1 time: 0.077531 Oct 11 02:18:11.000816 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3379/6802] 10.222.0.66 () {60 vars in 1256 bytes} [Tue Oct 11 02:18:10 2022] PUT /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:11.018998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:11.019771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:11.026475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.026964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.027434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.028129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.028583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.029007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.129111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:11.152051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:11.156299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:11.164116 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8022aa0-c4a6-4061-9b24-34d658588757 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1504 microversion: 2.1 time: 0.149049 Oct 11 02:18:11.164677 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3424/6803] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:11 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:11.185593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:11.186226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:11.192204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.192703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.193160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.193871 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.194349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.194796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.281939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:11.327114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:11.334674 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e819b14-e7f4-49e1-82c2-703281af457f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1504 microversion: 2.1 time: 0.153144 Oct 11 02:18:11.335241 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3380/6804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:11 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:11.357291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:11.359561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:11.365388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.365871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.366307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.366996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.367511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.367940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.398719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:11.404690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:18:11.411056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:18:11.411510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:18:11.411986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:18:11.412394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:18:11.412802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:18:11.474919 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-622d9e5b-7870-4e7e-980f-1d4005db1770 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4/action" status: 202 len: 0 microversion: 2.1 time: 0.121505 Oct 11 02:18:11.475567 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3425/6805] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:18:11 2022] POST /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:18:11.483996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:11.484802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:11.490877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.491414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.491874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.492589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:11.493063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:11.493506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:11.630217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:11.638641 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-933582d2-0a8a-4f3b-a4dd-db65d071d88f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1515 microversion: 2.1 time: 0.158483 Oct 11 02:18:11.639219 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3381/6806] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:11 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:12.662667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:12.663271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:12.670545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:12.671032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:12.671526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:12.672213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:12.672662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:12.673080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:12.891696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:12.899520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ffa4ca34-3e17-4a34-b80e-7663a3feba9e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1515 microversion: 2.1 time: 0.241646 Oct 11 02:18:12.900133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3426/6807] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:12 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:13.923148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:13.923798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:13.930508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:13.931009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:13.931486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:13.932188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:13.932659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:13.933092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:14.063947 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:14.071658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-719b61b4-1d26-4b2d-9d62-bc1e854ba906 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.152334 Oct 11 02:18:14.072895 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3382/6808] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:13 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:18:15.095839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:15.096403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:15.103508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:15.104048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:15.104490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:15.105187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:15.105641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:15.106073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:15.234569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:15.242357 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5550bdc4-7a54-4a7c-be16-293736f2c606 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.150738 Oct 11 02:18:15.242937 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3427/6809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:15 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:16.266936 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:16.267594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:16.274409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:16.274912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:16.275392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:16.276110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:16.276612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:16.277058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:16.407884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:16.416294 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e50d80e3-ff6e-4b73-8a69-43a4266b849c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.152746 Oct 11 02:18:16.416874 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3383/6810] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:16 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:17.439129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:17.439833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:17.446587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:17.447596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:17.448032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:17.448717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:17.449166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:17.449588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:17.578153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:17.585914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-79f0f545-e0d1-4c8a-bc72-0eabe8dd57ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.150686 Oct 11 02:18:17.586503 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3428/6811] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:17 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:18.610734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:18.611387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:18.617885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:18.618391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:18.618881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:18.619625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:18.620103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:18.620547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:18.750525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:18.758339 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-adc193da-3729-4cb7-b907-c4e245e068b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.151690 Oct 11 02:18:18.758930 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3384/6812] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:18 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:19.782668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:19.783566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:19.793056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:19.793795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:19.794588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:19.795772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:19.796465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:19.797101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:19.929509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:19.937330 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47602dc7-b5ad-4f43-a541-d14ca88d7d17 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.158750 Oct 11 02:18:19.937898 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3429/6813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:19 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:20.960271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:20.960906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:20.967708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:20.968208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:20.968660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:20.969366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:20.969836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:20.970280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:21.098591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:21.106815 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-293fe671-ef9d-4a2b-8afd-8d74ac1015ae tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.150460 Oct 11 02:18:21.107435 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3385/6814] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:20 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:22.130701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:22.131286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:22.138828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:22.139317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:22.139786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:22.140481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:22.140939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:22.141365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:22.277360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:22.285105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3fa13142-2376-468b-a685-5ed85a8b225f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.158372 Oct 11 02:18:22.285685 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3430/6815] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:22 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:23.307885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:23.308518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:23.315584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:23.316086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:23.316543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:23.317253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:23.317727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:23.318168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:23.445944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:23.454247 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2219e59-15da-4254-a79f-4d417b23391a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.150294 Oct 11 02:18:23.454817 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3386/6816] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:23 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:24.477969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:24.479050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:24.485835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:24.486319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:24.486754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:24.487473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:24.487928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:24.488348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:24.623050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:24.630765 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0e8bb567-24f2-407a-bab1-15ad800ef236 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.156761 Oct 11 02:18:24.631376 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3431/6817] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:24 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:25.654235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:25.654868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:25.661746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:25.662248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:25.662701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:25.663424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:25.663897 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:25.664342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:25.795288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:25.803096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8699147-c38c-46c5-bfff-94255c02cd26 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.152805 Oct 11 02:18:25.803707 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3387/6818] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:25 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:26.826172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:26.826792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:26.833540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:26.834027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:26.834470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:26.835163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:26.835650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:26.836080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:26.970289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:26.978216 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e2fe11c9-bc4d-47d6-a148-1229ad0259ab tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.155970 Oct 11 02:18:26.978799 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3432/6819] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:26 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:28.001448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:28.002041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:28.008865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:28.010012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:28.010471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:28.011180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:28.011677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:28.012122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:28.141633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:28.149360 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8c57f3e-6a1c-4b1b-9a3b-a074e88db6e7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.151913 Oct 11 02:18:28.149943 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3388/6820] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:27 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:29.172262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:29.172883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:29.179656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:29.180146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:29.180584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:29.181358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:29.181816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:29.182241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:29.310037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:29.317623 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1531ddc-8702-4ace-9338-c8fcccf9abd3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.149266 Oct 11 02:18:29.318185 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3433/6821] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:29 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:30.341411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:30.341967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:30.348810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:30.349317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:30.349775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:30.350495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:30.350970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:30.351446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:30.484362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:30.492173 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4201e558-10d1-4753-b106-86e792c261a6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.154754 Oct 11 02:18:30.492750 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3389/6822] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:30 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:31.515882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:31.516406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:31.523219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:31.523733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:31.524172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:31.525435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:31.525895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:31.526321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:31.651863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:31.659463 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c06ecf13-8611-4ed0-877e-07963dba87ba tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.147578 Oct 11 02:18:31.660031 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3434/6823] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:31 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:32.682059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:32.682696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:32.689607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:32.690107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:32.690563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:32.691302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:32.691803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:32.692248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:32.710359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:32.826107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:32.833928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd35111e-64ab-41e6-8fd8-dc93937497cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.155791 Oct 11 02:18:32.834535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3390/6824] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:32 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:33.858023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:33.858641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:33.865406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:33.865883 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:33.866316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:33.866998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:33.867497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:33.867925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:34.000832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:34.008528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fdd52e20-9a12-4068-b4a4-25d5e9ec397c tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.154393 Oct 11 02:18:34.009131 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3435/6825] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:33 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:35.031432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:35.032071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:35.039311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:35.039841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:35.040294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:35.041005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:35.041478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:35.041924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:35.172256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:35.179927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-839fb52d-3cfb-4a6a-af0f-b6ce00bff8a2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.152499 Oct 11 02:18:35.180505 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3391/6826] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:35 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:36.202517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:36.203125 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:36.209877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:36.210381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:36.210809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:36.211522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:36.211966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:36.212382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:36.348807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:36.356438 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91651915-56be-4460-b04c-94d832925a21 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.157875 Oct 11 02:18:36.357014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3436/6827] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:36 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:37.380017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:37.380571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:37.387492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:37.387991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:37.388443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:37.389149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:37.389614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:37.390052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:37.519486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:37.527119 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9159f8fb-985e-4bd9-bd72-481be24d291d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.151167 Oct 11 02:18:37.527734 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3392/6828] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:37 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:38.550579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:38.551204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:38.557382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:38.557870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:38.558309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:38.559003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:38.559680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:38.560115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:38.695963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:38.703847 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6cb04680-13b9-43a0-8c5f-87c58f820acb tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.157310 Oct 11 02:18:38.704428 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3437/6829] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:38 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:39.726939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:39.727593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:39.734297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:39.734788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:39.735234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:39.735955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:39.736416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:39.736848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:39.867496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:39.875211 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-758405f3-a54c-41b5-9da0-57cafebcca6b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1520 microversion: 2.1 time: 0.152422 Oct 11 02:18:39.875847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3393/6830] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:39 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:40.898205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:40.898878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:40.901639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:40.906733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:40.907325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:40.907681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:40.908389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:40.908847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:40.909278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:40.912638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:41.043094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "name": "network-vif-unplugged", "status": "completed", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:41.051140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:41.057545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=30 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:41.059772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2137d4a6-dbad-4d33-a134-05e9c78a4228 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1519 microversion: 2.1 time: 0.165418 Oct 11 02:18:41.060094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:41.060370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3438/6831] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:40 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:41.060974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:41.061429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:41.074438 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Creating event network-vif-unplugged:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h1-772273-9 Oct 11 02:18:41.080040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:18:41.090805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ba2a0123-41c9-42d3-b5de-2f48a97ea8d7 req-0648fac0-9f16-42dd-9dbd-80847a4e3af2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052460 Oct 11 02:18:41.091663 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3394/6832] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:42.086333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:42.086898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:42.094227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:42.094715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:42.095155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:42.095877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:42.096337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:42.096767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:42.224739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:42.232523 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bdbe0f94-4e04-4bd9-bc27-8cc679a8cf73 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1517 microversion: 2.1 time: 0.150217 Oct 11 02:18:42.233119 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3439/6833] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:42 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:43.107313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:43.116811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:43.117304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:43.117778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:43.129451 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Creating event network-changed:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h1-772273-9 Oct 11 02:18:43.135173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:18:43.145788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6f8e5b57-7c63-4d4c-9998-9753904f5e0d req-2e5cbd98-a649-43af-9685-5fce5b907244 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043394 Oct 11 02:18:43.146360 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3395/6834] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:43.256477 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:43.257097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:43.263879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:43.264366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:43.264806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:43.265737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:43.266193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:43.266617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:43.483684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:43.492375 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-53ab852a-5e55-479c-b659-bfcafc485235 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1517 microversion: 2.1 time: 0.239825 Oct 11 02:18:43.493294 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3440/6835] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:43 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:44.517885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:44.518701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:44.524706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.525895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.526351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:44.527053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.527546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.527982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:44.660980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:44.669561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c862b7d0-8d96-4d8f-b1f8-f541ddee84d9 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1514 microversion: 2.1 time: 0.156758 Oct 11 02:18:44.670159 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3396/6836] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:44 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:18:44.691811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:44.692296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:44.699132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.699655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.700092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:44.700781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.701232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.701655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:44.757872 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dda171a5-9764-49ae-9990-204b8d6c0848 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4/action" status: 204 len: 0 microversion: 2.1 time: 0.069888 Oct 11 02:18:44.758483 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3441/6837] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:18:44 2022] POST /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:18:44.767588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:44.768221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:44.774683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.775862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.776324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:44.777042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:44.777515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:44.778045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:45.030333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:45.038406 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-697d85f4-ab7c-4caa-b725-cc853022f8cd tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1514 microversion: 2.1 time: 0.275509 Oct 11 02:18:45.039002 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3397/6838] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:44 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:46.062143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:46.062846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:46.069951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:46.070446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:46.070895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:46.071625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:46.072861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:46.073290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:46.213566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:46.221312 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89b46b3c-e47b-4696-9664-294d4cbf3bd5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1506 microversion: 2.1 time: 0.163393 Oct 11 02:18:46.221891 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3442/6839] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:46 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:46.244110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:46.244773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:46.251662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:46.252163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:46.252617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:46.253324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:46.253794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:46.254241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:46.388894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:46.396665 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6588012-ae8a-4a9f-9a47-622a363c1985 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1506 microversion: 2.1 time: 0.157033 Oct 11 02:18:46.397245 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3398/6840] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:46 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:46.422440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ac008d1-712a-4e12-859f-bf08048f6602 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'create', calling method: .version_select at 0x7f112f6cf280>, body: {"keypair": {"name": "tempest-keypair-1884715300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIxhXpF/NWwv2EI9tkgTtbuWqzKxtgt/+4c4VERta6wExXdbjzHlsI1XN//PvqLvn1YriPfDX6YVdVmaOPbKq74iBa7XvA0Px6Xy/vW3AGT5RtrmMHYNZyBTxW4lgUpog=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:46.437818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1ac008d1-712a-4e12-859f-bf08048f6602 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:18:46.442897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-1ac008d1-712a-4e12-859f-bf08048f6602 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for user af73aba30e3a4d77a0182784bae675e4 and project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:18:46.470652 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ac008d1-712a-4e12-859f-bf08048f6602 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051994 Oct 11 02:18:46.471266 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3443/6841] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:18:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:46.646740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "name": "network-vif-plugged", "status": "completed", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:46.659005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:46.659674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:46.660236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:46.671786 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] Creating event network-vif-plugged:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h1-772273-9 Oct 11 02:18:46.677772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7f9cc03e-8d27-43eb-9b8b-a2f777b8f0d1 req-3a5beecb-12c4-406b-b641-6289b112f9b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036432 Oct 11 02:18:46.678646 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3399/6842] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:47.659799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:47.660562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:47.667062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:47.667583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:47.668031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:47.668725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:47.669182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:47.669611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:47.806636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:47.814838 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bb7f3a68-2b80-4c20-9de8-c8a216b49496 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 200 len: 1506 microversion: 2.1 time: 0.159864 Oct 11 02:18:47.815446 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3444/6843] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:47 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:18:47.839181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:47.840029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:47.846576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:47.847094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:47.847842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:47.848570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:47.849039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:47.849480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:47.875308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:18:47.950183 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f78f8bd-fbdf-4ade-b133-b5a9c2c09a01 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 204 len: 0 microversion: 2.1 time: 0.116509 Oct 11 02:18:47.950797 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3400/6844] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:18:47 2022] DELETE /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:18:48.004009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1261333672", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "7f4ac701-113b-4e04-97b0-6d2c312df453"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:48.058085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] validate_networks() for [('7f4ac701-113b-4e04-97b0-6d2c312df453', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:18:48.429097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:18:48.429522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:18:48.430003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:18:48.430416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:18:48.430833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:18:48.440851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:48.441338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:48.441780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:48.442513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:48.442968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:48.443423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:48.460653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:18:48.466516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Getting quotas for user af73aba30e3a4d77a0182784bae675e4 and project 7af5e1a885ba4e42b6c225d277bc1c91. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:18:48.480033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:18:48.482369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:18:48.527448 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03ccdaae-304d-4f5d-8858-c8f258443ba6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527245 Oct 11 02:18:48.534203 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3445/6845] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:18:48.540021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a6e8a30-d9b7-4e27-915d-2817edea0d76 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:48.541384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1a6e8a30-d9b7-4e27-915d-2817edea0d76 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:48.600329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1a6e8a30-d9b7-4e27-915d-2817edea0d76 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:48.607839 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a6e8a30-d9b7-4e27-915d-2817edea0d76 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1218 microversion: 2.1 time: 0.072095 Oct 11 02:18:48.608616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3401/6846] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:48 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:49.631568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:49.633087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:49.639509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:49.640010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:49.640453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:49.641168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:49.641678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:49.642112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:49.713960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:49.722846 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea52892d-563a-49ed-96dc-c03354cd85fc tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1276 microversion: 2.1 time: 0.096201 Oct 11 02:18:49.723482 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3446/6847] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:49 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:50.208725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a938a4e-d741-46bf-aaf9-6b3250c914d4", "name": "network-vif-deleted", "tag": "a301ee48-b1c6-4002-af98-d0f8b6d43af8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:50.226557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:50.227371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:50.227981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:50.239642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] Creating event network-vif-deleted:a301ee48-b1c6-4002-af98-d0f8b6d43af8 for instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 on n-h1-772273-9 Oct 11 02:18:50.246673 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8057e6fc-3f50-4852-b178-269fc8900251 req-bce38781-50b7-42e5-bef8-e6500c79ffde service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041242 Oct 11 02:18:50.247962 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3402/6848] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:50.745196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:50.745811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:50.753035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:50.753640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:50.754074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:50.754795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:50.755247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:50.755753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:50.970875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:50.978778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fce2e09b-8a6b-4379-bc7c-dfb7e7ea16ed tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.237513 Oct 11 02:18:50.995255 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3447/6849] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:50 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:18:51.326238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:51.337674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:51.338424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:51.339564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:51.351765 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] Creating event network-changed:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h2-772273-9 Oct 11 02:18:51.357541 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-70fd394d-e798-461b-bdfd-4a244a2091b4 req-86bfcbd0-34b2-40a0-b5f3-f39ccca938df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035771 Oct 11 02:18:51.358459 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3403/6850] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:52.002323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:52.002851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:52.009642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:52.010135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:52.010577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:52.011922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:52.012384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:52.012813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:52.146588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:52.154374 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60e050f8-856e-4b20-a957-55694daf198d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.155994 Oct 11 02:18:52.154957 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3448/6851] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:51 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:53.178739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:53.179401 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:53.185615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:53.186118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:53.186576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:53.187287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:53.187790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:53.188238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:53.317638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:53.325817 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1a206e1-b76a-452e-a8b8-cde739abe11e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.152245 Oct 11 02:18:53.326397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3404/6852] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:53 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:54.348565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:54.349176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:54.355960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:54.356438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:54.356870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:54.357552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:54.358000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:54.358414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:54.486021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:54.493552 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-906fb1a9-d344-44d0-818a-2484e2999813 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.149154 Oct 11 02:18:54.494120 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3449/6853] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:54 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:55.517302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:55.517960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:55.525081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:55.525582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:55.526036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:55.527381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:55.527851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:55.528292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:55.662166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:55.669849 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fd1184f-5fb4-40c1-9837-aa4a02f61e2b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.156563 Oct 11 02:18:55.670419 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3405/6854] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:55 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:56.693064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:56.693683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:56.701122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:56.701613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:56.702053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:56.702750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:56.703208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:56.703668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:56.833974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:56.842265 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db1160e7-82a2-4076-bc94-db62c86a5a88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.153176 Oct 11 02:18:56.842838 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3450/6855] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:56 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:56.981696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "name": "network-vif-plugged", "status": "completed", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:56.992547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:56.993768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:56.994226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:57.005788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] Creating event network-vif-plugged:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h2-772273-9 Oct 11 02:18:57.015303 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e6914bd8-99d0-486d-88af-be1541d9a741 req-7852a9ee-d2bb-4aa6-b5d5-8c5732e50ef5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033046 Oct 11 02:18:57.015303 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3406/6856] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:18:57.865200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:57.865727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:57.872498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:57.872973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:57.873403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:57.874088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:57.874535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:57.874951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:58.005327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:58.013528 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ff0b0402-d372-494f-b722-45985e7e2262 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1318 microversion: 2.1 time: 0.152275 Oct 11 02:18:58.014112 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3451/6857] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:57 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:59.036742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:59.037456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:59.040056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:59.046080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.046573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.047020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.047741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.048205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.048645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.176051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:59.183773 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a474c36e-1f86-4fd6-b375-10880df56dc7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1506 microversion: 2.1 time: 0.151265 Oct 11 02:18:59.184351 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3407/6858] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:59 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:59.206493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:59.207103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:59.209074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:59.209733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:59.216747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.217230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.217694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.218381 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.218834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.219510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.350317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:59.358165 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de2378a4-c41b-4756-9eb7-0f4b6f43562f tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1506 microversion: 2.1 time: 0.155225 Oct 11 02:18:59.358744 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3452/6859] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:59 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:18:59.379833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:18:59.382204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:59.388694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.389198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.389653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.390367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.390837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.391280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.419671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:59.425828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Old instance type m1.heat2, new instance type m1.heat {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:18:59.432764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:18:59.433238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:18:59.433746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:18:59.434147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:18:59.434573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:18:59.471142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:18:59.500549 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7dd7af4-4581-4009-bf49-c3bc20c79c46 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953/action" status: 202 len: 0 microversion: 2.1 time: 0.124687 Oct 11 02:18:59.501174 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3408/6860] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:18:59 2022] POST /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:18:59.509241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:18:59.509857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:18:59.516304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.516792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.517229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.517952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:18:59.518550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:18:59.519066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:18:59.652671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:18:59.660510 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98539cfe-9f60-4dcf-b981-c81a3229c69d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1513 microversion: 2.1 time: 0.155155 Oct 11 02:18:59.661071 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3453/6861] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:18:59 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:00.683393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:00.684147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:00.694801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:00.695313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:00.695796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:00.696518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:00.696994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:00.697438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:00.925839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:00.934349 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7f29a7d-80dd-4bcd-b388-23f8e462e091 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1513 microversion: 2.1 time: 0.254844 Oct 11 02:19:00.934865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3409/6862] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:00 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:01.958108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:01.958642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:01.965969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:01.966455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:01.966895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:01.967624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:01.968082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:01.968514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:02.100968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:02.108690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1771f120-6035-4734-9a28-81a910fbc909 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.154662 Oct 11 02:19:02.109265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3454/6863] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:01 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:03.132100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:03.132756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:03.140050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:03.140551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:03.141004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:03.141721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:03.142189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:03.142626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:03.270633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:03.278385 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bce71c1-d792-4b56-b191-119b5f414a27 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.150255 Oct 11 02:19:03.278968 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3410/6864] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:03 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:04.302071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:04.302692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:04.309652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:04.310140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:04.310587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:04.311278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:04.311764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:04.312192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:04.316165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:04.455414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:04.464178 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29621b80-d527-40c8-82d0-48dcd8a0c0b3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.165277 Oct 11 02:19:04.464795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3455/6865] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:04 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:05.488165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:05.488717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:05.495946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:05.496453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:05.496910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:05.497620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:05.498095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:05.498537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:05.627392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:05.635045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91bfb0ac-4322-46a2-a902-7112037954f7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.150893 Oct 11 02:19:05.635658 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3411/6866] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:05 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:06.657691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:06.658317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:06.665179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:06.665665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:06.666102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:06.667303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:06.667793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:06.668230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:06.805187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:06.813752 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0b5805f9-a610-46b5-a8fc-72d59142df3d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.159946 Oct 11 02:19:06.814340 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3456/6867] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:06 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:07.836756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:07.837388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:07.844489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:07.844986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:07.845438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:07.846143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:07.846609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:07.847059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:07.974980 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:07.982652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6b4ba1f-e596-4bb7-894d-762fc4f01639 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.149807 Oct 11 02:19:07.983241 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3412/6868] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:07 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:09.005224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:09.005837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:09.012693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:09.013177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:09.013610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:09.014310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:09.014761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:09.015185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:09.148158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:09.155914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d3db39fc-9b54-4c0c-8149-497023dc5083 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.154603 Oct 11 02:19:09.156497 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3457/6869] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:09 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:10.179979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:10.180639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:10.188151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:10.188647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:10.189099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:10.189803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:10.190272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:10.190717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:10.323456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:10.331136 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38a2f9a2-54a4-40f4-ab2d-0b3e2294f348 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.155076 Oct 11 02:19:10.331741 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3413/6870] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:10 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:11.355463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:11.356082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:11.358851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:11.364454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:11.364946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:11.365397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:11.366082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:11.366569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:11.366996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:11.496004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:11.503896 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a6e1347-d7b9-4a0a-8632-d86d3e78431a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.152354 Oct 11 02:19:11.504484 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3458/6871] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:11 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:12.527237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:12.527910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:12.530664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:12.536186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:12.536692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:12.537151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:12.537864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:12.538340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:12.538788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:12.671594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:12.679266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb98571f-686e-498e-8bb1-ebe364220764 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.156477 Oct 11 02:19:12.679871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3414/6872] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:12 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:13.702991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:13.703563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:13.710242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:13.710726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:13.711163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:13.711872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:13.712325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:13.712743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:13.840244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:13.848183 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dbb07889-5eeb-464e-ada4-03181cbcf382 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.149272 Oct 11 02:19:13.848764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3459/6873] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:13 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:14.872365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:14.872987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:14.879841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:14.880333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:14.880777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:14.881475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:14.881937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:14.882372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:15.014836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:15.022889 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a74db2f-0941-4bae-90eb-0b0771bdbea8 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.155135 Oct 11 02:19:15.023487 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3415/6874] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:14 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:16.045910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:16.046527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:16.053814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:16.054305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:16.054747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:16.055482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:16.055943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:16.056371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:16.185019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:16.192735 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90293a1f-34ee-4aa9-a234-0ba508da71aa tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.150712 Oct 11 02:19:16.193311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3460/6875] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:16 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:19:17.216066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:17.216713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:17.219011 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:19:17.219149 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 (ip 10.222.0.66) !!! Oct 11 02:19:17.228109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:17.228601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:17.229049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:17.229804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:17.230276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:17.230710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:17.359679 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:17.367319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-339161cf-f194-41f0-bbe7-84e2576f5f88 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.155900 Oct 11 02:19:17.367912 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3416/6876] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:17 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:18.390426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:18.391046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:18.397979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:18.398463 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:18.398901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:18.399626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:18.400082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:18.400508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:18.536460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:18.544713 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33b219d2-206e-4f68-aa73-432625fbde2d tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.158240 Oct 11 02:19:18.545290 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3461/6877] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:18 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:19.568244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:19.568685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:19.575799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:19.576299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:19.576751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:19.577459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:19.577930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:19.578372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:19.707378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:19.715547 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cb7571f-ab39-45b0-851b-1f9ab473891b tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.151587 Oct 11 02:19:19.716125 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3417/6878] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:19 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:20.739255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:20.739903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:20.747617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:20.748108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:20.748545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:20.749240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:20.749697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:20.750127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:20.882910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:20.891176 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd41c48b-6403-4b43-b46b-1aa55d91eed3 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.155796 Oct 11 02:19:20.891782 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3462/6879] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:20 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:21.914095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:21.914644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:21.922129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:21.922625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:21.923078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:21.923809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:21.924277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:21.924717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:22.054445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:22.062158 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c43d0bc-5ea9-4ed0-ac64-4ac79d9392d0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.152037 Oct 11 02:19:22.062764 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3418/6880] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:21 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:23.085791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:23.086438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:23.093430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:23.093914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:23.094354 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:23.095047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:23.095545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:23.095976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:23.232271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:23.239934 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a7b0b0ab-4e98-4ef2-a03a-ad94ac1d5984 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.158076 Oct 11 02:19:23.240528 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3463/6881] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:23 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:24.264113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:24.264736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:24.271560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:24.272053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:24.272501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:24.273200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:24.273664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:24.274097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:24.403141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:24.411076 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57961641-7fac-4c20-bff9-8527e1443a13 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.151539 Oct 11 02:19:24.411695 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3419/6882] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:24 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:25.434732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:25.435263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:25.442175 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:25.442665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:25.443107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:25.443821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:25.444276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:25.444699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:25.571465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:25.579152 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af8fb66a-489d-44cc-9790-cb5a85f180e6 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.149054 Oct 11 02:19:25.579753 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3464/6883] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:25 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:26.602303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:26.602929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:26.609712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:26.610203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:26.610656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:26.611404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:26.611869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:26.612304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:26.743116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:26.751601 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-174dbdcd-5e15-4d78-9b1d-2b2887569b07 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.153196 Oct 11 02:19:26.752173 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3420/6884] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:26 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:27.774937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:27.775588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:27.782450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:27.782938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:27.783403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:27.784101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:27.784555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:27.784981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:27.912474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:27.920736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a59de231-20c7-4f83-9a57-b2fdd3f25b54 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1518 microversion: 2.1 time: 0.149698 Oct 11 02:19:27.921298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3465/6885] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:27 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:28.767235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "name": "network-vif-unplugged", "status": "completed", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:28.777931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:28.778570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:28.779181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:28.794355 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Creating event network-vif-unplugged:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h1-772273-9 Oct 11 02:19:28.799687 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] Instance dc860c47-d4be-4287-ab24-3ad18b951953 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:19:28.812054 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8463c177-c069-485f-ae39-33e8c0dd5ba0 req-c0935ee9-1bd0-4669-974e-b3e6645a7046 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049089 Oct 11 02:19:28.812712 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3421/6886] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:28.943387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:28.944006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:28.951534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:28.952220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:28.952671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:28.953434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:28.953929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:28.954353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:29.090193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:29.098275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e64ca4a4-f91a-470d-9e7c-e78b503109a5 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1517 microversion: 2.1 time: 0.158805 Oct 11 02:19:29.098894 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3466/6887] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:28 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:30.122756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:30.123495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:30.130437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:30.130934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:30.131408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:30.132111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:30.132577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:30.133014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:30.264547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:30.272332 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b8b003f-955f-4f8c-a018-c7fa9cd1dc96 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1515 microversion: 2.1 time: 0.153806 Oct 11 02:19:30.272900 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3422/6888] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:30 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:30.841119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:30.851644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:30.852129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:30.852568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:30.864134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Creating event network-changed:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h1-772273-9 Oct 11 02:19:30.869336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] Instance dc860c47-d4be-4287-ab24-3ad18b951953 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:19:30.880070 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3b463b40-3e07-4add-981b-f6a36262b5fc req-02ae9058-8425-48c9-8c99-bb65e95ebffd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043397 Oct 11 02:19:30.880656 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3467/6889] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:19:31.295983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:31.296621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:31.303546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.304075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.304533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.305263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.305917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.306532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.310092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:31.468336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:31.476510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b0fbea02-2d87-48d8-a77e-fc3cf9228bef tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1512 microversion: 2.1 time: 0.185060 Oct 11 02:19:31.477114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3423/6890] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:31 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:31.500428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:31.501058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:31.507095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.507632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.508079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.508775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.509232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.509665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.566904 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1927258e-844c-470b-9a3a-840c5749fdb1 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "POST /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953/action" status: 204 len: 0 microversion: 2.1 time: 0.070565 Oct 11 02:19:31.567627 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3468/6891] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:19:31 2022] POST /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:19:31.576678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:31.577514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:31.584104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.584606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.585071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.585769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:31.586711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:31.587209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:31.792668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:31.800606 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1c89e27-df98-4b54-b857-933ba296c85a tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1512 microversion: 2.1 time: 0.228824 Oct 11 02:19:31.801206 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3424/6892] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:31 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:32.825029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:32.825762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:32.831843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:32.832335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:32.832778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:32.833476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:32.833936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:32.834362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:32.973895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:32.983698 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6347e9a8-e58a-43a4-8d77-2ebd4f84fcc0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1512 microversion: 2.1 time: 0.163616 Oct 11 02:19:32.984302 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3469/6893] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:32 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:34.008335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.008902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.016212 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.016722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.017180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.017898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.018371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.018851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.149169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:34.157029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62471ea0-58cc-4fa4-ab0b-774ef7510c66 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1504 microversion: 2.1 time: 0.152760 Oct 11 02:19:34.157614 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3425/6894] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:34 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:34.178859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.179505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.186756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.187232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.187691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.188370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.188813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.189231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.317768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:34.325452 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8ed56e6-71f8-430e-98ec-1a90b95ac148 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1504 microversion: 2.1 time: 0.150406 Oct 11 02:19:34.326014 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3470/6895] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:34 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:34.347706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.348341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.354355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.355398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.355853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.356557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.357023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.357463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.488522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:34.496976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a518516-6b53-4ec8-adcf-7602200707a4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1504 microversion: 2.1 time: 0.153489 Oct 11 02:19:34.497559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3426/6896] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:34 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:34.519135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.519611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.525445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.525926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.526357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.527662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.528108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.528523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.531108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:34.555126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:19:34.626621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e121880a-ed88-4a23-b4d1-536dddf0ecd2 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 204 len: 0 microversion: 2.1 time: 0.111120 Oct 11 02:19:34.627330 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3471/6897] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:19:34 2022] DELETE /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:19:34.643970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.644484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.650390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.650890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.651358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.652842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.653323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.653768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.678487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:19:34.722685 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.compute.api [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Instance is already in deleting state, ignoring this request Oct 11 02:19:34.723567 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a83775b4-d7bf-4dd0-b8f5-8a013ba65c60 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 204 len: 0 microversion: 2.1 time: 0.083532 Oct 11 02:19:34.724142 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3427/6898] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:19:34 2022] DELETE /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 02:19:34.732759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:34.733467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:34.739355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.739846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.740284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.740972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.741426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.741851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.876592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:34.884282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc97357f-0616-4f2a-887b-40df4e6fc8b4 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1510 microversion: 2.1 time: 0.155835 Oct 11 02:19:34.884859 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3472/6899] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:34 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:34.920450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "name": "network-vif-plugged", "status": "completed", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:34.931348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:34.932334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:34.933306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:34.945108 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] Creating event network-vif-plugged:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h1-772273-9 Oct 11 02:19:34.950825 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c2ff86de-7a28-4ede-9972-4571ee7c93e9 req-af8dd2cf-0d93-4f1b-896c-1db3ecd80917 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034288 Oct 11 02:19:34.951617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3428/6900] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:19:35.906832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:35.907471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:35.914180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:35.914666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:35.915091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:35.915817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:35.916269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:35.916689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:36.046322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af73aba30e3a4d77a0182784bae675e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af5e1a885ba4e42b6c225d277bc1c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:36.054252 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6c90ec6a-8270-4ba0-9ebc-0b19a9a80d5e tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 200 len: 1510 microversion: 2.1 time: 0.151317 Oct 11 02:19:36.054846 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3473/6901] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:35 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:36.426726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc860c47-d4be-4287-ab24-3ad18b951953", "name": "network-vif-deleted", "tag": "6c27f651-a503-4edf-84a2-d2e7a8f181ed"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:36.446132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:36.446733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:36.447252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:36.469350 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] Creating event network-vif-deleted:6c27f651-a503-4edf-84a2-d2e7a8f181ed for instance dc860c47-d4be-4287-ab24-3ad18b951953 on n-h1-772273-9 Oct 11 02:19:36.474524 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-747c494a-a650-4220-a804-43ff95961491 req-9ad2e5ce-91b4-43af-8e1c-ef0db7ccb108 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052587 Oct 11 02:19:36.475456 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3429/6902] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:37.079056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:37.079719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: dc860c47-d4be-4287-ab24-3ad18b951953] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:37.085996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.086479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.086917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.087668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.088128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.088557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.101858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] HTTP exception thrown: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Request method failure captured: Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 HTTP/1.1 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNJYD_JM1y2_xYk88dnan9T5LDDkmdj_kRy6UjowZO8CAi678jEGFy1ltwfyx6m6vE5aC9i4RGFhYvNvt5uILwurxV6IwBVMbO8MAr8xvUn69BMXr9kPWWkWPuA1xNU4Avioz08ufqEadkAxG7RqQO1kgmuLQUYnxcD3Pfmj6RfbDq4 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: af73aba30e3a4d77a0182784bae675e4 Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'dc860c47-d4be-4287-ab24-3ad18b951953'} Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.103518 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Returning 404 to user: Instance dc860c47-d4be-4287-ab24-3ad18b951953 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8d1483c1-3261-48b6-9fd4-31cef2c21a14 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953" status: 404 len: 111 microversion: 2.1 time: 0.030100 Oct 11 02:19:37.108006 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3474/6903] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:37 2022] GET /compute/v2.1/servers/dc860c47-d4be-4287-ab24-3ad18b951953 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:19:37.114223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91128b12-1e84-4d89-93eb-e31cbaa7e3b0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '.version_select at 0x7f112f537af0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:37.137793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91128b12-1e84-4d89-93eb-e31cbaa7e3b0 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884715300" status: 202 len: 0 microversion: 2.1 time: 0.027780 Oct 11 02:19:37.138379 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3430/6904] 10.222.0.66 () {58 vars in 1221 bytes} [Tue Oct 11 02:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884715300 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:19:37.735128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:37.735657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:37.741605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.742105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.742525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.743205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.743690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.744112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.757179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] HTTP exception thrown: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Request method failure captured: Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 HTTP/1.1 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNJYD_JM1y2_xYk88dnan9T5LDDkmdj_kRy6UjowZO8CAi678jEGFy1ltwfyx6m6vE5aC9i4RGFhYvNvt5uILwurxV6IwBVMbO8MAr8xvUn69BMXr9kPWWkWPuA1xNU4Avioz08ufqEadkAxG7RqQO1kgmuLQUYnxcD3Pfmj6RfbDq4 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: af73aba30e3a4d77a0182784bae675e4 Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0a938a4e-d741-46bf-aaf9-6b3250c914d4'} Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:19:37.758682 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Returning 404 to user: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3c9e7e07-3d86-4114-b0d0-48c0988021d7 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 404 len: 111 microversion: 2.1 time: 0.028823 Oct 11 02:19:37.762874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3475/6905] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:19:37 2022] DELETE /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:19:37.769578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:37.770341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] [instance: 0a938a4e-d741-46bf-aaf9-6b3250c914d4] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:37.777521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.778028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.778489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.779198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:37.779702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:37.780149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:37.793608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] HTTP exception thrown: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Request method failure captured: Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 HTTP/1.1 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNJYD_JM1y2_xYk88dnan9T5LDDkmdj_kRy6UjowZO8CAi678jEGFy1ltwfyx6m6vE5aC9i4RGFhYvNvt5uILwurxV6IwBVMbO8MAr8xvUn69BMXr9kPWWkWPuA1xNU4Avioz08ufqEadkAxG7RqQO1kgmuLQUYnxcD3Pfmj6RfbDq4 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7af5e1a885ba4e42b6c225d277bc1c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7af5e1a885ba4e42b6c225d277bc1c91 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-199171067 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: af73aba30e3a4d77a0182784bae675e4 Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerDiskConfigTestJSON-199171067-project Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0a938a4e-d741-46bf-aaf9-6b3250c914d4'} Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:19:37.795231 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] Returning 404 to user: Instance 0a938a4e-d741-46bf-aaf9-6b3250c914d4 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7942deef-c69f-4efb-8610-5b89e111e925 tempest-ServerDiskConfigTestJSON-199171067 tempest-ServerDiskConfigTestJSON-199171067-project] 10.222.0.66 "GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4" status: 404 len: 111 microversion: 2.1 time: 0.031997 Oct 11 02:19:37.799459 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3431/6906] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:37 2022] GET /compute/v2.1/servers/0a938a4e-d741-46bf-aaf9-6b3250c914d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:19:46.345546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee264d2a-beb9-4fdf-a8a0-1413b78bc516 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: .version_select at 0x7f112eff9160>, body: {"keypair": {"name": "tempest-keypair-956746741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsWNRzp0199GOo27e8gHnOL4vFtpWuuejL3aZrkbF/N2LM7CEJ79+74wC4Z7lWeZwN5OSWzah/qSnexSp+lD/O51c7FAVjkRegAJ3MC0CcajEB/Q4IiYmIXlkS2OO/NQg=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:46.351213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:46.363900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ee264d2a-beb9-4fdf-a8a0-1413b78bc516 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:19:46.368911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ee264d2a-beb9-4fdf-a8a0-1413b78bc516 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:19:46.393051 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee264d2a-beb9-4fdf-a8a0-1413b78bc516 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177020 Oct 11 02:19:46.393655 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3476/6907] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:19:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:47.645341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2003529284", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ac24a44-2325-4c9c-a353-919a01a2b810"}], "security_groups": [{"name": "tempest-securitygroup--1250482476"}], "key_name": "tempest-keypair-956746741", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:47.655027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:47.757154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] validate_networks() for [('0ac24a44-2325-4c9c-a353-919a01a2b810', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:19:47.785019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:48.137502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:19:48.137942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:19:48.138431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:19:48.138865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:19:48.139294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:19:48.148723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:48.149240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:48.149694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:48.150440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:48.150922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:48.151937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:48.169474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:19:48.174781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:19:48.187667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:19:48.190010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:19:48.237743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-716239a4-099c-47fc-bf28-9b8dd8ae52d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.597084 Oct 11 02:19:48.238403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3432/6908] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:19:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:19:48.250590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fd144bca-e8ca-462a-bde4-d35a57e5379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:48.251890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fd144bca-e8ca-462a-bde4-d35a57e5379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:48.256097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:19:48.319938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fd144bca-e8ca-462a-bde4-d35a57e5379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:48.327601 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fd144bca-e8ca-462a-bde4-d35a57e5379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1238 microversion: 2.1 time: 0.080799 Oct 11 02:19:48.340103 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3477/6909] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:48 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:49.352757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:49.353388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:49.360457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:49.360963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:49.361423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:49.362203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:49.362678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:49.363115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:49.429703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:49.439427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c50d7558-c802-4585-ac28-a97b1c180162 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1290 microversion: 2.1 time: 0.091291 Oct 11 02:19:49.447905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3433/6910] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:49 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:50.463418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:50.465372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:50.472766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:50.473260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:50.473729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:50.474464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:50.474917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:50.475364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:50.614043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:50.622418 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ee580d42-4d2e-427e-b925-05c6bee39c16 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1364 microversion: 2.1 time: 0.163892 Oct 11 02:19:50.623006 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3478/6911] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:50 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:50.925815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:50.937428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:50.937920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:50.938396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:50.949955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] Creating event network-changed:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h1-772273-9 Oct 11 02:19:50.954922 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-01aca5cb-641a-410d-90b1-8edacc868a15 req-54d10baa-7c25-4e8e-9dda-1a1ce64f7014 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032880 Oct 11 02:19:50.955562 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3434/6912] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:51.645699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:51.646318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:51.653106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:51.653599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:51.654046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:51.654741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:51.655196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:51.655645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:51.797686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:51.805476 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e63dd1c-1627-4edb-b69b-8090996099b4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1364 microversion: 2.1 time: 0.163743 Oct 11 02:19:51.806117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3479/6913] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:51 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:52.830031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:52.830745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:52.836919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:52.837423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:52.837877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:52.839119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:52.839622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:52.840066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:52.975052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:52.983763 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9073aac-7d3c-432c-b2c8-3385b9b80187 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1364 microversion: 2.1 time: 0.158796 Oct 11 02:19:52.984518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3435/6914] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:52 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:54.006243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:54.006858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:54.013921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:54.014414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:54.014854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:54.015650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:54.016112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:54.016545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:54.152096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:54.159879 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b518c5f2-39c0-4d49-a79a-a3d5e76c4e92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1364 microversion: 2.1 time: 0.157562 Oct 11 02:19:54.160453 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3480/6915] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:54 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:54.971104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "name": "network-vif-plugged", "status": "completed", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:54.983181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:54.984063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:54.984508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:54.996222 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] Creating event network-vif-plugged:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h1-772273-9 Oct 11 02:19:55.001389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6af60ad6-7985-439d-b66f-0544fd943413 req-362d1a0e-a502-456b-aa24-82059a705b53 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Oct 11 02:19:55.002332 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3436/6916] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:55.183575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:55.184195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:55.190928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:55.191438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:55.191876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:55.192566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:55.193017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:55.193437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:55.322642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:55.330393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-65f44b19-242a-45f1-9c50-f757dcb3ab1f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1364 microversion: 2.1 time: 0.151716 Oct 11 02:19:55.330967 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3481/6917] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:55 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:19:56.354079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:56.354719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:56.361790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:56.362326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:56.362781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:56.363517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:56.363989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:56.364426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:56.496805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:19:56.504898 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba26d582-3533-47ac-8254-edc33fc3c573 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1551 microversion: 2.1 time: 0.155158 Oct 11 02:19:56.505480 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3437/6918] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:19:56 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:19:56.527254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:19:56.527775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:19:56.534533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:56.535017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:56.535496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:56.536191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:56.536645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:56.537070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:56.613714 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b75fe090-d709-45de-a345-6195d55c8a49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090838 Oct 11 02:19:56.614324 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3482/6919] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:19:56 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:19:57.843077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:19:57.854229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:19:57.854725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:19:57.855175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:19:57.868979 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] Creating event network-changed:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h1-772273-9 Oct 11 02:19:57.873985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-678ca358-fefc-455d-b238-db2eff0f2860 req-f7307145-f716-4d69-ac72-a9bf5ca8071b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035245 Oct 11 02:19:57.874603 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3438/6920] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:20:33.783662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.784580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.785211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=28 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.789219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:33.789829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:33.798336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:33.798821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:33.799260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:33.799971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:33.800424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:33.800849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:33.933807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:33.941732 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec8a19e5-b3a9-4c0e-961f-71faa44e502d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.160130 Oct 11 02:20:33.942338 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3483/6921] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:33 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:33.965630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:33.966343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:33.968325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.969006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.969753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.970392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:33.977786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:33.978287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:33.978741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:33.979488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:33.980598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:33.981039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.112243 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:34.120865 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8d1a615-94b2-4c12-9ddc-f6637de7f69c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.159713 Oct 11 02:20:34.121451 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3439/6922] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:33 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:34.143110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:34.143699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:34.149594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.150073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.150501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.151183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.151659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.152078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.286329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:34.294441 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ad3ea564-396f-4c5d-98f4-72abd6a9d48d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.155267 Oct 11 02:20:34.295020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3484/6923] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:34 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:34.317473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:20:34.319829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:34.325722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.326225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.326681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.327412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.327888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.328326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.356331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:34.361629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Old instance type m1.heat2, new instance type m1.heat {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:20:34.368094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:20:34.368531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:20:34.369022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:20:34.369566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:20:34.370000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:20:34.431748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fea17c85-4056-4ac4-a05e-7fe45b04beff tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/action" status: 202 len: 0 microversion: 2.1 time: 0.118001 Oct 11 02:20:34.432307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3440/6924] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:20:34 2022] POST /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:20:34.441184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:34.441816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:34.447834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.448410 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.448847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.449544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:34.450014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:34.450430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:34.587379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:34.595969 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0221dad2-a8bf-4a5e-aaa2-b61b7b024d35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1677 microversion: 2.1 time: 0.158827 Oct 11 02:20:34.596539 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3485/6925] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:34 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:35.620457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:35.621117 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:35.628002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:35.628491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:35.628949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:35.629663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:35.630138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:35.630582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:35.765845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:35.773663 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae80ee80-7557-472c-bdf5-cee2da1192fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1677 microversion: 2.1 time: 0.158231 Oct 11 02:20:35.774249 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3441/6926] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:35 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:36.798011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:36.798656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:36.804909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:36.805399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:36.805833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:36.806523 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:36.806981 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:36.807431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:36.936307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:36.943895 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a471c99-b376-4404-9688-916385c06ed9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.149856 Oct 11 02:20:36.944474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3486/6927] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:36 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:37.967325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:37.967917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:37.974941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:37.975476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:37.975931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:37.976640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:37.977108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:37.977547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:38.106324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:38.114184 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-738f86a6-70c8-43ec-81f8-bff3509c81d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.150821 Oct 11 02:20:38.114756 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3442/6928] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:37 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:39.138817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:39.139471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:39.146221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:39.146708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:39.147150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:39.147874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:39.148335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:39.148763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:39.279633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:39.287388 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6eefaf9f-fe70-443a-9344-6e094b15545c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.153059 Oct 11 02:20:39.287909 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3487/6929] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:39 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:40.310322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:40.310872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:40.317641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:40.318139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:40.318580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:40.319281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:40.319834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:40.320268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:40.447951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:40.456258 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0a3993d-e0c4-44d0-beaf-a935945d6008 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.150050 Oct 11 02:20:40.456831 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3443/6930] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:40 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:41.481150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:41.481682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:41.488507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:41.489005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:41.489442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:41.490135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:41.490589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:41.491012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:41.625401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:41.633143 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e1f81352-b893-4dfb-8a3f-6ff97dd54e41 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.156515 Oct 11 02:20:41.633729 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3488/6931] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:41 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:42.656732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:42.657351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:42.664103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:42.664603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:42.665047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:42.665745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:42.666208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:42.666659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:42.797870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:42.805536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f03330f-9a68-4239-89cb-530942766370 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.153252 Oct 11 02:20:42.806114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3444/6932] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:42 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:43.829241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:43.829784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:43.836654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:43.837138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:43.837573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:43.838262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:43.838713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:43.839135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:43.967053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:43.974991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-554ac182-320b-46d5-ad89-99ff7c98665a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.149705 Oct 11 02:20:43.975611 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3489/6933] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:43 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:44.998940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:44.999582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:45.006330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:45.006823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:45.007272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:45.007992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:45.008455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:45.008889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:45.143688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:45.151487 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72c7cd33-a579-4a75-9ac8-c936e1e01949 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.156964 Oct 11 02:20:45.152064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3445/6934] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:44 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:46.175057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:46.175713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:46.182385 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:46.182865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:46.183299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:46.184009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:46.184459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:46.184879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:46.312894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:46.320449 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45163206-f77c-4529-8562-433a19b1cb91 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.149283 Oct 11 02:20:46.321026 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3490/6935] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:46 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:47.344019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:47.344655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:47.351730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:47.352235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:47.352696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:47.353407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:47.353888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:47.354332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:47.485514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:47.493159 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-198d1a0a-1423-4f7b-948b-53edf05169ec tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.153059 Oct 11 02:20:47.493737 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3446/6936] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:47 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:48.517736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:48.518935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:48.525725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:48.526201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:48.526657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:48.527360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:48.528433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:48.528850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:48.658855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:48.666496 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbf153ee-defc-438a-8bed-4d679bf2de66 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.152796 Oct 11 02:20:48.667089 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3491/6937] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:48 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:49.690827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:49.691478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:49.698239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:49.698719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:49.699176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:49.699902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:49.700372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:49.700813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:49.831963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:49.839648 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f31d403b-1e79-4bf8-8840-9328cdeb274e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.152710 Oct 11 02:20:49.840227 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3447/6938] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:49 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:50.862428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:50.863046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:50.869521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:50.870008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:50.870446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:50.871145 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:50.872162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:50.872587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:51.005038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:51.013459 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-881c1385-a44f-44fa-9bb8-3995775486ef tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.155008 Oct 11 02:20:51.014047 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3492/6939] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:50 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:52.036706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:52.037371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:52.044734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:52.045240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:52.045712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:52.046413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:52.046887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:52.047353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:52.175603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:52.183429 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29e462f5-eefb-485a-b3d2-f1ce5dd8e4d2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1682 microversion: 2.1 time: 0.150668 Oct 11 02:20:52.184664 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3448/6940] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:52 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:53.207607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:53.208222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:53.215088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:53.215607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:53.216049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:53.216744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:53.217201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:53.217628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:53.430157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:53.438502 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b6600b5-0f71-4f37-b011-ed471ae4c82d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1681 microversion: 2.1 time: 0.234878 Oct 11 02:20:53.439298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3493/6941] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:53 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:53.659780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "name": "network-vif-unplugged", "status": "completed", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:20:53.670653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:53.671238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:53.671757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:53.684494 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Creating event network-vif-unplugged:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h2-772273-9 Oct 11 02:20:53.690011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:20:53.700989 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6cc856aa-782a-42b9-91f8-2e50f1485b60 req-f4587346-6247-4561-88b5-63267e57e57f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045746 Oct 11 02:20:53.701606 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3449/6942] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:20:54.462651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:54.464067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:54.471152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:54.471917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:54.472406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:54.473101 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:54.473558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:54.473986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:54.699243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:54.707467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1027151b-9de4-44b8-a081-81ce7c668d9b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1681 microversion: 2.1 time: 0.249269 Oct 11 02:20:54.708041 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3494/6943] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:54 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:55.731052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:55.731695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:55.738516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:55.739002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:55.739479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:55.740176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:55.740637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:55.741072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:55.780798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:20:55.790435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:55.790939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:55.791508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:55.802686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Creating event network-changed:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h2-772273-9 Oct 11 02:20:55.807951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:20:55.818463 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6bac51db-16e8-461f-a0ec-ac9847017288 req-6e96499a-e399-4962-b1d6-cf1901ff9a92 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104613 Oct 11 02:20:55.819064 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3450/6944] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:20:55.922894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:55.930736 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9c45ecee-c167-4a27-8d99-4edd42f4b5ae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1679 microversion: 2.1 time: 0.203573 Oct 11 02:20:55.931325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3495/6945] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:55 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:20:56.955680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:56.956398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:56.962716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:56.963211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:56.963691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:56.964391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:56.964859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:56.965798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:57.149193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:57.157895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5feda172-278e-4980-942d-4283457c564a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1679 microversion: 2.1 time: 0.207422 Oct 11 02:20:57.158473 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3451/6946] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:56 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:58.181273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:58.181886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:58.184734 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:20:58.184883 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:20:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 (ip 10.222.0.66) !!! Oct 11 02:20:58.192382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.192870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.193306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.193995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.194450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.194879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.322984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:58.330577 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3997d254-b16c-4df6-9edd-16eb76801299 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1676 microversion: 2.1 time: 0.153256 Oct 11 02:20:58.331148 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3496/6947] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:58 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:58.353920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:20:58.354474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:58.362706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.363209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.363701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.364410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.364880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.365324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.425998 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5133ed50-d31f-44fe-9544-5c590a37120d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/action" status: 204 len: 0 microversion: 2.1 time: 0.075823 Oct 11 02:20:58.426677 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3452/6948] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:20:58 2022] POST /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:20:58.436380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:58.436993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:58.443743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.444297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.444826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.446224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:58.446679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:58.447126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:58.587729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:58.595956 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ddb409f-dd34-4d1d-968a-0abf2f1f37e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1676 microversion: 2.1 time: 0.165032 Oct 11 02:20:58.596827 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3497/6949] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:58 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:20:59.622637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:20:59.623218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:20:59.629456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:59.629968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:59.630424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:59.631146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:20:59.631640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:20:59.632084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:20:59.766490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:20:59.768945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:20:59.776713 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39dea7f6-7b05-4d94-80d6-39b372cc87ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1676 microversion: 2.1 time: 0.160116 Oct 11 02:20:59.777335 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3453/6950] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:20:59 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:21:00.800417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:00.800937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:00.807702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:00.808185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:00.808621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:00.809835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:00.810289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:00.810713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.208652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:01.216369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-143d2f2e-840d-42a0-b3c8-1bc4d383379b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.419951 Oct 11 02:21:01.216943 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3498/6951] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:00 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:01.239451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:01.240091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:01.248138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.248646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.249103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.249815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.250294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.250741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.381790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:01.389599 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c0b12ac1-5a57-4ae3-9506-1ba19db47f31 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.154400 Oct 11 02:21:01.390178 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3454/6952] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:01 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:01.412009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:01.412568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:01.419118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.419750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.420095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.420803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.421263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.421699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.439384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:01.553899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:01.561782 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bc8250e6-76b6-4362-89c0-684570640677 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1668 microversion: 2.1 time: 0.153729 Oct 11 02:21:01.562655 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3499/6953] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:01 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:01.580710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "name": "network-vif-plugged", "status": "completed", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:01.591893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.592210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.592652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:01.592818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.593155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:01.599267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.599820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.600251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.600949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.601406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.601830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.605544 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] Creating event network-vif-plugged:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h2-772273-9 Oct 11 02:21:01.611393 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-26468e53-5c95-4535-88e8-bc7b424a3bce req-9b62daae-a2b8-4898-9e6c-ddd72b08cad1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Oct 11 02:21:01.612175 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3455/6954] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:01.628562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:21:01.705248 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1b47add8-282e-4845-9cd5-04f5d6a8bed7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 204 len: 0 microversion: 2.1 time: 0.116573 Oct 11 02:21:01.706257 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3500/6955] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:21:01 2022] DELETE /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:21:01.715712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:01.716453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:01.722854 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.723376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.723840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.724582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:01.725055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:01.725500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:01.856790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:01.864593 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d23aed8-204c-4def-9d3c-d5d63d4cb0c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1674 microversion: 2.1 time: 0.153827 Oct 11 02:21:01.865179 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3456/6956] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:01 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:02.888724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:02.889682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:02.896370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:02.896863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:02.897357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:02.898041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:02.898499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:02.898931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:03.031041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:03.038531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be821d9d-fd40-4047-963f-96ffcb280546 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1674 microversion: 2.1 time: 0.154416 Oct 11 02:21:03.039096 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3501/6957] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:02 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:04.062705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:04.063239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:04.066119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=41 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:04.072168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:04.072685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:04.073173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:04.073906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:04.074922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:04.075437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:04.145811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:04.154140 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e627beb1-8f8e-4076-b1c3-45b37503b81a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 200 len: 1606 microversion: 2.1 time: 0.095494 Oct 11 02:21:04.154931 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3457/6958] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:04 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:04.319834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e08bfc-2738-494f-8ed9-619cba9d7d39", "name": "network-vif-deleted", "tag": "409a5a33-220a-4392-a4fd-b442b57a4256"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:04.326563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:04.332280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:04.332764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:04.333196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:04.345111 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] Creating event network-vif-deleted:409a5a33-220a-4392-a4fd-b442b57a4256 for instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 on n-h2-772273-9 Oct 11 02:21:04.351447 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-54700621-7e9d-4e40-a4df-20989f29beba req-b4baa326-f973-4cda-8842-21b0a83f9bc6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035729 Oct 11 02:21:04.352015 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3502/6959] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:05.176968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:05.177785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:05.185207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.185713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.186190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.186868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.187520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.187973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.201758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 HTTP/1.1 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c5e08bfc-2738-494f-8ed9-619cba9d7d39'} Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:21:05.203481 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a74e3e09-96dc-4ba3-aece-0d3c35ddba9d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 404 len: 111 microversion: 2.1 time: 0.031987 Oct 11 02:21:05.207905 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3458/6960] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:05 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:21:05.221793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:05.222529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:05.228717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.229209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.229645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.230342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.231392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.231825 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.244974 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 HTTP/1.1 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c5e08bfc-2738-494f-8ed9-619cba9d7d39'} Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:21:05.246620 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be114db8-c297-463e-9d27-ade6a947bda1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 404 len: 111 microversion: 2.1 time: 0.032159 Oct 11 02:21:05.250763 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3503/6961] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:05 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:21:05.298642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2051427947", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "0ac24a44-2325-4c9c-a353-919a01a2b810"}], "security_groups": [{"name": "tempest-securitygroup--1250482476"}], "key_name": "tempest-keypair-956746741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:05.405283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] validate_networks() for [('0ac24a44-2325-4c9c-a353-919a01a2b810', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:21:05.777275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:21:05.778331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:21:05.778828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:21:05.779288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:21:05.779764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:21:05.788621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.789149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.789611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.790359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:05.790834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:05.791282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:05.807839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:21:05.813616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:21:05.826374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:21:05.828718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:21:05.875390 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0334d3dd-ad42-4b24-a5b1-47897e7f3825 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.580697 Oct 11 02:21:05.876059 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3459/6962] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:21:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:21:05.887514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92e4dcc2-225b-4517-97a4-43f45e9372cc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:05.888263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92e4dcc2-225b-4517-97a4-43f45e9372cc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:05.942892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92e4dcc2-225b-4517-97a4-43f45e9372cc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:05.952809 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92e4dcc2-225b-4517-97a4-43f45e9372cc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1238 microversion: 2.1 time: 0.069353 Oct 11 02:21:05.953371 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3504/6963] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:05 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:06.977874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:06.978662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:06.985628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:06.986141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:06.986697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:06.987934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:06.988091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:06.988807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:07.056163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:07.064044 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-abe667c3-0895-419c-92cd-93dd54434f23 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1290 microversion: 2.1 time: 0.090901 Oct 11 02:21:07.064615 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3460/6964] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:06 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:08.088986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:08.089738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:08.097588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:08.098176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:08.098693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:08.099448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:08.099915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:08.100352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:08.236948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:08.244770 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-61b9f3bb-5264-4984-97e3-46d8876580f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.160044 Oct 11 02:21:08.245460 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3505/6965] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:08 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:08.632541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:08.645977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:08.646511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:08.646965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:08.659752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] Creating event network-changed:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h1-772273-9 Oct 11 02:21:08.667125 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e448e0f6-5179-49a3-b7f7-505d5579b1d8 req-b402d4a2-ddcb-4b34-a9b1-f16156cc819b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039361 Oct 11 02:21:08.667777 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3461/6966] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:09.268824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:09.269383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:09.277534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:09.278029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:09.278506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:09.279216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:09.279731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:09.280166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:09.408436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:09.416095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9999fbe-9d66-4e8a-b13a-427de1169871 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.151563 Oct 11 02:21:09.416671 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3506/6967] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:09 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:10.441621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:10.442341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:10.448583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:10.449082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:10.450100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:10.450802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:10.451273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:10.451749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:10.584457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:10.592582 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d02d7887-d888-4759-b390-69aa56761698 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.156077 Oct 11 02:21:10.593155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3462/6968] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:10 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:11.616630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:11.617245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:11.624290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:11.624785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:11.625216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:11.626284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:11.626396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:11.626795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:11.756009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:11.764134 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a540930-b0d1-4d14-ae9c-2e3a096d1a61 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.151423 Oct 11 02:21:11.764702 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3507/6969] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:11 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:21:12.788029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:12.788657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:12.796103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:12.796605 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:12.797065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:12.797765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:12.798232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:12.798671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:12.930280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:12.937930 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a3ce6eb-4048-4d1d-89d3-7cafa6a1c16e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.153853 Oct 11 02:21:12.938501 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3463/6970] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:12 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:13.335164 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "name": "network-vif-plugged", "status": "completed", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:13.347668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:13.348231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:13.348628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:13.360737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] Creating event network-vif-plugged:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h1-772273-9 Oct 11 02:21:13.365726 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9fb2e2ed-3f3f-479c-918c-23eba8f3cdf7 req-5ae7edc2-7a03-4675-9e79-24aac6c35e0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034272 Oct 11 02:21:13.366407 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3508/6971] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:13.961882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:13.962512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:13.969971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:13.970477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:13.970929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:13.971926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:13.972395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:13.972834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:14.098966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:14.106642 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d9761b2-1340-4789-80c2-43441cf60025 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1364 microversion: 2.1 time: 0.148726 Oct 11 02:21:14.107219 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3464/6972] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:13 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:21:15.131717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:15.132349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:15.138436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:15.138928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:15.139393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:15.140099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:15.140558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:15.140988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:15.276661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:15.285004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edf8b8ac-debc-43ae-bf66-7a364c4ccde3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1550 microversion: 2.1 time: 0.158607 Oct 11 02:21:15.285576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3509/6973] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:15 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:15.310209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:15.310749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:15.317549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:15.318046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:15.318498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:15.319200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:15.319698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:15.320139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:15.397408 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0dc9a930-edc2-4b76-9a6c-fe84ebc8983d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091023 Oct 11 02:21:15.398024 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3465/6974] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:21:15 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:16.321585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:16.326538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:16.333244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:16.333733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:16.334170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:16.345599 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] Creating event network-changed:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h1-772273-9 Oct 11 02:21:16.351039 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d0c52b7e-b42b-4131-926e-323970d6fe8b req-3a1b09fc-c25a-4848-bb1e-d5d8cd7996de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033188 Oct 11 02:21:16.351702 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3510/6975] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:21:49.435019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.436404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.438462 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.439327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=55 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.444581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:21:49.456271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:49.456768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:49.457213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:49.479281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 02:21:49.522268 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5571d576-e42c-4601-9a33-f06b7b89c7c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.087945 Oct 11 02:21:49.522975 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3466/6976] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:21:49 2022] POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:21:49.529608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=19 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.530437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:21:49.535244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:49.535994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:49.544131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:49.544726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:49.545170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:49.546491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:49.546954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:49.547407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:49.685287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:49.693531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c47cb5f-59bf-4672-a00d-ae80977689c4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.166090 Oct 11 02:21:49.694108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3511/6977] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:49 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:50.718588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:50.719308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:50.726139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:50.726881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:50.727357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:50.728083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:50.728557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:50.729004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:50.861891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:50.869686 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af2133d6-1225-4beb-83dd-0db828db99c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.156896 Oct 11 02:21:50.870266 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3467/6978] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:50 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:51.892500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:51.893236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:51.899952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:51.900442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:51.900884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:51.901579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:51.902054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:51.902461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:52.038701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:52.047181 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e59a55cc-c2ce-49c4-acf7-6aa0f9241962 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.158573 Oct 11 02:21:52.047807 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3512/6979] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:51 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:53.070506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:53.071130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:53.078591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:53.079083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:53.079575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:53.080272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:53.080735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:53.081169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:53.207927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:53.215574 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-821f5753-0522-4048-9c1d-221bd6afa04b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.148959 Oct 11 02:21:53.216141 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3468/6980] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:53 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:54.239973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:54.240608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:54.247549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:54.248693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:54.249131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:54.249833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:54.250285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:54.250711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:54.381351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:54.389777 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-83fc1b01-0de5-40ec-b1ec-11c4f78c0f13 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.153807 Oct 11 02:21:54.390366 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3513/6981] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:54 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:55.413547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:55.414228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:55.421298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:55.421807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:55.422268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:55.423056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:55.423566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:55.424040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:55.555311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:55.563630 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79b6b778-4336-424b-ae81-c42bc66e28c9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.153964 Oct 11 02:21:55.564210 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3469/6982] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:55 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:56.587366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:56.587984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:56.595274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:56.595793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:56.596486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:56.597183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:56.597646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:56.598068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:56.726057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:56.733813 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ccca6149-adff-43d8-8306-e77544ff35ad tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.150441 Oct 11 02:21:56.734395 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3514/6983] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:56 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:57.756528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:57.757162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:57.764006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:57.764507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:57.764961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:57.765664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:57.766134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:57.766576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:57.898200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:57.906694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ae19c71-bf5b-4e1a-97d4-3efa476b4f80 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.154023 Oct 11 02:21:57.907214 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3470/6984] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:57 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:21:58.929781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:21:58.930439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:21:58.937988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:58.938481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:58.938934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:58.939663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:21:58.940123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:21:58.940560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:21:59.070068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:21:59.077764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a21a0c06-23fd-4bc0-9c4d-644c206cd8bf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.151931 Oct 11 02:21:59.078333 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3515/6985] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:21:58 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:00.101662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:00.102346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:00.110010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.110517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.110999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.111732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.112216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.112648 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.239712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:00.247604 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5a62aef-afb9-4706-99cb-26a12bf26dd9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1654 microversion: 2.1 time: 0.149826 Oct 11 02:22:00.248782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3471/6986] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:00 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:00.270947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:00.273263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:00.281010 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.281441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.281888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.282588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.283047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.283506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.310926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:00.316297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Old instance type m1.heat2, new instance type m1.heat {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:22:00.322739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:22:00.323165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:22:00.323691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:22:00.324106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:22:00.324522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:22:00.386641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f893ee73-6abb-4d7f-93dc-35112ce6de2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.119706 Oct 11 02:22:00.387265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3516/6987] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:22:00 2022] POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:22:00.396103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:00.396736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:00.402572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.403073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.403565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.404909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:00.405385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:00.405835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:00.544321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:00.555170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-901dee87-7e30-4226-8dbc-5e57bf270830 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.162874 Oct 11 02:22:00.555872 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3472/6988] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:00 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:01.579884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:01.580623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:01.587577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:01.588152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:01.588766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:01.589492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:01.589955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:01.590389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:01.724139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:01.732753 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54c0505a-b9ef-45f1-9010-67089cb3212d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1677 microversion: 2.1 time: 0.158093 Oct 11 02:22:01.733546 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3517/6989] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:01 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:02.756362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:02.757026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:02.763860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:02.764363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:02.764821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:02.765529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:02.766003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:02.766452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:02.898483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:02.906665 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7b8af8e-5e72-4801-80d8-633b6f8dbfbd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1682 microversion: 2.1 time: 0.154248 Oct 11 02:22:02.907244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3473/6990] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:02 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:03.930851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:03.931555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:03.939596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:03.940094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:03.940538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:03.941255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:03.941717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:03.942245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:04.150201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:04.158223 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c55f9766-dd14-43ee-92e1-eded98ecbbf7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1681 microversion: 2.1 time: 0.232035 Oct 11 02:22:04.158973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3518/6991] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:03 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:04.431180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:04.441513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:04.441845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:04.442293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:04.454240 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Creating event network-vif-unplugged:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h2-772273-9 Oct 11 02:22:04.459614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:22:04.471135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5ef87d07-dbf5-4bea-aadb-f65e6f87f738 req-24eab936-ca64-473e-bb57-a22ed7d2c964 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043458 Oct 11 02:22:04.472075 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3474/6992] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:22:05.182174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:05.182939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:05.190266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:05.190779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:05.191264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:05.191990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:05.192450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:05.192906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:05.429327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:05.437769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5eaf920a-4c4e-4b39-8864-84fe08324a0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1681 microversion: 2.1 time: 0.259587 Oct 11 02:22:05.438362 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3519/6993] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:05 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:06.462054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:06.462664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:06.469869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:06.470380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:06.470838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:06.471857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:06.472337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:06.472781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:06.512179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:06.523481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:06.523969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:06.524412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:06.536432 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Creating event network-changed:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h2-772273-9 Oct 11 02:22:06.541874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:22:06.553141 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2a90042d-ed56-4446-9836-ffc9d8906dc4 req-976589fe-b802-4d49-89a3-5e9a1efc657b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044585 Oct 11 02:22:06.554005 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3520/6994] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:22:06.610827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:06.619610 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd97f26a-2377-4a34-94ce-6d0623f78747 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1679 microversion: 2.1 time: 0.162694 Oct 11 02:22:06.620498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3475/6995] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:06 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:07.645852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:07.646492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:07.652701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:07.653197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:07.653645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:07.655226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:07.655554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:07.656002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:07.793519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:07.801748 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13804f27-1615-4284-826e-cb58e2a45efe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1679 microversion: 2.1 time: 0.161180 Oct 11 02:22:07.802325 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3521/6996] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:07 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:08.824551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:08.825223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:08.832638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:08.833139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:08.833599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:08.834309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:08.834783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:08.835225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:08.962029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:08.969809 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-061036a7-3b4d-4cbf-80ab-5d1af0e10faf tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1675 microversion: 2.1 time: 0.149169 Oct 11 02:22:08.970396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3476/6997] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:08 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:08.992423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:08.992970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:09.000332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:09.000822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:09.001261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:09.001964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:09.002426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:09.002856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:09.059196 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5cdfc2fe-9cf6-4ec9-82bd-39ae73ba9902 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action" status: 204 len: 0 microversion: 2.1 time: 0.070628 Oct 11 02:22:09.060590 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3522/6998] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:22:08 2022] POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:22:09.069068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:09.069696 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:09.076362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:09.076923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:09.077532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:09.078317 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:09.078824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:09.079454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:09.214925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:09.222959 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-482beabf-e34f-4944-b0db-d6b5a8b41267 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1675 microversion: 2.1 time: 0.157877 Oct 11 02:22:09.223832 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3477/6999] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:09 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:10.248091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:10.248906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:10.255921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.256399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.256843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.257554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.258016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.258581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.402824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:10.410761 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fe1111f3-3fb6-4088-aa0a-85df2970b3b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1654 microversion: 2.1 time: 0.167657 Oct 11 02:22:10.411356 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3523/7000] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:10 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:10.433549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:10.434170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:10.441568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.442062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.442509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.443207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.443699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.444142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.572500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:10.580824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d98e745-06b6-4b5c-a890-e50a4fc29f1e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1654 microversion: 2.1 time: 0.151147 Oct 11 02:22:10.581403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3478/7001] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:10 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:10.603070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:10.609557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.610048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.610490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.635600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Going to try to start instance {{(pid=120493) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 02:22:10.657560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:10.675783 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3da6386b-ad75-4034-b669-db992986ca06 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.076394 Oct 11 02:22:10.676400 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3524/7002] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:22:10 2022] POST /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:22:10.685953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:10.686675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:10.692805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.693308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.693765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.694486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:10.695546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:10.695999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:10.917944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:10.926214 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a308fbe5-736d-4ed8-a2b1-858c004d36d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1663 microversion: 2.1 time: 0.245150 Oct 11 02:22:10.926800 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3479/7003] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:10 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1663 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:11.947602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "name": "network-vif-plugged", "status": "completed", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:11.949813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:11.951689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:11.958900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:11.959442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:11.959895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:11.960612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:11.961081 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:11.961517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:11.965868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:11.966390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:11.966829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:11.978626 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] Creating event network-vif-plugged:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h2-772273-9 Oct 11 02:22:11.984376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3c81a9a4-0e7f-4fd0-be16-af88e8958ebb req-9f10ff59-c857-4184-81e5-dcaa0c5eace6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095783 Oct 11 02:22:11.985269 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3525/7004] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:22:12.093888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:12.101960 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80c5d38e-b5ae-4976-90e0-14e3e68fc1b5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1667 microversion: 2.1 time: 0.156222 Oct 11 02:22:12.102544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3480/7005] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:11 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:12.126042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:12.126635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:12.132908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:12.133392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:12.133832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:12.134527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:12.134988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:12.135442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:12.159986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:22:12.235112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a134376c-5552-498d-9508-734cee50dfeb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 204 len: 0 microversion: 2.1 time: 0.113557 Oct 11 02:22:12.235969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3526/7006] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:22:12 2022] DELETE /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:22:12.244460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:12.245091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:12.251662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:12.252165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:12.252621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:12.253331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:12.253804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:12.254249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:12.694999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:12.698567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:12.703793 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ab0f81e-5a11-43f7-8ec0-2bd872896650 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1673 microversion: 2.1 time: 0.463214 Oct 11 02:22:12.704371 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3481/7007] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:12 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1673 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:13.728020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:13.728723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:13.735489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:13.735980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:13.736417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:13.737115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:13.737574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:13.738000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:13.951844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:13.959723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-32afa245-2588-46e9-a896-e4e9199db26c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 200 len: 1673 microversion: 2.1 time: 0.236066 Oct 11 02:22:13.960525 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3527/7008] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:13 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:14.510067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7", "name": "network-vif-deleted", "tag": "0cd05baa-18d4-4908-a0d2-28890c3f331a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:14.527898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:14.528489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:14.529629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:14.542982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] Creating event network-vif-deleted:0cd05baa-18d4-4908-a0d2-28890c3f331a for instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 on n-h2-772273-9 Oct 11 02:22:14.548007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d0bd9800-3ad9-4adb-aec9-02609cdf277e req-b7b1f9bb-631c-47e5-a8ba-28255ff4b154 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042461 Oct 11 02:22:14.549012 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3482/7009] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:22:14.985138 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:14.985763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:14.992455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:14.992949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:14.993392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:14.994095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:14.994552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:14.994982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:15.008425 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 HTTP/1.1 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd62e9f8f-9bfe-486e-b936-90ff1cdd0fc7'} Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:22:15.014614 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a3c8f47b-66f0-4d9a-bda9-1286a2566cae tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 404 len: 111 microversion: 2.1 time: 0.030859 Oct 11 02:22:15.018442 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3528/7010] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:14 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:22:15.029598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:15.030448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:15.037055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:15.037610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:15.038139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:15.038929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:15.039464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:15.039909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:15.053682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 HTTP/1.1 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd62e9f8f-9bfe-486e-b936-90ff1cdd0fc7'} Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:22:15.055440 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad5d0faf-bbc3-4cc0-93e8-9104c1d7ad92 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 404 len: 111 microversion: 2.1 time: 0.032492 Oct 11 02:22:15.059004 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3483/7011] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:15 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:22:15.105118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2021420436", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "0ac24a44-2325-4c9c-a353-919a01a2b810"}], "security_groups": [{"name": "tempest-securitygroup--1250482476"}], "key_name": "tempest-keypair-956746741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:15.222364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] validate_networks() for [('0ac24a44-2325-4c9c-a353-919a01a2b810', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:22:15.653394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:22:15.653822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:22:15.654305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:22:15.654750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:22:15.655168 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:22:15.664066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:15.664701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:15.665317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:15.666052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:15.666521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:15.666955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:15.683273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:22:15.688968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:22:15.701623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:22:15.703974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:22:15.753376 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f8ec08f6-3d27-4243-9380-fe2567ee82c1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.652095 Oct 11 02:22:15.754040 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3529/7012] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:22:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:22:15.765869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e00aa1e6-edae-4239-aae7-604b4d4fb0fb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:15.766620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e00aa1e6-edae-4239-aae7-604b4d4fb0fb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:15.826999 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e00aa1e6-edae-4239-aae7-604b4d4fb0fb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:15.835005 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e00aa1e6-edae-4239-aae7-604b4d4fb0fb tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1238 microversion: 2.1 time: 0.073604 Oct 11 02:22:15.835628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3484/7013] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:15 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:16.858511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:16.859133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:16.867215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:16.867736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:16.868188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:16.868897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:16.869360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:16.869793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:16.931107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:16.939029 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f130f90-eaac-45aa-b7fa-0106eaa17107 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1296 microversion: 2.1 time: 0.084325 Oct 11 02:22:16.939657 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3530/7014] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:16 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:17.963996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:17.964667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:17.972001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:17.972511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:17.972975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:17.973697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:17.974173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:17.974620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:18.108165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:18.116082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a92efe21-a84a-4d69-b46d-29687d445d0f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.156056 Oct 11 02:22:18.116806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3485/7015] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:17 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:18.422031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:18.431592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:18.432088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:18.432527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:18.446329 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] Creating event network-changed:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:22:18.451810 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5dc57b8c-f3b8-4bf1-bb1f-25d867a7903f req-6ebf782c-5c14-43e4-b559-35be4fd176db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091766 Oct 11 02:22:18.452489 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3531/7016] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:22:19.140181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:19.140849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:19.147848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:19.148350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:19.148809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:19.149516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:19.149986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:19.150427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:19.282962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:19.291078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c56490b-9235-49ea-a9f8-81fac9577bf5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.155426 Oct 11 02:22:19.291682 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3486/7017] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:19 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:20.315784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:20.316509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:20.318453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:20.324288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:20.324768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:20.325206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:20.325886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:20.326339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:20.326756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:20.457471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:20.465152 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf4c6d43-5e9a-4a82-a88d-999add2db84a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.154537 Oct 11 02:22:20.465732 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3532/7018] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:20 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:21.490342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:21.490867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:21.493827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=45 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:21.500111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:21.500630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:21.501087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:21.501795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:21.502265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:21.502706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:21.630300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:21.637974 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb81d830-a6d0-41b4-95be-34d1062db06e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.151924 Oct 11 02:22:21.638554 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3487/7019] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:21 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:22:22.660900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:22.661511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:22.668379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:22.668856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:22.669286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:22.669967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:22.670918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:22.671361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:22.801778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:22.809430 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b8b53a7e-9268-466f-90dd-37d1de271456 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.152436 Oct 11 02:22:22.810003 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3533/7020] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:22 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:23.732821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "name": "network-vif-plugged", "status": "completed", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:23.743780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:23.744273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:23.744717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:23.758319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] Creating event network-vif-plugged:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:22:23.763163 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e7ba4878-8f99-4ed7-bf7f-5ec7210c9dd4 req-eea63b9f-e8f9-4c59-8696-8b259a45cef4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034151 Oct 11 02:22:23.764522 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3488/7021] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:22:23.833799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:23.834343 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:23.841375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:23.841688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:23.842124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:23.842829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:23.843285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:23.843734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:23.973402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:23.980940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ccc8f0eb-f132-4a6f-a073-abd094ff9acc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.151268 Oct 11 02:22:23.981521 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3534/7022] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:23 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:25.006154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:25.006878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:25.013268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:25.013770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:25.014229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:25.014931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:25.015430 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:25.016725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:25.153428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:25.164757 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf1cb979-2096-4dc4-8e11-73ee4b1a2d70 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1364 microversion: 2.1 time: 0.163763 Oct 11 02:22:25.165769 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3489/7023] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:24 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:26.192460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:26.193074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:26.195744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:26.196403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:26.203026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:26.203534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:26.203970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:26.204653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:26.205104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:26.205529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:26.335505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:22:26.343167 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49b45ec7-80e9-4d04-afdd-8ec937d93193 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1550 microversion: 2.1 time: 0.154605 Oct 11 02:22:26.343762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3535/7024] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:22:26 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:22:26.366450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:22:26.366968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:22:26.368959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:22:26.375646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:26.376152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:26.376609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:26.377322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:26.377798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:26.378245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:26.454849 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0618efbc-99ed-4f63-b6a7-0b562088596e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092197 Oct 11 02:22:26.455482 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3490/7025] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:22:26 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:22:27.381851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:22:27.392183 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:22:27.392743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:22:27.393245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:22:27.404171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] Creating event network-changed:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:22:27.409304 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-9fb7f555-a06c-4aeb-b742-a03791604fba req-6b1a40c4-cb5d-481d-8570-579b55df1a54 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031234 Oct 11 02:22:27.409985 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3536/7026] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:00.473389 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:00.474332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=34 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:00.475417 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:23:00.475593 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/action (ip 10.222.0.66) !!! Oct 11 02:23:00.480661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:00.482908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:00.491732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:00.492237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:00.492693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:00.493404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:00.493875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:00.494322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:00.522413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:00.527839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Old instance type m1.heat2, new instance type m1.heat {{(pid=120494) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:23:00.534201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:23:00.534636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:23:00.535122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:23:00.535576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:23:00.536003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:23:00.597608 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-097bdbad-1777-421c-b4d3-cd44e4119021 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/action" status: 202 len: 0 microversion: 2.1 time: 0.126229 Oct 11 02:23:00.598226 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3491/7027] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:23:00 2022] POST /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:23:00.604931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=9 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:00.605668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:00.606835 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:23:00.606963 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 (ip 10.222.0.66) !!! Oct 11 02:23:00.611636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:00.612346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:00.622279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:00.623319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:00.623783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:00.624486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:00.624945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:00.625407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:00.765432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:00.773440 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-00741955-880a-4aae-a077-7342565412b9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1676 microversion: 2.1 time: 0.170710 Oct 11 02:23:00.774016 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3537/7028] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:00 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:01.797638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:01.798271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:01.804952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:01.805447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:01.805894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:01.806589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:01.807139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:01.807610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:01.940262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:01.948371 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a6027ed-1717-4f90-88a8-2d7eb498ba7c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1676 microversion: 2.1 time: 0.155564 Oct 11 02:23:01.948966 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3492/7029] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:01 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:02.973078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:02.973701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:02.980514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:02.981007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:02.981452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:02.982789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:02.983250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:02.983709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:03.114733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:03.122475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38ffdbb7-363e-4242-81ab-6e20275c13c7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.153675 Oct 11 02:23:03.123074 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3538/7030] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:02 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:04.147219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:04.147885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:04.155278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:04.155807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:04.156262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:04.156967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:04.157436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:04.157877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:04.290461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:04.298204 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbec8c58-c5f3-4687-b3a2-90a2b632eae5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.154851 Oct 11 02:23:04.298782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3493/7031] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:04 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:05.321869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:05.322488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:05.329756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:05.330262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:05.330681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:05.331396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:05.331859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:05.332286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:05.461072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:05.469504 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be257874-c00a-4142-a94c-ae64ccbbd05b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.151555 Oct 11 02:23:05.470095 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3539/7032] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:05 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:06.493145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:06.493666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:06.501346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:06.501853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:06.502306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:06.503015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:06.503514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:06.503959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:06.641089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:06.648846 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26370a26-432a-48ec-bbc8-026d7316ec00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.159732 Oct 11 02:23:06.649430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3494/7033] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:06 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:07.672635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:07.673157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:07.679392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:07.679884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:07.680325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:07.681016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:07.681473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:07.681902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:07.807988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:07.815663 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1854eb83-14f8-40d1-b348-373105019170 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.147192 Oct 11 02:23:07.816248 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3540/7034] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:07 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:08.838759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:08.839417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:08.846406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:08.846906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:08.847377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:08.848084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:08.848584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:08.849029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:08.975395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:08.983738 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4560b215-d6ef-4379-8c00-178fdd8a7102 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.148804 Oct 11 02:23:08.984317 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3495/7035] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:08 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:10.007103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:10.007675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:10.014532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:10.015026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:10.015503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:10.016437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:10.016903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:10.017336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:10.148518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:10.156172 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-106bc8c5-764c-496f-8b15-861afc3adc35 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.153135 Oct 11 02:23:10.156749 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3541/7036] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:10 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:11.179973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:11.180608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:11.188022 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:11.188561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:11.189030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:11.189977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:11.190458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:11.190903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:11.320165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:11.327824 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3efcb821-4f5f-44f0-8a21-74d54ae13aa4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.152131 Oct 11 02:23:11.328397 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3496/7037] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:11 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:12.351235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:12.351822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:12.359249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:12.359774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:12.360224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:12.360926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:12.361388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:12.361819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:12.494681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:12.502393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-49921685-a5f9-4b15-981d-fb9b31e83aa0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.155207 Oct 11 02:23:12.502970 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3542/7038] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:12 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:13.525664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:13.526296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:13.533130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:13.533633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:13.534083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:13.534786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:13.535253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:13.535715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:13.665403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:13.673106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59215113-5c73-404b-ab15-79dc27119984 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.151340 Oct 11 02:23:13.673680 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3497/7039] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:13 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:14.696122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:14.696739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:14.704112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:14.704624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:14.705060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:14.705752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:14.706212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:14.706642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:14.836406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:14.846083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-85a0c823-abcb-4ca4-9288-109910667574 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.153442 Oct 11 02:23:14.846699 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3543/7040] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:14 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:15.870008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:15.870643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:15.878064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:15.878566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:15.879020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:15.879763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:15.880238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:15.880685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:16.006939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:16.014734 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78094e53-4250-4ce6-8e32-c7228f5900ee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.148641 Oct 11 02:23:16.015318 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3498/7041] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:15 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:17.038770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:17.039415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:17.045311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:17.045801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:17.046242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:17.046936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:17.047414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:17.047869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:17.183979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:17.192648 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a68d081e-b799-45f2-a94f-0358b068498a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.158714 Oct 11 02:23:17.193228 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3544/7042] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:17 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:23:18.217053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:18.217764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:18.224501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:18.225004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:18.225459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:18.226168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:18.226641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:18.227084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:18.358303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:18.366019 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ad52286-8feb-4b79-84e2-b08b2b39c0d4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1681 microversion: 2.1 time: 0.153307 Oct 11 02:23:18.366595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3499/7043] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:18 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:19.390110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:19.390659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:19.397559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:19.398046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:19.398486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:19.399212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:19.399928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:19.400370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:19.592952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:19.601000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e4c96197-e5ea-4b69-bb04-81280c74d525 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1680 microversion: 2.1 time: 0.215049 Oct 11 02:23:19.601584 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3545/7044] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:19 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:19.850429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "name": "network-vif-unplugged", "status": "completed", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:19.861094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:19.861726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:19.862140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:19.874587 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Creating event network-vif-unplugged:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h2-772273-9 Oct 11 02:23:19.880068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] Instance 0b27221e-2083-45bb-a78f-a78efa24b285 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:23:19.891237 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-88f20a09-5934-4e37-aaa3-51c65e958539 req-ab53eebe-0e68-4491-a2c6-af46c9f4934c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044415 Oct 11 02:23:19.892138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3500/7045] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:20.625134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:20.625820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:20.632843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:20.633341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:20.633789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:20.634510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:20.634974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:20.635437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:20.840663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:20.848776 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-560f30b1-96b2-485c-a73c-61e756eefa2e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1680 microversion: 2.1 time: 0.227736 Oct 11 02:23:20.849370 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3546/7046] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:20 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:21.873467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:21.874187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:21.880367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:21.880868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:21.881320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:21.882019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:21.882484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:21.882927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:21.907112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:21.917221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:21.917711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:21.918148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:21.929871 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Creating event network-changed:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h2-772273-9 Oct 11 02:23:21.935348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] Instance 0b27221e-2083-45bb-a78f-a78efa24b285 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:23:21.946403 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-05c66064-7596-406b-88b7-6a4697ceccb4 req-35764fa8-6c60-43cf-bb5f-ca71d2b646b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Oct 11 02:23:21.947154 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3547/7047] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:23:22.025868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:22.035514 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f1ae6e1-b4e5-43a4-8443-1c2c79e4cda0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1678 microversion: 2.1 time: 0.167186 Oct 11 02:23:22.036127 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3501/7048] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:21 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:23.060902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:23.061616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:23.068068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:23.068558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:23.069000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:23.069732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:23.070191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:23.070648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:23.201422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:23.209201 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8498c307-6360-42df-89d3-e96dae51a117 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1678 microversion: 2.1 time: 0.153623 Oct 11 02:23:23.209781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3548/7049] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:23 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:24.233429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:24.234051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:24.241731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.242232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.242682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.243417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.243883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.244315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.485066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:24.492909 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-43ada1cb-fd2d-431e-9aaf-d6d145457b18 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1675 microversion: 2.1 time: 0.264119 Oct 11 02:23:24.493495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3502/7050] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:24 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:24.515791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:24.516345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:24.523386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.523885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.524318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.525015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.525467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.525936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.563844 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.564330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.564771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.565534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.565995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.566422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.586268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:23:24.591936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:23:24.689936 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8df6744b-e4a4-4f94-a2aa-510b93c590dd tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/action" status: 202 len: 0 microversion: 2.1 time: 0.177893 Oct 11 02:23:24.690629 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3549/7051] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:23:24 2022] POST /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 02:23:24.698770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:24.699431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:24.705538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.706038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.706508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.707251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:24.707733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:24.708179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:24.902703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:24.911078 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c108d0b-1546-421f-aac0-5b2303b117f4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.216210 Oct 11 02:23:24.911718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3503/7052] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:24 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:25.935685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:25.936396 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:25.944237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:25.944771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:25.945161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:25.945850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:25.946304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:25.946730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:26.079156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:26.082884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:26.088011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-37e0d2cb-3547-401e-b9d9-40a97e3d4a3d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.157212 Oct 11 02:23:26.088610 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3550/7053] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:25 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:27.111061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:27.111736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:27.118447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:27.118949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:27.119439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:27.121052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:27.121919 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:27.122926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:27.268043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:27.276536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed388735-6c21-4f8f-9ea9-4bdf8bf481f5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.169912 Oct 11 02:23:27.277148 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3504/7054] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:27 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:28.301148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:28.301779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:28.309182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:28.309684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:28.310159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:28.311056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:28.311719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:28.312388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:28.464155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:28.473457 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-57cdf8dc-3d0c-476d-bc98-298ff8a9c89f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.176144 Oct 11 02:23:28.474038 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3551/7055] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:28 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:28.626321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:28.637264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:28.637755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:28.638315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:28.650021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Creating event network-changed:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:23:28.655450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] Instance 0b27221e-2083-45bb-a78f-a78efa24b285 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:23:28.667615 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-cb319824-f990-49a8-9fc2-6177760ea65a req-7e0de693-7808-4256-8492-ae34a5119868 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046506 Oct 11 02:23:28.668559 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3505/7056] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:29.497306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:29.497823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:29.504655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:29.505144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:29.505584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:29.506275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:29.506734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:29.507163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:29.635038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:29.643313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cc250094-1b33-4649-86e0-1de915eeee27 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.150033 Oct 11 02:23:29.643916 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3552/7057] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:29 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:30.667597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:30.668523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:30.671052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=35 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:30.677249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:30.678043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:30.678745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:30.679622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:30.680255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:30.680878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:30.687658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:30.833863 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:30.841657 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e375163-a70a-49d1-8042-4eb88c5a72fa tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1674 microversion: 2.1 time: 0.178664 Oct 11 02:23:30.842247 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3506/7058] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:30 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:31.867070 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:31.867707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:31.870370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:31.876347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:31.876837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:31.877304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:31.878002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:31.878460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:31.878886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.010857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:32.021979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ab4962e-5399-4028-91c5-5792d5660d54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1667 microversion: 2.1 time: 0.158799 Oct 11 02:23:32.022568 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3553/7059] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:31 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:32.044433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:32.045070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:32.052133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.052633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.053088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.053803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.054275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.054716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.187186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:32.194944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7bd4f991-f8b4-4a71-872d-dde912594a00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1667 microversion: 2.1 time: 0.154412 Oct 11 02:23:32.195563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3507/7060] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:32 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:32.217871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:32.218459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:32.224709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.225199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.225640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.226337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.226801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.227228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.356289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:32.364545 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f9826dbc-8f09-4f78-8a18-24df73c182db tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1667 microversion: 2.1 time: 0.150729 Oct 11 02:23:32.365133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3554/7061] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:32 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:32.387092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:32.387636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:32.393770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.394424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.394899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.395681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.396149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.396585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.424180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:23:32.498015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e37dbe7a-759d-4c43-8a1c-be7ee5d1fc58 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 204 len: 0 microversion: 2.1 time: 0.113968 Oct 11 02:23:32.499019 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3508/7062] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:23:32 2022] DELETE /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 02:23:32.507305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:32.507944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:32.513899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.514392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.514834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.515565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:32.516028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:32.516458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:32.642536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:32.650313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38a9bb37-bc53-47b6-b4b9-c166907ee14f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1673 microversion: 2.1 time: 0.147025 Oct 11 02:23:32.650893 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3555/7063] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:32 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:33.674020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:33.674737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:33.681543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:33.682043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:33.682491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:33.683197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:33.683692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:33.684134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:33.815742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:33.823510 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30dc7166-dae5-4d41-9406-91f1f20f5713 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1673 microversion: 2.1 time: 0.153710 Oct 11 02:23:33.824107 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3509/7064] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:33 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:34.063292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "name": "network-vif-plugged", "status": "completed", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:34.074428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:34.074921 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:34.075680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:34.088013 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] Creating event network-vif-plugged:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:23:34.093150 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c47b6bfd-259d-4a2a-80d4-bf9ee94b8fab req-099fb40f-bb7c-46d3-bd42-d590040a493a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034525 Oct 11 02:23:34.094037 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3556/7065] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:34.661042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b27221e-2083-45bb-a78f-a78efa24b285", "name": "network-vif-deleted", "tag": "522725ac-e0a6-4643-8374-141bd10d6e35"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:34.670977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:34.671508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:34.672137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:34.684484 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] Creating event network-vif-deleted:522725ac-e0a6-4643-8374-141bd10d6e35 for instance 0b27221e-2083-45bb-a78f-a78efa24b285 on n-h1-772273-9 Oct 11 02:23:34.689393 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0ee72f41-26ce-4e1e-ab70-3ccb32151f11 req-c5dd00fe-eda7-4b8a-87f9-8a5154516bda service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Oct 11 02:23:34.690008 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3510/7066] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:34.847969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:34.848685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:34.851699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:34.855485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:34.856198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:34.856648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:34.857356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:34.857877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:34.858313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:34.893413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:34.893902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:34.894341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:34.894789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lazy-loading 'fault' on Instance uuid 0b27221e-2083-45bb-a78f-a78efa24b285 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:23:34.936973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:34.944728 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c66bf11c-65ec-4c4b-a2c1-843e11c17635 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 200 len: 1328 microversion: 2.1 time: 0.102231 Oct 11 02:23:34.945311 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3557/7067] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:34 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:35.970468 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:35.971128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:35.977276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:35.977774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:35.978220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:35.978912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:35.979431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:35.979869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:35.992808 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 HTTP/1.1 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0b27221e-2083-45bb-a78f-a78efa24b285'} Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:23:35.994408 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-febee003-287c-4d49-a3a5-f376ab222218 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 404 len: 111 microversion: 2.1 time: 0.030869 Oct 11 02:23:35.999556 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3511/7068] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:35 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:23:36.013751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:36.015034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:36.022039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:36.022531 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:36.022976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:36.023718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:36.024185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:36.024613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:36.038332 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 HTTP/1.1 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0b27221e-2083-45bb-a78f-a78efa24b285'} Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:23:36.040039 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc5543ae-a4ed-415e-8166-3b4166c9e4c8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 404 len: 111 microversion: 2.1 time: 0.031750 Oct 11 02:23:36.044236 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3558/7069] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:36 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:23:36.089888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-511643145", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "0ac24a44-2325-4c9c-a353-919a01a2b810"}], "security_groups": [{"name": "tempest-securitygroup--1250482476"}], "key_name": "tempest-keypair-956746741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:36.194787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] validate_networks() for [('0ac24a44-2325-4c9c-a353-919a01a2b810', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:23:36.616004 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:23:36.616452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:23:36.616996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:23:36.617428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:23:36.617891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:23:36.626597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:36.627100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:36.627592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:36.628346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:36.628821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:36.629267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:36.645717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:23:36.650925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:23:36.663717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:23:36.666028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:23:36.712707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41b49f68-5f50-47f2-b91a-a3d309168f21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626662 Oct 11 02:23:36.713363 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3512/7070] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:23:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:23:36.725664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-21a8dcd8-ffae-4db4-bf50-8907ce8060a5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:36.726586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-21a8dcd8-ffae-4db4-bf50-8907ce8060a5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:36.780925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-21a8dcd8-ffae-4db4-bf50-8907ce8060a5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:36.788074 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-21a8dcd8-ffae-4db4-bf50-8907ce8060a5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1237 microversion: 2.1 time: 0.066543 Oct 11 02:23:36.788771 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3559/7071] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:36 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:37.811917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:37.812685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:37.819623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:37.820135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:37.820601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:37.821318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:37.821790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:37.822236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:37.925559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:37.934149 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fba71ca9-bb24-4796-807c-d0404f84e973 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1295 microversion: 2.1 time: 0.127091 Oct 11 02:23:37.934833 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3513/7072] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:37 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:38.958858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:38.959642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:38.967489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:38.967986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:38.968430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:38.969132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:38.969594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:38.970027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:39.119694 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:39.131889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:39.132624 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:39.133083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:39.145263 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] Creating event network-changed:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:23:39.150398 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8849f21c-fd86-4fad-939f-ec191d8b2066 req-e9c2f729-aec9-4fc8-aef2-b617a5c41a36 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034820 Oct 11 02:23:39.152420 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3514/7073] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:23:39.217545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:39.225621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3977f00c-aa2f-4976-bab5-48380d95f648 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.270663 Oct 11 02:23:39.226557 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3560/7074] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:38 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:40.250059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:40.250795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:40.257035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:40.257536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:40.257998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:40.258706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:40.259219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:40.259689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:40.386328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:40.394138 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b1477ef-166f-4fca-be36-2faadd344928 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.149194 Oct 11 02:23:40.394714 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3515/7075] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:40 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:41.418041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:41.418583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:41.425665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:41.426448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:41.426896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:41.427655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:41.428118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:41.428549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:41.556233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:41.564580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-649fbb8c-95ba-403d-882e-aaf5d432ddb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.150606 Oct 11 02:23:41.565162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3561/7076] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:41 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:42.588437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:42.588990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:42.596654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:42.597155 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:42.597609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:42.598321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:42.598794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:42.599239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:42.734548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:42.742320 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90f514da-b257-469e-857c-957256c7aa26 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.157875 Oct 11 02:23:42.742907 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3516/7077] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:42 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:43.765624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:43.766236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:43.773134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:43.773613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:43.774048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:43.775057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:43.775615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:43.776051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:43.911862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:43.919530 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ac9dc37-7982-4728-a9f5-dd64f0ec5a21 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.157812 Oct 11 02:23:43.920117 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3562/7078] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:43 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:44.942593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:44.943150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:44.949869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:44.950360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:44.950810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:44.951540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:44.952005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:44.952439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:45.084423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:45.092814 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46b82718-417c-42de-b86e-568573b4a505 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.153575 Oct 11 02:23:45.093395 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3517/7079] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:44 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:46.116103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:46.116723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:46.124166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:46.124657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:46.125105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:46.125805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:46.126271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:46.126701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:46.255791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:46.264043 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-20d830f0-a041-40ca-9ca5-65872d5f9790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.151774 Oct 11 02:23:46.264938 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3563/7080] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:46 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:46.485544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-plugged", "status": "completed", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:46.496324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:46.496817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:46.497255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:46.510094 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] Creating event network-vif-plugged:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:23:46.515622 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-564f8c5b-7cfc-4876-86d8-c5c26c9511b0 req-28289241-6604-43da-b413-a832774c715c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034042 Oct 11 02:23:46.516289 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3518/7081] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:47.288397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:47.289015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:47.290857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:47.297438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:47.297927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:47.298370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:47.299059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:47.299554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:47.299989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:47.439471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:47.447797 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bd6eb5f1-5c54-448a-a226-2ee53ab90e84 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1363 microversion: 2.1 time: 0.163186 Oct 11 02:23:47.448408 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3564/7082] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:47 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:48.469888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:48.470853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:23:48.475959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:48.476676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:48.483807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:48.484313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:48.484772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:48.485483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:48.485965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:48.486409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:48.647905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:23:48.656415 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92d7a262-a33c-404b-8e48-76efdc6a31a7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1549 microversion: 2.1 time: 0.187579 Oct 11 02:23:48.657005 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3519/7083] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:23:48 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:23:48.679453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:23:48.680098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:23:48.686992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:48.687511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:48.687955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:48.688660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:48.689120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:48.689724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:48.816338 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60b1cac5-3926-4603-acb7-6abc723cd8a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140735 Oct 11 02:23:48.816995 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3565/7084] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:23:48 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:23:50.126111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:23:50.136093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:23:50.136747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:23:50.137037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:23:50.148365 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] Creating event network-changed:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:23:50.153200 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4007dc41-6e15-420f-8192-ae03c7277ccc req-424cbe20-3cf6-49ce-af4c-e2f086138f3f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031295 Oct 11 02:23:50.153796 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3520/7085] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:25:03.705438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=29 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:03.706189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=76 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:03.707699 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:25:03.708129 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba (ip 10.222.0.66) !!! Oct 11 02:25:03.716147 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:03.716697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:03.728207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:03.728758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:03.729203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:03.729899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:03.730363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:03.730792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:03.867649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:03.872914 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1f9b21a0-4396-4736-90f0-58a8e03b5405 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1666 microversion: 2.1 time: 0.171100 Oct 11 02:25:03.873493 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3566/7086] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:03 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:03.895449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:03.896240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:03.901731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f060128-86c0-49ac-90c8-e6e0c0b09c06"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:03.905024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:03.913763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:03.914925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:03.914925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:03.915594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:03.916074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:03.916521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:04.164658 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-080d2314-ba58-405d-b0d7-9fb318b56c6b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271772 Oct 11 02:25:04.165512 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3521/7087] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:25:03 2022] POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:25:14.887865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:14.890215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:14.893137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:14.894181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:14.899728 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:14.900220 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:14.900660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:14.901355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:14.901813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:14.902246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:14.930331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:14.935672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Old instance type m1.heat2, new instance type m1.heat {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:25:14.943082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:25:14.943543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:25:14.944023 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:25:14.944431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:25:14.944845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:25:15.007417 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48cee08d-68d4-4af2-a5e3-9cffd4286790 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/action" status: 202 len: 0 microversion: 2.1 time: 0.123534 Oct 11 02:25:15.008041 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3567/7088] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:25:14 2022] POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:25:15.014475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:15.015610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:15.021387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:15.021578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:15.028371 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:15.029046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:15.029341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:15.030065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:15.030540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:15.030982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:15.173592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:15.182161 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62ba4270-32bf-45e8-8f5b-a1b691acdaf1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1721 microversion: 2.1 time: 0.169593 Oct 11 02:25:15.189865 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3522/7089] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:15 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:16.206882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:16.207433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:16.214331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:16.214821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:16.215257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:16.215973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:16.216428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:16.216857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:16.382342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:16.390970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7bba73c5-4714-4091-a11d-698c3900d046 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1721 microversion: 2.1 time: 0.188924 Oct 11 02:25:16.391590 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3568/7090] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:16 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:17.414328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:17.414880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:17.421775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:17.422307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:17.422764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:17.423536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:17.424014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:17.424458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:17.806020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:17.814301 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-824a86c2-9958-4c68-8536-830e063d12f7 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.404082 Oct 11 02:25:17.815472 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3523/7091] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:17 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:18.838912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:18.839562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:18.846566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:18.847045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:18.847520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:18.848211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:18.848662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:18.849085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:18.976765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:18.984981 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11f8943a-dfb2-48ff-bd0e-7ea60acf4de2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.150054 Oct 11 02:25:18.985552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3569/7092] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:18 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:20.008024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:20.008581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:20.015469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:20.015983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:20.016439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:20.017160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:20.018143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:20.018586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:20.148237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:20.156443 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a01cb39e-0e9e-40a9-b03c-e7cdf4eb2327 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.152438 Oct 11 02:25:20.157025 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3524/7093] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:20 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:21.180358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:21.180905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:21.187805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:21.188294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:21.188733 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:21.189951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:21.190408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:21.190840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:21.322099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:21.330370 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4d4bdf2b-0579-46af-ad0e-5533592bd564 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.154047 Oct 11 02:25:21.330960 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3570/7094] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:21 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:22.353832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:22.354412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:22.361235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:22.361741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:22.362199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:22.362910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:22.363403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:22.363849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:22.489819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:22.498216 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f6375ea-68cc-4982-ba4a-abb687ebe2c5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.148365 Oct 11 02:25:22.498782 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3525/7095] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:22 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:23.523096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:23.523776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:23.530521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:23.531014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:23.531487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:23.532189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:23.532649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:23.533080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:23.669423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:23.677680 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f2077f7d-5a95-4b19-8607-d7d02d7cefb8 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.159155 Oct 11 02:25:23.678262 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3571/7096] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:23 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:24.701264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:24.701803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:24.708642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:24.709149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:24.709606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:24.710321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:24.710795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:24.711239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:24.838169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:24.847195 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b8f90f45-ab57-464e-88c2-5bc94a0ed201 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.149544 Oct 11 02:25:24.847799 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3526/7097] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:24 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:25.871317 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:25.871962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:25.879631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:25.880120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:25.880563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:25.881261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:25.881902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:25.882338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:26.011743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:26.020171 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-01d24bbd-ba3e-447a-aec9-989791fc8c7e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.152741 Oct 11 02:25:26.020762 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3572/7098] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:25 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:27.043181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:27.043847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:27.050682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:27.051186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:27.051681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:27.052398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:27.052869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:27.053314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:27.181164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:27.189389 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b22057a0-a154-408f-8f08-40cb54d9e824 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.150150 Oct 11 02:25:27.189962 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3527/7099] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:27 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:28.213244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:28.213899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:28.221124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:28.221600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:28.222041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:28.222736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:28.223198 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:28.223660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:28.352402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:28.360661 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-60aedd10-be9a-4b89-9c42-b6e3961697d5 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.151377 Oct 11 02:25:28.361237 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3573/7100] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:28 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:29.384602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:29.385175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:29.391789 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:29.392299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:29.392792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:29.393516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:29.394106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:29.395195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:29.530544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:29.539446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7eeb340f-4e47-4613-9d67-64fbfe539bb4 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.158976 Oct 11 02:25:29.540024 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3528/7101] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:29 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:30.562309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:30.563238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:30.571427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:30.572093 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:30.572550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:30.573308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:30.573959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:30.574449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:30.709329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:30.718059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-063d6425-d40f-426a-8b56-18ef82ee6570 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1726 microversion: 2.1 time: 0.159814 Oct 11 02:25:30.718665 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3574/7102] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:30 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:31.438771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-unplugged", "status": "completed", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:31.450118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:31.450617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:31.451068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:31.463457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Creating event network-vif-unplugged:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h1-772273-9 Oct 11 02:25:31.468834 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:25:31.481233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e7d39a92-b58c-49e6-942a-6688e4ea8de7 req-18253e61-a5f8-401a-8840-3984ef341e4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046403 Oct 11 02:25:31.481856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3529/7103] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:25:31.742225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:31.742837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:31.749636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:31.750133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:31.750568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:31.751262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:31.751738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:31.752162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:31.885106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:31.894095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6178a0f-fcb5-4923-a90a-2005165b5877 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1725 microversion: 2.1 time: 0.156263 Oct 11 02:25:31.894716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3575/7104] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:31 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:32.918088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:32.918740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:32.926531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:32.927039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:32.927526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:32.928256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:32.928730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:32.929177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:33.060345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:33.068774 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0eedf14a-05b1-4112-aecd-7e8e784c2486 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.155097 Oct 11 02:25:33.069356 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3530/7105] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:32 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:33.518777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:33.529556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:33.530034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:33.530464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:33.542580 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Creating event network-changed:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h1-772273-9 Oct 11 02:25:33.547902 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:25:33.558549 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c4ec6f48-992a-46fb-ba67-d62461f6032e req-36c30049-0a83-42c4-bcf9-62d86c86678e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043559 Oct 11 02:25:33.559145 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3576/7106] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:25:34.092232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:34.093592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:34.101977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:34.102727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:34.103295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:34.104149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:34.104881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:34.105578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:34.244024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:34.252481 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a1f5ea5d-c845-4778-b1da-32f9864bea3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.164175 Oct 11 02:25:34.253069 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3531/7107] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:34 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:35.277861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:35.278656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:35.285015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:35.285446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:35.285891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:35.286600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:35.287062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:35.287530 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:35.429457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:35.438251 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3edf8600-069d-45ce-9626-e811b97c5715 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.165551 Oct 11 02:25:35.438861 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3577/7108] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:35 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:36.462739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:36.463302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:36.470392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:36.470899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:36.471381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:36.472713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:36.473193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:36.473641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:36.607045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:36.615504 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40aeecfb-f4cb-408d-9475-29e75db4c422 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.156832 Oct 11 02:25:36.616088 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3532/7109] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:36 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:37.638539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:37.639157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:37.645978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:37.646468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:37.646911 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:37.647629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:37.648091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:37.648520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:37.775697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:37.783893 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-721d210e-8159-406c-9831-b9b67831f147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.149481 Oct 11 02:25:37.784481 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3578/7110] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:37 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:38.807190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:38.807896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:38.814739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:38.815234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:38.816368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:38.817072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:38.817539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:38.817979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:38.943841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:38.952021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3370ee53-f282-4e81-9a30-a31b850b77a0 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.148725 Oct 11 02:25:38.952593 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3533/7111] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:38 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:39.976047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:39.976667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:39.983505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:39.983996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:39.984441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:39.985142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:39.985605 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:39.986037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:40.117744 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:40.126000 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3c14b14-7a25-422a-ab17-8bd166faa76a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.154431 Oct 11 02:25:40.126586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3579/7112] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:39 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:41.149020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:41.149654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:41.156491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:41.156993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:41.157449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:41.158158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:41.158631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:41.159071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:41.291448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:41.300675 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eaf67473-68e0-4d74-bb2b-ff3e0b6cdd3f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.155586 Oct 11 02:25:41.303128 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3534/7113] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:41 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:42.324615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:42.325135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:42.332035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:42.332521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:42.332958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:42.333647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:42.334108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:42.334534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:42.466049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:42.475039 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5aab8888-0ea1-4e0a-9393-a1a7c72a3c78 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.154474 Oct 11 02:25:42.475659 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3580/7114] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:42 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:43.499466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:43.500356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:43.508061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:43.508571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:43.509032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:43.509756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:43.510234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:43.510685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:43.640536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:43.649620 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c72224b8-a57d-4376-8be7-01d832236993 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1723 microversion: 2.1 time: 0.154239 Oct 11 02:25:43.650254 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3535/7115] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:43 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:44.672804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:44.673488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:44.680267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.680762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.681212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.681931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.682383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.682816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.816211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:44.826254 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5fc0d58f-2f89-467a-a7d2-2d473dea3e8e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1720 microversion: 2.1 time: 0.157407 Oct 11 02:25:44.826845 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3581/7116] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:44 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:44.850476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:44.851038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:44.857904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.858413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.858873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.859619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.860098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.860554 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.898650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.899144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.899623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.900367 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:44.900837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:44.901275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:44.920837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:25:44.927466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Getting quotas for user acb3807dd30a4a589ff771bfccbbb5ea and project f4a80521aa0b4dd2a956dbe7d12eccbb. Resources: {'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:25:44.991634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:45.032668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afee5b59-aff1-4cad-82b0-b58f0f1ecf11 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/action" status: 202 len: 0 microversion: 2.1 time: 0.186883 Oct 11 02:25:45.033656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3536/7117] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:25:44 2022] POST /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:25:45.042109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:45.042909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:45.048424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=35 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:45.050247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:45.050710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:45.051388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:45.052161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:45.052532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:45.053006 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:45.056609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:45.196200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:45.204625 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-39778e71-f38d-443b-916f-56d461bf0bb2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.166557 Oct 11 02:25:45.205219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3582/7118] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:45 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:46.228631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:46.229604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:46.232360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:46.239082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:46.239602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:46.240054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:46.240763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:46.241228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:46.241665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:46.371574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:46.381576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b54a733d-7563-48fa-b6e6-61ad424647ba tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.157508 Oct 11 02:25:46.382162 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3537/7119] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:46 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:46.744568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-plugged", "status": "completed", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:46.755416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:46.755968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:46.756407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:46.768280 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Creating event network-vif-plugged:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h1-772273-9 Oct 11 02:25:46.774082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:25:46.785700 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7afadb27-525e-4408-a4dc-4b26d64789e3 req-4163dfeb-e796-4308-b635-86bdac0c2d9b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044366 Oct 11 02:25:46.786338 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3583/7120] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:25:47.404966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:47.405733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:47.412539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:47.413219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:47.413762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:47.414492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:47.415053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:47.415630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:47.878498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:47.887260 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96495156-1057-4054-9659-abf6c1509afe tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.486229 Oct 11 02:25:47.887873 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3538/7121] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:47 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:48.911944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:48.912691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:48.918899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:48.919416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:48.919863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:48.920567 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:48.921031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:48.921462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:49.062324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:49.071105 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7b4d9f28-6013-4348-a66b-759953930e88 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.164600 Oct 11 02:25:49.071734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3584/7122] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:48 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:50.094630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:50.095276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:50.102970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:50.103599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:50.104068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:50.104796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:50.105283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:50.105788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:50.138193 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-unplugged", "status": "completed", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:50.149043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:50.149798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:50.150231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:50.162740 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Creating event network-vif-unplugged:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:25:50.168094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:25:50.181010 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0770af86-395c-4d1e-98a2-d505a9c80394 req-9a9a5f64-cf16-410c-b6ce-c46e40f4d54d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046860 Oct 11 02:25:50.181764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3585/7123] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:25:50.358631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:50.368122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d83e5b4c-b387-40a7-92d5-64b2b9f91775 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.277713 Oct 11 02:25:50.369096 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3539/7124] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:50 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:51.394562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:51.395268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:51.402154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:51.402638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:51.403079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:51.403801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:51.404256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:51.404689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:51.544650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:51.553403 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b3cd79c0-6821-4f66-8edd-e92775914000 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.163976 Oct 11 02:25:51.560634 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3586/7125] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:51 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:52.197193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:25:52.207471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:52.207967 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:52.208415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:52.220137 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Creating event network-changed:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:25:52.225471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:25:52.236191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f67d73be-8b83-4119-87cc-c1043bd5f66f req-9cc51bf6-af1a-435b-b445-dc1704b7c608 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043298 Oct 11 02:25:52.236886 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3540/7126] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:25:52.576661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:52.577960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:52.584876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:52.585538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:52.586136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:52.587009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:52.587502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:52.587929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:52.760457 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:52.772708 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-afb0cc81-7b47-44da-aa6d-a454b93eacbc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.198712 Oct 11 02:25:52.773573 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3587/7127] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:52 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:53.798337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:53.799073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:53.806377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:53.806900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:53.807383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:53.808126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:53.808659 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:53.809129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:53.957581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:53.966253 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e55302dd-ef2c-40e8-92b4-59790db35453 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.173167 Oct 11 02:25:53.966847 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3541/7128] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:53 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:54.990283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:54.990839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:54.997787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:54.998283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:54.998731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:54.999471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:54.999963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:55.000399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:55.205246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:55.214641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-612b9d68-d8d2-4ad8-8790-4de7f9e4954c tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.228408 Oct 11 02:25:55.223378 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3588/7129] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:54 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:56.239113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:56.239783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:56.244237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:25:56.248298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:56.248879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:56.249344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:56.250076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:56.250555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:56.251007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:56.388762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:56.397122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a4a7ad6-5b05-419a-b2d3-0d2e4a5ec487 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.161912 Oct 11 02:25:56.397696 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3542/7130] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:56 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:57.420757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:57.421382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:57.428464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:57.428960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:57.429403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:57.430100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:57.430564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:57.430997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:57.562737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:57.571584 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7d61705b-54fb-49f1-a886-261cc07fafee tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.154798 Oct 11 02:25:57.572207 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3589/7131] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:57 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:58.595736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:58.596379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:58.603226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:58.603849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:58.604260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:58.604978 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:58.605456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:58.605905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:58.777686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:58.785927 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b2c7df0-c8dc-4b5b-bf69-af2204d30b72 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.194453 Oct 11 02:25:58.786503 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3543/7132] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:58 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:25:59.809585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:25:59.810204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:25:59.817133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:59.817618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:59.818643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:59.819371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:25:59.819823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:25:59.820253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:25:59.949579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:25:59.957999 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c44b3ec-50c0-4864-9860-f8350109097e tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.152364 Oct 11 02:25:59.958586 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3590/7133] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:25:59 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:01.036729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:01.038018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:01.045048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:01.045555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:01.046014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:01.046734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:01.047216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:01.047702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:01.180101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:01.188659 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d03ed94-8a9f-4806-88fc-486f440dc8b3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.156008 Oct 11 02:26:01.189262 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3544/7134] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:01 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:02.212398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:02.213019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:02.220129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:02.220616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:02.221050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:02.221737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:02.222192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:02.222622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:02.354194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:02.362488 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e40c7786-36f5-4ae6-b379-db80a314f567 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.154594 Oct 11 02:26:02.363084 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3591/7135] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:02 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:03.386340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:03.386903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:03.393707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:03.394208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:03.394664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:03.395399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:03.395877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:03.396339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:03.528701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:03.537598 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d07c31bb-16f1-4f5c-9544-0ab028e8b51b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.154657 Oct 11 02:26:03.538187 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3545/7136] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:03 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:04.560970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:04.561594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:04.568483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:04.568980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:04.569456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:04.570157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:04.570618 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:04.571050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:04.706955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:04.717369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3042c723-8d44-4b5a-9fc2-7d61d298fb8a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1719 microversion: 2.1 time: 0.160343 Oct 11 02:26:04.718168 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3592/7137] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:04 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:05.741632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:05.742257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:05.749150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:05.749645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:05.750097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:05.750803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:05.751268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:05.751735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:05.884333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:05.892919 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b9b9c686-836b-4c3d-a03a-e94f2e7cc8e6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1712 microversion: 2.1 time: 0.155242 Oct 11 02:26:05.893495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3546/7138] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:05 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:05.916592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:05.917378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:05.924258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:05.924747 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:05.925217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:05.925949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:05.926412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:05.926863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.056319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:06.064589 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8538d6e4-dc99-43f2-a301-89fe5b7714a3 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1712 microversion: 2.1 time: 0.152198 Oct 11 02:26:06.065172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3593/7139] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:05 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:06.087764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:06.088400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:06.094638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.095143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.095638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.096352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.096824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.097275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.230461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:06.238895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cde8c56-3114-44b0-8f60-18744be010dc tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1712 microversion: 2.1 time: 0.155704 Oct 11 02:26:06.239568 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3547/7140] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:06 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:26:06.262141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:06.262568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:06.268696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.269192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.269635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.270333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.270792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.271221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.296918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:26:06.375908 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-822fceae-d805-4215-ae4a-c1985ab9fb7a tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 204 len: 0 microversion: 2.1 time: 0.117290 Oct 11 02:26:06.376897 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3594/7141] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:06 2022] DELETE /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:26:06.385857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:06.386481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:06.392560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.393073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.393533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.394254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:06.394731 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:06.395179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:06.528420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:06.537506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26d525c6-f945-4d6e-9669-2a824d47fa2f tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1718 microversion: 2.1 time: 0.154951 Oct 11 02:26:06.538082 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3548/7142] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:06 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:06.992969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-plugged", "status": "completed", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:07.006615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:07.007091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:07.007746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:07.033095 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] Creating event network-vif-plugged:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:26:07.039170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-579a508b-7a3b-4ffd-b2d4-59ec2977f20e req-4361ea9a-e191-4505-85bb-f04836fd0f98 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050990 Oct 11 02:26:07.039860 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3595/7143] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:26:07.560493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:07.561121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:07.568409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:07.568910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:07.569360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:07.570062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:07.570529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:07.570972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:07.701578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:07.710244 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55cdb5cf-90dd-4174-9cc2-ddc860f9e9f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1718 microversion: 2.1 time: 0.153549 Oct 11 02:26:07.710850 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3549/7144] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:07 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:08.736391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:08.737118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:08.745158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:08.746089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:08.746760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:08.747649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:08.748339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:08.748943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:08.821319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:08.830694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3048096a-3f38-4d1e-bcfb-ddaded963147 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1650 microversion: 2.1 time: 0.098974 Oct 11 02:26:08.831537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3596/7145] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:08 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1650 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:08.993593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f6ab48-48f1-49de-bec1-356ab53ea9ba", "name": "network-vif-deleted", "tag": "25821e79-aa60-4211-b65b-4e6602822f8c"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:09.008137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:09.008640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:09.009093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:09.022779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] Creating event network-vif-deleted:25821e79-aa60-4211-b65b-4e6602822f8c for instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba on n-h2-772273-9 Oct 11 02:26:09.028754 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a9d49d22-5e90-45da-afbc-3302002bb7fc req-d16c05a7-1663-441d-b1e0-d8ce0fcc88e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Oct 11 02:26:09.029839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3550/7146] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:09.854784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:09.855459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:09.863535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:09.864155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:09.864677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:09.865479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:09.866019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:09.866527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:09.940376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:09.951040 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5eb0d3e8-4719-4659-b70a-9beab416c273 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1368 microversion: 2.1 time: 0.100293 Oct 11 02:26:09.963712 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3597/7147] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:09 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:10.975131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:10.975824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:10.983018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:10.983576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:10.984041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:10.984771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:10.985250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:10.985698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:11.051692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:11.060033 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40dd1eea-a29f-434c-b7e4-faa09b9d2f49 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1368 microversion: 2.1 time: 0.089397 Oct 11 02:26:11.060610 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3551/7148] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:10 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:12.084303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:12.084836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:12.091816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:12.092300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:12.092735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:12.093432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:12.094153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:12.094576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:12.109831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:12.157977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:12.166941 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-efcd59e7-e0b3-4308-baea-b42284f783a9 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1368 microversion: 2.1 time: 0.086550 Oct 11 02:26:12.167566 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3598/7149] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:12 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:13.190028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:13.190673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:13.198172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:13.198683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:13.199236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:13.199876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:13.200360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:13.200808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:13.231726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:13.232233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:13.232963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:13.233434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lazy-loading 'fault' on Instance uuid 98f6ab48-48f1-49de-bec1-356ab53ea9ba {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:26:13.274077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb3807dd30a4a589ff771bfccbbb5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a80521aa0b4dd2a956dbe7d12eccbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:13.282471 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d6904a0-e956-43d3-9b20-1144ecb6005b tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 200 len: 1373 microversion: 2.1 time: 0.096423 Oct 11 02:26:13.283044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3552/7150] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:13 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:14.306235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:14.306764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:14.313890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:14.314391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:14.314826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:14.315582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:14.316114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:14.316690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:14.331380 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba HTTP/1.1 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '98f6ab48-48f1-49de-bec1-356ab53ea9ba'} Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:14.333090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:14.338624 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-324517b6-d2a8-49c8-b57c-277791ebb1f1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 404 len: 111 microversion: 2.1 time: 0.032860 Oct 11 02:26:14.339752 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3599/7151] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:14 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:14.398092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:14.400604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:14.407514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:14.408224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:14.408685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:14.409413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:14.409893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:14.410370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:14.414480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:14.424707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-volume_attachments HTTP/1.1 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '98f6ab48-48f1-49de-bec1-356ab53ea9ba'} Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:14.426707 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24a96c1b-26b2-47a3-8ad3-00980a7aa964 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035423 Oct 11 02:26:14.431205 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3553/7152] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:26:14 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.750954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.751514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.754504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:17.759761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.760276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.760724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.761434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.761899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.762337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.778267 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba HTTP/1.1 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '98f6ab48-48f1-49de-bec1-356ab53ea9ba'} Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.779932 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a339c9e4-8c75-4a15-81e1-a80bd71bcb00 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 404 len: 111 microversion: 2.1 time: 0.034413 Oct 11 02:26:17.784745 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3600/7153] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:17 2022] DELETE /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.793082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.793780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 98f6ab48-48f1-49de-bec1-356ab53ea9ba] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.798147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=36 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:17.803055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.803592 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.804046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.804768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.805234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.805672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.821572 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba HTTP/1.1 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '98f6ab48-48f1-49de-bec1-356ab53ea9ba'} Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.823158 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 98f6ab48-48f1-49de-bec1-356ab53ea9ba could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bbb29435-91ba-4d68-9c46-12bf32377e7d tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba" status: 404 len: 111 microversion: 2.1 time: 0.037127 Oct 11 02:26:17.827124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3554/7154] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:17 2022] GET /compute/v2.1/servers/98f6ab48-48f1-49de-bec1-356ab53ea9ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.835105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.835627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.841957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.842456 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.842941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.843982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.844445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.844878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.859244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 HTTP/1.1 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '0b27221e-2083-45bb-a78f-a78efa24b285'} Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.860894 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1718153e-0e16-4309-b6c0-837db4239878 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 404 len: 111 microversion: 2.1 time: 0.031752 Oct 11 02:26:17.865316 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3601/7155] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:17 2022] DELETE /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.873047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.873736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: 0b27221e-2083-45bb-a78f-a78efa24b285] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.879792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.880840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.881297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.882016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.882496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.882953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.897162 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 HTTP/1.1 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '0b27221e-2083-45bb-a78f-a78efa24b285'} Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.898734 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance 0b27221e-2083-45bb-a78f-a78efa24b285 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fca64393-658f-41aa-ad3c-f7110a259c54 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285" status: 404 len: 111 microversion: 2.1 time: 0.031048 Oct 11 02:26:17.904135 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3555/7156] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:17 2022] GET /compute/v2.1/servers/0b27221e-2083-45bb-a78f-a78efa24b285 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.908865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.909379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.915898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.916388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.916834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.917528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.918141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.918577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.933009 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 HTTP/1.1 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'd62e9f8f-9bfe-486e-b936-90ff1cdd0fc7'} Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.934574 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7561894-3f65-41d6-a9e6-18a2a83277a2 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 404 len: 111 microversion: 2.1 time: 0.031223 Oct 11 02:26:17.938922 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3602/7157] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:17 2022] DELETE /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.945657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.946375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.952577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.953079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.953536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.954246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.954723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.955171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.971928 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 HTTP/1.1 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'd62e9f8f-9bfe-486e-b936-90ff1cdd0fc7'} Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:17.973498 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39793fe2-bd44-4c50-84f7-c01af5f673e1 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7" status: 404 len: 111 microversion: 2.1 time: 0.033754 Oct 11 02:26:17.977501 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3556/7158] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:17 2022] GET /compute/v2.1/servers/d62e9f8f-9bfe-486e-b936-90ff1cdd0fc7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:17.984005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:17.984513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:17.990655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.991139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.991639 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:17.992346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:17.992808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:17.993243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:18.009965 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 HTTP/1.1 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c5e08bfc-2738-494f-8ed9-619cba9d7d39'} Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:18.012021 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2ffb17a9-d9a5-45a1-b705-9af35258b8f6 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 404 len: 111 microversion: 2.1 time: 0.035421 Oct 11 02:26:18.021349 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3603/7159] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:17 2022] DELETE /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:18.028386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:18.028634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [instance: c5e08bfc-2738-494f-8ed9-619cba9d7d39] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:18.034857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:18.035395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:18.035857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:18.036574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:18.037056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:18.037498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:18.052338 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] HTTP exception thrown: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Request method failure captured: Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 HTTP/1.1 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNLC_GNLPkokGsTAn0e9jVtAbrE6_MMs062jUD8yf7zDf5bN1Yfw7f--lCl96PgPtYJhFZugIUDT4XBfpiuSHtBCBGqqGATnW6mo0a4btBTUb5GnTBiSDHEhP_Webb2jHPUgPRyMRdGXL4gwm1fkNEf9yTyAJQAaO2x2qEtCVogjsNA Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f4a80521aa0b4dd2a956dbe7d12eccbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f4a80521aa0b4dd2a956dbe7d12eccbb Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerActionsTestJSON-1391624073 Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: acb3807dd30a4a589ff771bfccbbb5ea Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServerActionsTestJSON-1391624073-project Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'c5e08bfc-2738-494f-8ed9-619cba9d7d39'} Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:18.054088 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Returning 404 to user: Instance c5e08bfc-2738-494f-8ed9-619cba9d7d39 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4bba60c2-d126-4130-ad2e-f11b9b0b9769 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39" status: 404 len: 111 microversion: 2.1 time: 0.031603 Oct 11 02:26:18.058772 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3557/7160] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:18 2022] GET /compute/v2.1/servers/c5e08bfc-2738-494f-8ed9-619cba9d7d39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:18.064436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-41225803-5b29-4109-942b-17fc5f182656 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] Calling method '.version_select at 0x7f1134981e50>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:18.069383 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41225803-5b29-4109-942b-17fc5f182656 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [75a3c8cc-c55d-4764-a5f9-be303381d842] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:26:19.076517 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [None req-41225803-5b29-4109-942b-17fc5f182656 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] [75a3c8cc-c55d-4764-a5f9-be303381d842] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 39114. Oct 11 02:26:19.096869 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-41225803-5b29-4109-942b-17fc5f182656 tempest-ServerActionsTestJSON-1391624073 tempest-ServerActionsTestJSON-1391624073-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956746741" status: 202 len: 0 microversion: 2.1 time: 1.036445 Oct 11 02:26:19.097459 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3604/7161] 10.222.0.66 () {58 vars in 1218 bytes} [Tue Oct 11 02:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956746741 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:26:28.181512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:28.182285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:28.303737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367255663", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "1467e613-439d-44fe-9055-c21db76b81fb"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:28.359979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] validate_networks() for [('1467e613-439d-44fe-9055-c21db76b81fb', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:26:28.775901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:26:28.776423 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:26:28.777163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:26:28.777697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:26:28.778202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:26:28.787831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:28.788435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:28.788998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:28.789827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:28.790481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:28.790941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:28.808931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Getting quotas for project f2e42b4625d9457697ff44b1887d4e60. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:26:28.814449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Getting quotas for user d091032adcb84b44a2df0fd0d9fdc4c5 and project f2e42b4625d9457697ff44b1887d4e60. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:26:28.827912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:26:28.830330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:26:28.878349 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6bc4d2e2-b6eb-4501-9fac-14a1457fee23 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702453 Oct 11 02:26:28.883687 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3558/7162] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:26:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:26:28.888312 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=13 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:28.892803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1dcb65ca-f7cd-484d-a74d-6799044c3939 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:28.893437 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1dcb65ca-f7cd-484d-a74d-6799044c3939 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:28.964897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1dcb65ca-f7cd-484d-a74d-6799044c3939 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:28.972271 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1dcb65ca-f7cd-484d-a74d-6799044c3939 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1217 microversion: 2.1 time: 0.085765 Oct 11 02:26:28.987305 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3605/7163] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:28 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:29.997639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:29.998265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:30.005388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:30.006714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:30.007383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:30.008266 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:30.008890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:30.009492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:30.101112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:30.109722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1245129-4b27-4f95-b948-8d35dc676af9 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1277 microversion: 2.1 time: 0.117003 Oct 11 02:26:30.110916 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3559/7164] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:29 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:31.135716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:31.137254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:31.145601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:31.146106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:31.146554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:31.147306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:31.147988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:31.148587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:31.302299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:31.311610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cd02e17c-9475-4da9-b2ba-29e449c8e224 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.180738 Oct 11 02:26:31.312902 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3606/7165] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:31 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:31.484177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73673efa-466b-4e92-8a21-8535f4046d65", "tag": "186de3e9-ada6-4e3a-8bdf-b71f6121b563"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:31.495526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:31.496031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:31.496487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:31.509104 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] Creating event network-changed:186de3e9-ada6-4e3a-8bdf-b71f6121b563 for instance 73673efa-466b-4e92-8a21-8535f4046d65 on n-h1-772273-9 Oct 11 02:26:31.515860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e1a37ab3-e456-4a14-ab41-264ab74e9006 req-db09226a-c7b5-4c4d-bec8-b5cb75fe8188 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035425 Oct 11 02:26:31.516498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3560/7166] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:32.335651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:32.336268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:32.343118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:32.343889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:32.344334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:32.345041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:32.345495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:32.345907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:32.475897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:32.483666 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-965d7836-6243-418c-baf3-d25f552dd4bc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.152101 Oct 11 02:26:32.484260 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3607/7167] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:32 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:33.508292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:33.508923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:33.515087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:33.515616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:33.516070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:33.516775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:33.517240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:33.517681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:33.650047 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:33.657707 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b9b9cbd-5968-4b91-9146-195296e08b42 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.155269 Oct 11 02:26:33.658273 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3561/7168] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:33 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:34.681869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:34.682482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:34.689316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:34.689803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:34.690244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:34.690971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:34.691465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:34.691897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:34.821619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:34.829203 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0eb68737-47cc-49fe-9e98-290f61eb9e4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.151376 Oct 11 02:26:34.829909 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3608/7169] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:34 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:35.852872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:35.854060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:35.862193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:35.862700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:35.863149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:35.863885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:35.864354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:35.864791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:35.992668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:36.000361 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-943afc56-c8c6-4319-9f07-8c62b36140d0 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.151479 Oct 11 02:26:36.000935 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3562/7170] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:35 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:36.930483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73673efa-466b-4e92-8a21-8535f4046d65", "name": "network-vif-plugged", "status": "completed", "tag": "186de3e9-ada6-4e3a-8bdf-b71f6121b563"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:36.940975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:36.941459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:36.941950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:36.953112 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] Creating event network-vif-plugged:186de3e9-ada6-4e3a-8bdf-b71f6121b563 for instance 73673efa-466b-4e92-8a21-8535f4046d65 on n-h1-772273-9 Oct 11 02:26:36.958533 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4a92b660-62aa-4d14-b507-9723ec65b0a8 req-5c0dd3c7-6858-4a11-8122-fc43da445099 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Oct 11 02:26:36.959136 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3609/7171] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:37.024930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:37.025596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:37.032560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:37.033124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:37.033588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:37.034350 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:37.034851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:37.035296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:37.171428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:37.179132 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2783469-1d36-4b03-8e23-48a65c9cd4f1 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.159456 Oct 11 02:26:37.179743 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3563/7172] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:37 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:38.203694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:38.204704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:38.211007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:38.211542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:38.211990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:38.212691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:38.213153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:38.213585 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:38.349165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:38.356925 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-006d1dc8-faf0-41fc-ab28-6f8731c806be tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1317 microversion: 2.1 time: 0.159228 Oct 11 02:26:38.357484 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3610/7173] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:38 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:39.380755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:39.381398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:39.384265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:39.384983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:39.390853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:39.391379 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:39.391846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:39.392564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:39.393041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:39.393490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:39.529452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:39.537915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7641cdd-b3e3-4c7f-ab34-6b0b1b9bf5bd tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.161195 Oct 11 02:26:39.538520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3564/7174] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:39 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:39.598420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-10357627", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "1467e613-439d-44fe-9055-c21db76b81fb"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:39.606965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:39.652746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] validate_networks() for [('1467e613-439d-44fe-9055-c21db76b81fb', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:26:40.022516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:26:40.022936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:26:40.023436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:26:40.023847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:26:40.024261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:26:40.032995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:40.033473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:40.033912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:40.034629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:40.035106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:40.035584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:40.052128 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Getting quotas for project f2e42b4625d9457697ff44b1887d4e60. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:26:40.057275 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Getting quotas for user d091032adcb84b44a2df0fd0d9fdc4c5 and project f2e42b4625d9457697ff44b1887d4e60. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:26:40.069707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:26:40.072037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:26:40.117452 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6ff1fccc-e9e0-4637-a665-f057d3960cad tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522813 Oct 11 02:26:40.118180 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3611/7175] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:26:40.129976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df44803b-9fa9-4e39-8f51-c896ab57bf60 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:40.130769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df44803b-9fa9-4e39-8f51-c896ab57bf60 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:40.185623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df44803b-9fa9-4e39-8f51-c896ab57bf60 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:40.192576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df44803b-9fa9-4e39-8f51-c896ab57bf60 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1215 microversion: 2.1 time: 0.067229 Oct 11 02:26:40.195514 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3565/7176] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:40 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:41.215084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:41.215865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:41.225273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:41.225273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:41.225273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:41.225273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:41.225953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:41.226455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:41.290667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:41.299106 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-daebd0a6-7374-41df-b69c-bd84bbd0ed8e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1273 microversion: 2.1 time: 0.088750 Oct 11 02:26:41.299717 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3612/7177] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:41 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:42.321593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:42.322242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:42.329568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:42.330071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:42.330521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:42.331230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:42.331749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:42.332191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:42.422516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7202a8d-dfe0-4f36-80bb-b5d1969c366f", "tag": "6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:42.434705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:42.435674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:42.436294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:42.448743 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] Creating event network-changed:6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32 for instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f on n-h2-772273-9 Oct 11 02:26:42.453734 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3abb2043-98e3-451e-bc2f-c5466fc06ba5 req-c3726a7d-845a-4093-97ab-7861b333e81a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035529 Oct 11 02:26:42.454572 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3613/7178] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:26:42.480066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:42.487919 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eba07fde-119d-44ff-b634-68fe3bcb7bbf tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.170326 Oct 11 02:26:42.488500 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3566/7179] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:42 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:43.512289 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:43.512901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:43.519104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:43.519602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:43.520722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:43.521411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:43.521862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:43.522284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:43.649349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:43.656964 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5dd50e42-93cf-482b-a91f-99f4a8ce79b2 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.150012 Oct 11 02:26:43.657542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3614/7180] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:43 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:44.679689 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:44.680355 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:44.683525 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:26:44.683661 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f (ip 10.222.0.66) !!! Oct 11 02:26:44.691488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:44.692073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:44.692534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:44.693261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:44.693739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:44.694188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:44.822724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:44.831234 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d7dafb4-aa54-4c28-b605-7ae0b0300b09 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.155539 Oct 11 02:26:44.831853 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3567/7181] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:44 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:45.854098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:45.854724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:45.862188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:45.862675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:45.863114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:45.863842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:45.864320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:45.864798 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:45.999451 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:46.007818 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95bd7e0e-eed0-475d-8eb0-97342cb146d7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.157588 Oct 11 02:26:46.008418 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3615/7182] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:45 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:26:47.031297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:47.031971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:47.040581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:47.041096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:47.041558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:47.042284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:47.042896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:47.043368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:47.175645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:47.184176 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4514c31-c856-4fed-943e-2799aac5591a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.157677 Oct 11 02:26:47.184770 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3568/7183] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:47 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:48.208429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:48.208956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:48.211759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:48.217005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:48.217484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:48.217914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:48.218861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:48.219310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:48.219879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:48.353269 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:48.361038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-003972ab-6319-4467-82f5-4b8a00e42a7c tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.157167 Oct 11 02:26:48.361620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3616/7184] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:48 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:49.190157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7202a8d-dfe0-4f36-80bb-b5d1969c366f", "name": "network-vif-plugged", "status": "completed", "tag": "6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:49.200593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:49.201086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:49.201525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:49.215476 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] Creating event network-vif-plugged:6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32 for instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f on n-h2-772273-9 Oct 11 02:26:49.220926 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b216434c-b9a7-4020-b733-7643bad27ffd req-bc3b3a28-a762-4c3f-bf90-221663437b7e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Oct 11 02:26:49.221524 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3569/7185] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:49.384280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:49.384892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:49.391675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:49.392160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:49.392593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:49.393277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:49.393732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:49.394152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:49.522909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:49.530531 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7f8932b5-0a96-4145-980e-a73603b7c327 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.150193 Oct 11 02:26:49.531106 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3617/7186] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:49 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:50.554489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:50.555867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:50.559749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:50.564997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:50.565722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:50.566360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:50.567292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:50.567801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:50.568250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:50.721305 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:50.729721 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59d199ff-efba-44c1-80dc-f9a67ad8319d tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1315 microversion: 2.1 time: 0.179488 Oct 11 02:26:50.730307 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3570/7187] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:50 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:51.753090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:51.753608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:51.756007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:51.756882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:51.763052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:51.763583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:51.764025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:51.764715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:51.765172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:51.765600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:51.897326 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:51.905499 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6023e5b6-e548-4a5b-9475-01ef64894f8a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1505 microversion: 2.1 time: 0.156417 Oct 11 02:26:51.906110 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3618/7188] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:51 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:51.927989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:51.928541 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:51.935364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:51.935893 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:51.936351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:51.937068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:51.937546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:51.937992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:51.972922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:26:52.048266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e940c0e4-672f-422c-94ff-798368a02a4e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 204 len: 0 microversion: 2.1 time: 0.124454 Oct 11 02:26:52.048949 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3571/7189] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:51 2022] DELETE /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:26:52.057749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:52.058377 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:52.064644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:52.065129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:52.065571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:52.066264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:52.067390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:52.067827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:52.194693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:52.206589 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6a25c0f0-ae07-4e85-a14f-fea70f968f89 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1511 microversion: 2.1 time: 0.152524 Oct 11 02:26:52.207676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3619/7190] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:52 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:53.231660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:53.232421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:53.239892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:53.240399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:53.240859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:53.241568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:53.242044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:53.242490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:53.374610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:53.382440 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12ad3ef9-e959-450d-960a-e73da8039b39 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1511 microversion: 2.1 time: 0.155170 Oct 11 02:26:53.383030 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3572/7191] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:53 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:53.931500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7202a8d-dfe0-4f36-80bb-b5d1969c366f", "name": "network-vif-deleted", "tag": "6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:53.946500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:53.948826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:53.949604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:53.966399 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] Creating event network-vif-deleted:6b6ddb77-7461-46eb-b10e-9ad2f7dd9e32 for instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f on n-h2-772273-9 Oct 11 02:26:53.984935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b55482a5-ae8b-45b4-939c-94953acbcaab req-722ce941-2f57-48d8-9a40-cd31bfa20818 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057236 Oct 11 02:26:53.985570 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3620/7192] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:54.405569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:54.406136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:54.412842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:54.413334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:54.413781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:54.414482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:54.414954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:54.415417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:54.450086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:54.450597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:54.451065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:54.451576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lazy-loading 'fault' on Instance uuid e7202a8d-dfe0-4f36-80bb-b5d1969c366f {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:26:54.493244 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:54.501130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2d42322-13b2-4a24-a234-49958b3fa52a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 200 len: 1305 microversion: 2.1 time: 0.099599 Oct 11 02:26:54.501702 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3573/7193] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:54 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:55.525686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:55.526391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:55.532905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.533459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.533899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.534598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.535054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.536033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.549286 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f HTTP/1.1 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e7202a8d-dfe0-4f36-80bb-b5d1969c366f'} Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:55.551528 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 404 to user: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a05c18de-5a95-47f0-b009-db4475d5a4fe tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 404 len: 111 microversion: 2.1 time: 0.032436 Oct 11 02:26:55.558100 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3621/7194] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:55 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:55.562598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:55.563770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:55.570449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.570945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.571426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.572133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.572601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.573039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.698855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:55.706486 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80cc6acf-0feb-4a3c-b2f4-265120e98189 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.147902 Oct 11 02:26:55.707587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3574/7195] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:55 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:55.729863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:55.732171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:55.737900 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4/action HTTP/1.1 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 32 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: {"resize": {"flavorRef": "452"}} Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4', 'body': {'resize': {'flavorRef': '452'}}} Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:55.739499 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 404 to user: Instance c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47f99e1a-91ea-4173-94b9-13703e2c810e tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "POST /compute/v2.1/servers/c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4/action" status: 404 len: 111 microversion: 2.1 time: 0.015079 Oct 11 02:26:55.743604 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3622/7196] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:26:55 2022] POST /compute/v2.1/servers/c7d291d0-8367-42b4-ad3b-d4d90bf3d9f4/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:55.749419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:55.750051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:55.756051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.756574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.757010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.757724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.758198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.758642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.777711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:55.901684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:55.909443 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1de00f2-2b6e-4d59-baff-adb086a95423 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.163909 Oct 11 02:26:55.910019 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3575/7197] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:55 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:55.932994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:55.937625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:55.944044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.944526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.944956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:55.945638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:55.946089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:55.946529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.077212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:56.085071 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0bc8f13f-11e9-43b2-bc44-d160ed9cfecc tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.155913 Oct 11 02:26:56.085653 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3623/7198] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:55 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:56.108760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "89bc6580-1d57-4d00-af04-1eaccad852c7"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:56.111055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.117591 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.118084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.118532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.119233 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.119727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.120165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.158102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:56.163612 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action HTTP/1.1 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 65 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: {"resize": {"flavorRef": "89bc6580-1d57-4d00-af04-1eaccad852c7"}} Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: exception: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '73673efa-466b-4e92-8a21-8535f4046d65', 'body': {'resize': {'flavorRef': '89bc6580-1d57-4d00-af04-1eaccad852c7'}}} Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:56.165520 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 400 to user: Flavor 89bc6580-1d57-4d00-af04-1eaccad852c7 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a94addce-efb9-42d9-ac83-83300c9c910f tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action" status: 400 len: 107 microversion: 2.1 time: 0.062250 Oct 11 02:26:56.170442 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3576/7199] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:26:56 2022] POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 02:26:56.175676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.176843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.182853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.183370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.183820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.184521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.184985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.185418 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.316512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:56.324273 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a93446a5-2231-4b78-93cd-3e129387fd14 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.152408 Oct 11 02:26:56.324849 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3624/7200] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:56 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:56.347205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.348419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.354316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.354824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.355288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.356034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.356509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.356960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.487753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:56.495508 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0be06a1f-93f8-4327-a5de-b6295de2dc3b tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.152482 Oct 11 02:26:56.496115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3577/7201] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:56 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:56.517917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be5ae25-602e-4691-8c72-9ff28bc83b0a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be5ae25-602e-4691-8c72-9ff28bc83b0a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: request: POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action HTTP/1.1 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 29 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: {"resize": {"flavorRef": ""}} Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '73673efa-466b-4e92-8a21-8535f4046d65', 'body': {'resize': {'flavorRef': ''}}} Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise error Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi '' Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.522082 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9be5ae25-602e-4691-8c72-9ff28bc83b0a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9be5ae25-602e-4691-8c72-9ff28bc83b0a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action" status: 400 len: 113 microversion: 2.1 time: 0.009692 Oct 11 02:26:56.527716 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3625/7202] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:26:56 2022] POST /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 02:26:56.532045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.532675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.539227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.539758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.540213 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.540927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.541399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.541839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.667414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:56.675198 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00ebe581-f6f9-4ecd-b75e-caa2fb3e9205 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1506 microversion: 2.1 time: 0.147170 Oct 11 02:26:56.675801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3578/7203] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:56 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:56.701338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.701832 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.709453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.709917 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.710349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.711032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.711522 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.711946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.725482 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f HTTP/1.1 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'e7202a8d-dfe0-4f36-80bb-b5d1969c366f'} Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:56.727007 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 404 to user: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0f082ea2-36e2-405e-83bb-04797281a510 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 404 len: 111 microversion: 2.1 time: 0.031827 Oct 11 02:26:56.731839 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3626/7204] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:56 2022] DELETE /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:56.736887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.737527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: e7202a8d-dfe0-4f36-80bb-b5d1969c366f] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.743412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.743927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.744390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.745105 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.745582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.746030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.759631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f HTTP/1.1 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'e7202a8d-dfe0-4f36-80bb-b5d1969c366f'} Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:26:56.761180 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 404 to user: Instance e7202a8d-dfe0-4f36-80bb-b5d1969c366f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c3843af-5bfd-47a3-aeef-099268319ed7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f" status: 404 len: 111 microversion: 2.1 time: 0.029626 Oct 11 02:26:56.765480 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3579/7205] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:56 2022] GET /compute/v2.1/servers/e7202a8d-dfe0-4f36-80bb-b5d1969c366f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:26:56.771682 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.772647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.778528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.779008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.779472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.780155 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.780607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.781059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.806189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:26:56.833048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=100 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:56.881467 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e6a89873-241f-4762-a9b0-201abb559c99 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "DELETE /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 204 len: 0 microversion: 2.1 time: 0.113903 Oct 11 02:26:56.882133 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3627/7206] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:26:56 2022] DELETE /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:26:56.890677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:56.891324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:56.897260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.897765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.898226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:56.898941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:56.899459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:56.899909 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:57.033340 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:57.041849 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8564baee-0067-4e19-b337-788c9bc83e96 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1512 microversion: 2.1 time: 0.155185 Oct 11 02:26:57.042426 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3580/7207] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:56 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:58.067641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:58.068325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:58.074988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:58.075502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:58.075941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:58.076634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:58.077094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:58.077520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:58.207882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:58.215690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e82cef7-9a38-4274-8e3c-f77ddbf8f8a7 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1512 microversion: 2.1 time: 0.153258 Oct 11 02:26:58.216282 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3628/7208] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:58 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:26:58.825520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73673efa-466b-4e92-8a21-8535f4046d65", "name": "network-vif-deleted", "tag": "186de3e9-ada6-4e3a-8bdf-b71f6121b563"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:26:58.831193 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:26:58.837414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:58.837917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:58.838583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:58.853405 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] Creating event network-vif-deleted:186de3e9-ada6-4e3a-8bdf-b71f6121b563 for instance 73673efa-466b-4e92-8a21-8535f4046d65 on n-h1-772273-9 Oct 11 02:26:58.858831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4cfcb9f0-ca91-41d2-a9ed-80fbb5017fa5 req-3d20158f-5f06-41dc-b0e3-c6695619c3cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037052 Oct 11 02:26:58.859762 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3581/7209] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:26:59.239750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:26:59.240432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:26:59.247851 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:59.248372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:59.248814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:59.249578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:59.250038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:59.250465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:59.281886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:26:59.282359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:26:59.282799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:26:59.283251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lazy-loading 'fault' on Instance uuid 73673efa-466b-4e92-8a21-8535f4046d65 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:26:59.328994 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd091032adcb84b44a2df0fd0d9fdc4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e42b4625d9457697ff44b1887d4e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:26:59.336103 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a0edbbb7-d37d-4086-b0d3-2535511566f4 tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 200 len: 1307 microversion: 2.1 time: 0.101204 Oct 11 02:26:59.336721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3629/7210] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:26:59 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:00.361255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:00.361974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] [instance: 73673efa-466b-4e92-8a21-8535f4046d65] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:00.368600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:00.369097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:00.369549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:00.370253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:00.370721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:00.371159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:00.384891 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] HTTP exception thrown: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Request method failure captured: Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 HTTP/1.1 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNRUCZHIZHR0V7Ov6kM5oHfq4jRmZV2K5Aehp7sGL6TPCJo4VIgLYl4n9o_JjdzM5f8-jkuP6afeGmss3uxSjCkwRFrdXgPxFuig0CFVOvGdeyBbeqG_0XeKEPZ5E3NckFAnjpyVFLs1yfUiEBZDrplWptt2BffUoQehS4weDRs3BDU Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f2e42b4625d9457697ff44b1887d4e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: f2e42b4625d9457697ff44b1887d4e60 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272347659 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: d091032adcb84b44a2df0fd0d9fdc4c5 Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-ServersNegativeTestJSON-272347659-project Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '73673efa-466b-4e92-8a21-8535f4046d65'} Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:27:00.386513 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] Returning 404 to user: Instance 73673efa-466b-4e92-8a21-8535f4046d65 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aba58964-1bef-40c6-a16b-c0e869e3498a tempest-ServersNegativeTestJSON-272347659 tempest-ServersNegativeTestJSON-272347659-project] 10.222.0.66 "GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65" status: 404 len: 111 microversion: 2.1 time: 0.032106 Oct 11 02:27:00.391111 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3582/7211] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:00 2022] GET /compute/v2.1/servers/73673efa-466b-4e92-8a21-8535f4046d65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:27:31.339405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:31.341945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:31.545982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c5d95f31-7a08-4f2c-b6ba-7aeca7a57eb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: .version_select at 0x7f11388b49d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-533867930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwLirFBIe/lXSDwNkJ6ZsBcvo6iGSj+Zv1uQmMR3hgXJGjABqitkWN6nTTdgMe6+om3kt3jFde2wnaMq5Cu2idTu78IMDvpTBX3o2mTqCSBNHo1l2D7/KTkCJhZLn501g=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:27:31.561960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c5d95f31-7a08-4f2c-b6ba-7aeca7a57eb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:27:31.567836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-c5d95f31-7a08-4f2c-b6ba-7aeca7a57eb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:27:31.594817 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c5d95f31-7a08-4f2c-b6ba-7aeca7a57eb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260803 Oct 11 02:27:31.595589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3630/7212] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:27:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:31.648641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-799669684", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-533867930", "networks": [{"uuid": "2de4a64f-1a15-4721-a4cf-006a3bc14b45"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:27:31.657705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:31.658384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=30 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:31.705836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] validate_networks() for [('2de4a64f-1a15-4721-a4cf-006a3bc14b45', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:27:32.090184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:27:32.090868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:27:32.091377 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:27:32.091808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:27:32.092433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:27:32.102476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:32.102981 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:32.103473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:32.104220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:32.104701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:32.105146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:32.122952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:27:32.128265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:27:32.140913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:27:32.143281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:27:32.192697 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af5fd2e1-b064-4c5d-bc38-7ddcd1b66962 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548962 Oct 11 02:27:32.193360 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3583/7213] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:27:32.215254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5914ac7d-3455-4b38-9577-4d1284f8de31 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:32.215942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5914ac7d-3455-4b38-9577-4d1284f8de31 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:32.275356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5914ac7d-3455-4b38-9577-4d1284f8de31 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:32.282446 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5914ac7d-3455-4b38-9577-4d1284f8de31 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1261 microversion: 2.1 time: 0.078407 Oct 11 02:27:32.283243 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3631/7214] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:32 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:33.308100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:33.308664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:33.322798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:33.323709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:33.324352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:33.326695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:33.327412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:33.328024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:33.407587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:33.418367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52575f56-779f-441d-8004-6464e44c8809 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1331 microversion: 2.1 time: 0.115717 Oct 11 02:27:33.419614 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3584/7215] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:33 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:34.444788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:34.446061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:34.460668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:34.461267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:34.461787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:34.462568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:34.463130 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:34.463658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:34.644408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:34.653102 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15d4bb27-53e9-438d-bc7b-ff83612ea024 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.214507 Oct 11 02:27:34.653851 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3632/7216] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:34 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:34.804977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a31be8d-940d-47a2-a4f9-380e6259d0e2", "tag": "af574d40-5456-4776-9467-9a336f5a5009"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:27:34.815996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:34.816691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:34.817313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:34.829804 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] Creating event network-changed:af574d40-5456-4776-9467-9a336f5a5009 for instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 on n-h1-772273-9 Oct 11 02:27:34.835646 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7222b57e-ab48-477d-b5d9-0c0b820b9162 req-23ed4fec-9a4e-44aa-b4f6-526d3fd2341f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108591 Oct 11 02:27:34.836616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3585/7217] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:27:35.677689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:35.678318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:35.685182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:35.685674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:35.686119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:35.686818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:35.687282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:35.687743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:35.813526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:35.821737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ce63d65-2f69-4ef2-96e7-97fb2c2bc1d6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.148508 Oct 11 02:27:35.822358 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3633/7218] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:35 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:36.846086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:36.847296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:36.853600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:36.854102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:36.854558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:36.855273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:36.855776 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:36.856217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:36.993492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:37.001092 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a5283da-7bc0-434c-87e5-035be79a5dc0 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.160442 Oct 11 02:27:37.001661 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3586/7219] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:36 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:38.024426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:38.025115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:38.031399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:38.031896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:38.032337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:38.033146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:38.033603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:38.034051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:38.163814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:38.171519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1de471cb-6bc7-4c61-a0d8-4b9eacc3576d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.151196 Oct 11 02:27:38.172098 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3634/7220] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:38 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:39.194384 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:39.194956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:39.201802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:39.202314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:39.202774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:39.203523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:39.204003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:39.204449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:39.329743 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a31be8d-940d-47a2-a4f9-380e6259d0e2", "name": "network-vif-plugged", "status": "completed", "tag": "af574d40-5456-4776-9467-9a336f5a5009"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:27:39.343008 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:39.343534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:39.343973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:39.355863 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] Creating event network-vif-plugged:af574d40-5456-4776-9467-9a336f5a5009 for instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 on n-h1-772273-9 Oct 11 02:27:39.356528 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:39.361313 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-246c888c-b0f5-4d06-8465-de5d428babfe req-72a58239-1933-481f-ab59-33651be16b7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100936 Oct 11 02:27:39.362239 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3635/7221] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:27:39.366022 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba2eb9c3-d7a2-46e4-a9a3-a8cce120a81f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.175617 Oct 11 02:27:39.366627 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3587/7222] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:39 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:40.391246 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:40.391978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:40.398285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:40.398781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:40.399215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:40.399961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:40.400411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:40.400833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:40.532648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:40.540489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e5da50b-34f8-45e2-a56d-9250a3f5d7e7 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1361 microversion: 2.1 time: 0.154485 Oct 11 02:27:40.541005 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3636/7223] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:40 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:41.563540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:41.564185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:41.570958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:41.571491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:41.571949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:41.572662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:41.573132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:41.573581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:41.700130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:41.708025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-799a1d5d-873b-46d2-954b-c78b1fe5d430 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1553 microversion: 2.1 time: 0.148525 Oct 11 02:27:41.709124 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3588/7224] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:41 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:41.731701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:41.732324 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:41.739253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:41.739804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:41.740244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:41.740936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:41.741391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:41.741818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:41.872508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:27:41.880210 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-95312446-50b5-4cfc-909a-53fd71df4f95 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1553 microversion: 2.1 time: 0.152464 Oct 11 02:27:41.880795 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3637/7225] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:27:41 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:27:43.523003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe7ebb6e-88a1-41ad-aa3c-269dd8471733"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:27:43.525411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:43.527438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:43.528113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:43.534950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:43.535471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:43.535921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:43.536925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:43.537280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:43.537519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:43.776477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-990e52e2-80ab-43dc-967c-df3ebfc4c3dd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257880 Oct 11 02:27:43.777098 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3589/7226] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:27:43 2022] POST /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:54.494200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:54.494693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:54.496797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:54.498754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:54.499569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=32 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:54.507691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:54.508310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:54.508764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:54.509472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:54.509936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:54.510372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:54.591371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lazy-loading 'services' on Instance uuid 5a31be8d-940d-47a2-a4f9-380e6259d0e2 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:27:54.667006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c250308d-d668-45c1-b15b-b692677852c6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments/fe7ebb6e-88a1-41ad-aa3c-269dd8471733" status: 202 len: 0 microversion: 2.1 time: 0.176655 Oct 11 02:27:54.667666 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3638/7227] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:27:54 2022] DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments/fe7ebb6e-88a1-41ad-aa3c-269dd8471733 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:27:54.674021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:54.674996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:27:54.680249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:54.683852 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:54.698126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:54.698996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:54.699701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:54.700998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:54.701639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:54.702197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:54.734886 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3223eaf5-127a-4608-96af-7c1af5ed7e9d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062600 Oct 11 02:27:54.735496 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3590/7228] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:54 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:55.749046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:55.751652 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:55.758415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:55.758910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:55.759362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:55.760104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:55.760558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:55.761075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:55.792011 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-edb88537-9def-4cbb-b4bc-ea323edefe64 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048233 Oct 11 02:27:55.792600 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3639/7229] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:55 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:56.808346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:56.811387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:56.818425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:56.818929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:56.819414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:56.820138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:56.820612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:56.821064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:56.853220 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2b0e5ee-6fbd-4900-9b60-d3330a5a9da5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052218 Oct 11 02:27:56.858095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3591/7230] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:56 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:27:57.865547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:57.867833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:57.874656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:57.875150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:57.875621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:57.876334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:57.876771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:57.877196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:57.907808 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a5debc0b-fe14-4e6e-81bd-5b3e25dd21aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046770 Oct 11 02:27:57.908383 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3640/7231] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:57 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:58.921157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:58.923534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:58.930535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:58.931031 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:58.931509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:58.932220 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:58.932684 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:58.933121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:58.962669 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e298faa-52a5-4442-8972-6940658fcf46 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Oct 11 02:27:58.963246 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3592/7232] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:58 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:27:59.975624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:27:59.977815 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:27:59.984588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:59.985071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:59.985510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:27:59.986203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:27:59.986654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:27:59.987079 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:00.016590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-314d9d67-5749-46b7-b19d-5ce6d6b9d61d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045493 Oct 11 02:28:00.017172 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3641/7233] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:27:59 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:28:00.028071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:00.028580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:00.035500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:00.036518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:00.036979 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:00.037702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:00.038173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:00.038622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:00.118560 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 is not attached to volume fe7ebb6e-88a1-41ad-aa3c-269dd8471733 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments/fe7ebb6e-88a1-41ad-aa3c-269dd8471733 HTTP/1.1 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 is not attached to volume fe7ebb6e-88a1-41ad-aa3c-269dd8471733 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'server_id': '5a31be8d-940d-47a2-a4f9-380e6259d0e2', 'id': 'fe7ebb6e-88a1-41ad-aa3c-269dd8471733'} Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fe7ebb6e-88a1-41ad-aa3c-269dd8471733. Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 is not attached to volume fe7ebb6e-88a1-41ad-aa3c-269dd8471733 Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:00.141115 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 is not attached to volume fe7ebb6e-88a1-41ad-aa3c-269dd8471733 Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 is not attached to volume fe7ebb6e-88a1-41ad-aa3c-269dd8471733 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-694125f6-5386-4470-881f-9bf8e3a6ceb3 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments/fe7ebb6e-88a1-41ad-aa3c-269dd8471733" status: 404 len: 154 microversion: 2.1 time: 0.118802 Oct 11 02:28:00.145477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3593/7234] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:28:00 2022] DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2/os-volume_attachments/fe7ebb6e-88a1-41ad-aa3c-269dd8471733 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:28:03.495791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:03.496367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:03.503446 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:03.503949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:03.504926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:03.505666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:03.506129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:03.506562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:03.533925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:28:03.612576 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2f3d9bfe-9a24-42f7-8187-db6a4adbd3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 204 len: 0 microversion: 2.1 time: 0.120369 Oct 11 02:28:03.616549 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3642/7235] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:28:03 2022] DELETE /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 02:28:03.621746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:03.622434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:03.629245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:03.630283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:03.630748 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:03.631498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:03.631983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:03.632432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:03.768075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:03.777058 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a923c9ef-5af8-4905-b175-41acdb4e9a89 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1559 microversion: 2.1 time: 0.159219 Oct 11 02:28:03.777654 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3594/7236] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:03 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:28:04.801013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:04.802219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:04.809156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:04.809643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:04.810087 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:04.810778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:04.811236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:04.811695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:04.947616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:04.955485 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7a242192-26e5-4979-afe9-e8214067863b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1559 microversion: 2.1 time: 0.158809 Oct 11 02:28:04.956275 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3643/7237] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:04 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:05.980030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:05.980555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:05.989008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:05.989527 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:05.989996 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:05.990729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:05.991207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:05.991703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:05.996758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a31be8d-940d-47a2-a4f9-380e6259d0e2", "name": "network-vif-deleted", "tag": "af574d40-5456-4776-9467-9a336f5a5009"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:06.010372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:06.011445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:06.012546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:06.034184 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] Creating event network-vif-deleted:af574d40-5456-4776-9467-9a336f5a5009 for instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 on n-h1-772273-9 Oct 11 02:28:06.039654 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7d963517-b615-4a11-b97a-d82ae71185c3 req-29543198-98d5-4f0e-b7ec-719152cfc5eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Oct 11 02:28:06.040852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3644/7238] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:28:06.063576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:06.072479 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c2e8fe0-ae14-4b8f-97fc-d17aa7ee82b4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 200 len: 1517 microversion: 2.1 time: 0.096674 Oct 11 02:28:06.073065 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3595/7239] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:05 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 1517 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:07.097243 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:07.097859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 5a31be8d-940d-47a2-a4f9-380e6259d0e2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:07.104247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:07.104742 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:07.105182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:07.105882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:07.106340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:07.106771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:07.121559 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 HTTP/1.1 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '5a31be8d-940d-47a2-a4f9-380e6259d0e2'} Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:07.123208 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance 5a31be8d-940d-47a2-a4f9-380e6259d0e2 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8788e006-87ad-4868-b59c-fbcec4a607bd tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2" status: 404 len: 111 microversion: 2.1 time: 0.032282 Oct 11 02:28:07.128519 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3645/7240] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:07 2022] GET /compute/v2.1/servers/5a31be8d-940d-47a2-a4f9-380e6259d0e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:28:07.135675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42160082-7e7a-4dd8-b98e-f42e2efb7c06 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '.version_select at 0x7f113402ff70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:07.160390 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42160082-7e7a-4dd8-b98e-f42e2efb7c06 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-533867930" status: 202 len: 0 microversion: 2.1 time: 0.028641 Oct 11 02:28:07.161076 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3596/7241] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-533867930 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:28:07.175988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d849bfa9-8616-4012-8d06-7ff10e62f382 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: .version_select at 0x7f1138911a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-74793137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEjNxXRq6vuJ8m/1laEisBSQEaDO/SydUT5FFERhlpATynV3gMrxhYuoaE/cbIi5bcNpr8hkNW/A0D4HerYFy/Ioh5ZCPo634g5jhoT1Lp7HX48+SIzx5k0CT5DtDrlwg=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:07.191888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d849bfa9-8616-4012-8d06-7ff10e62f382 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:28:07.197831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-d849bfa9-8616-4012-8d06-7ff10e62f382 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:28:07.220393 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d849bfa9-8616-4012-8d06-7ff10e62f382 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048438 Oct 11 02:28:07.220997 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3646/7242] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:28:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:07.272721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-852330076", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-74793137", "networks": [{"uuid": "2de4a64f-1a15-4721-a4cf-006a3bc14b45"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:07.326551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] validate_networks() for [('2de4a64f-1a15-4721-a4cf-006a3bc14b45', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:28:07.697189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:28:07.697629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:28:07.698118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:28:07.698540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:28:07.698992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:28:07.708124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:07.708628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:07.709071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:07.709813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:07.710278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:07.710711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:07.728121 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:28:07.733385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:28:07.745211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:28:07.747525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:28:07.793788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-daa2fd52-8981-4c35-b168-cff8822c2fb6 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524957 Oct 11 02:28:07.794441 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3597/7243] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:28:07.805738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0781883b-01d6-44ab-b1ad-6b2a2a9a14d9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:07.806357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0781883b-01d6-44ab-b1ad-6b2a2a9a14d9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:07.862181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0781883b-01d6-44ab-b1ad-6b2a2a9a14d9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:07.870250 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0781883b-01d6-44ab-b1ad-6b2a2a9a14d9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1260 microversion: 2.1 time: 0.068510 Oct 11 02:28:07.870852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3647/7244] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:07 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:08.894111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:08.895951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:08.902612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:08.903128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:08.903616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:08.904346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:08.904824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:08.905272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:08.975511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:08.983761 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-add92173-ba3a-45c9-9ebd-adc9c90b192c tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1320 microversion: 2.1 time: 0.094474 Oct 11 02:28:08.984350 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3598/7245] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:08 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1320 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:10.007619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:10.008249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:10.015189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:10.015734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:10.016187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:10.016899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:10.017362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:10.017795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:10.147149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:10.154888 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-531640a9-0549-407e-9b6c-22af204c931f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.151212 Oct 11 02:28:10.155499 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3648/7246] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:10 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:10.207459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f332d8f-c72b-4b7d-8f71-faa70d86006d", "tag": "fde1d7c2-2d4b-4db5-a768-86e0e2296161"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:10.221618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:10.222511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:10.222643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:10.234950 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] Creating event network-changed:fde1d7c2-2d4b-4db5-a768-86e0e2296161 for instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d on n-h1-772273-9 Oct 11 02:28:10.239896 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4dd96ba9-b243-431d-86a0-a8794b8f8de5 req-08a6d4bb-12ee-4a8e-a320-746e7a24f317 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036480 Oct 11 02:28:10.240520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3599/7247] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:11.178277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:11.178899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:11.185867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:11.186353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:11.186797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:11.187526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:11.187984 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:11.188412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:11.318709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:11.326505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6dd58019-9f02-4ea6-a80f-d9a78ab9399f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.152274 Oct 11 02:28:11.327081 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3649/7248] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:11 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:12.351255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:12.352020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:12.358225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:12.358729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:12.359189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:12.359935 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:12.360442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:12.360891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:12.492159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:12.499942 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-807c3d4a-3e68-4e7b-852a-075fed36672f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.154509 Oct 11 02:28:12.500532 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3600/7249] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:12 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:13.523420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:13.524043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:13.530974 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:13.531510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:13.531952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:13.532650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:13.533110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:13.533545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:13.662016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:13.670098 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d88491ed-6c10-4177-8e73-d9a8c2be4a67 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.151169 Oct 11 02:28:13.670694 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3650/7250] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:13 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:14.694330 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:14.694962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:14.701779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:14.702274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:14.702725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:14.703459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:14.703932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:14.704373 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:14.835319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:14.843432 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b77fec8c-6379-4caa-8137-44ff2867b184 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.153832 Oct 11 02:28:14.844009 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3601/7251] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:14 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:15.406082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f332d8f-c72b-4b7d-8f71-faa70d86006d", "name": "network-vif-plugged", "status": "completed", "tag": "fde1d7c2-2d4b-4db5-a768-86e0e2296161"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:15.417358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:15.417849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:15.418560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:15.429798 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] Creating event network-vif-plugged:fde1d7c2-2d4b-4db5-a768-86e0e2296161 for instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d on n-h1-772273-9 Oct 11 02:28:15.434707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-788f707d-284b-4fe8-80a4-3598e2e8aa2f req-06c3ea39-6ea6-4625-b72c-8bbe6f084da8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Oct 11 02:28:15.435395 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3651/7252] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:15.866557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:15.867182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:15.874002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:15.874498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:15.874950 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:15.875685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:15.876156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:15.876620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:16.002649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:16.010986 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a05afb7-a0a8-46c0-91c0-8b24905a25e5 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1360 microversion: 2.1 time: 0.148854 Oct 11 02:28:16.011589 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3602/7253] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:15 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:17.035328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:17.036594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:17.042705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:17.043189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:17.043656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:17.044350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:17.044818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:17.045238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:17.180568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:17.188424 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-aba51d3a-96fe-4e95-912d-a5685a00de73 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1551 microversion: 2.1 time: 0.158287 Oct 11 02:28:17.188992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3652/7254] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:17 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:17.210751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:17.211417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:17.218954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:17.219487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:17.219949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:17.220668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:17.221142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:17.221586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:17.352849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:17.361337 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24a2e50b-a329-4431-bf7a-2d7a0bb7e2f4 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1551 microversion: 2.1 time: 0.154580 Oct 11 02:28:17.361925 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3603/7255] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:17 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:18.858644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b5638b-3949-4856-9846-3f471f98169d"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:18.861052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:18.863046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:18.869872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:18.870352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:18.870787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:18.871515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:18.871962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:18.872384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:19.112299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-638643a1-6f2e-4292-a25b-26ce84842e19 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257482 Oct 11 02:28:19.112953 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3653/7256] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:28:18 2022] POST /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:29.818750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:29.819299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:29.821302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.822091 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.823442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.824094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=70 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.831487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:29.831993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:29.832450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:29.833164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:29.833633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:29.834074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:29.914740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lazy-loading 'services' on Instance uuid 4f332d8f-c72b-4b7d-8f71-faa70d86006d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:28:29.984678 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4016ca8-3608-434f-94c6-31d3820c31db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments/85b5638b-3949-4856-9846-3f471f98169d" status: 202 len: 0 microversion: 2.1 time: 0.170071 Oct 11 02:28:29.985301 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3604/7257] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:28:29 2022] DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments/85b5638b-3949-4856-9846-3f471f98169d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:28:29.993018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.993854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:29.998397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:30.000861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:30.009111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:30.009607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:30.010047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:30.010756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:30.011218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:30.011683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:30.045629 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-100cc116-fd5d-40c2-997e-453b754f49da tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055192 Oct 11 02:28:30.046205 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3654/7258] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:29 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:31.060321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:31.062724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:31.069722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:31.070229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:31.070690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:31.071435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:31.071911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:31.072359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:31.102347 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b54a2e4-d9bf-4290-9416-caabd3c8324f tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 Oct 11 02:28:31.102925 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3605/7259] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:31 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:32.115027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:32.117264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:32.124162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:32.124756 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:32.125262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:32.126051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:32.126572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:32.127065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:32.156351 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c7983a76-604c-40ae-8566-d681e3db5cb9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Oct 11 02:28:32.156921 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3655/7260] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:32 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:33.169635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:33.171786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:33.179166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:33.179706 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:33.180167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:33.180886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:33.181359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:33.181804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:33.215041 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76715e46-c133-498b-a02a-e2fa16540596 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049539 Oct 11 02:28:33.215642 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3606/7261] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:33 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:34.227583 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:34.229848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:34.236637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:34.237120 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:34.237553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:34.238244 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:34.238703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:34.240067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:34.269919 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec611c77-262e-41bd-b03d-982bf382de81 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Oct 11 02:28:34.270495 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3656/7262] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:34 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:35.282424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:35.284713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:35.292009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:35.292504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:35.292953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:35.293761 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:35.294231 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:35.294667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:35.323313 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e387e92f-3a10-492f-92db-6a249e216a5d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044967 Oct 11 02:28:35.323894 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3607/7263] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:28:35 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:28:35.334968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:35.335496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:35.342818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:35.343304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:35.343773 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:35.344467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:35.344927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:35.345358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:35.421269 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d is not attached to volume 85b5638b-3949-4856-9846-3f471f98169d Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments/85b5638b-3949-4856-9846-3f471f98169d HTTP/1.1 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d is not attached to volume 85b5638b-3949-4856-9846-3f471f98169d Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '4f332d8f-c72b-4b7d-8f71-faa70d86006d', 'id': '85b5638b-3949-4856-9846-3f471f98169d'} Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 85b5638b-3949-4856-9846-3f471f98169d. Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d is not attached to volume 85b5638b-3949-4856-9846-3f471f98169d Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:35.423205 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d is not attached to volume 85b5638b-3949-4856-9846-3f471f98169d Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d is not attached to volume 85b5638b-3949-4856-9846-3f471f98169d {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f72f8cd-b3df-4e98-876c-f2620f2102fb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments/85b5638b-3949-4856-9846-3f471f98169d" status: 404 len: 154 microversion: 2.1 time: 0.094281 Oct 11 02:28:35.427310 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3657/7264] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:28:35 2022] DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d/os-volume_attachments/85b5638b-3949-4856-9846-3f471f98169d => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:28:38.767178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:38.768030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:38.775588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:38.776057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:38.776508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:38.777224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:38.777688 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:38.778127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:38.803623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:28:38.882122 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b337742a-6fa1-46b3-bc70-15cb5fd6158a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 204 len: 0 microversion: 2.1 time: 0.118677 Oct 11 02:28:38.882779 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3608/7265] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:28:38 2022] DELETE /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:28:38.891361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:38.891983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:38.899040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:38.899574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:38.900016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:38.900721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:38.901176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:38.901600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:39.032436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:39.042302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5b7cad08-876e-476d-9af6-f50278c9a3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1557 microversion: 2.1 time: 0.154989 Oct 11 02:28:39.042888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3658/7266] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:38 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:40.066444 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:40.067165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:40.074030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:40.074531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:40.074985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:40.075729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:40.076199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:40.076640 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:40.208914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:40.216970 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a5edea9-b325-4b10-940e-0e43a7de71cb tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1557 microversion: 2.1 time: 0.154875 Oct 11 02:28:40.217818 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3609/7267] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:40 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:40.976036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f332d8f-c72b-4b7d-8f71-faa70d86006d", "name": "network-vif-deleted", "tag": "fde1d7c2-2d4b-4db5-a768-86e0e2296161"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:40.990465 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:40.990940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:40.991753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:41.013154 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] Creating event network-vif-deleted:fde1d7c2-2d4b-4db5-a768-86e0e2296161 for instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d on n-h1-772273-9 Oct 11 02:28:41.018639 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-05157e8d-0811-4738-ae4b-67367f66a229 req-be9d672f-4ea1-4fe6-b23d-517532a0926d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046732 Oct 11 02:28:41.019261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3659/7268] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:41.241538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:41.242099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:41.248975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:41.249480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:41.249938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:41.250651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:41.251124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:41.251601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:41.281447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:41.281941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:41.282392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:41.282853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lazy-loading 'fault' on Instance uuid 4f332d8f-c72b-4b7d-8f71-faa70d86006d {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:28:41.324223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:41.331977 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a99d3ee1-2c41-490e-b78e-ffb1dc9e2ed8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 200 len: 1350 microversion: 2.1 time: 0.095078 Oct 11 02:28:41.332560 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3610/7269] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:41 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:42.356353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:42.357059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: 4f332d8f-c72b-4b7d-8f71-faa70d86006d] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:42.364828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:42.365328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:42.365797 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:42.366497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:42.366956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:42.367419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:42.381468 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d HTTP/1.1 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4f332d8f-c72b-4b7d-8f71-faa70d86006d'} Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:28:42.383102 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance 4f332d8f-c72b-4b7d-8f71-faa70d86006d could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40f83c60-7925-4280-9be5-4f945ef8eb30 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d" status: 404 len: 111 microversion: 2.1 time: 0.032454 Oct 11 02:28:42.387778 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3660/7270] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:42 2022] GET /compute/v2.1/servers/4f332d8f-c72b-4b7d-8f71-faa70d86006d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:28:42.393279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c30680b0-e5ee-4531-9301-26bf97934fb1 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '.version_select at 0x7f112fa29700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:42.413882 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c30680b0-e5ee-4531-9301-26bf97934fb1 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-74793137" status: 202 len: 0 microversion: 2.1 time: 0.024447 Oct 11 02:28:42.414483 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3611/7271] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 02:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-74793137 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:28:42.431601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8fc079a9-3c8c-4bfa-9913-1919ed1fa78e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: .version_select at 0x7f112fc861f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-538775470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzz9vkLr1JX6vA2EHXM25CXimgaVVTesr4o7EexBKrlRWntYi8nB9u0yvWMRGbuhnb6PxaD4AkLhbTXRxub3vNV3n7eRGIEM8qSPjRb+loM4MMn3QRCT/wCgKjy8tVcrg=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:42.447304 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8fc079a9-3c8c-4bfa-9913-1919ed1fa78e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:28:42.452572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-8fc079a9-3c8c-4bfa-9913-1919ed1fa78e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:28:42.476370 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8fc079a9-3c8c-4bfa-9913-1919ed1fa78e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048696 Oct 11 02:28:42.476970 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3661/7272] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:28:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:42.527069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1248451680", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-538775470", "networks": [{"uuid": "2de4a64f-1a15-4721-a4cf-006a3bc14b45"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:42.579267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] validate_networks() for [('2de4a64f-1a15-4721-a4cf-006a3bc14b45', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:28:43.344658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:28:43.345107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:28:43.345661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:28:43.346115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:28:43.346550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:28:43.355356 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:43.355872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:43.356332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:43.357087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:43.357562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:43.358008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:43.375065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:28:43.380857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Getting quotas for user 070640b38d7a4579b748123ecc1d9675 and project 280fd2411e1846769ceeee0d29893d58. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:28:43.393167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:28:43.396140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:28:43.442747 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f0cfe8f-58d1-4ee6-95e3-d794212447bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919062 Oct 11 02:28:43.443595 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3612/7273] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:28:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:28:43.455364 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b460f422-6e78-4ca8-833a-ddb40e2d1d7a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:43.455990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b460f422-6e78-4ca8-833a-ddb40e2d1d7a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:43.512671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b460f422-6e78-4ca8-833a-ddb40e2d1d7a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:43.519683 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b460f422-6e78-4ca8-833a-ddb40e2d1d7a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1262 microversion: 2.1 time: 0.068984 Oct 11 02:28:43.520262 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3662/7274] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:43 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:44.544300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:44.545054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:44.552032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:44.552582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:44.553054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:44.553785 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:44.554267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:44.554722 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:44.622878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:44.630895 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e1a6887-a8f2-4bae-a907-a0764dcc7fe8 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1320 microversion: 2.1 time: 0.091978 Oct 11 02:28:44.631815 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3613/7275] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:44 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1320 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:45.654303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:45.654930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:45.662299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:45.662794 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:45.663238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:45.663973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:45.664433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:45.664869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:45.745352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69a22fa-4dc6-430d-812c-dfe9f8a3a99a", "tag": "a88cca98-c256-413c-b1cc-dc2e326a4e52"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:45.763450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:45.764551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:45.765546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:45.778457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] Creating event network-changed:a88cca98-c256-413c-b1cc-dc2e326a4e52 for instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a on n-h2-772273-9 Oct 11 02:28:45.785722 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e9793f56-4c78-4b0e-9d7f-04834ec6d1a5 req-147bdeaf-42b8-46b5-bbbf-a2e15b9bcbd7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049469 Oct 11 02:28:45.786922 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3614/7276] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:45.800271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:45.808610 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ccc2e10-989e-4d6c-a730-a72048848f33 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.158283 Oct 11 02:28:45.809197 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3663/7277] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:45 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:46.832865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:46.833633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:46.840173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:46.840683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:46.841142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:46.841855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:46.842595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:46.843042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:46.974480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:46.982170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91eb64c8-ac9e-4843-be92-81586feddc6b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.154483 Oct 11 02:28:46.982750 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3615/7278] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:46 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:48.004868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:48.005508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:48.012485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:48.012975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:48.013415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:48.014117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:48.014574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:48.015000 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:48.143526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:48.151769 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ed71fb9-8ba0-47b7-bd13-55f61045075e tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.150808 Oct 11 02:28:48.152352 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3664/7279] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:47 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:49.175265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:49.175923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:49.182425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:49.182929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:49.183471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:49.184185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:49.184658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:49.185102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:49.313902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:49.322148 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ed26c15-f599-481f-84be-1bcfc27b4bfa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.150978 Oct 11 02:28:49.322718 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3616/7280] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:49 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:50.345749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:50.346316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:50.353633 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:50.354109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:50.354569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:50.355476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:50.355935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:50.356359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:50.493436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:50.501165 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-86b781de-96bc-43f1-bcee-0a397722c55b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.159660 Oct 11 02:28:50.501745 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3665/7281] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:50 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:51.524002 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:51.524672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:51.531754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:51.532263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:51.532719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:51.533437 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:51.533915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:51.534359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:51.662636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:51.670346 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15705178-98f5-4c8c-b6d2-bf54b56e9219 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.150338 Oct 11 02:28:51.670931 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3617/7282] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:51 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:51.876713 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a22fa-4dc6-430d-812c-dfe9f8a3a99a", "name": "network-vif-plugged", "status": "completed", "tag": "a88cca98-c256-413c-b1cc-dc2e326a4e52"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:51.887677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:51.888611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:51.889053 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:51.900292 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] Creating event network-vif-plugged:a88cca98-c256-413c-b1cc-dc2e326a4e52 for instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a on n-h2-772273-9 Oct 11 02:28:51.905292 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-17c6d26a-89c0-4d32-8aa5-e50123ea832b req-da05a6c5-f408-4b37-b688-837d0403ab7c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 Oct 11 02:28:51.905889 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3666/7283] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:28:52.693491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:52.694120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:52.701041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:52.701536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:52.701991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:52.702698 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:52.703172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:52.703709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:52.835755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:52.843991 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e282fe7-def9-4d7e-94da-44b1a995fcf9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1362 microversion: 2.1 time: 0.154824 Oct 11 02:28:52.844535 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3618/7284] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:52 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:53.865334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:53.869996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:53.870746 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:53.877249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:53.877740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:53.878182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:53.878882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:53.879368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:53.879804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:54.007720 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:54.015676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6668b371-3ac2-4a7a-bbbe-5977bf0ab65d tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1553 microversion: 2.1 time: 0.152136 Oct 11 02:28:54.016261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3667/7285] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:53 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:54.038712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:28:54.039321 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:54.041325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:54.042086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:28:54.048887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:54.049386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:54.049839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:54.050548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:54.051016 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:54.051496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:54.180370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:28:54.188232 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8b886a88-1aa0-4027-9a96-e613e77da3aa tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1553 microversion: 2.1 time: 0.153723 Oct 11 02:28:54.188806 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3619/7286] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:28:54 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:28:55.679777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:28:55.682201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:28:55.688768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:55.689254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:55.689717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:55.690415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:28:55.690870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:28:55.691300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:28:55.928302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b146fbfc-16ec-489b-bb3d-f396a4aaf810 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "POST /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252906 Oct 11 02:28:55.928977 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3668/7287] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:28:55 2022] POST /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:06.647508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:06.648076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:06.650621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:06.651435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:06.657881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:06.658422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:06.658887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:06.659713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:06.660189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:06.660638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:06.753798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lazy-loading 'services' on Instance uuid b69a22fa-4dc6-430d-812c-dfe9f8a3a99a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:29:06.827317 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb80cc62-0c99-479c-9b96-8e07e018545b tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments/1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9" status: 202 len: 0 microversion: 2.1 time: 0.183874 Oct 11 02:29:06.828128 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3620/7288] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:29:06 2022] DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments/1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:29:06.837434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:06.839939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:06.843248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:06.844152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:06.852209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:06.852709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:06.853156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:06.853868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:06.854332 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:06.854769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:06.888545 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-38307313-677a-45b5-92c7-3629a465fa93 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056028 Oct 11 02:29:06.889286 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3669/7289] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:06 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:07.903122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:07.905611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:07.912104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:07.912674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:07.913141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:07.913867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:07.914343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:07.914794 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:07.946073 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84c206c9-f2d4-42c5-937a-fb9af3dfbc8a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048310 Oct 11 02:29:07.946651 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3621/7290] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:07 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:08.958341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:08.960781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:08.967997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:08.968493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:08.968963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:08.969662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:08.970127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:08.970556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:09.001249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-985f4add-0c49-41d5-aa30-d0ec79d93463 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046991 Oct 11 02:29:09.005932 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3670/7291] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:08 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:10.014027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:10.016412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:10.023386 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:10.023903 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:10.024364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:10.025089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:10.025590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:10.026087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:10.056539 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4cab4af-4cee-4df6-a662-700646479832 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Oct 11 02:29:10.057118 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3622/7292] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:10 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:11.069638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:11.071977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:11.079837 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:11.080335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:11.080782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:11.081491 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:11.081950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:11.082378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:11.113440 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dc9a6443-f9af-467f-b7dc-4c8ba333f3db tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048452 Oct 11 02:29:11.114021 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3671/7293] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:11 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:12.126159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:12.128558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:12.135362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:12.135865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:12.136318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:12.137030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:12.137502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:12.137945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:12.167418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-499682c1-9986-46b0-99a8-c224eed760b9 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045393 Oct 11 02:29:12.167992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3623/7294] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:29:12 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:29:12.178598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:12.179092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:12.185990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:12.186480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:12.186925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:12.187648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:12.188112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:12.188545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:12.264240 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a is not attached to volume 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments/1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 HTTP/1.1 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a is not attached to volume 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': 'b69a22fa-4dc6-430d-812c-dfe9f8a3a99a', 'id': '1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9'} Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9. Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a is not attached to volume 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:29:12.265867 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a is not attached to volume 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a is not attached to volume 1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8625d20a-0986-42ea-8e65-fefbea4ad9cf tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments/1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9" status: 404 len: 154 microversion: 2.1 time: 0.092794 Oct 11 02:29:12.271135 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3672/7295] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:29:12 2022] DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a/os-volume_attachments/1b8a0a31-68f4-44fd-8bde-b1c0d72b4cc9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:29:15.615805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:15.616404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:15.623395 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:15.623983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:15.624515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:15.625302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:15.625853 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:15.626388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:15.653219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:29:15.731772 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee3e63fc-8ded-4d94-9863-39440ff341ab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 204 len: 0 microversion: 2.1 time: 0.119693 Oct 11 02:29:15.732697 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3624/7296] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:29:15 2022] DELETE /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:29:15.740965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:15.741736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:15.749598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:15.750116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:15.750562 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:15.751266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:15.751802 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:15.752225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:15.889673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:15.897712 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c24631b-515b-47fc-91ad-e1080853802a tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1559 microversion: 2.1 time: 0.160710 Oct 11 02:29:15.898314 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3673/7297] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:15 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:16.921982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:16.922708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:16.930531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:16.931034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:16.931531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:16.932584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:16.933060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:16.933507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:17.069051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:17.076825 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e9e532e-e75d-4a8e-8b10-871cebdd22bc tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1559 microversion: 2.1 time: 0.159198 Oct 11 02:29:17.077410 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3625/7298] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:16 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:17.803427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a22fa-4dc6-430d-812c-dfe9f8a3a99a", "name": "network-vif-deleted", "tag": "a88cca98-c256-413c-b1cc-dc2e326a4e52"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:29:17.815109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:17.815903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:17.816342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:17.830016 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] Creating event network-vif-deleted:a88cca98-c256-413c-b1cc-dc2e326a4e52 for instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a on n-h2-772273-9 Oct 11 02:29:17.835745 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-6d130f09-0f33-4069-ba09-398a5dae1c54 req-b1992cf5-c1b4-4e80-89ba-f92f03068bd1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Oct 11 02:29:17.836568 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3674/7299] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:18.100191 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:18.100820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:18.107143 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:18.107664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:18.108119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:18.108830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:18.109302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:18.109737 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:18.141072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:18.141567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:18.142017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:18.142475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lazy-loading 'fault' on Instance uuid b69a22fa-4dc6-430d-812c-dfe9f8a3a99a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:29:18.187052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '070640b38d7a4579b748123ecc1d9675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280fd2411e1846769ceeee0d29893d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:18.196133 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e40b81b-5477-4d80-a615-35e1359ebcab tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 200 len: 1352 microversion: 2.1 time: 0.100009 Oct 11 02:29:18.196819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3626/7300] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:18 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:19.221301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:19.222017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] [instance: b69a22fa-4dc6-430d-812c-dfe9f8a3a99a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:19.228723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:19.229216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:19.229665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:19.230362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:19.230822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:19.231254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:19.245641 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] HTTP exception thrown: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Request method failure captured: Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a HTTP/1.1 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNSO65bKcl9AMaQxtYtFjCBx_qvoyuq8DjslgLiBlA2SfovJWxzhzMmZ30MCUlOz3E7tfMWuQfvUGOcpVpWEh67kZ2MfKpiqDndLHevOxbxRct1JuYefTzeSu6bzPvfxsARFm6XxNKDskf4Y-R25QQNyOotzLPRN4EvA41-JxZ1Va9w Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_280fd2411e1846769ceeee0d29893d58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/280fd2411e1846769ceeee0d29893d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 280fd2411e1846769ceeee0d29893d58 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-61978821 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 070640b38d7a4579b748123ecc1d9675 Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestEncryptedCinderVolumes-61978821-project Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b69a22fa-4dc6-430d-812c-dfe9f8a3a99a'} Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:29:19.247300 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Returning 404 to user: Instance b69a22fa-4dc6-430d-812c-dfe9f8a3a99a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-909e2a4b-461f-47f9-a282-6ad409412855 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a" status: 404 len: 111 microversion: 2.1 time: 0.032909 Oct 11 02:29:19.252250 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3675/7301] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:19 2022] GET /compute/v2.1/servers/b69a22fa-4dc6-430d-812c-dfe9f8a3a99a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:29:19.257530 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b630b22-c8dc-4b2f-b398-a8271d145283 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] Calling method '.version_select at 0x7f1134300700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:19.277011 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b630b22-c8dc-4b2f-b398-a8271d145283 tempest-TestEncryptedCinderVolumes-61978821 tempest-TestEncryptedCinderVolumes-61978821-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-538775470" status: 202 len: 0 microversion: 2.1 time: 0.023247 Oct 11 02:29:19.277605 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3627/7302] 10.222.0.66 () {58 vars in 1275 bytes} [Tue Oct 11 02:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-538775470 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:29:45.634229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9522624d-b73e-456e-9f34-90b7a9f10996 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: .version_select at 0x7f112f7aaca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1760006739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BQSkU6/wRGJqclIH5LV2oXtE53wvbgo3l6lUi8EOfSWqf4/oSHV2fRaQXcOYHgzB9XtNAreTvR4GaY9EH/Z2OnCybJBNs8MLKP+xkTCr9VxSqkScJmuu8khJ1xP1AdQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:29:45.640032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:45.640674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:45.652441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9522624d-b73e-456e-9f34-90b7a9f10996 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:29:45.657498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9522624d-b73e-456e-9f34-90b7a9f10996 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for user 37eee3a25d5546a2af88acee3b42d56c and project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:29:45.679070 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9522624d-b73e-456e-9f34-90b7a9f10996 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048765 Oct 11 02:29:45.679697 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3676/7303] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:29:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:45.727325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:45.728643 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:45.732961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1520016590", "imageRef": "8bd66192-ca5a-4cc2-b108-de6486932f38", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1760006739", "networks": [{"uuid": "e66b0317-c64b-4bbd-8cfd-e7fb910db118"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:29:45.786299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] validate_networks() for [('e66b0317-c64b-4bbd-8cfd-e7fb910db118', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:29:46.160983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:29:46.161433 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:29:46.161937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:29:46.162369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:29:46.162804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:29:46.171720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:46.172230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:46.172691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:46.173452 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:46.173928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:46.174382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:46.192166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:29:46.197415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for user 37eee3a25d5546a2af88acee3b42d56c and project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:29:46.209663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:29:46.211968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8bd66192-ca5a-4cc2-b108-de6486932f38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:29:46.259097 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d7583d0-a61f-4e89-a169-07b167920b15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533791 Oct 11 02:29:46.259805 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3628/7304] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:29:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:29:46.271237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4c2c9209-e977-45c4-8e25-b4fdbdaf35b6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:46.272048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4c2c9209-e977-45c4-8e25-b4fdbdaf35b6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:46.327534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4c2c9209-e977-45c4-8e25-b4fdbdaf35b6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:46.336108 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4c2c9209-e977-45c4-8e25-b4fdbdaf35b6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1259 microversion: 2.1 time: 0.068935 Oct 11 02:29:46.336676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3677/7305] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:46 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:47.360641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:47.361699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:47.368994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:47.369512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:47.369972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:47.370704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:47.371181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:47.371661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:47.435325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:47.445523 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6cfc0c49-c3fc-45a3-8464-8ba7fc512758 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1317 microversion: 2.1 time: 0.090275 Oct 11 02:29:47.447918 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3629/7306] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:47 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:48.469833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:48.470461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:48.478518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:48.479021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:48.479500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:48.480235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:48.480692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:48.481116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:48.619404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:48.627761 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e8263319-a04c-4109-bfe6-60112a143e76 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.161947 Oct 11 02:29:48.628541 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3678/7307] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:48 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:49.650175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:49.650798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:49.657795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:49.658310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:49.658778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:49.659535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:49.660045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:49.660671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:49.823185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:49.832086 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c326e7e1-c08b-4c27-b20d-6257d105df49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.185716 Oct 11 02:29:49.832833 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3630/7308] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:49 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:50.854615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:50.855282 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:50.862541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:50.863726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:50.864200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:50.864916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:50.865387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:50.865820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:51.029232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:51.039170 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2165a1ee-379f-40ec-b826-9d05a0298053 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.188237 Oct 11 02:29:51.047939 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3679/7309] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:50 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:52.072428 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:52.073109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:52.080426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:52.081078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:52.081572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:52.082632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:52.083352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:52.084027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:52.230204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:52.239546 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fe8cb111-4ba3-423e-ab8a-927cdc1580c9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.171182 Oct 11 02:29:52.248415 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3631/7310] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:52 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:53.264709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:53.265492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:53.272759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:53.273254 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:53.273685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:53.274386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:53.274836 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:53.275439 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:53.423508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:53.432757 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a12a9076-fa15-49f0-b0ef-5c593612c4ba tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.174330 Oct 11 02:29:53.433706 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3680/7311] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:53 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:54.456398 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:54.457657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:54.464857 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:54.465614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:54.466249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:54.467436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:54.468099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:54.468753 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:54.610498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:54.618541 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-064503cf-315c-4314-8dfb-63f73f559f2a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.166105 Oct 11 02:29:54.619143 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3632/7312] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:54 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:55.642347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:55.642922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:55.650260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:55.650758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:55.651199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:55.651975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:55.652435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:55.652862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:55.786935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:55.794759 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ea44b9c9-6959-4af0-9835-81e9d0f1cdf2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.156485 Oct 11 02:29:55.795359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3681/7313] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:55 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:55.974303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:29:55.990497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:55.991010 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:55.991493 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:56.006841 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] Creating event network-changed:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:29:56.016693 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0d0a100b-db61-4deb-84c4-6c7131819875 req-cfe0bc2a-17cd-4a19-b8ff-e685c8d16e3a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046273 Oct 11 02:29:56.017489 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3633/7314] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:29:56.818325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:56.818967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:56.820874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:56.826985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:56.827492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:56.827936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:56.828628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:56.829084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:56.829513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:56.963511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:56.971497 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2b96190e-4f92-4e2f-8f97-d7be413a140d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.157641 Oct 11 02:29:56.972082 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3682/7315] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:56 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:57.991801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:57.992597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:29:57.997860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:57.998616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:58.006263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:58.006763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:58.007216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:58.007983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:58.008453 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:58.008895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:58.140918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:58.149123 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce99d1e2-363f-4237-b790-ae2080ba378f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.158347 Oct 11 02:29:58.149705 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3634/7316] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:57 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:29:59.172100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:29:59.172724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:29:59.180278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:59.180768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:59.181210 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:59.181909 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:29:59.182373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:29:59.182808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:29:59.309846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:29:59.317786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-061cd1b1-922e-4388-9514-6cbd21941b58 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.149623 Oct 11 02:29:59.318367 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3683/7317] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:29:59 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:00.341024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:00.341926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:00.348629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:00.349138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:00.349606 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:00.350360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:00.350946 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:00.351431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:00.482424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:00.490698 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3399ddc0-df48-4f5f-9e41-ab4a6a374c05 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.153748 Oct 11 02:30:00.491269 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3635/7318] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:00 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:01.513417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:01.514074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:01.521508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:01.521991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:01.522431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:01.523123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:01.523609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:01.524044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:01.651271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:01.659577 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db94b472-7c74-494d-938d-af305c9c506a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.150031 Oct 11 02:30:01.660190 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3684/7319] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:01 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:01.756518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "name": "network-vif-plugged", "status": "completed", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:30:01.767308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:01.767849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:01.768291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:01.779980 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] Creating event network-vif-plugged:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:30:01.784941 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e26fcbb0-69ea-4f76-a93b-b2404c673cfa req-d4e96028-d935-454d-a570-0cb58dc9c9ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Oct 11 02:30:01.785538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3636/7320] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:30:02.682011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:02.682634 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:02.689493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:02.689982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:02.690427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:02.691676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:02.692141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:02.692572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:02.818971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:02.826866 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-50ea69cb-fff2-4d63-ab34-07aaa2fdd9f7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1359 microversion: 2.1 time: 0.148758 Oct 11 02:30:02.827467 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3685/7321] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:02 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:03.851602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:03.852322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:03.858458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:03.858976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:03.859463 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:03.860165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:03.860654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:03.861092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:03.991850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:03.999605 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-891f3f87-18f8-473b-b718-a0b9ab0a2ce5 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1549 microversion: 2.1 time: 0.153719 Oct 11 02:30:04.000117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3637/7322] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:03 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:04.022036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:04.022658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:04.029638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.030617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.030617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.031256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.031751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.032187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.162478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:04.170337 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-298b9b30-8e70-4911-8f05-077ea94ab2c8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1549 microversion: 2.1 time: 0.152792 Oct 11 02:30:04.170920 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3686/7323] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:04 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:04.192593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:04.197543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:04.198324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Searching by: {'deleted': False, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 02:30:04.203846 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.204339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.204788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.205523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.206065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.207142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.230989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 02:30:04.257944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-559f884e-86d9-4fc0-a871-37e3fcd27126 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069834 Oct 11 02:30:04.258469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3638/7324] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 02:30:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:30:04.270804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:04.271441 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:04.277260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.277745 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.278184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.278875 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:04.279325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:04.279776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:04.411988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:04.419874 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f751724d-2ce4-435f-a660-48b618a7a940 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1549 microversion: 2.1 time: 0.153532 Oct 11 02:30:04.420474 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3687/7325] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:04 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:05.993037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc4bb02-db0c-46c3-bafb-5f8877dce8d0"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:30:05.995446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:06.002274 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:06.002717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:06.003717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:06.004432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:06.004906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:06.005351 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:06.240557 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1476c45e-f597-4f2d-8ef0-87efe6707be9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251266 Oct 11 02:30:06.241198 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3639/7326] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:30:05 2022] POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:30:19.279150 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:19.279804 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:19.283035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:30:19.283686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=60 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:30:19.289818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:19.290313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:19.290755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:19.291483 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:19.291946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:19.292380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:19.425594 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:19.433824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb9163e1-d749-4019-9625-0942438c3f2d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1595 microversion: 2.1 time: 0.158645 Oct 11 02:30:19.434409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3688/7327] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:19 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:21.465222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:30:21.466705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:30:21.467938 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:30:21.642140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:30:21.656061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:21.656636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:21.656997 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:21.668326 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] Creating event network-changed:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:30:21.673609 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-17f02107-067a-47d3-955b-0256e4e05bd5 req-b0cf4952-57eb-48fd-98e8-70d483dfa239 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210832 Oct 11 02:30:21.675617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3640/7328] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:30:22.584191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1781385098"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:30:22.584858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:22.592262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:22.592759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:22.593206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:22.594073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:22.594569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:22.595028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:22.727159 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Adding security group 2e708af3-26d9-4d06-a33e-c0ed313735f4 to port b8157c26-876c-4938-98bc-9b4c27a64e1d Oct 11 02:30:23.040244 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9dc85c83-8fb4-438e-a3ae-35599e41e08c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action" status: 202 len: 0 microversion: 2.1 time: 0.459986 Oct 11 02:30:23.040804 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3689/7329] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:30:22 2022] POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:30:23.051238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:30:23.052045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:30:23.058298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:23.058808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:23.059265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:23.060051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:23.060542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:23.060995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:23.214567 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:30:23.224490 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f16e1dea-85be-4836-9e11-bcc7229a58a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1761 microversion: 2.1 time: 0.179177 Oct 11 02:30:23.225108 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3641/7330] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:30:23 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:30:23.689807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:30:23.700208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:30:23.700688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:30:23.701118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:30:23.713575 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] Creating event network-changed:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:30:23.719007 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-60db9d96-051c-4a7b-bf52-3bba8c1bd507 req-056f5e99-1ecc-4976-8999-2bc2e9c3cf0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033803 Oct 11 02:30:23.719657 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3690/7331] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:32:01.260816 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:32:01.261588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:32:01.266124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:32:01.268512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:01.275945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:01.276460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:01.276920 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:01.277639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:01.278118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:01.278566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:01.350995 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ad754ad-192d-4b1f-907b-4ee43b7cc280 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action" status: 202 len: 0 microversion: 2.1 time: 0.092011 Oct 11 02:32:01.351716 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3642/7332] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:32:01 2022] POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:32:01.359035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:32:01.359806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=12 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:32:01.361776 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:32:01.361983 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:32:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 (ip 10.222.0.66) !!! Oct 11 02:32:01.368499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:01.369290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:01.377311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:01.377799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:01.378236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:01.378993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:01.379999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:01.380434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:01.581284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:01.589617 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-636d0c96-3933-43eb-a3ff-0f59e395ac04 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1763 microversion: 2.1 time: 0.233504 Oct 11 02:32:01.590475 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3691/7333] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:01 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1763 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:32:02.613209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:02.614480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:02.617157 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:32:02.617297 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 (ip 10.222.0.66) !!! Oct 11 02:32:02.625788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:02.626289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:02.626738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:02.627475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:02.627942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:02.628380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:02.824169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:02.832692 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1504c4c5-4bf0-4386-bf1b-8d6db52ece95 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1768 microversion: 2.1 time: 0.223790 Oct 11 02:32:02.833538 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3643/7334] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:02 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1768 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:32:03.857895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:03.858506 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:03.865860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:03.866346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:03.866783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:03.867509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:03.867970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:03.868400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:04.009600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:04.017943 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c942ba77-e14e-45f2-a40b-4d430f2d1c62 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1768 microversion: 2.1 time: 0.164042 Oct 11 02:32:04.018537 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3692/7335] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:03 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1768 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:32:05.041635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:05.042301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:05.049139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:05.049642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:05.050098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:05.050813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:05.051953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:05.052416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:05.200295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:05.209252 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cf17a92-d51c-453f-9434-7e2415173117 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1768 microversion: 2.1 time: 0.171640 Oct 11 02:32:05.209837 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3644/7336] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:05 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1768 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:32:06.233241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:06.233813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:06.241322 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:06.241814 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:06.242255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:06.242956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:06.243436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:06.243868 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:06.391862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:06.400282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-551c9eb0-b44f-47bc-9cc3-8ecc4091969c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1768 microversion: 2.1 time: 0.171072 Oct 11 02:32:06.400871 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3693/7337] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:06 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1768 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:32:07.424544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:32:07.425187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:32:07.432636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:07.433151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:07.433646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:07.434378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:32:07.434864 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:32:07.435313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:32:07.579411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:32:07.589084 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-799ddedd-d0b3-4ae0-bf74-7e7b86c11228 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1761 microversion: 2.1 time: 0.168531 Oct 11 02:32:07.589670 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3645/7338] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:32:07 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:15.313311 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:15.314104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=18 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:15.319194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1781385098"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:15.319817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:15.326489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:15.326968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:15.327427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:15.328123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:15.328577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:15.329049 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:15.461890 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Removing security group 2e708af3-26d9-4d06-a33e-c0ed313735f4 from port b8157c26-876c-4938-98bc-9b4c27a64e1d Oct 11 02:33:15.759590 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a76ab991-551d-4bbe-811d-c95fadbc44ed tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action" status: 202 len: 0 microversion: 2.1 time: 0.448117 Oct 11 02:33:15.760498 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3694/7339] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:33:15 2022] POST /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:33:15.770572 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:15.780275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:15.781049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:15.783119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:15.783797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:15.784323 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:15.797847 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] Creating event network-changed:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:33:15.803489 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e290802c-c227-41ef-ada0-81369e27f647 req-0b44134b-87ff-4d2c-bde0-1e6bd9d9f83c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038061 Oct 11 02:33:15.804597 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3646/7340] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:33:16.982691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:16.983208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:16.989204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:16.989689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:16.990126 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:16.991509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:16.991969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:16.992402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:17.075689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lazy-loading 'services' on Instance uuid fb4e0f74-f318-436b-b337-aebbfbc74c46 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:33:17.152993 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-53c093ec-259a-40b8-a29d-7c8c85f3849f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments/7dc4bb02-db0c-46c3-bafb-5f8877dce8d0" status: 202 len: 0 microversion: 2.1 time: 0.175656 Oct 11 02:33:17.153554 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3695/7341] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:33:16 2022] DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments/7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:33:17.163651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:17.166721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:17.174732 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:17.175780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:17.176320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:17.177074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:17.177558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:17.178011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:17.221042 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c5e0b55-2bc5-4360-84ce-a4fb1ccfadab tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062631 Oct 11 02:33:17.221656 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3647/7342] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:17 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:17.821037 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:17.831435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:17.831929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:17.832370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:17.845360 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] Creating event network-changed:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:33:17.851138 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-72f98f36-8be2-43cd-aef4-74d2099cb432 req-9b8d35ff-3b61-4f85-92a4-f872044d512a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034681 Oct 11 02:33:17.851995 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3696/7343] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:18.234676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:18.236862 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:18.243916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:18.244993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:18.245615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:18.248751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:18.249393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:18.250412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:18.281652 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9b7e325-2f30-420a-b572-ece1faf60190 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051204 Oct 11 02:33:18.282236 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3648/7344] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:18 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:19.296177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:19.298711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:19.306533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:19.307114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:19.307703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:19.308571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:19.309105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:19.309607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:19.341831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-81cf24c9-be8c-4e3c-9786-bd497a8ce896 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051043 Oct 11 02:33:19.342419 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3697/7345] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:19 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:20.355092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:20.357402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:20.364539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:20.365049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:20.365509 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:20.366288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:20.366769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:20.367221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:20.397318 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0a8cb9d-29cd-495c-8b71-77e13ea4915a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Oct 11 02:33:20.397898 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3649/7346] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:20 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:21.409951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:21.412760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:21.419710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:21.420196 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:21.420664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:21.421369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:21.421830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:21.422260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:21.452355 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2dc49ab8-ae8f-4889-a431-0f6e4cb25979 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Oct 11 02:33:21.452932 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3698/7347] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:21 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:22.465514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:22.467851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:22.474738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:22.475246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:22.475752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:22.476607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:22.477086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:22.477529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:22.507545 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-41cd05ff-da02-44df-8c78-2923dfe94af8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046682 Oct 11 02:33:22.508113 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3650/7348] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:33:22 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:33:22.518839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:22.519369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:22.525934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:22.526444 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:22.526884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:22.527620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:22.528080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:22.528507 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:22.603774 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] HTTP exception thrown: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 is not attached to volume 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Request method failure captured: Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments/7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 HTTP/1.1 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNUL5W9ftqfUvVLSXHN0t4FWHS7RhsS1S0OxBk1S_tp2qkUaTaDGANGYllfLjnTVXk3vCXV-rnD7JgqFknckC4itTJ_46GOh-iXU2Bk8FP2x8ZvQKdgJZOErxUio--vCbZNRMPcp1WwgphRWQQitllDs8NsQ6iDaSgZWvylaxXHtPVg Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 37eee3a25d5546a2af88acee3b42d56c Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 is not attached to volume 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': 'fb4e0f74-f318-436b-b337-aebbfbc74c46', 'id': '7dc4bb02-db0c-46c3-bafb-5f8877dce8d0'} Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0. Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 is not attached to volume 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:33:22.605397 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 is not attached to volume 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Returning 404 to user: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 is not attached to volume 7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-04f79ec9-c063-4c2f-9bea-518762072f9f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments/7dc4bb02-db0c-46c3-bafb-5f8877dce8d0" status: 404 len: 154 microversion: 2.1 time: 0.092115 Oct 11 02:33:22.609790 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3699/7349] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:33:22 2022] DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46/os-volume_attachments/7dc4bb02-db0c-46c3-bafb-5f8877dce8d0 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:33:25.855118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:25.855787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:25.862710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:25.863199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:25.863690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:25.864412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:25.864890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:25.865366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:25.891476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:33:25.972711 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3aaf787b-d876-403a-b09d-4a0d001b0cd7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 204 len: 0 microversion: 2.1 time: 0.121243 Oct 11 02:33:25.973352 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3651/7350] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:33:25 2022] DELETE /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:33:25.982421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:25.983043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:25.991113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:25.991643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:25.992086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:25.992796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:25.993256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:25.993716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:26.135194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:26.143160 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-90ed2539-ffe2-435e-bee2-4b7056517421 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1555 microversion: 2.1 time: 0.164821 Oct 11 02:33:26.143796 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3700/7351] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:25 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:27.167399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:27.168056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:27.175627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:27.176122 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:27.176574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:27.177278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:27.177745 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:27.178180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:27.307510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:27.315441 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9cd69d0-21c9-4b56-8635-03a70217012c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1555 microversion: 2.1 time: 0.152388 Oct 11 02:33:27.316006 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3652/7352] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:27 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:28.341089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:28.343383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:28.350762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:28.351473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:28.351976 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:28.353044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:28.353882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:28.354375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:28.384719 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4e0f74-f318-436b-b337-aebbfbc74c46", "name": "network-vif-deleted", "tag": "b8157c26-876c-4938-98bc-9b4c27a64e1d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:28.396542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:28.397135 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:28.397811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:28.411444 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] Creating event network-vif-deleted:b8157c26-876c-4938-98bc-9b4c27a64e1d for instance fb4e0f74-f318-436b-b337-aebbfbc74c46 on n-h1-772273-9 Oct 11 02:33:28.416918 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c6cf1d63-9879-459d-9968-d182702f7ffd req-36c71731-1dfa-4e5f-ada5-2a5fc1ccd09d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099179 Oct 11 02:33:28.417550 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3701/7353] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:28.444192 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:28.452072 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbb4a685-78be-4f58-8443-1c6809ae0d8f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 200 len: 1344 microversion: 2.1 time: 0.115157 Oct 11 02:33:28.453243 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3653/7354] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:28 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 1344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:29.479486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:29.480118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: fb4e0f74-f318-436b-b337-aebbfbc74c46] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:29.486262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:29.486750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:29.487195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:29.487915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:29.488378 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:29.488812 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:29.502567 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] HTTP exception thrown: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Request method failure captured: Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 HTTP/1.1 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNUL5W9ftqfUvVLSXHN0t4FWHS7RhsS1S0OxBk1S_tp2qkUaTaDGANGYllfLjnTVXk3vCXV-rnD7JgqFknckC4itTJ_46GOh-iXU2Bk8FP2x8ZvQKdgJZOErxUio--vCbZNRMPcp1WwgphRWQQitllDs8NsQ6iDaSgZWvylaxXHtPVg Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 37eee3a25d5546a2af88acee3b42d56c Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'fb4e0f74-f318-436b-b337-aebbfbc74c46'} Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:33:29.504219 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Returning 404 to user: Instance fb4e0f74-f318-436b-b337-aebbfbc74c46 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6e883916-ed28-49d7-aae3-b5eb2cfd8bc0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46" status: 404 len: 111 microversion: 2.1 time: 0.031987 Oct 11 02:33:29.509589 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3702/7355] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:29 2022] GET /compute/v2.1/servers/fb4e0f74-f318-436b-b337-aebbfbc74c46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:33:29.514600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-120d69ef-c41f-4263-b2b7-0ab65aa06d7f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '.version_select at 0x7f113402f790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:29.538157 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-120d69ef-c41f-4263-b2b7-0ab65aa06d7f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1760006739" status: 202 len: 0 microversion: 2.1 time: 0.027546 Oct 11 02:33:29.538732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3654/7356] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 02:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1760006739 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:33:38.638096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a948c42-286f-4d28-a4c4-e056cb33cb4b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: .version_select at 0x7f112f799310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1377350423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0BK2J406xg554C+rI1Ck+H7/lVD1wsZyPtUQKQoRh84s9Mcaj/5kofE02kLv7OC0HyLpMSOusFYOoNSLwGS6rSXyXuH8RmUjhUwXJapJZPj+dR2KY6vMNm4OVqw6O86w=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:38.654255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9a948c42-286f-4d28-a4c4-e056cb33cb4b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:33:38.660292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-9a948c42-286f-4d28-a4c4-e056cb33cb4b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for user 37eee3a25d5546a2af88acee3b42d56c and project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:33:38.682938 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a948c42-286f-4d28-a4c4-e056cb33cb4b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049028 Oct 11 02:33:38.683506 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3703/7357] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:33:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:33:38.730929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:38.735693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-514170229", "imageRef": "14b699ef-e05c-49d5-9020-848a18d92ec7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1377350423", "networks": [{"uuid": "e66b0317-c64b-4bbd-8cfd-e7fb910db118"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:38.788396 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] validate_networks() for [('e66b0317-c64b-4bbd-8cfd-e7fb910db118', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:33:39.163653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:33:39.164100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:33:39.164583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:33:39.165003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:33:39.165426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:33:39.174146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:39.174666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:39.175109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:39.175892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:39.176359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:39.176806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:39.196861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:33:39.202150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Getting quotas for user 37eee3a25d5546a2af88acee3b42d56c and project 51e4c52c7a86411ea795cbb0e2a15d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:33:39.214908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:33:39.217095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='14b699ef-e05c-49d5-9020-848a18d92ec7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:33:39.262463 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0778e97e-540b-4dd4-ab54-7422fe3f045d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533300 Oct 11 02:33:39.263120 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3655/7358] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:33:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:33:39.274809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b9ed0f6a-d0a5-4906-af79-954d41d17754 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:39.275459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b9ed0f6a-d0a5-4906-af79-954d41d17754 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:39.328358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b9ed0f6a-d0a5-4906-af79-954d41d17754 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:39.337239 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b9ed0f6a-d0a5-4906-af79-954d41d17754 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1258 microversion: 2.1 time: 0.066761 Oct 11 02:33:39.337996 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3704/7359] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:39 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:40.364168 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d5b4e67-9317-4664-9938-5828e06d3c5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:40.365390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d5b4e67-9317-4664-9938-5828e06d3c5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:40.417664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d5b4e67-9317-4664-9938-5828e06d3c5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:40.424621 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d5b4e67-9317-4664-9938-5828e06d3c5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1258 microversion: 2.1 time: 0.065260 Oct 11 02:33:40.425198 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3656/7360] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:40 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:41.447494 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8cdcf311-dff2-4fa8-a861-9d6e4566e5dc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:41.448111 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8cdcf311-dff2-4fa8-a861-9d6e4566e5dc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:41.450110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:41.515016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8cdcf311-dff2-4fa8-a861-9d6e4566e5dc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:41.521948 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8cdcf311-dff2-4fa8-a861-9d6e4566e5dc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1258 microversion: 2.1 time: 0.079302 Oct 11 02:33:41.522530 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3705/7361] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:41 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:42.545299 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-acc59677-cd81-40fa-93d6-fda421c9be5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:42.545957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-acc59677-cd81-40fa-93d6-fda421c9be5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:42.605202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-acc59677-cd81-40fa-93d6-fda421c9be5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:42.612168 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-acc59677-cd81-40fa-93d6-fda421c9be5a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1258 microversion: 2.1 time: 0.070887 Oct 11 02:33:42.612751 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3657/7362] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:42 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:43.635965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:43.636586 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:43.643493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:43.643988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:43.644433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:43.645129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:43.645589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:43.646028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:43.706519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:43.714433 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2166ed98-ae31-4fcc-a2d8-0cc9bb69ec6a tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1262 microversion: 2.1 time: 0.082446 Oct 11 02:33:43.715023 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3706/7363] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:43 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:44.737799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:44.739054 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:44.748634 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:44.749478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:44.750102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:44.751120 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:44.751631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:44.752272 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:44.829612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:44.841748 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a51de74c-237d-4da9-8f2b-0caa5f04e38d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1316 microversion: 2.1 time: 0.107772 Oct 11 02:33:44.843039 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3658/7364] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:44 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:45.867267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:45.868034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:45.870626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:45.877514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:45.878734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:45.879616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:45.880734 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:45.882242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:45.883107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:46.023536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:46.032097 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a071ebf-416a-4171-8ee9-cfc5110ca6d9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.168716 Oct 11 02:33:46.032717 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3707/7365] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:45 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:47.055402 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:47.056182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:47.058982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:47.064638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:47.065150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:47.065631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:47.066362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:47.066839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:47.067287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:47.222526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:47.235193 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-526474be-ace7-49db-8fbf-085c156ae714 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.184528 Oct 11 02:33:47.236129 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3659/7366] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:47 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:48.258816 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:48.260314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:48.273258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:48.274223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:48.274983 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:48.276067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:48.276834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:48.277650 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:48.418612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:48.427275 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a8b7101c-0315-4fa1-b420-8a03a793464b tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.172843 Oct 11 02:33:48.428265 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3708/7367] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:48 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:49.452758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:49.454447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:49.461708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:49.463898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:49.464966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:49.466612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:49.467882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:49.468599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:49.469275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:49.612295 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:49.621802 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f3fe36b-18b8-41ad-ab5d-dd6c93300a51 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.173028 Oct 11 02:33:49.622403 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3660/7368] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:49 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:50.648715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:50.649534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:50.656543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:50.657031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:50.657469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:50.658173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:50.658629 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:50.659389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:50.799208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:50.807830 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-98ff5603-6749-43dd-8802-dc1e2a3d6bb2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.163181 Oct 11 02:33:50.808408 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3709/7369] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:50 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:51.830934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:51.831593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:51.838409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:51.839157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:51.839639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:51.840352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:51.840823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:51.841267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:51.971285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:51.979596 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a334197a-0d04-4e5c-a0bc-508fe5df7765 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.152550 Oct 11 02:33:51.980183 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3661/7370] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:51 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:53.002200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:53.002826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:53.004714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:53.011475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:53.011968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:53.012414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:53.013122 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:53.013587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:53.014022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:53.144657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:53.152636 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-45a6cd22-ac95-49af-ae2a-3f7ce7543fc2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.154412 Oct 11 02:33:53.153219 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3710/7371] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:52 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:54.174793 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:54.175448 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:54.177298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:33:54.183741 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:54.184236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:54.184686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:54.185383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:54.185847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:54.186284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:54.313112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:54.320901 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49e30798-7c88-4906-868b-a9f495202ea2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.150064 Oct 11 02:33:54.321483 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3662/7372] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:54 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:55.344565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:55.345189 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:55.352137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:55.352624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:55.353063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:55.353760 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:55.354217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:55.354646 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:55.487162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:55.496567 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4959bcb1-29c5-493e-b186-a2c44cf6c028 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.155923 Oct 11 02:33:55.497331 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3711/7373] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:55 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:56.177346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:33:56.190039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:56.191412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:56.192284 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:56.204340 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] Creating event network-changed:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:33:56.209811 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ab42fd0d-54cd-45c0-9a24-bab1e9c62720 req-72c80b46-dc98-4b4e-aad6-20080946b90d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036530 Oct 11 02:33:56.210433 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3663/7374] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:33:56.520717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:56.521891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:56.528674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:56.529166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:56.529604 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:56.530308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:56.530766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:56.531199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:56.660024 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:56.667647 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-08c9c51b-1da6-4c1f-a358-da6984d65437 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.150951 Oct 11 02:33:56.668225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3712/7375] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:56 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:57.691600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:57.692312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:57.698994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:57.699531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:57.699986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:57.700686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:57.701150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:57.701588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:57.837603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:57.845576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9b6c92c-f623-4ef1-9105-8f320484395c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.159205 Oct 11 02:33:57.846168 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3664/7376] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:57 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:33:58.868934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:33:58.869657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:33:58.876576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:58.877073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:58.877520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:58.878229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:33:58.878691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:33:58.879124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:33:59.007623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:33:59.015702 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-373c492d-95a1-4065-a5eb-e4aa6cc21b40 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.151250 Oct 11 02:33:59.016298 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3713/7377] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:33:58 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:00.038475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:00.039111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:00.045721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:00.046162 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:00.046620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:00.047331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:00.047837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:00.048285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:00.175426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:00.183682 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48892514-0c9e-4ccf-8e35-77cd7fcef32e tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.149427 Oct 11 02:34:00.184264 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3665/7378] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:00 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:01.207436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:01.207950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:01.215749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:01.216237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:01.216676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:01.217370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:01.217838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:01.218255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:01.353549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:01.361401 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a62048b-e423-4dc1-b36f-3ba839cdb1a8 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.157995 Oct 11 02:34:01.362012 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3714/7379] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:01 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:01.452531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "name": "network-vif-plugged", "status": "completed", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:34:01.462582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:01.463086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:01.463842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:01.475015 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] Creating event network-vif-plugged:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:34:01.480118 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7f515ba1-dccf-4274-aaa0-f7b7722c1ae3 req-51338b1b-0fdc-4569-9f86-9e6d2efbc73d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086286 Oct 11 02:34:01.480717 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3666/7380] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:34:02.384901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:02.385429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:02.392239 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:02.392729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:02.393171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:02.393867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:02.394327 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:02.394757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:02.521129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:02.529385 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f8c66fd6-ac3c-4f96-8626-4384b6a68559 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1358 microversion: 2.1 time: 0.148522 Oct 11 02:34:02.529959 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3715/7381] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:02 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:03.554076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:03.555458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:03.561806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.562287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.562739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.563473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.563941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.564380 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.695895 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:03.703581 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff1f38b8-6796-4a4e-8570-dc66ea942063 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1548 microversion: 2.1 time: 0.154821 Oct 11 02:34:03.704152 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3667/7382] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:03 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:34:03.726878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:03.727529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:03.734376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.734859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.735296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.736014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.736473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.736901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.864027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:03.872242 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-db8a7eb4-11d7-4f8a-941e-feb1ea1e990c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1548 microversion: 2.1 time: 0.149904 Oct 11 02:34:03.872823 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3716/7383] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:03 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:03.894238 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:03.899145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:03.899969 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Searching by: {'deleted': False, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 02:34:03.905204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.905707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.906156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.906915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.907417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.907869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.931695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 02:34:03.958264 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91ac8b8b-b84e-4eb9-8c4e-3a2b85eba803 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067919 Oct 11 02:34:03.958856 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3668/7384] 10.222.0.66 () {58 vars in 1125 bytes} [Tue Oct 11 02:34:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:34:03.970914 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:03.971572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:03.978017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.978498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.978935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:03.979658 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:03.980115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:03.980563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:04.118204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:04.126019 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e546f4d-36cc-4c5b-878b-bd1db56cd6b1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1548 microversion: 2.1 time: 0.159020 Oct 11 02:34:04.126602 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3717/7385] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:03 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:05.645418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "390e065f-3129-4173-9f09-a08e3a9fc88e"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:34:05.647899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:05.654714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:05.655219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:05.655710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:05.656422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:05.656894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:05.657338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:05.948758 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8e77881-2f5a-4d7c-8bc1-be179289fae9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307274 Oct 11 02:34:05.952154 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3669/7386] 10.222.0.66 () {60 vars in 1323 bytes} [Tue Oct 11 02:34:05 2022] POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:34:16.734558 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:16.735173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:16.737315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=21 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:34:16.737964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=72 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:34:16.743777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:16.744265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:16.744703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:16.745395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:16.745846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:16.746268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:16.872662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:16.880977 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54bb5578-9446-4877-ad2a-561b52c01d24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1594 microversion: 2.1 time: 0.150607 Oct 11 02:34:16.881559 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3718/7387] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:16 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:34:18.793008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:34:18.793951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=21 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:34:18.796110 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:34:18.815987 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:34:18.831550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:18.832471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:18.833190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:18.847286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] Creating event network-changed:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:34:18.853563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-477243d0-bfa7-4a7a-b831-85f5b4ab6c49 req-e47edced-7296-47e7-83ec-7e5e11cb59a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062342 Oct 11 02:34:18.854311 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3670/7388] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:34:19.957177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1694432860"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:34:19.957768 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:19.965871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:19.966357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:19.966822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:19.967555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:19.968014 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:19.968442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:20.097243 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.network.security_group_api [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Adding security group cc72918d-1338-4a1b-b5cd-31e6ab07387d to port eff1f958-f9f5-4474-8ba4-deee5468b619 Oct 11 02:34:20.416113 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a2e6d90-bbdd-48c4-ac6a-d13c5baf28a2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.462793 Oct 11 02:34:20.416974 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3719/7389] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:34:19 2022] POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:34:20.426457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:34:20.427769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:34:20.435029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:20.436342 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:20.436850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:20.437587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:20.438069 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:20.438520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:20.588638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:34:20.597175 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9756bbce-f7f4-4974-b0c8-997d1266eca9 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1760 microversion: 2.1 time: 0.175758 Oct 11 02:34:20.597868 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3671/7390] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:34:20 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:34:20.867626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:34:20.877791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:34:20.878347 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:34:20.878873 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:34:20.891941 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] Creating event network-changed:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:34:20.897902 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8faf4422-c0cc-4ed7-9bc6-57f03bcd6f34 req-09ded1bf-f5a1-48be-9cbf-89277172e34f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034002 Oct 11 02:34:20.899309 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3720/7391] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:35:15.040792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:35:15.041571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:35:15.086403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:35:15.089083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:15.095083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:15.095619 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:15.096077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:15.096788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:15.097260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:15.097704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:15.169123 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efa6f967-dc04-4bcb-8538-4234ad5f43c0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.133212 Oct 11 02:35:15.169748 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3672/7392] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:35:15 2022] POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:35:15.178808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:15.179548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:15.183307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:35:15.183989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=12 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:35:15.190424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:15.190918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:15.191405 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:15.192113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:15.192572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:15.192998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:15.344762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:15.353858 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d3c41d87-2a74-4383-9e73-6517e0e67680 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1752 microversion: 2.1 time: 0.179362 Oct 11 02:35:15.354452 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3721/7393] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:15 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:16.380478 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:16.381125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:16.387990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:16.388496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:16.388948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:16.389658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:16.390129 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:16.390575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:16.531908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:16.540189 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31d9b8bc-fca7-4d06-b592-988c6ce602ae tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.165108 Oct 11 02:35:16.540769 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3673/7394] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:16 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:17.563942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:17.564550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:17.571958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:17.572445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:17.572888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:17.573582 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:17.574041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:17.574469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:17.718972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:17.727260 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-07ea7aa6-e144-4355-b0c0-dfd3eba6a79d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.167371 Oct 11 02:35:17.727875 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3722/7395] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:17 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:18.751273 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:18.751927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:18.759076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:18.759599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:18.760050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:18.760777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:18.761241 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:18.761680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:18.901311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:18.909536 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e07cfdb2-e63c-4865-9767-767aec03a7fb tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.162418 Oct 11 02:35:18.910115 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3674/7396] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:18 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:19.933103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:19.933721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:19.940480 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:19.940965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:19.941398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:19.942086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:19.942540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:19.942966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:20.089838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:20.097747 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91072606-0609-4fd7-89da-135a8ef84de2 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.169170 Oct 11 02:35:20.098332 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3723/7397] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:19 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:21.122229 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:21.122858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:21.129764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:21.130261 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:21.130709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:21.131438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:21.131905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:21.132346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:21.273156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:21.281495 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aa314e17-7751-4f31-8ffe-345699790c79 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.163904 Oct 11 02:35:21.282073 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3675/7398] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:21 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:22.304357 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:22.305005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:22.308594 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:35:22.308741 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:35:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e (ip 10.222.0.66) !!! Oct 11 02:35:22.318057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:22.318543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:22.318979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:22.319703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:22.320169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:22.320589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:22.466389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:22.474593 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-67df80c5-151f-48f3-acfd-3f0bc4d3718c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.174173 Oct 11 02:35:22.475169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3724/7399] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:22 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:23.498254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:23.498889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:23.505928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:23.506435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:23.506896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:23.507655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:23.508127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:23.508571 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:23.652501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:23.660856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cf4198a-929b-45ea-8197-eac6c3742877 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.167156 Oct 11 02:35:23.661444 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3676/7400] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:23 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:24.685025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:24.685676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:24.692617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:24.693109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:24.693550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:24.694245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:24.694706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:24.695139 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:24.835103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:24.843723 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1a3c08f6-1f07-4cbc-a2cf-c1ac7a2d93fc tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.163119 Oct 11 02:35:24.844305 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3725/7401] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:24 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:25.867058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:25.867699 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:25.875558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:25.876059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:25.876517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:25.877232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:25.877705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:25.878152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:26.025157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:26.033762 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd79a409-036d-46da-a86c-ba3c58115c24 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.170682 Oct 11 02:35:26.034384 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3677/7402] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:25 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:27.058146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:27.058764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:27.065721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:27.066211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:27.066659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:27.067361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:27.067820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:27.068248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:27.212979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:27.221382 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e794058-0cc9-4f72-b14c-0419b8cd9cb1 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.167719 Oct 11 02:35:27.221983 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3726/7403] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:27 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:28.244975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:28.245614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:28.252490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:28.252992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:28.253450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:28.254160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:28.254633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:28.255076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:28.400137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:28.408526 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d8ad535-6447-401b-b9bb-dea7928cda49 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.168058 Oct 11 02:35:28.409114 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3678/7404] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:28 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:29.432691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:29.433226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:29.440136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:29.440622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:29.441067 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:29.441759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:29.442218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:29.442648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:29.588163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:29.596474 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b55137da-fd88-48ca-8652-c3f8b343be8d tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.168458 Oct 11 02:35:29.597053 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3727/7405] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:29 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:30.621088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:30.621725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:30.628524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:30.629034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:30.629496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:30.630217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:30.630695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:30.631144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:30.772315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:30.780657 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a3841878-982e-4265-8949-0be0f2b82c78 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1757 microversion: 2.1 time: 0.164119 Oct 11 02:35:30.781224 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3679/7406] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:30 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:35:31.803712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:35:31.804314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:35:31.811781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:31.812261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:31.812693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:31.813376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:35:31.813826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:35:31.814248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:35:31.966497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:35:31.974653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-09c6af0c-c247-4a07-9201-c2afdfabec9c tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1760 microversion: 2.1 time: 0.174958 Oct 11 02:35:31.975224 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3728/7407] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:35:31 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:36:35.173388 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:36:35.174157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:36:35.178828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1694432860"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:36:35.179503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:35.187934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:35.188450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:35.188934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:35.189655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:35.190133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:35.190579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:35.321037 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Removing security group cc72918d-1338-4a1b-b5cd-31e6ab07387d from port eff1f958-f9f5-4474-8ba4-deee5468b619 Oct 11 02:36:35.627857 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3a06c1e-95cb-45a1-a4e9-ef0d93dd1322 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.456630 Oct 11 02:36:35.628293 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3680/7408] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:36:35 2022] POST /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:36:35.635667 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:36:35.636503 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=48 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:36:35.769325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:36:35.779874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:35.780963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:35.781865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:35.794685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] Creating event network-changed:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:36:35.799821 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] [6a0dba5f-81d4-4db0-9ba5-dbfd85ea334f] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:36:36.807397 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] [6a0dba5f-81d4-4db0-9ba5-dbfd85ea334f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 40846. Oct 11 02:36:36.811247 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4c3268bf-6f93-4452-8d61-6386d57b6e3f req-83404937-7619-4254-a801-42b5e9c79c4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.179501 Oct 11 02:36:36.812679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3729/7409] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:36:37.097296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:37.100977 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:36:37.104878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:37.111978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:37.112635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:37.113166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:37.120766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:37.121810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:37.122436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:37.123476 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:37.124104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:37.124702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:37.125300 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] Creating event network-changed:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:36:37.130672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8d81112e-b3d0-4521-adea-92ff92d2410c req-60134776-0e02-4ba2-82ba-45a76c106eeb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039800 Oct 11 02:36:37.131976 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3730/7410] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:37.217320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lazy-loading 'services' on Instance uuid 4fecbb03-7e4f-4d51-9398-0db5a1236f1e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:36:37.298007 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-02d6308d-aa92-46cf-8209-b26ec47e1ff6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments/390e065f-3129-4173-9f09-a08e3a9fc88e" status: 202 len: 0 microversion: 2.1 time: 0.209657 Oct 11 02:36:37.298621 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3681/7411] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:36:37 2022] DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments/390e065f-3129-4173-9f09-a08e3a9fc88e => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:36:37.307714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:37.310094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:37.324241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:37.325258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:37.326140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:37.327265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:37.328114 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:37.328726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:37.375527 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-512385a6-7287-4dbf-9ed8-027f95a27561 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070966 Oct 11 02:36:37.376570 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3731/7412] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:37 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:38.391236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:38.393669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:38.400017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:38.400526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:38.400984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:38.401701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:38.402173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:38.402614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:38.432532 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a085b310-1e05-4d8c-9390-c409f27b2bdd tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Oct 11 02:36:38.433117 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3682/7413] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:38 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:39.445208 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:39.447671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:39.455075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:39.455687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:39.456201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:39.457073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:39.457687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:39.457957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:39.489420 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d6829887-9e4b-4a47-ba75-8f12847da010 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Oct 11 02:36:39.489997 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3732/7414] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:39 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:40.502363 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:40.504656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:40.511654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:40.512165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:40.512627 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:40.513346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:40.513826 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:40.514275 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:40.544954 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1a2732e-f2b3-473f-b66a-fc24ca76b9e4 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Oct 11 02:36:40.545548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3683/7415] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:40 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:41.556949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:41.559321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:41.566353 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:41.566916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:41.567453 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:41.568278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:41.568813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:41.569313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:41.599894 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2937b082-8708-41af-8939-257dd650ce01 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046989 Oct 11 02:36:41.600715 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3733/7416] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:41 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:42.612126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:42.614332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:42.621179 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:42.621675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:42.622124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:42.622825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:42.623293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:42.623751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:42.652631 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83c90949-5db6-4691-8b1e-191dfc4fcc98 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044635 Oct 11 02:36:42.653190 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3684/7417] 10.222.0.66 () {58 vars in 1302 bytes} [Tue Oct 11 02:36:42 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 02:36:42.664598 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:42.665096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:42.672791 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:42.673284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:42.673980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:42.674688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:42.675151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:42.675610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:42.752399 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] HTTP exception thrown: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e is not attached to volume 390e065f-3129-4173-9f09-a08e3a9fc88e Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Request method failure captured: Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: request: DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments/390e065f-3129-4173-9f09-a08e3a9fc88e HTTP/1.1 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNUL5W9ftqfUvVLSXHN0t4FWHS7RhsS1S0OxBk1S_tp2qkUaTaDGANGYllfLjnTVXk3vCXV-rnD7JgqFknckC4itTJ_46GOh-iXU2Bk8FP2x8ZvQKdgJZOErxUio--vCbZNRMPcp1WwgphRWQQitllDs8NsQ6iDaSgZWvylaxXHtPVg Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 37eee3a25d5546a2af88acee3b42d56c Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e is not attached to volume 390e065f-3129-4173-9f09-a08e3a9fc88e Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'server_id': '4fecbb03-7e4f-4d51-9398-0db5a1236f1e', 'id': '390e065f-3129-4173-9f09-a08e3a9fc88e'} Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 390e065f-3129-4173-9f09-a08e3a9fc88e. Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e is not attached to volume 390e065f-3129-4173-9f09-a08e3a9fc88e Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:36:42.754075 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e is not attached to volume 390e065f-3129-4173-9f09-a08e3a9fc88e Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Returning 404 to user: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e is not attached to volume 390e065f-3129-4173-9f09-a08e3a9fc88e {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-97df054e-acb7-4c60-b322-df7c18c47a0f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments/390e065f-3129-4173-9f09-a08e3a9fc88e" status: 404 len: 154 microversion: 2.1 time: 0.095069 Oct 11 02:36:42.758992 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3734/7418] 10.222.0.66 () {58 vars in 1416 bytes} [Tue Oct 11 02:36:42 2022] DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e/os-volume_attachments/390e065f-3129-4173-9f09-a08e3a9fc88e => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:36:46.006874 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:46.007471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:46.014524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:46.015036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:46.015598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:46.016331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:46.016807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:46.017258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:46.042957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:36:46.130696 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20e5824d-e6ee-4991-808f-b59ddb99aba6 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 204 len: 0 microversion: 2.1 time: 0.127390 Oct 11 02:36:46.131587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3685/7419] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:36:46 2022] DELETE /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:36:46.140180 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:46.140820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:46.148131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:46.148879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:46.149544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:46.150458 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:46.151133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:46.151783 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:46.285891 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:36:46.293672 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9cd7b2ae-2e44-4d5d-a494-acfaaf2eb429 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1554 microversion: 2.1 time: 0.157994 Oct 11 02:36:46.294256 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3735/7420] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:36:46 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:36:47.317460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:47.318219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:47.328959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:47.329459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:47.329916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:47.330630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:47.331104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:47.331582 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:47.465027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:36:47.473878 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-915987c1-730e-451c-af34-d1e43d824d5f tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1554 microversion: 2.1 time: 0.160817 Oct 11 02:36:47.474475 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3686/7421] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:36:47 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:36:48.372707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fecbb03-7e4f-4d51-9398-0db5a1236f1e", "name": "network-vif-deleted", "tag": "eff1f958-f9f5-4474-8ba4-deee5468b619"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:36:48.383874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:48.384361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:48.385438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:48.397694 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] Creating event network-vif-deleted:eff1f958-f9f5-4474-8ba4-deee5468b619 for instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e on n-h2-772273-9 Oct 11 02:36:48.402606 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-49f8243b-e2fe-40df-b671-99947f504b60 req-1a8f7d1c-212d-4842-b401-8fecd4b11520 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033897 Oct 11 02:36:48.403213 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3736/7422] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:36:48.497173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:48.497902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:48.505617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:48.506190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:48.506709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:48.507570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:48.508106 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:48.508611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:48.540251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:48.540752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:48.541197 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:48.541658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lazy-loading 'fault' on Instance uuid 4fecbb03-7e4f-4d51-9398-0db5a1236f1e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:36:48.582784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eee3a25d5546a2af88acee3b42d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e4c52c7a86411ea795cbb0e2a15d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:36:48.590984 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f4406b4-e19f-41ff-ba79-00247c4362e7 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 200 len: 1348 microversion: 2.1 time: 0.097588 Oct 11 02:36:48.591544 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3687/7423] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:36:48 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:36:49.617055 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:49.617706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] [instance: 4fecbb03-7e4f-4d51-9398-0db5a1236f1e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:36:49.623886 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:49.624373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:49.624811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:49.625499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:36:49.625955 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:36:49.626383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:36:49.640162 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] HTTP exception thrown: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Request method failure captured: Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e HTTP/1.1 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNUL5W9ftqfUvVLSXHN0t4FWHS7RhsS1S0OxBk1S_tp2qkUaTaDGANGYllfLjnTVXk3vCXV-rnD7JgqFknckC4itTJ_46GOh-iXU2Bk8FP2x8ZvQKdgJZOErxUio--vCbZNRMPcp1WwgphRWQQitllDs8NsQ6iDaSgZWvylaxXHtPVg Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/51e4c52c7a86411ea795cbb0e2a15d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 51e4c52c7a86411ea795cbb0e2a15d2f Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970341831 Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 37eee3a25d5546a2af88acee3b42d56c Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestMinimumBasicScenario-970341831-project Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '4fecbb03-7e4f-4d51-9398-0db5a1236f1e'} Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:36:49.641775 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Returning 404 to user: Instance 4fecbb03-7e4f-4d51-9398-0db5a1236f1e could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a60f091f-4088-4abf-b090-61429da87c15 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e" status: 404 len: 111 microversion: 2.1 time: 0.031399 Oct 11 02:36:49.646581 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3737/7424] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:36:49 2022] GET /compute/v2.1/servers/4fecbb03-7e4f-4d51-9398-0db5a1236f1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:36:49.651786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09a05374-696d-40d2-a016-35b087d137d0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] Calling method '.version_select at 0x7f112fa3ff70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:36:49.671914 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09a05374-696d-40d2-a016-35b087d137d0 tempest-TestMinimumBasicScenario-970341831 tempest-TestMinimumBasicScenario-970341831-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1377350423" status: 202 len: 0 microversion: 2.1 time: 0.023909 Oct 11 02:36:49.672494 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3688/7425] 10.222.0.66 () {58 vars in 1272 bytes} [Tue Oct 11 02:36:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1377350423 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:36:58.927026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b95c717-4205-4160-aa94-9a4baf26aa2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: .version_select at 0x7f112f69f9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1519152619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAElpwG8pyNfT1lWzB458QGWR3BLAETI9cXFL1yYpBRCgxAicv9f2Kl48XmDEIEShQdcfMlX3hWmVtSlgK4mQqCJqDAIDu0XBkG+7TZ0UxhrqzrAQMqOAnyrc2aXWDaXIQ=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:36:58.942063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6b95c717-4205-4160-aa94-9a4baf26aa2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:36:58.948004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-6b95c717-4205-4160-aa94-9a4baf26aa2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:36:58.973319 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b95c717-4205-4160-aa94-9a4baf26aa2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.207581 Oct 11 02:36:58.973930 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3738/7426] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:36:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:37:04.676667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:04.678809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:04.683983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1616130222", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "3e80ad12-3713-40d1-abbc-3ce68d45f8cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1519152619", "security_groups": [{"name": "tempest-secgroup-smoke-1763649998"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:04.932190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] validate_networks() for [('3e80ad12-3713-40d1-abbc-3ce68d45f8cc', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:37:05.392866 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:37:05.393311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:37:05.393799 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:37:05.394221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:37:05.394645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:37:05.403616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:05.404118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:05.404574 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:05.405324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:05.405795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:05.406235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:05.425255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:37:05.430552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:37:05.443811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:37:05.446151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:37:05.493584 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9f91921e-7fc9-478e-ae6c-931309f0296d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818667 Oct 11 02:37:05.494490 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3689/7427] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:37:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:37:05.503752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=38 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:05.512876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-89c28599-e725-4798-a396-325bd0dc2a80 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:05.513661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-89c28599-e725-4798-a396-325bd0dc2a80 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:05.647712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-89c28599-e725-4798-a396-325bd0dc2a80 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:05.657462 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-89c28599-e725-4798-a396-325bd0dc2a80 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1267 microversion: 2.1 time: 0.155007 Oct 11 02:37:05.658152 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3739/7428] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:05 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:06.682882 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:06.684224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:06.694604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:06.695331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:06.696097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:06.696840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:06.697486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:06.698115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:06.777546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:06.801375 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df009018-4744-4717-9cc2-fcccdf0c2b40 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1319 microversion: 2.1 time: 0.124243 Oct 11 02:37:06.802940 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3690/7429] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:06 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:07.826097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:07.827426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:07.829631 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:07.835989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:07.836766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:07.837209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:07.837920 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:07.838389 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:07.838820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:07.973099 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:07.980983 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dee0f3ca-35f4-4cc8-8e62-f5ebe2875e75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.158918 Oct 11 02:37:07.981567 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3740/7430] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:07 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:08.323287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03368a29-251f-41a1-ae12-cbd36be71c8a", "tag": "8c09a418-21a0-4aac-86df-3442f68185ac"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:08.338594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:08.339098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:08.339579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:08.353860 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] Creating event network-changed:8c09a418-21a0-4aac-86df-3442f68185ac for instance 03368a29-251f-41a1-ae12-cbd36be71c8a on n-h1-772273-9 Oct 11 02:37:08.360118 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5dff6974-3f21-4fc1-baa6-c901cf8a1c3c req-d12398ac-0a2a-4a40-8fe3-db8b630471cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041025 Oct 11 02:37:08.360896 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3691/7431] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:37:09.003668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:09.004217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:09.011205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:09.011724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:09.012162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:09.012855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:09.013313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:09.014241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:09.145882 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:09.153921 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9ba9288e-a95c-4a6a-8ac0-a3c2264117ce tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.154122 Oct 11 02:37:09.155518 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3741/7432] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:08 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:10.178130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:10.178860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:10.186504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:10.187015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:10.187525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:10.188248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:10.188729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:10.189176 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:10.321357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:10.329673 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aca76a51-806b-4d42-83b9-1e34be790833 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.155898 Oct 11 02:37:10.330265 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3692/7433] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:10 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:11.353613 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:11.354236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:11.361051 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:11.361541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:11.361986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:11.362683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:11.363163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:11.363601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:11.502362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:11.510485 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1df47850-29fb-4b5e-a839-0fb134a06410 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.161210 Oct 11 02:37:11.511075 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3742/7434] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:11 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:12.533968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:12.534620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:12.541410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:12.541911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:12.542358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:12.543060 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:12.543552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:12.543994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:12.676439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:12.684170 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-90e4289a-1771-4dd4-a990-737dc1816c97 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.154086 Oct 11 02:37:12.684700 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3693/7435] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:12 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:13.707757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:13.708376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:13.715408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:13.715895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:13.716338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:13.717025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:13.717482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:13.717916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:13.857129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:13.865452 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-e04cc37b-8688-47b2-888a-85e7c7dddec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.161664 Oct 11 02:37:13.866271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3743/7436] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:13 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:13.991868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03368a29-251f-41a1-ae12-cbd36be71c8a", "name": "network-vif-plugged", "status": "completed", "tag": "8c09a418-21a0-4aac-86df-3442f68185ac"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:14.002752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:14.003265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:14.003814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:14.015517 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] Creating event network-vif-plugged:8c09a418-21a0-4aac-86df-3442f68185ac for instance 03368a29-251f-41a1-ae12-cbd36be71c8a on n-h1-772273-9 Oct 11 02:37:14.020873 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e2347ee2-f0c7-4828-afbd-08e6d35f4b30 req-20939749-94cb-40d5-93a3-2c557ba5a8ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 Oct 11 02:37:14.021846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3694/7437] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:37:14.888271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:14.889472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:14.896294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:14.896787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:14.897226 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:14.897915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:14.898372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:14.898795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:15.031973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:15.039727 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-20014fa6-30da-4ce2-ab65-13e8f65320b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1393 microversion: 2.1 time: 0.155367 Oct 11 02:37:15.040290 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3744/7438] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:14 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:16.064376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:16.065116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:16.068112 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:16.068842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:16.075286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:16.075818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:16.076282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:16.077027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:16.077503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:16.077952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:16.207770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:16.216027 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f8c5212f-7b55-4af0-ac68-d0e72291e6ae tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1564 microversion: 2.1 time: 0.156155 Oct 11 02:37:16.217111 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3695/7439] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:16 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:16.238838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:16.239492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:16.241345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:16.247628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:16.248642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:16.249088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:16.249786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:16.250245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:16.250674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:16.383982 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:16.392407 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-484cd4ad-cf89-468b-9baa-db56db40b60c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1564 microversion: 2.1 time: 0.157454 Oct 11 02:37:16.392985 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3745/7440] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:16 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:18.267865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:18.268506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:18.269999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03368a29-251f-41a1-ae12-cbd36be71c8a", "tag": "8c09a418-21a0-4aac-86df-3442f68185ac"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:18.275218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:18.276332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:18.276808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:18.277578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:18.278254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:18.278704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:18.281847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:18.282333 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:18.282769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:18.294353 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] Creating event network-changed:8c09a418-21a0-4aac-86df-3442f68185ac for instance 03368a29-251f-41a1-ae12-cbd36be71c8a on n-h1-772273-9 Oct 11 02:37:18.299805 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7fb675c5-6973-4e27-b48f-95006f311a01 req-b9fc5f0c-9b4e-40a0-8764-d442499201e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033582 Oct 11 02:37:18.300621 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3746/7441] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:37:18.426169 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:18.434265 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4dde0eb-9ae0-4355-9ccc-34b9174d53c1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1564 microversion: 2.1 time: 0.170880 Oct 11 02:37:18.434984 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3696/7442] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:18 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:41.690855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=13 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:41.691621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=38 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:41.695821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:41.698110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:41.705004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:41.705487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:41.705924 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:41.706616 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:41.707074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:41.707548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:41.760435 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1325517b-8f3b-4bec-8f09-430ca4676b4f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action" status: 200 len: 24574 microversion: 2.1 time: 0.071669 Oct 11 02:37:41.761093 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3747/7443] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:37:41 2022] POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:37:52.866391 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:52.866957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:52.869276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:52.869949 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=36 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:52.876797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:52.877293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:52.877742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:52.878447 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:52.878943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:52.879405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:52.943987 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-629c5051-f346-4e69-89da-ed22d5300d0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action" status: 202 len: 0 microversion: 2.1 time: 0.081446 Oct 11 02:37:52.944619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3697/7444] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:37:52 2022] POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:37:52.954705 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:52.955424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:52.958276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:52.959641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:37:52.966881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:52.967388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:52.967828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:52.968521 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:52.968970 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:52.969470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:53.106933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:53.115550 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-11263e81-807e-4636-b9b2-ec9c841a6942 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1688 microversion: 2.1 time: 0.165591 Oct 11 02:37:53.116348 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3748/7445] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:52 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:54.141693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:54.142460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:54.148653 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:54.149150 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:54.149600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:54.150297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:54.150763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:54.151205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:54.286649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:54.294401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-74a15993-b12c-4e04-81f8-ca12edef4da7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1668 microversion: 2.1 time: 0.158039 Oct 11 02:37:54.294971 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3698/7446] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:54 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:55.387608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:55.389856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:55.400871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.401358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.401789 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.402479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.402933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.403394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.452620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a78b1c2a-9ec1-43d9-a2dc-2d874d7189de tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action" status: 200 len: 32645 microversion: 2.1 time: 0.068902 Oct 11 02:37:55.453279 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3749/7447] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:37:55 2022] POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action => generated 32645 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:37:55.465136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:55.465691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:55.472589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.473089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.473539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.474239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.474702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.475136 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.542331 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b9f2dc2-2893-46ab-8c95-6f5b4b8136f6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action" status: 202 len: 0 microversion: 2.1 time: 0.081181 Oct 11 02:37:55.543128 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3699/7448] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:37:55 2022] POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 02:37:55.552892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:55.553607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:55.560765 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.561416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.561919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.562712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:55.563784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:55.564223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:55.701428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:55.709828 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b7f73d1b-5948-4eb5-8647-f487de7328c7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1675 microversion: 2.1 time: 0.161335 Oct 11 02:37:55.710409 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3750/7449] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:55 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:56.734906 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:56.735654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:56.742615 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:56.743119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:56.743600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:56.744315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:56.744787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:56.745234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:56.877309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:56.885082 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-048f16b2-766f-491d-9fe8-145330fcb183 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1683 microversion: 2.1 time: 0.154499 Oct 11 02:37:56.885655 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3700/7450] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:56 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:56.983062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:56.985894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:56.993454 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:56.993935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:56.994370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:56.995054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:56.995541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:56.995967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:57.045123 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-af4947ad-9282-469b-96d0-5643b7f542e7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action" status: 200 len: 38443 microversion: 2.1 time: 0.065718 Oct 11 02:37:57.045896 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3751/7451] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:37:56 2022] POST /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a/action => generated 38443 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:37:58.042712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:58.043239 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:58.048622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03368a29-251f-41a1-ae12-cbd36be71c8a", "tag": "8c09a418-21a0-4aac-86df-3442f68185ac"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:37:58.050902 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:58.051440 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:58.051908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:58.052647 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:58.053123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:58.053798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:58.059015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:58.059525 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:58.059956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:58.072308 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] Creating event network-changed:8c09a418-21a0-4aac-86df-3442f68185ac for instance 03368a29-251f-41a1-ae12-cbd36be71c8a on n-h1-772273-9 Oct 11 02:37:58.077685 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a08d0fd4-61bc-4aff-a365-c17a9f80820e req-223cf591-46a9-4b06-ac39-2f698f8fb6ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Oct 11 02:37:58.079205 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3752/7452] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:37:58.083245 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:37:58.168594 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40544e6a-4175-440f-8b89-9e347ad29698 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 204 len: 0 microversion: 2.1 time: 0.129682 Oct 11 02:37:58.174079 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3701/7453] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:37:58 2022] DELETE /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:37:58.183599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:58.184259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:58.191429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:58.192137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:58.192757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:58.193624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:58.194231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:58.194888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:58.333450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:58.341534 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-93f9c11b-e1cb-4414-8c9e-b208cf76520d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1689 microversion: 2.1 time: 0.166080 Oct 11 02:37:58.342217 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3753/7454] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:58 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:37:59.368154 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:37:59.368952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:37:59.375589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:59.376102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:59.376562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:59.377280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:37:59.377791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:37:59.378242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:37:59.510203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:37:59.518685 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d238e375-d0dc-4e32-bdbe-0705df8d8f18 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1689 microversion: 2.1 time: 0.155160 Oct 11 02:37:59.519267 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3702/7455] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:37:59 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:00.188277 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03368a29-251f-41a1-ae12-cbd36be71c8a", "name": "network-vif-deleted", "tag": "8c09a418-21a0-4aac-86df-3442f68185ac"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:00.199359 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:00.199867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:00.200296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:00.211214 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] Creating event network-vif-deleted:8c09a418-21a0-4aac-86df-3442f68185ac for instance 03368a29-251f-41a1-ae12-cbd36be71c8a on n-h1-772273-9 Oct 11 02:38:00.216006 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-7fb3fc16-ec9a-4884-9f8b-1a2c8bdec725 req-c0a857cc-12e9-4b25-926b-0e4652da89d7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Oct 11 02:38:00.216615 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3754/7456] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:38:00.542260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:00.543190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:00.551180 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:00.551744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:00.552208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:00.552983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:00.553460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:00.553982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:00.589921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:00.590366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:00.590848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:00.591406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lazy-loading 'fault' on Instance uuid 03368a29-251f-41a1-ae12-cbd36be71c8a {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:38:00.635772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:00.644136 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2f677878-6432-45a6-afc2-8a3b7d8b2a09 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 200 len: 1357 microversion: 2.1 time: 0.105905 Oct 11 02:38:00.644730 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3703/7457] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:00 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:01.669980 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:01.670690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 03368a29-251f-41a1-ae12-cbd36be71c8a] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:01.677509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:01.677999 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:01.678445 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:01.679142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:01.679624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:01.680058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:01.693475 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] HTTP exception thrown: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Request method failure captured: Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a HTTP/1.1 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNbKjY6ZdcgMNXZyMPcF7Su1j_UZbMM4gBKQB8_4heR9wHR5HVtdPEr4V2AlDJ3VVgozFKwOBwkqXAgTfjUJZ4i5JF0O-KLvI51urS0Mi2DK7LRSs6iqi4TGM5WQ2SL8_sjbWQoLGyhu_9GbjYrr9wp8g4fWlQgv9MiLVEH40aB62a0 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26e8eca70cc34ca9a6896185d3b420e1 Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '03368a29-251f-41a1-ae12-cbd36be71c8a'} Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:38:01.695132 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Returning 404 to user: Instance 03368a29-251f-41a1-ae12-cbd36be71c8a could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2a1567c5-e67f-415d-8e5c-383e2bff232d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a" status: 404 len: 111 microversion: 2.1 time: 0.031820 Oct 11 02:38:01.700059 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3755/7458] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:01 2022] GET /compute/v2.1/servers/03368a29-251f-41a1-ae12-cbd36be71c8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 02:38:04.991145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-da0f02ae-fa7b-441d-9209-26d9edd5216d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '.version_select at 0x7f1134151940>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:05.013102 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-da0f02ae-fa7b-441d-9209-26d9edd5216d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1519152619" status: 202 len: 0 microversion: 2.1 time: 0.025787 Oct 11 02:38:05.014669 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3704/7459] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 02:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1519152619 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 02:38:05.047876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-789accff-5619-4458-94cf-9422539ff02a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: .version_select at 0x7f112f7aac10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1181276476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeXi8tmRyEwjvaWuCKalKBAaI+KBL5WkZ1jXIUjXoQ9SeHYwGLSSjqYlVRRYO6+FKsyJBf9Dx/lUHiybQKsmwzl36OdiXoIavXostkXu71xWiUkfgi9P266gDhsO0Boog=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:05.065109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-789accff-5619-4458-94cf-9422539ff02a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:38:05.070237 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-789accff-5619-4458-94cf-9422539ff02a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:38:05.093044 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-789accff-5619-4458-94cf-9422539ff02a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050933 Oct 11 02:38:05.093649 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3756/7460] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:38:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:38:11.237039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-894229005", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "20edc9f3-f9f0-4e6c-bb3e-8f28c028056e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1181276476", "security_groups": [{"name": "tempest-secgroup-smoke-1597117598"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:11.248672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:11.359076 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] validate_networks() for [('20edc9f3-f9f0-4e6c-bb3e-8f28c028056e', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:38:11.789286 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:38:11.789795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:38:11.790353 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:38:11.790959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:38:11.791492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:38:11.801480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:11.801995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:11.802458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:11.803250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:11.803855 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:11.804333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:11.824971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:38:11.830421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:38:11.843508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:38:11.846013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:38:11.896071 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92c45857-a381-405c-bf76-e3ae1fb421f9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.663337 Oct 11 02:38:11.896944 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3705/7461] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:38:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:38:11.906271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=32 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:11.911859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1c26c1b1-6a0b-43b8-a51e-1f0aaeeac2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:11.912584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1c26c1b1-6a0b-43b8-a51e-1f0aaeeac2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:11.969962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1c26c1b1-6a0b-43b8-a51e-1f0aaeeac2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:11.976922 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1c26c1b1-6a0b-43b8-a51e-1f0aaeeac2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1266 microversion: 2.1 time: 0.072442 Oct 11 02:38:11.977502 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3757/7462] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:11 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:38:13.000603 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60278726-bd22-4e69-9583-ab961527d5e9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:13.001531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60278726-bd22-4e69-9583-ab961527d5e9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:13.073921 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-60278726-bd22-4e69-9583-ab961527d5e9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:13.081283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60278726-bd22-4e69-9583-ab961527d5e9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1266 microversion: 2.1 time: 0.085505 Oct 11 02:38:13.081900 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3706/7463] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:12 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:14.104853 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1f639cd-146a-4189-84eb-27dd402d867d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:14.105464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1f639cd-146a-4189-84eb-27dd402d867d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:14.166066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1f639cd-146a-4189-84eb-27dd402d867d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:14.174307 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1f639cd-146a-4189-84eb-27dd402d867d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1266 microversion: 2.1 time: 0.073261 Oct 11 02:38:14.174888 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3758/7464] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:14 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:15.198324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4b5c5c06-332b-44ae-97a0-01d142e7eb04 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:15.199103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4b5c5c06-332b-44ae-97a0-01d142e7eb04 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:15.255265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4b5c5c06-332b-44ae-97a0-01d142e7eb04 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:15.263286 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4b5c5c06-332b-44ae-97a0-01d142e7eb04 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1266 microversion: 2.1 time: 0.069098 Oct 11 02:38:15.264159 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3707/7465] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:15 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:16.286661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:16.287305 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:16.294187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:16.294674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:16.295112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:16.295839 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:16.296303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:16.296730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:16.358065 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:16.366588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-55bba39d-6c28-48e0-9944-64a12bedd5a5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1270 microversion: 2.1 time: 0.083795 Oct 11 02:38:16.367524 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3759/7466] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:16 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:17.389485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:17.390123 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:17.398041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:17.398556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:17.399018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:17.399821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:17.400296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:17.400842 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:17.470898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:17.478655 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-004e1ae9-5cb6-43f8-a2af-5ad0ed675869 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1324 microversion: 2.1 time: 0.093112 Oct 11 02:38:17.479240 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3708/7467] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:17 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1324 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:18.345140 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3086-deae-476f-9feb-2d8354c35d60", "tag": "143b0bdb-d297-4b7a-86f2-60acc8e9a209"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:18.355730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:18.356215 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:18.356659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:18.369640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] Creating event network-changed:143b0bdb-d297-4b7a-86f2-60acc8e9a209 for instance b51d3086-deae-476f-9feb-2d8354c35d60 on n-h1-772273-9 Oct 11 02:38:18.374849 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-a49a6b9d-64a5-4fd0-ab0d-9465939de15c req-1cc163f0-db0f-48e0-b8a1-09ceea9c4edc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034536 Oct 11 02:38:18.376486 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3760/7468] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:38:18.503810 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:18.504445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:18.511297 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:18.511829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:18.512283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:18.512994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:18.513460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:18.513901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:18.722824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:18.730520 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56db63c7-2ffd-400b-8726-2363c7b40ccb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.231575 Oct 11 02:38:18.731103 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3709/7469] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:18 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:19.755892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:19.756606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:19.762888 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:19.763412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:19.763863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:19.764573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:19.765038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:19.765472 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:19.995897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:20.003876 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-875e5c9f-42db-47ed-92de-1fd508e34acc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.253121 Oct 11 02:38:20.004469 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3761/7470] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:19 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:21.026289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:21.026925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:21.033928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:21.034438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:21.034898 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:21.035655 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:21.036159 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:21.036608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:21.170465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:21.178903 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9811c4e7-0c82-4b25-ab5b-8a0c26273a96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.156707 Oct 11 02:38:21.179523 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3710/7471] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:21 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:22.201993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:22.202617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:22.209471 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:22.209964 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:22.210406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:22.211422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:22.211881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:22.212309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:22.348284 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:22.355989 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-40dd5c8b-0c1e-49f8-837e-3f9709e51adc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.157988 Oct 11 02:38:22.356577 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3762/7472] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:22 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:23.380725 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:23.381393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:23.383276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:23.385045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:23.391491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:23.392001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:23.392467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:23.393186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:23.393665 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:23.394113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:23.533258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:23.540983 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-649d20f9-ce65-4745-91cb-8236cfde070d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.164249 Oct 11 02:38:23.541569 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3711/7473] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:23 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:24.373681 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3086-deae-476f-9feb-2d8354c35d60", "name": "network-vif-plugged", "status": "completed", "tag": "143b0bdb-d297-4b7a-86f2-60acc8e9a209"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:24.381187 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:24.381948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:24.387358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:24.387867 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:24.388308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:24.400589 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] Creating event network-vif-plugged:143b0bdb-d297-4b7a-86f2-60acc8e9a209 for instance b51d3086-deae-476f-9feb-2d8354c35d60 on n-h1-772273-9 Oct 11 02:38:24.405642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b10deecd-8379-409f-ab32-0fbb51db4371 req-dd72c45a-05ac-4225-bc1c-ea5b88046da2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Oct 11 02:38:24.406259 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3763/7474] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:38:24.564596 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:24.565263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:24.572137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:24.572642 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:24.573102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:24.573822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:24.574302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:24.574750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:24.703119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:24.711427 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a452012-81d9-4270-95d8-ec82213de6d4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1392 microversion: 2.1 time: 0.151393 Oct 11 02:38:24.712016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3712/7475] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:24 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:25.736009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:25.736630 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:25.742759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:25.743242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:25.743752 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:25.744452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:25.744907 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:25.745336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:25.879759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:25.887591 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-901a8615-d754-4eb2-85de-d1a43485219e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1565 microversion: 2.1 time: 0.157443 Oct 11 02:38:25.888162 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3764/7476] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:25 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:25.910024 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:25.910650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:25.912538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:25.918480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:25.918977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:25.919459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:25.920165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:25.920628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:25.921066 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:26.056182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:26.065666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee9a0481-b547-4d61-8172-bc2597f5c8cd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1565 microversion: 2.1 time: 0.160052 Oct 11 02:38:26.066270 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3713/7477] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:25 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:27.648581 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:38:27.649207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:27.650550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3086-deae-476f-9feb-2d8354c35d60", "tag": "143b0bdb-d297-4b7a-86f2-60acc8e9a209"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:27.656538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:27.657425 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:27.657574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:27.658474 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:27.659627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:27.659627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:27.661096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:27.661593 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:27.662037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:27.674502 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] Creating event network-changed:143b0bdb-d297-4b7a-86f2-60acc8e9a209 for instance b51d3086-deae-476f-9feb-2d8354c35d60 on n-h1-772273-9 Oct 11 02:38:27.681446 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6e09fdf7-2549-4864-bef4-4be7e64bd1f5 req-7b574c1e-df89-4e58-adbc-2362e5e7cac6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034563 Oct 11 02:38:27.682213 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3714/7478] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:38:27.890668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:38:27.899375 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f95f3680-7a33-467b-aac7-52ab2ab7f1f3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1565 microversion: 2.1 time: 0.255006 Oct 11 02:38:27.900205 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3765/7479] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:38:27 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:38:51.191489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:38:51.193915 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:38:51.196252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:51.196917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=40 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:38:51.204609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:51.205125 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:51.205586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:51.206313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:38:51.206800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:38:51.207255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:38:51.260981 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1c8ecb1-ef07-44ab-8743-17c7ecc8e8e0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action" status: 200 len: 24564 microversion: 2.1 time: 0.074366 Oct 11 02:38:51.261635 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3715/7480] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:38:51 2022] POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action => generated 24564 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:39:02.374975 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:39:02.377781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:02.380276 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:02.380938 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:02.382092 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:39:02.382220 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action (ip 10.222.0.66) !!! Oct 11 02:39:02.389542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:02.390027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:02.390464 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:02.391159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:02.391641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:02.392072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:02.465484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ca53cf75-697e-4537-8834-cd05a92a49bc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action" status: 202 len: 0 microversion: 2.1 time: 0.094253 Oct 11 02:39:02.466365 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3766/7481] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:39:02 2022] POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:39:02.475892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:02.476612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:02.479283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:02.479986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:02.487683 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:02.488185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:02.488635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:02.489345 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:02.489820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:02.490257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:03.034074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:03.041688 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c4843e9c-5d0e-44ef-ae4c-a78b305d7e42 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1676 microversion: 2.1 time: 0.570091 Oct 11 02:39:03.042628 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3716/7482] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:02 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1676 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:04.065637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:04.066348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:04.074170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:04.074676 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:04.075117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:04.075838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:04.076303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:04.076736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:04.208400 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:04.216063 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-91159599-e72a-42ef-9bfe-62a4617c0819 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.154774 Oct 11 02:39:04.216641 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3767/7483] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:04 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:05.241538 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:05.242174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:05.251525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:05.251525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:05.251924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:05.252729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:05.253263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:05.253808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:05.389234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:05.397106 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82ff5172-0ffa-4e3d-babf-bacb91474cf9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.159568 Oct 11 02:39:05.397684 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3717/7484] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:05 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:06.421098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:06.421627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:06.428563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:06.429054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:06.429519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:06.430222 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:06.430714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:06.431151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:06.563709 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:06.571471 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2d3d6acd-5eba-4b1b-b0ca-22a496508715 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.154423 Oct 11 02:39:06.572046 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3768/7485] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:06 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:07.595051 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:07.595716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:07.602505 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:07.603011 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:07.603504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:07.604218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:07.604691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:07.605137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:07.740163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:07.747944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-028f1193-05ad-46db-aff5-ba9eb151e084 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.156839 Oct 11 02:39:07.748520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3718/7486] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:07 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:08.772123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:08.772739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:08.779085 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:08.779617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:08.780056 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:08.780751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:08.781856 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:08.782285 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:08.912659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:08.920370 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-df36d6bd-b6fb-4b6f-bbac-15b88db25679 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.152230 Oct 11 02:39:08.920952 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3769/7487] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:08 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:09.943887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:09.944501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:09.951385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:09.951894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:09.952361 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:09.953079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:09.953560 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:09.954008 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:10.084702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:10.092752 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b32d2b0b-2a06-4105-94d6-e0db5ee7c92e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.152918 Oct 11 02:39:10.093336 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3719/7488] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:09 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:11.116603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:11.117218 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:11.124260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:11.124753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:11.125775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:11.126478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:11.126940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:11.127398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:11.260455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:11.268278 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7e977180-6ba9-46dd-a6ea-58ec6b5ad58c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.155652 Oct 11 02:39:11.268852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3770/7489] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:11 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:12.291551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:12.292188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:12.299012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:12.299561 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:12.300019 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:12.300733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:12.301207 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:12.301651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:12.434983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:12.443434 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57360d9b-c6b1-483d-8b08-5caa2c102ed6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.155925 Oct 11 02:39:12.444022 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3720/7490] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:12 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:13.468213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:13.468754 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:13.475755 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:13.476240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:13.476675 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:13.477358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:13.477811 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:13.478233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:13.616019 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:13.623707 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-184b024c-e3da-4581-8fd7-c11a3ec86b06 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.159434 Oct 11 02:39:13.624285 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3771/7491] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:13 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:14.647991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:14.648550 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:14.655579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:14.656084 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:14.657046 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:14.657757 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:14.658230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:14.658675 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:14.794569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:14.802361 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-761095cf-ec8d-4f60-82df-c1996a8f2146 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.158422 Oct 11 02:39:14.802915 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3721/7492] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:14 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:15.825374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:15.826004 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:15.833035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:15.833532 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:15.833971 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:15.834671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:15.835432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:15.835863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:15.971671 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:15.979495 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7c9960d5-7bb7-4aa1-94cd-8995d6cdab73 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.158086 Oct 11 02:39:15.980104 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3772/7493] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:15 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:17.004414 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:17.005050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:17.012354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:17.013214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:17.013681 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:17.014399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:17.015217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:17.016352 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:17.149848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:17.161454 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-270975e0-42b8-46f8-8da3-840baba6fb75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.161488 Oct 11 02:39:17.162044 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3722/7494] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:16 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:18.184684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:18.185341 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:18.192940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:18.193430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:18.193872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:18.194570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:18.195032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:18.195518 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:18.325498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:18.333947 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9866b9f6-acb5-4c32-a06b-6262f8c9bbfb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1681 microversion: 2.1 time: 0.153203 Oct 11 02:39:18.334531 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3773/7495] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:18 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:19.357841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:19.358375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:19.366285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:19.366788 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:19.367246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:19.368003 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:19.368477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:19.368923 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:19.503601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:19.511310 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95e04912-a001-4d4d-b051-3f2768d6708a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1684 microversion: 2.1 time: 0.157586 Oct 11 02:39:19.511917 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3723/7496] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:19 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:45.704772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:39:45.707001 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:45.709325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:45.710450 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:45.716948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:45.717442 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:45.717916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:45.718617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:45.719092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:45.719578 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:45.776582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1849915c-ba2a-43f8-bbc7-55f6706e79e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action" status: 200 len: 69245 microversion: 2.1 time: 0.075845 Oct 11 02:39:45.777280 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3774/7497] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:39:45 2022] POST /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60/action => generated 69245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:39:53.089705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:53.090228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:53.092311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:53.093200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=48 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:39:53.099726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:53.100249 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:53.100709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:53.101633 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:53.102271 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:53.102724 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:53.130072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:39:53.153544 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3086-deae-476f-9feb-2d8354c35d60", "tag": "143b0bdb-d297-4b7a-86f2-60acc8e9a209"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:39:53.165412 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:53.166587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:53.167288 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:53.179370 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] Creating event network-changed:143b0bdb-d297-4b7a-86f2-60acc8e9a209 for instance b51d3086-deae-476f-9feb-2d8354c35d60 on n-h1-772273-9 Oct 11 02:39:53.185264 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-e5d84b2c-a2a9-4902-aef3-441bef978306 req-55a6bca8-e242-49e2-883e-67c7cd39e307 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097168 Oct 11 02:39:53.186169 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3775/7498] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:39:53.222574 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52da6d5c-53f9-4d92-889b-9b9eb4a01d25 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 204 len: 0 microversion: 2.1 time: 0.136757 Oct 11 02:39:53.223727 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3724/7499] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:39:53 2022] DELETE /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:39:53.235693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:53.236573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:53.243248 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:53.243912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:53.244459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:53.245270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:53.245842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:53.246379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:53.387554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:53.395553 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0a23c0fb-99f6-4212-8d68-e946241c2087 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1690 microversion: 2.1 time: 0.166099 Oct 11 02:39:53.396141 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3776/7500] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:53 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:54.419848 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:54.420488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:54.429313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:54.429815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:54.430268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:54.430982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:54.431469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:54.431910 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:54.594641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:54.602563 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-103cbf20-c111-46c8-b412-5fc944ccb01c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1690 microversion: 2.1 time: 0.187162 Oct 11 02:39:54.603147 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3725/7501] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:54 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:55.201028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3086-deae-476f-9feb-2d8354c35d60", "name": "network-vif-deleted", "tag": "143b0bdb-d297-4b7a-86f2-60acc8e9a209"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:39:55.212502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:55.212947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:55.213349 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:55.225082 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] Creating event network-vif-deleted:143b0bdb-d297-4b7a-86f2-60acc8e9a209 for instance b51d3086-deae-476f-9feb-2d8354c35d60 on n-h1-772273-9 Oct 11 02:39:55.230246 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ace3d2cb-237b-4e4a-a733-d9a66420c864 req-bd40e5b7-eefb-4b54-b5ac-9431ea813992 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033099 Oct 11 02:39:55.231031 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3777/7502] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:39:55.626824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:55.628049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:55.635068 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:55.635602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:55.636058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:55.636962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:55.637432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:55.637872 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:55.674086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:55.674589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:55.675039 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:55.675701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lazy-loading 'fault' on Instance uuid b51d3086-deae-476f-9feb-2d8354c35d60 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:39:55.721695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:39:55.728994 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad3d4bb4-613e-4414-bd37-11ac953b77bd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 200 len: 1356 microversion: 2.1 time: 0.106798 Oct 11 02:39:55.729573 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3726/7503] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:55 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:39:56.754809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:56.755534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: b51d3086-deae-476f-9feb-2d8354c35d60] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:39:56.761635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:56.762117 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:56.762554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:56.763236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:39:56.763718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:39:56.764141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:39:56.777659 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] HTTP exception thrown: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Request method failure captured: Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 HTTP/1.1 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNbKjY6ZdcgMNXZyMPcF7Su1j_UZbMM4gBKQB8_4heR9wHR5HVtdPEr4V2AlDJ3VVgozFKwOBwkqXAgTfjUJZ4i5JF0O-KLvI51urS0Mi2DK7LRSs6iqi4TGM5WQ2SL8_sjbWQoLGyhu_9GbjYrr9wp8g4fWlQgv9MiLVEH40aB62a0 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26e8eca70cc34ca9a6896185d3b420e1 Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'b51d3086-deae-476f-9feb-2d8354c35d60'} Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:39:56.779272 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Returning 404 to user: Instance b51d3086-deae-476f-9feb-2d8354c35d60 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2e0fc8ae-2e7a-45c1-b914-c047c25f3fd7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60" status: 404 len: 111 microversion: 2.1 time: 0.031176 Oct 11 02:39:56.784701 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3778/7504] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:39:56 2022] GET /compute/v2.1/servers/b51d3086-deae-476f-9feb-2d8354c35d60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:39:59.750495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-578f7a08-c1a3-433d-a4c9-3a8fb2f8099b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '.version_select at 0x7f112fa64280>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:39:59.770165 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-578f7a08-c1a3-433d-a4c9-3a8fb2f8099b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1181276476" status: 202 len: 0 microversion: 2.1 time: 0.024383 Oct 11 02:39:59.770836 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3727/7505] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 02:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1181276476 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:39:59.800727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec2ef7dc-ec74-47fa-8703-11def059540f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: .version_select at 0x7f113898c550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1072353592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkRVqhKA95IydnfFsvJzV4/tXKMaSbfgz6/iIv5Ee6H4MGwEZp+Oxo1DuO5BcmkBX7s1baOZX+bf99PI4iYSNyWlNziycNkYrDSznaTyyWqKlliCf8jU0Bj1m1MNU30vA=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:39:59.822380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ec2ef7dc-ec74-47fa-8703-11def059540f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:39:59.827640 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-ec2ef7dc-ec74-47fa-8703-11def059540f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:39:59.852676 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec2ef7dc-ec74-47fa-8703-11def059540f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056448 Oct 11 02:39:59.853320 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3779/7506] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:39:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:40:05.699218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-186693037", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "c8afa074-5b4f-41af-8af0-9c9ae7bacd31"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1072353592", "security_groups": [{"name": "tempest-secgroup-smoke-2052420085"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:05.726474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:05.820818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] validate_networks() for [('c8afa074-5b4f-41af-8af0-9c9ae7bacd31', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:40:06.251814 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:40:06.252840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:40:06.256264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:40:06.257370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:40:06.258461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:40:06.277316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:06.278555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:06.279372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:06.282556 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:06.283287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:06.284035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:06.315791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:40:06.323721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:40:06.343454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:40:06.347525 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:40:06.418531 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a8ac616-6d39-4c5a-88bd-2d3908be5c35 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723080 Oct 11 02:40:06.420630 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3728/7507] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:40:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:40:06.444781 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8e901950-ab39-46a0-b766-75b1cb650de0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:06.445950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8e901950-ab39-46a0-b766-75b1cb650de0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:06.539166 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8e901950-ab39-46a0-b766-75b1cb650de0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:06.548637 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8e901950-ab39-46a0-b766-75b1cb650de0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1266 microversion: 2.1 time: 0.108212 Oct 11 02:40:06.550186 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3780/7508] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:06 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:07.573419 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c46bff00-b3fa-4f8b-a0c4-da46ba6de8fe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:07.574336 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c46bff00-b3fa-4f8b-a0c4-da46ba6de8fe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:07.637101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c46bff00-b3fa-4f8b-a0c4-da46ba6de8fe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:07.644939 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c46bff00-b3fa-4f8b-a0c4-da46ba6de8fe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1266 microversion: 2.1 time: 0.076877 Oct 11 02:40:07.645532 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3729/7509] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:07 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:08.667895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d64525d0-f972-457b-a58c-aa80440c3c32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:08.668683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d64525d0-f972-457b-a58c-aa80440c3c32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:08.672563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:08.740068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d64525d0-f972-457b-a58c-aa80440c3c32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:08.748053 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d64525d0-f972-457b-a58c-aa80440c3c32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1266 microversion: 2.1 time: 0.083965 Oct 11 02:40:08.748911 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3781/7510] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:08 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:09.770182 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-02275b02-a26b-4c5f-ac09-706fb54afda7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:09.770829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-02275b02-a26b-4c5f-ac09-706fb54afda7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:09.825824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02275b02-a26b-4c5f-ac09-706fb54afda7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:09.832959 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-02275b02-a26b-4c5f-ac09-706fb54afda7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1266 microversion: 2.1 time: 0.066736 Oct 11 02:40:09.833590 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3730/7511] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:09 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:10.856546 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:10.857090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:10.864068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:10.864564 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:10.865011 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:10.865706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:10.866171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:10.866607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:10.931678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:10.940520 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4a4c06a1-dfff-4500-b19f-0db6f0e89116 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1270 microversion: 2.1 time: 0.088036 Oct 11 02:40:10.941105 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3782/7512] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:10 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:11.964302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:11.964933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:11.973014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:11.973526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:11.973992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:11.974710 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:11.975187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:11.975664 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:12.038294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:12.046653 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3a8b71a-23d0-4f81-a93a-58946b5713c5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1324 microversion: 2.1 time: 0.086337 Oct 11 02:40:12.047244 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3731/7513] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:11 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1324 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:12.882399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:12.895469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:12.896047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:12.896691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:12.909912 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] Creating event network-changed:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h1-772273-9 Oct 11 02:40:12.915148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-3e94ef61-e647-4f05-82b8-ceed37ebd1f2 req-5654fce8-41d1-4e3e-94db-42a95f300cc3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036546 Oct 11 02:40:12.916261 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3783/7514] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:40:13.070144 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:13.070775 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:13.077970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:13.078483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:13.079102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:13.079867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:13.080354 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:13.080803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:13.211961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:13.220807 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfe6278a-2bb6-499b-a5ec-54314ef4077b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.154806 Oct 11 02:40:13.221396 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3732/7515] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:13 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:14.244858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:14.245699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:14.252829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:14.253321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:14.253769 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:14.254468 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:14.254928 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:14.255371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:14.393736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:14.401659 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a47faa21-aea9-4d42-ae3b-9b2e92b5b28d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.161154 Oct 11 02:40:14.415359 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3784/7516] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:14 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:15.425850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:15.426490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:15.433443 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:15.433951 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:15.434415 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:15.435139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:15.435649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:15.436104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:15.567427 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:15.575414 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfb48247-5be4-4efb-98a8-897ff5423d96 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.154423 Oct 11 02:40:15.576003 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3733/7517] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:15 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:16.598772 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:16.599443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:16.602245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:16.608352 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:16.608849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:16.609295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:16.610030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:16.610492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:16.610926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:16.741234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:16.748930 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c7e6c75-7e48-4d35-bd91-08f0c43fc112 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.154133 Oct 11 02:40:16.749515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3785/7518] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:16 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:17.771636 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:17.772263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:17.774314 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:17.780477 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:17.780972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:17.781418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:17.783859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:17.784339 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:17.784781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:17.917503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:17.925650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd42ca4e-0ec5-4f01-bd76-182bc69e033f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.157992 Oct 11 02:40:17.926163 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3734/7519] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:17 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:18.949644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:18.950399 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:18.954509 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:18.960407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:18.960912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:18.961356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:18.962068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:18.962636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:18.963080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:19.037586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "name": "network-vif-plugged", "status": "completed", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:19.048800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:19.049303 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:19.049754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:19.061272 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] Creating event network-vif-plugged:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h1-772273-9 Oct 11 02:40:19.066465 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-df013aff-871a-4444-9fd8-803e4b5ced01 req-e9b062a4-e8c8-43b6-affa-245fb1aa46d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102712 Oct 11 02:40:19.067083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3735/7520] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:40:19.108387 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:19.117034 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf14484f-ad1a-4eb4-a6f9-b055b1c15c84 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.171365 Oct 11 02:40:19.117629 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3786/7521] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:18 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:20.137752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:20.143611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:20.144343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:20.150829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:20.151366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:20.151827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:20.152546 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:20.153021 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:20.153471 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:20.297390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:20.305452 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4fa65e1-1ad5-41f2-af59-70e198008df9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1392 microversion: 2.1 time: 0.168660 Oct 11 02:40:20.306058 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3736/7522] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:20 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:40:21.329206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:21.329820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:21.336864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:21.337345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:21.337778 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:21.338469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:21.338922 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:21.339374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:21.477552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:21.486072 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7ddc6eaa-07e8-4a7d-8756-bb9274fa5bac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1564 microversion: 2.1 time: 0.160731 Oct 11 02:40:21.486679 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3787/7523] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:21 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:21.508756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:21.509383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:21.516265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:21.516762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:21.517750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:21.518454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:21.519099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:21.519570 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:21.651728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:21.659982 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-028c0b1b-32fa-4304-99b5-33e7e84fa619 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1564 microversion: 2.1 time: 0.155424 Oct 11 02:40:21.660556 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3737/7524] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:21 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:23.261535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:23.262148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:23.264697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:23.271294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:23.271820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:23.271991 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:23.272253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:23.273174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:23.273834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:23.274302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:23.278368 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:23.278954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:23.279536 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:23.292859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] Creating event network-changed:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h1-772273-9 Oct 11 02:40:23.299066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f4e5567e-4cd7-4460-92e3-7ef7925a2e99 req-a8edc520-6255-4012-bb7e-28f669930a75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038328 Oct 11 02:40:23.300194 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3738/7525] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:40:23.420987 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:23.429046 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3780f810-77bd-48d4-a25f-04502bf8bf3a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1564 microversion: 2.1 time: 0.171559 Oct 11 02:40:23.429598 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3788/7526] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:23 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:46.672483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:46.675484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:46.679020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=42 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:46.685795 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:46.686300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:46.686769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:46.687519 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:46.688027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:46.688475 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:46.741348 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8d841e7-67db-4835-84ac-9efc5109ac2e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action" status: 200 len: 24561 microversion: 2.1 time: 0.073136 Oct 11 02:40:46.742106 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3739/7527] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:40:46 2022] POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action => generated 24561 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:40:53.128636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:40:53.130896 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:53.133204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=7 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:53.133852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=38 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:40:53.140328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:53.140810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:53.141245 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:53.141936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:53.142414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:53.142840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:53.226314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:53.232411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Old instance type m1.heat2, new instance type m1.heat {{(pid=120493) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 02:40:53.238912 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:40:53.239329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:40:53.239826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:40:53.240230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:40:53.240638 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:40:53.304148 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-52f61fae-e940-4ede-959b-ec44362c4c1f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action" status: 202 len: 0 microversion: 2.1 time: 0.179379 Oct 11 02:40:53.304676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3789/7528] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:40:53 2022] POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:40:53.313529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:53.314833 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:53.322804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:53.323312 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:53.323798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:53.324695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:53.324995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:53.325533 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:53.467292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:53.476174 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2dc29cd-9c06-4a1f-b734-7e1ae459f18f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1692 microversion: 2.1 time: 0.166828 Oct 11 02:40:53.476758 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3740/7529] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:53 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:54.502292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:54.502913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:54.510809 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:54.511299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:54.511759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:54.512632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:54.513089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:54.513512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:54.656216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:54.664411 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-dba6f5f5-a896-41dd-8f22-b9c13eac4cb2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1692 microversion: 2.1 time: 0.167023 Oct 11 02:40:54.665064 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3790/7530] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:54 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:40:55.688911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:55.689511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:55.697762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:55.698300 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:55.698765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:55.699597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:55.700188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:55.700644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:55.832940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:55.841128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c29f628f-31bb-48d1-a2ee-922ceb7ccea8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.157021 Oct 11 02:40:55.841706 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3741/7531] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:55 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:56.865202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:56.865828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:56.872672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:56.873159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:56.873595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:56.874318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:56.874775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:56.875204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:57.010737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:57.018565 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-831552cc-5565-47f3-a148-a6ce2d680487 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.157377 Oct 11 02:40:57.019811 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3791/7532] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:56 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:58.042127 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:58.042772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:58.049808 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:58.050965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:58.051451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:58.052173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:58.052649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:58.053100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:58.184399 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:58.192249 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd374872-3c7c-410f-b68d-8abe4896cda1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.154101 Oct 11 02:40:58.192839 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3742/7533] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:58 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:40:59.217031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:40:59.217655 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:40:59.225015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:59.225502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:59.225947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:59.226643 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:40:59.227105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:40:59.227569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:40:59.355460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:40:59.363811 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be5a8841-6ada-46de-8e41-03aae54ae2b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.150759 Oct 11 02:40:59.364391 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3792/7534] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:40:59 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:00.388116 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:00.388807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:00.395953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:00.396457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:00.396918 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:00.397626 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:00.398100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:00.398544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:00.535431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:00.543258 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-02b75254-2cb2-4470-8ec6-2cf179ad9438 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.159385 Oct 11 02:41:00.543869 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3743/7535] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:00 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:01.566330 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:01.566969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:01.574009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:01.574500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:01.574944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:01.575683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:01.576177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:01.576608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:01.708106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:01.716081 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8133819e-f5b4-4da1-acf9-d6d67a1c7b0e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.153659 Oct 11 02:41:01.716672 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3793/7536] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:01 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:02.741093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:02.741644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:02.748666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:02.749172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:02.749630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:02.750346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:02.750819 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:02.751267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:03.203298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:03.212358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3901bb6-47d3-4176-ae04-31d7672bd8bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.475788 Oct 11 02:41:03.212941 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3744/7537] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:02 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:41:04.235653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:04.236221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:04.243110 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:04.243626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:04.244062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:04.244776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:04.245231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:04.245659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:04.376351 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:04.383976 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3781f4b5-6f8a-464d-9703-5a9a3afc2cdc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.152746 Oct 11 02:41:04.384542 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3794/7538] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:04 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:05.408108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:05.408674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:05.416097 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:05.416604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:05.417067 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:05.417787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:05.418267 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:05.418727 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:05.554090 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:05.562035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-916cf00b-e275-47b9-9550-2c07a6348f02 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.158067 Oct 11 02:41:05.562619 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3745/7539] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:05 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:06.585726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:06.586255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:06.593549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:06.594036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:06.594473 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:06.595162 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:06.595642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:06.596061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:06.728426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:06.736196 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6431c925-7192-4e37-a7cd-ac27b2578817 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1697 microversion: 2.1 time: 0.154818 Oct 11 02:41:06.736774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3795/7540] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:06 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:07.760407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:07.760940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:07.767809 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:07.768324 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:07.769869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:07.770601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:07.771086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:07.771576 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:07.915705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:07.923821 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd8635d2-2abd-4814-a4bc-74a3bc3d4d00 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1696 microversion: 2.1 time: 0.167407 Oct 11 02:41:07.924494 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3746/7541] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:07 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:08.263599 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "name": "network-vif-unplugged", "status": "completed", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:41:08.273368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:08.273889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:08.274325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:08.286994 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Creating event network-vif-unplugged:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h2-772273-9 Oct 11 02:41:08.292905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120493) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:41:08.305937 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5b4213e4-1720-4aaa-9edb-55bda37ca0e5 req-9827eab2-8fb0-4bee-8a1d-d7c6f54a35c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046046 Oct 11 02:41:08.306558 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3796/7542] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:41:08.947610 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:08.948237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:08.955055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:08.955588 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:08.956050 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:08.956752 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:08.957217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:08.957654 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:09.090412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:09.098822 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-460bb670-7d15-4634-b5f6-73065bfb4ba1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1696 microversion: 2.1 time: 0.155174 Oct 11 02:41:09.099421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3747/7543] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:08 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:10.123493 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:10.124213 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:10.131278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:10.131801 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:10.132252 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:10.132957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:10.133417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:10.133850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:10.262505 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:10.270831 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8a65721e-8504-41e9-9803-4c26efb94644 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1694 microversion: 2.1 time: 0.151720 Oct 11 02:41:10.271676 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3797/7544] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:10 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:10.338590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:41:10.349258 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:10.349747 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:10.350194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:10.361526 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Creating event network-changed:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h2-772273-9 Oct 11 02:41:10.366784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-772273-9', 'n-h1-772273-9'} {{(pid=120494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 02:41:10.377519 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f27c80b7-9ea8-4491-95c9-2b01e0e12440 req-4722773f-fe10-404d-8820-a4794dcc2fe8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042575 Oct 11 02:41:10.378123 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3748/7545] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:41:11.295296 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:11.295958 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:11.303669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:11.304165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:11.304610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:11.305339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:11.305828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:11.306261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:11.441653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:11.449492 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1fcdab8b-4d18-4274-9017-edb00a6fd57e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1694 microversion: 2.1 time: 0.158225 Oct 11 02:41:11.450073 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3798/7546] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:11 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:12.475887 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:12.476534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:12.482709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.483216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.483712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.484439 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.484917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.485369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.615632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:12.623464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d7b2284-b3eb-407e-b534-4641e898268c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1691 microversion: 2.1 time: 0.153695 Oct 11 02:41:12.624238 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3749/7547] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:12 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:12.646557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:41:12.647095 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:12.653878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.654369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.654808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.655537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.655998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.656422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.715824 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-a13ae5df-080e-4358-95e9-f94cd24a2215 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action" status: 204 len: 0 microversion: 2.1 time: 0.073474 Oct 11 02:41:12.716457 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3799/7548] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:41:12 2022] POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:41:12.725485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:12.726170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:12.732036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.732535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.732985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.733701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.734170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.734611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.877205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:12.885444 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4daafe28-0f60-4031-8580-39730211fd1d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1691 microversion: 2.1 time: 0.164582 Oct 11 02:41:12.886029 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3750/7549] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:12 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:12.908553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:12.909300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:12.915552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.916042 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.916485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:12.917205 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:12.917647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:12.918149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:13.053969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:13.062282 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d0b9e02a-b8ac-4c46-b8f5-7b326b35bff5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1691 microversion: 2.1 time: 0.158153 Oct 11 02:41:13.063111 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3800/7550] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:12 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:14.080786 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "name": "network-vif-plugged", "status": "completed", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:41:14.086786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:41:14.087665 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:14.092309 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:14.092817 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:14.093260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:14.095976 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:14.096475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:14.096978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:14.097686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:14.098321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:14.098758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:14.106070 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] Creating event network-vif-plugged:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h2-772273-9 Oct 11 02:41:14.111702 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4ecc92cd-a68e-4060-8faf-f5a7950a82a8 req-11b05344-610f-4497-97ed-b094a44574d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 Oct 11 02:41:14.113987 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3751/7551] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:41:14.242995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:41:14.250788 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15728e5c-9e10-46e4-89e0-93a3494cf8b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1683 microversion: 2.1 time: 0.168504 Oct 11 02:41:14.251379 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3801/7552] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:41:14 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:41:46.463364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=27 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:41:46.464255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=70 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:41:46.468668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:41:46.470986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:41:46.478483 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:46.478990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:46.479482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:46.480198 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:41:46.480673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:41:46.481119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:41:46.538963 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf9cf4f7-47ec-4986-b55e-e3fb6a8c0ec7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action" status: 200 len: 24532 microversion: 2.1 time: 0.076981 Oct 11 02:41:46.539617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3752/7553] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:41:46 2022] POST /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062/action => generated 24532 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:42:03.821668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:03.829059 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:03.829515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:03.832124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=30 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:03.833249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:03.833812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:03.839478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:03.840088 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:03.840758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:03.841534 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:03.842202 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:03.842696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:03.871931 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:42:03.895691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:03.908157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:03.909098 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:03.909746 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:03.922643 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] Creating event network-changed:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h2-772273-9 Oct 11 02:42:03.928831 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-eaf0ef99-2181-47ff-92b4-d424daca66e2 req-9f01c703-b918-4fa2-bcc8-9fd17720a2f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104981 Oct 11 02:42:03.929649 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3753/7554] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:42:03.953279 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fc4507fc-40e2-450d-ba31-6820ad3866b0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 204 len: 0 microversion: 2.1 time: 0.135644 Oct 11 02:42:03.957530 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3802/7555] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:42:03 2022] DELETE /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:42:03.965210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:03.967015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:03.973579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:03.974099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:03.975135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:03.975925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:03.976409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:03.976865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:04.122087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:04.130319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cb3420f-bd56-4c80-86aa-2be91de515ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1689 microversion: 2.1 time: 0.170496 Oct 11 02:42:04.130999 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3754/7556] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:03 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:05.156687 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:05.157664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:05.166519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:05.167040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:05.167627 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:05.168336 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:05.168795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:05.169224 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:05.346702 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:05.355052 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92cffa90-9841-4376-9be8-2899cbd362be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 200 len: 1689 microversion: 2.1 time: 0.202854 Oct 11 02:42:05.355614 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3803/7557] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:05 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:05.943328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b2ed04-5545-4cf8-8652-6405fb60a062", "name": "network-vif-deleted", "tag": "c7a828f4-4680-4fbf-9ba2-f688d117dd20"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:05.954841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:05.955362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:05.956132 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:05.967270 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] Creating event network-vif-deleted:c7a828f4-4680-4fbf-9ba2-f688d117dd20 for instance a0b2ed04-5545-4cf8-8652-6405fb60a062 on n-h2-772273-9 Oct 11 02:42:05.972223 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a0529968-eb8f-449c-8d71-869db55451aa req-471f61d7-beb2-44d7-ab13-d6d20c0a5609 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Oct 11 02:42:05.972819 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3755/7558] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:42:06.379178 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:06.380274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: a0b2ed04-5545-4cf8-8652-6405fb60a062] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:06.388219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:06.388715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:06.389159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:06.389905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:06.390368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:06.390979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:06.404929 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] HTTP exception thrown: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Request method failure captured: Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 HTTP/1.1 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNbKjY6ZdcgMNXZyMPcF7Su1j_UZbMM4gBKQB8_4heR9wHR5HVtdPEr4V2AlDJ3VVgozFKwOBwkqXAgTfjUJZ4i5JF0O-KLvI51urS0Mi2DK7LRSs6iqi4TGM5WQ2SL8_sjbWQoLGyhu_9GbjYrr9wp8g4fWlQgv9MiLVEH40aB62a0 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26e8eca70cc34ca9a6896185d3b420e1 Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'a0b2ed04-5545-4cf8-8652-6405fb60a062'} Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:42:06.406668 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Returning 404 to user: Instance a0b2ed04-5545-4cf8-8652-6405fb60a062 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5c88248b-f283-4303-b067-bf873c870879 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062" status: 404 len: 111 microversion: 2.1 time: 0.033768 Oct 11 02:42:06.411609 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3804/7559] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:06 2022] GET /compute/v2.1/servers/a0b2ed04-5545-4cf8-8652-6405fb60a062 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:42:09.416637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fe61356-c086-42a8-a08c-92c58bb3a3e4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '.version_select at 0x7f1134cdbee0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:09.421165 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fe61356-c086-42a8-a08c-92c58bb3a3e4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [4c58fb03-0fce-477d-876a-3b8aa126f8fb] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:42:10.429567 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [None req-5fe61356-c086-42a8-a08c-92c58bb3a3e4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [4c58fb03-0fce-477d-876a-3b8aa126f8fb] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41654. Oct 11 02:42:10.449274 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fe61356-c086-42a8-a08c-92c58bb3a3e4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072353592" status: 202 len: 0 microversion: 2.1 time: 1.038611 Oct 11 02:42:10.449868 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3756/7560] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 02:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072353592 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:42:10.478871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3de9bc27-a4c3-40b0-9763-1b268eece3f4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: .version_select at 0x7f112f8211f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1807795996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpnEIGqdChvQ8rOiPT/b+cPT/99UWWnRXaYDcxLZK+xgLymP8xeWJiDGn9fVg5Fm9aLUWiVqXfAwPNpOkrkxgu4F/8ykq7L/O1f6yFUMH0H31iNDQVOM3KFDys6eTOz9w=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:10.494848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-3de9bc27-a4c3-40b0-9763-1b268eece3f4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:42:10.500007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-3de9bc27-a4c3-40b0-9763-1b268eece3f4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:42:10.524920 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3de9bc27-a4c3-40b0-9763-1b268eece3f4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050789 Oct 11 02:42:10.525556 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3805/7561] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:42:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:42:16.531094 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:16.535695 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1584580487", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "134057a7-3fcb-405c-8901-611a0310cfca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1807795996", "security_groups": [{"name": "tempest-secgroup-smoke-1338866701"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:16.711093 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] validate_networks() for [('134057a7-3fcb-405c-8901-611a0310cfca', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:42:17.216177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:42:17.216623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:42:17.217124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:42:17.217555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:42:17.218043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:42:17.227472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:17.227994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:17.228460 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:17.229225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:17.229705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:17.230156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:17.262998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:42:17.269494 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:42:17.283431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:42:17.285944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:42:17.343283 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbc49c55-aa9f-4dcf-9e30-f25ef751fd32 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813915 Oct 11 02:42:17.343985 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3757/7562] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:42:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:42:17.353840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:17.358584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0938bab5-b6b7-4c90-ba22-faa6e34c09bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:17.359641 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0938bab5-b6b7-4c90-ba22-faa6e34c09bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:17.476427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0938bab5-b6b7-4c90-ba22-faa6e34c09bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:17.485588 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0938bab5-b6b7-4c90-ba22-faa6e34c09bb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1267 microversion: 2.1 time: 0.133913 Oct 11 02:42:17.486515 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3806/7563] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:17 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:42:18.511420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:18.512446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:18.520188 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:18.520985 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:18.521957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:18.523056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:18.523796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:18.524445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:18.612787 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:18.622312 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-399cde8d-d006-4aa1-8282-c0f748ded0e3 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1327 microversion: 2.1 time: 0.115955 Oct 11 02:42:18.624765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3758/7564] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:18 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:19.650297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:19.651826 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:19.659606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:19.660328 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:19.660766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:19.661968 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:19.662434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:19.662929 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:19.810596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:19.819083 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-31773d7e-8f36-406a-889a-da696b235641 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.172938 Oct 11 02:42:19.819767 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3807/7565] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:19 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:20.150657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742ed318-249c-45b7-975f-6621eb5b7629", "tag": "7fbfc2c3-597f-468a-8073-37b35ab8381a"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:20.162738 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:20.163254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:20.163721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:20.179130 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] Creating event network-changed:7fbfc2c3-597f-468a-8073-37b35ab8381a for instance 742ed318-249c-45b7-975f-6621eb5b7629 on n-h1-772273-9 Oct 11 02:42:20.184188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-bc4442e9-8d5a-4761-abe3-35db92262300 req-93528e53-94f0-47a2-825d-f7c792a76d8e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037413 Oct 11 02:42:20.185167 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3759/7566] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:42:20.842115 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:20.842717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:20.850195 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:20.850679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:20.851118 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:20.851835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:20.852295 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:20.852722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:20.987278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:20.995099 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bfe632b0-239a-4eac-850d-da9cf015adfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.156927 Oct 11 02:42:20.995707 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3808/7567] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:20 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:22.019703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:22.020416 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:22.027446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:22.027962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:22.028425 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:22.029173 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:22.029657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:22.030498 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:22.158823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:22.167115 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-968b3447-e03d-4c67-ab1b-f1699369aa0f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.152632 Oct 11 02:42:22.167732 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3760/7568] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:22 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:23.189438 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:23.190116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:23.197204 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:23.197691 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:23.198133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:23.198860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:23.199316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:23.199771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:23.330104 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:23.338357 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92a3d386-d4be-430e-b1c1-deeb8329b805 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.152875 Oct 11 02:42:23.338952 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3809/7569] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:23 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:24.362124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:24.362751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:24.369573 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:24.370070 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:24.370518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:24.371221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:24.371713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:24.372153 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:24.506818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:24.514670 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6047549c-b810-47d5-aa64-9913d4dbf935 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.156581 Oct 11 02:42:24.515251 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3761/7570] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:24 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:25.491978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742ed318-249c-45b7-975f-6621eb5b7629", "name": "network-vif-plugged", "status": "completed", "tag": "7fbfc2c3-597f-468a-8073-37b35ab8381a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:25.504997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:25.505978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:25.506435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:25.517781 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] Creating event network-vif-plugged:7fbfc2c3-597f-468a-8073-37b35ab8381a for instance 742ed318-249c-45b7-975f-6621eb5b7629 on n-h1-772273-9 Oct 11 02:42:25.523692 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4bc47f06-7dd8-43bf-ba8a-127655cf363b req-df75c601-002f-4282-ac64-9a25801a35bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035974 Oct 11 02:42:25.524301 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3810/7571] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:42:25.538539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:25.539838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:25.547103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:25.547652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:25.548181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:25.549118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:25.549770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:25.550225 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:25.683925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:25.691823 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b5dcfd9c-fed7-4a57-a0d9-de3a97b1febe tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.157911 Oct 11 02:42:25.692410 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3762/7572] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:25 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:26.716279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:26.716996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:26.724072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:26.725116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:26.725563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:26.726261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:26.726721 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:26.727153 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:26.867614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:26.875423 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b98b72b-2b1f-4a47-ad1c-485e663a3338 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1393 microversion: 2.1 time: 0.163453 Oct 11 02:42:26.876011 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3811/7573] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:26 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:27.899685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:27.900327 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:27.903660 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:27.904359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:27.910375 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:27.910881 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:27.911370 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:27.912087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:27.912564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:27.913013 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:28.042820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:28.050666 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a48e5bfd-3af0-4066-81a2-8f472941e428 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1565 microversion: 2.1 time: 0.155614 Oct 11 02:42:28.051248 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3763/7574] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:27 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:28.073680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:28.074257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:28.076306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:28.082775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:28.083257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:28.083718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:28.084403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:28.084858 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:28.085278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:28.220266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:28.228038 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-880740f7-ace8-4e70-be3e-fd2fab2f58af tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1565 microversion: 2.1 time: 0.158307 Oct 11 02:42:28.228626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3812/7575] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:28 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:30.121036 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:42:30.121704 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:30.122307 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742ed318-249c-45b7-975f-6621eb5b7629", "tag": "7fbfc2c3-597f-468a-8073-37b35ab8381a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:30.128467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:30.129668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:30.130138 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:30.131514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:30.132216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:30.132697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:30.133141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:30.133626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:30.134063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:30.149563 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] Creating event network-changed:7fbfc2c3-597f-468a-8073-37b35ab8381a for instance 742ed318-249c-45b7-975f-6621eb5b7629 on n-h1-772273-9 Oct 11 02:42:30.156037 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c7635eb5-31b9-44e9-8ce4-1cb6d4b35204 req-74059123-a575-49fe-8875-d50c15959ed2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Oct 11 02:42:30.157287 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3813/7576] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:42:30.273928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:42:30.288271 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a3aac5f-5a26-4d78-a3e5-ead0424172aa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1565 microversion: 2.1 time: 0.171622 Oct 11 02:42:30.289232 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3764/7577] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:42:30 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:42:51.544360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:42:51.546669 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:42:51.549762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:51.550428 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=34 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:42:51.557659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:51.558188 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:51.558751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:51.559484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:42:51.559953 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:42:51.560386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:42:51.624101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bbe1b7ac-9c5f-4433-a7e9-3382acfc8c54 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action" status: 200 len: 24564 microversion: 2.1 time: 0.083932 Oct 11 02:42:51.624798 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3814/7578] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:42:51 2022] POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action => generated 24564 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:43:02.331599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:02.334205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:02.334890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=40 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:02.342163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:02.342680 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:02.343142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:02.366126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 02:43:02.412720 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61456c93-9179-4bcd-a612-224f38d6eaac tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action" status: 202 len: 0 microversion: 2.1 time: 0.084558 Oct 11 02:43:02.413498 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3765/7579] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:43:02 2022] POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:43:02.422499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:02.423319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:02.426350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:02.427197 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=4 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:02.433954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:02.434452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:02.434894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:02.435628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:02.436160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:02.436588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:02.571433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:02.579151 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4e8e9a40-5c74-418a-a9e1-c7a24cef5223 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.161018 Oct 11 02:43:02.579764 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3815/7580] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:02 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:03.603315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:03.604048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:03.611507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:03.612005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:03.612458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:03.613167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:03.613632 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:03.614073 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:03.743072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:03.750965 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b65d1743-3d61-4720-9125-ffc87dd4196a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.151734 Oct 11 02:43:03.751579 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3766/7581] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:03 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:04.776489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:04.777113 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:04.783965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:04.784459 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:04.784899 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:04.785589 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:04.786047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:04.786475 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:04.918497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:04.926277 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bea44f96-4fa4-42f0-9c2c-6d8608d3615a tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.154292 Oct 11 02:43:04.926852 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3816/7582] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:04 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:05.950181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:05.950851 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:05.958017 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:05.958516 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:05.958972 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:05.959721 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:05.960195 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:05.960638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:06.090708 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:06.098500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa825ecf-122b-453c-a2f9-e407d91d36cc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.152334 Oct 11 02:43:06.099078 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3767/7583] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:05 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:07.122600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:07.123124 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:07.129885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:07.130379 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:07.130847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:07.131559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:07.132025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:07.133050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:07.267989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:07.276290 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fbf6d7ea-40d0-4c6c-bcd6-4226a3eb3387 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.157807 Oct 11 02:43:07.276874 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3817/7584] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:07 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:08.300175 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:08.300762 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:08.307700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:08.308208 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:08.308670 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:08.309390 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:08.309870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:08.310322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:08.440467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:08.448908 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-029b5e02-075d-4b6b-ac29-7034aa9b3082 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.152712 Oct 11 02:43:08.449491 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3768/7585] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:08 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:09.472516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:09.473063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:09.480431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:09.480926 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:09.481367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:09.482063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:09.482519 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:09.482951 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:09.617527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:09.625379 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7be8211d-3b3c-4441-a8dd-6c44009a992f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.156968 Oct 11 02:43:09.625971 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3818/7586] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:09 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:10.649294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:10.649975 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:10.656703 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:10.657214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:10.657682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:10.658407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:10.658885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:10.659358 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:10.790652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:10.798548 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a08c263-4e7a-4102-bf8b-c8e12f5a5d76 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.153329 Oct 11 02:43:10.799130 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3769/7587] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:10 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:11.822500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:11.823123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:11.830035 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:11.830527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:11.830969 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:11.831698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:11.832415 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:11.832846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:11.961919 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:11.969636 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3894a176-fa05-47a8-9196-d7d9a1ba090c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1694 microversion: 2.1 time: 0.151794 Oct 11 02:43:11.970252 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3819/7588] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:11 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:12.993236 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:12.993879 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:13.000815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:13.001313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:13.001766 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:13.002466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:13.002931 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:13.003392 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:13.137302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:13.144991 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53046d94-979b-4827-9edc-9df6016d83fa tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1671 microversion: 2.1 time: 0.155720 Oct 11 02:43:13.145563 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3770/7589] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:12 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:14.238993 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:14.241236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:14.248779 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:14.249262 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:14.249695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:14.250382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:14.250841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:14.251264 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:14.305577 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c89f218c-c8fa-495a-9929-0a25029c8738 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action" status: 200 len: 38390 microversion: 2.1 time: 0.070342 Oct 11 02:43:14.306569 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3820/7590] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:43:14 2022] POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action => generated 38390 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:43:14.318226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:14.325177 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:14.325685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:14.326151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:14.348145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 02:43:14.392924 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6505f202-43df-4d8a-b07b-9e12a23eb623 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action" status: 202 len: 0 microversion: 2.1 time: 0.078462 Oct 11 02:43:14.393548 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3771/7591] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:43:14 2022] POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 02:43:14.402384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:14.403620 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:14.410538 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:14.411212 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:14.411706 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:14.412427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:14.412897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:14.414045 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:14.558808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:14.566705 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-903da523-9283-41a5-8295-3eac957e5bfc tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1680 microversion: 2.1 time: 0.168612 Oct 11 02:43:14.567286 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3821/7592] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:14 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:15.592001 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:15.592713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:15.598797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:15.599290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:15.599769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:15.600464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:15.600928 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:15.601393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:15.731913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:15.739891 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b1f271b-1845-463b-8df1-90a24abaa8ef tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1684 microversion: 2.1 time: 0.153054 Oct 11 02:43:15.740477 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3772/7593] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:15 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:41.940972 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:41.943228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:41.945890 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=14 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:41.946551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=40 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:41.952495 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:41.952988 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:41.953433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:41.954133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:41.954603 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:41.955034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:42.014926 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d1790f9c-8778-4697-92f6-586ed9c20f52 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action" status: 200 len: 62945 microversion: 2.1 time: 0.077895 Oct 11 02:43:42.015999 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3822/7594] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:43:41 2022] POST /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629/action => generated 62945 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:43:49.014914 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:49.015473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:49.018614 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=16 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:49.019512 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:43:49.022881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742ed318-249c-45b7-975f-6621eb5b7629", "tag": "7fbfc2c3-597f-468a-8073-37b35ab8381a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:49.026602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:49.027470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:49.028171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:49.029313 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:49.029806 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:49.030905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:49.034699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:49.035466 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:49.035894 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:49.051297 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] Creating event network-changed:7fbfc2c3-597f-468a-8073-37b35ab8381a for instance 742ed318-249c-45b7-975f-6621eb5b7629 on n-h1-772273-9 Oct 11 02:43:49.057207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fc6c943d-f891-4b68-a33c-e982fdf59566 req-ac44a6a9-597e-47db-b091-99796accd469 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038828 Oct 11 02:43:49.058268 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3823/7595] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:43:49.061145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:43:49.147399 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67cca34b-e2ce-40c4-b940-628269facaa5 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 204 len: 0 microversion: 2.1 time: 0.136261 Oct 11 02:43:49.151584 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3773/7596] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:43:49 2022] DELETE /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:43:49.158316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:49.159062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:49.166066 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:49.166549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:49.166998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:49.167740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:49.168203 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:49.168635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:49.314109 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:49.322096 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5cc5ae49-8c3b-455f-ac92-0dd44c70668b tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1690 microversion: 2.1 time: 0.168844 Oct 11 02:43:49.322675 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3824/7597] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:49 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:50.346973 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:50.347726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:50.355742 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:50.356252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:50.356711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:50.357431 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:50.357912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:50.358366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:50.489998 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:50.497818 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7db4bdb-cd5e-48a8-8a20-3569bd5470e8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1690 microversion: 2.1 time: 0.155163 Oct 11 02:43:50.498405 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3774/7598] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:50 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:51.135096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742ed318-249c-45b7-975f-6621eb5b7629", "name": "network-vif-deleted", "tag": "7fbfc2c3-597f-468a-8073-37b35ab8381a"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:51.145408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:51.145901 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:51.146338 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:51.157621 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] Creating event network-vif-deleted:7fbfc2c3-597f-468a-8073-37b35ab8381a for instance 742ed318-249c-45b7-975f-6621eb5b7629 on n-h1-772273-9 Oct 11 02:43:51.162600 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-d27c6f1c-36b5-49d6-8f25-8c200513792c req-17941fb4-0b9b-4997-926b-54153c0ec0b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Oct 11 02:43:51.163240 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3825/7599] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:43:51.522226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:51.523562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:51.532641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:51.533161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:51.533622 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:51.534364 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:51.534840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:51.535289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:51.570856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:51.571383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:51.571875 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:51.572422 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lazy-loading 'fault' on Instance uuid 742ed318-249c-45b7-975f-6621eb5b7629 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:43:51.615667 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:43:51.624917 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d80d3ec-369c-4764-b98a-c76ad8443151 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 200 len: 1357 microversion: 2.1 time: 0.106628 Oct 11 02:43:51.625509 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3775/7600] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:51 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:43:52.656072 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:52.656708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: 742ed318-249c-45b7-975f-6621eb5b7629] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:43:52.662898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:52.663416 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:52.663869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:52.664566 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:43:52.665026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:43:52.665462 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:43:52.679129 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] HTTP exception thrown: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Request method failure captured: Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 HTTP/1.1 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNbKjY6ZdcgMNXZyMPcF7Su1j_UZbMM4gBKQB8_4heR9wHR5HVtdPEr4V2AlDJ3VVgozFKwOBwkqXAgTfjUJZ4i5JF0O-KLvI51urS0Mi2DK7LRSs6iqi4TGM5WQ2SL8_sjbWQoLGyhu_9GbjYrr9wp8g4fWlQgv9MiLVEH40aB62a0 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26e8eca70cc34ca9a6896185d3b420e1 Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': '742ed318-249c-45b7-975f-6621eb5b7629'} Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:43:52.680771 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Returning 404 to user: Instance 742ed318-249c-45b7-975f-6621eb5b7629 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a1dff24-3000-4e29-aed0-4d7161a98808 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629" status: 404 len: 111 microversion: 2.1 time: 0.031490 Oct 11 02:43:52.685684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3826/7601] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:43:52 2022] GET /compute/v2.1/servers/742ed318-249c-45b7-975f-6621eb5b7629 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:43:56.010841 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18b991d0-6c86-437f-aca0-4fe2e6609ba6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '.version_select at 0x7f11387b1e50>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:43:56.036285 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18b991d0-6c86-437f-aca0-4fe2e6609ba6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1807795996" status: 202 len: 0 microversion: 2.1 time: 0.030083 Oct 11 02:43:56.037052 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3776/7602] 10.222.0.66 () {58 vars in 1284 bytes} [Tue Oct 11 02:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1807795996 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:43:56.071918 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-bf8ed4dd-abec-47a3-abee-35682a4e3731 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: .version_select at 0x7f113898c4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-179076515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7RwcHRgkc8p8Adg5jnDvK62P5boEaWwMWpyn9nmmc0V83RgVRlURnjQO0Q9aZXCZQg3X2Pj8Cuf7samvfi/146F43/833QaO9FOlJ5wC3OdYSehlfl6fClsk0O3/Lq9A=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:43:56.089033 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-bf8ed4dd-abec-47a3-abee-35682a4e3731 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:43:56.094116 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-bf8ed4dd-abec-47a3-abee-35682a4e3731 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:43:56.119131 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-bf8ed4dd-abec-47a3-abee-35682a4e3731 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052133 Oct 11 02:43:56.119784 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3827/7603] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:43:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:44:01.382315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1013793938", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "networks": [{"uuid": "79d75c51-4beb-4436-a15c-86e82b2cbd67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-179076515", "security_groups": [{"name": "tempest-secgroup-smoke-1802244359"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:01.508631 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] validate_networks() for [('79d75c51-4beb-4436-a15c-86e82b2cbd67', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:44:01.620693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:01.940856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:44:01.941502 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:44:01.941989 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:44:01.943232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:44:01.943701 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:44:01.953442 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:01.953955 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:01.954406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:01.955160 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:01.955650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:01.956293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:01.980302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:44:01.986815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Getting quotas for user 26e8eca70cc34ca9a6896185d3b420e1 and project 21690f544a3542c1a92183cbc3b229cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:44:02.003489 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:44:02.005986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:44:02.057244 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93a071a3-92b4-45a1-add5-c233da8736f8 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680054 Oct 11 02:44:02.058030 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3777/7604] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:44:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:44:02.071221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-13d5ce8a-5fda-4e0d-91c0-6652cbfcc2f2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:02.074342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-13d5ce8a-5fda-4e0d-91c0-6652cbfcc2f2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:02.133273 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-13d5ce8a-5fda-4e0d-91c0-6652cbfcc2f2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:02.140261 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-13d5ce8a-5fda-4e0d-91c0-6652cbfcc2f2 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1266 microversion: 2.1 time: 0.074479 Oct 11 02:44:02.140842 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3828/7605] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:02 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:03.168048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:03.170018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:03.178075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:03.179126 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:03.191977 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:03.192774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:03.193277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:03.193760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:03.283644 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:03.292099 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0371ace-c475-4147-9507-9e299f1b6d75 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1336 microversion: 2.1 time: 0.130351 Oct 11 02:44:03.293223 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3778/7606] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:03 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1336 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:04.316554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:04.322250 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:04.324470 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=16 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:04.337227 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:04.337726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:04.338174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:04.338906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:04.339398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:04.339843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:04.585699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:04.593836 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-70b0389e-64e2-4d94-be59-4a14d288232e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.282039 Oct 11 02:44:04.594427 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3829/7607] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:04 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:04.998646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db093e98-10c2-4cd9-8ea9-fa9de85ed6c7", "tag": "78da6453-4c62-44f4-8284-c96624b34bf3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:05.011251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:05.011790 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:05.012247 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:05.024589 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] Creating event network-changed:78da6453-4c62-44f4-8284-c96624b34bf3 for instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 on n-h1-772273-9 Oct 11 02:44:05.030357 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-536dbca2-6ca0-4046-ab75-ae97e120d5e8 req-6a3c9323-50ae-405e-a617-36fb169163e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035514 Oct 11 02:44:05.031632 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3779/7608] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:44:05.618185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:05.618862 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:05.625696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:05.626191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:05.626636 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:05.627358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:05.627828 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:05.628261 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:05.764795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:05.772566 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29144509-51ce-46ea-9517-6485766b22be tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.158995 Oct 11 02:44:05.773183 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3830/7609] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:05 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:06.797837 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:06.798673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:06.805222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:06.805818 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:06.806277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:06.806995 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:06.807486 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:06.807925 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:06.941713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:06.950056 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-815a144b-7b73-49a0-be05-39d24ed6db26 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.157964 Oct 11 02:44:06.950642 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3780/7610] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:06 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:07.975751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:07.976725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:07.983819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:07.984433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:07.984898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:07.985607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:07.986089 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:07.986501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:08.119238 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:08.127166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-294ca346-8960-476d-bbc8-a7cff27c93e1 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.157404 Oct 11 02:44:08.127973 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3831/7611] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:07 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:09.157043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:09.157580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:09.165005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:09.165508 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:09.165966 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:09.166673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:09.167145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:09.167620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:09.300953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:09.309291 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4dfd6b4-1b0c-4c74-a324-40e2b5cc4631 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.156293 Oct 11 02:44:09.309871 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3781/7612] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:09 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:09.893750 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db093e98-10c2-4cd9-8ea9-fa9de85ed6c7", "name": "network-vif-plugged", "status": "completed", "tag": "78da6453-4c62-44f4-8284-c96624b34bf3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:09.904995 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:09.905625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:09.906058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:09.918090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] Creating event network-vif-plugged:78da6453-4c62-44f4-8284-c96624b34bf3 for instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 on n-h1-772273-9 Oct 11 02:44:09.923061 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-f35670ea-4f98-4a9f-be12-3304099fdcc9 req-699bc44a-9944-4bbc-aaaa-0a3cf9a320cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Oct 11 02:44:09.923692 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3832/7613] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:44:10.332470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:10.333005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:10.339883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:10.340387 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:10.340839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:10.341545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:10.342015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:10.342455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:10.476693 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:10.484388 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-278bc7ce-11cb-4c80-a7c9-34b5b046c12e tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1392 microversion: 2.1 time: 0.156159 Oct 11 02:44:10.484967 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3782/7614] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:10 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:11.509703 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:11.510423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:11.516609 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:11.517096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:11.517537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:11.518234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:11.518692 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:11.519123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:11.650535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:11.658310 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-397d4c47-241a-4efd-8f89-3c1e8d0e43ee tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1564 microversion: 2.1 time: 0.154302 Oct 11 02:44:11.658900 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3833/7615] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:11 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:11.680901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:11.681539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:11.688362 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:11.688867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:11.689328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:11.690041 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:11.690518 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:11.690968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:11.827668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:11.836267 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-520ee388-b583-4157-87fd-8683b35b4bfd tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1564 microversion: 2.1 time: 0.159293 Oct 11 02:44:11.836846 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3783/7616] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:11 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:13.411559 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:13.412355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:13.413604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db093e98-10c2-4cd9-8ea9-fa9de85ed6c7", "tag": "78da6453-4c62-44f4-8284-c96624b34bf3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:13.419933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:13.420750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:13.421112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:13.423063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:13.425930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:13.426776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:13.426941 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:13.427470 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:13.427715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:13.428026 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:13.428904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:13.429576 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:13.430271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:13.440096 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] Creating event network-changed:78da6453-4c62-44f4-8284-c96624b34bf3 for instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 on n-h1-772273-9 Oct 11 02:44:13.445358 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-385b9fe1-d24f-426c-8a02-c704e0c6c691 req-69bb9fed-e2d8-419b-a567-e10138eb02f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036333 Oct 11 02:44:13.445972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3784/7617] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:44:13.652880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:13.660957 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5d0f04de-3eb9-477b-bc56-b0fb81739c59 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1564 microversion: 2.1 time: 0.254297 Oct 11 02:44:13.661774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3834/7618] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:13 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:36.897393 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:36.898310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=36 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:36.903119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:36.905459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:36.913911 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:36.914413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:36.914868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:36.915612 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:36.916089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:36.916531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:36.971285 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-278a03e4-fa11-4415-a2a3-268651e2bb86 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action" status: 200 len: 24566 microversion: 2.1 time: 0.075637 Oct 11 02:44:36.971948 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3785/7619] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:44:36 2022] POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:44:43.367610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:43.368163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:43.370149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:43.370807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=32 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:44:43.372077 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:44:43.372419 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action (ip 10.222.0.66) !!! Oct 11 02:44:43.379555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:43.380047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:43.380488 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:43.381848 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:43.382316 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:43.382763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:43.406662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lazy-loading 'flavor' on Instance uuid db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:44:43.472642 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4fa45557-b54e-498b-9599-85de56965a7f tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.109323 Oct 11 02:44:43.473301 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3835/7620] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:44:43 2022] POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:44:43.481992 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:43.482736 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:43.491128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:43.491828 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:43.492283 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:43.493012 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:43.493492 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:43.494000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:43.625457 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:43.634233 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05dfa7b1-36b2-4a2b-8364-2ecd3558e901 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1690 microversion: 2.1 time: 0.156562 Oct 11 02:44:43.634801 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3786/7621] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:43 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:44.658303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:44.658932 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:44.666373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:44.666855 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:44.667291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:44.667998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:44.668452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:44.668876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:44.801061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:44.809302 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3941e702-6d82-48ad-8109-fea111372ae4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1673 microversion: 2.1 time: 0.155391 Oct 11 02:44:44.809877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3836/7622] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:44 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:45.906646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:45.908926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:45.917405 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:45.917913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:45.918378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:45.919101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:45.919608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:45.920058 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:45.969966 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4b5025c-b70e-4133-8410-a775a8b817a0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action" status: 200 len: 35052 microversion: 2.1 time: 0.067199 Oct 11 02:44:45.970870 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3787/7623] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:44:45 2022] POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action => generated 35052 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:44:45.982548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:45.983082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:45.989860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:45.990345 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:45.990780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:45.991496 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:45.991966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:45.992403 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:46.057940 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-be7c3d5a-76e8-4a8d-9562-f46d31cb0a2c tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.079108 Oct 11 02:44:46.058620 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3837/7624] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:44:45 2022] POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:44:46.067778 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:46.069030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:46.076796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:46.077334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:46.077796 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:46.078521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:46.079079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:46.079555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:46.608769 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:46.617102 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c0c2599-1436-49ee-8a09-46a2943dd6d0 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1679 microversion: 2.1 time: 0.553852 Oct 11 02:44:46.617889 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3788/7625] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:46 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1679 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:47.644478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:47.645192 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:47.651431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:47.651925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:47.652374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:47.653074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:47.653541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:47.653973 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:47.795271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:47.802970 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b4e78e84-d428-408a-b15b-493dad5c16d6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1679 microversion: 2.1 time: 0.163702 Oct 11 02:44:47.803579 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3838/7626] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:47 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:44:48.826697 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:48.827382 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:48.835434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:48.835942 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:48.836406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:48.837148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:48.837628 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:48.838077 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:48.966115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:48.973944 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db461007-c11a-4a79-bfd2-32bf43856ac4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1682 microversion: 2.1 time: 0.151247 Oct 11 02:44:48.974524 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3789/7627] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:48 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:49.083607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:49.085787 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:49.092595 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:49.093080 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:49.093513 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:49.094201 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:49.094656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:49.095084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:49.139076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-de30938f-fcb4-4813-826a-f4cc2bde9ebb tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action" status: 200 len: 35052 microversion: 2.1 time: 0.059687 Oct 11 02:44:49.139734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3839/7628] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:44:49 2022] POST /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7/action => generated 35052 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 02:44:50.161715 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:50.162418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:50.169616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:50.170095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:50.170553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:50.171652 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:50.171770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db093e98-10c2-4cd9-8ea9-fa9de85ed6c7", "tag": "78da6453-4c62-44f4-8284-c96624b34bf3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:50.172187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:50.172276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:50.182937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:50.183533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:50.184434 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:50.198978 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] Creating event network-changed:78da6453-4c62-44f4-8284-c96624b34bf3 for instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 on n-h1-772273-9 Oct 11 02:44:50.200135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:44:50.204266 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-fff41c84-a519-4e7c-ac6d-b048185662d9 req-b77cfb1d-2178-4942-b074-8f0e67ec6df8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Oct 11 02:44:50.205057 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3840/7629] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:44:50.291316 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ef7f5b9-fc7b-4f24-87a2-77079f06d5d7 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 204 len: 0 microversion: 2.1 time: 0.132533 Oct 11 02:44:50.295421 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3790/7630] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:44:50 2022] DELETE /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:44:50.302350 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:50.303156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:50.310146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:50.310730 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:50.311249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:50.312082 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:50.312619 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:50.313368 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:50.482543 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:50.490451 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f3edb79b-77f3-43a9-9775-dea8fb53cb10 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1688 microversion: 2.1 time: 0.193098 Oct 11 02:44:50.491040 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3841/7631] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:50 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:51.515797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:51.516436 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:51.524199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:51.524705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:51.525163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:51.525908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:51.526385 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:51.526832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:51.664913 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:51.672717 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a488da31-a50a-4647-b8b7-5d7812bf694d tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1688 microversion: 2.1 time: 0.161356 Oct 11 02:44:51.673322 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3791/7632] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:51 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:52.432420 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db093e98-10c2-4cd9-8ea9-fa9de85ed6c7", "name": "network-vif-deleted", "tag": "78da6453-4c62-44f4-8284-c96624b34bf3"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:44:52.444762 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:52.445292 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:52.445740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:52.458219 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] Creating event network-vif-deleted:78da6453-4c62-44f4-8284-c96624b34bf3 for instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 on n-h1-772273-9 Oct 11 02:44:52.464405 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-ccec357c-b5ef-40e5-b3a2-7f23a495efe1 req-8c8f42db-e47e-466e-8738-c6810b5de3b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Oct 11 02:44:52.465012 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3842/7633] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:44:52.697544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:52.698307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:52.706020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:52.706540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:52.707007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:52.707780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:52.708260 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:52.708709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:52.742204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:52.742714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:52.743167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:52.743717 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lazy-loading 'fault' on Instance uuid db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:44:52.786497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e8eca70cc34ca9a6896185d3b420e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21690f544a3542c1a92183cbc3b229cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:44:52.795401 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6d22127-d92b-43cc-95a1-ce916fa9dda4 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 200 len: 1356 microversion: 2.1 time: 0.102266 Oct 11 02:44:52.796013 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3792/7634] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:52 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:44:53.820406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:53.821107 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] [instance: db093e98-10c2-4cd9-8ea9-fa9de85ed6c7] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:44:53.828362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:53.828847 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:53.829270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:53.829956 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:44:53.830407 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:44:53.831098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:44:53.844640 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] HTTP exception thrown: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Request method failure captured: Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 HTTP/1.1 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNbKjY6ZdcgMNXZyMPcF7Su1j_UZbMM4gBKQB8_4heR9wHR5HVtdPEr4V2AlDJ3VVgozFKwOBwkqXAgTfjUJZ4i5JF0O-KLvI51urS0Mi2DK7LRSs6iqi4TGM5WQ2SL8_sjbWQoLGyhu_9GbjYrr9wp8g4fWlQgv9MiLVEH40aB62a0 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/21690f544a3542c1a92183cbc3b229cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 21690f544a3542c1a92183cbc3b229cb Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-633419147 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: 26e8eca70cc34ca9a6896185d3b420e1 Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestNetworkAdvancedServerOps-633419147-project Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'db093e98-10c2-4cd9-8ea9-fa9de85ed6c7'} Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:44:53.846259 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Returning 404 to user: Instance db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cdf805d2-26e8-4353-a984-be4ec15ed4a9 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7" status: 404 len: 111 microversion: 2.1 time: 0.031637 Oct 11 02:44:53.851807 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3843/7635] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:44:53 2022] GET /compute/v2.1/servers/db093e98-10c2-4cd9-8ea9-fa9de85ed6c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:44:57.416344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8b81965-e787-4662-8b00-f97d617d46b6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] Calling method '.version_select at 0x7f112fa29790>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:44:57.440695 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8b81965-e787-4662-8b00-f97d617d46b6 tempest-TestNetworkAdvancedServerOps-633419147 tempest-TestNetworkAdvancedServerOps-633419147-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-179076515" status: 202 len: 0 microversion: 2.1 time: 0.028330 Oct 11 02:44:57.441685 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3793/7636] 10.222.0.66 () {58 vars in 1281 bytes} [Tue Oct 11 02:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-179076515 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:45:08.667257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=18 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:08.668478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:08.896606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b707e361-cd64-4f81-8686-32ff3a7a4316 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'create', calling method: .version_select at 0x7f112f0e8ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-909583458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH0EPSFkYADdH3KJ9ocPdtkPPMUHeMhiFodRyrcPJ/DnTdI068TcLC913I9/k59nD5UGckT7KhpKeUU02aY1hgJY774vYvpGcO346FjbgLVpyeOo8PvoQmOn83l+WG0cg=="}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:45:08.914390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b707e361-cd64-4f81-8686-32ff3a7a4316 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:45:08.924761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-b707e361-cd64-4f81-8686-32ff3a7a4316 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for user 670256b965a34790bd4ac2ba743903d3 and project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'key_pairs'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:45:08.953288 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b707e361-cd64-4f81-8686-32ff3a7a4316 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.292092 Oct 11 02:45:08.954271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3844/7637] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:45:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:45:09.924101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:09.924934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:09.929308 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-513965632", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-909583458", "security_groups": [{"name": "tempest-secgroup-smoke-1625612977"}], "networks": [{"uuid": "c9be4997-0ca4-442b-8926-729946ad25ab"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:45:10.039599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] validate_networks() for [('c9be4997-0ca4-442b-8926-729946ad25ab', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:45:10.448320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:45:10.448929 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:45:10.449618 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:45:10.450190 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:45:10.450926 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:45:10.461611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:10.462310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:10.462944 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:10.463800 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:10.464270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:10.464849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:10.489202 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:45:10.496322 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for user 670256b965a34790bd4ac2ba743903d3 and project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:45:10.512374 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:45:10.515034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:45:10.567668 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e147a1af-0602-4bda-b888-38271989a79b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645359 Oct 11 02:45:10.569713 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3794/7638] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:45:10.581176 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c6cc8566-1d09-4d7d-b20a-df20c0ca1c61 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:10.582427 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c6cc8566-1d09-4d7d-b20a-df20c0ca1c61 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:10.642186 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c6cc8566-1d09-4d7d-b20a-df20c0ca1c61 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:10.649188 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c6cc8566-1d09-4d7d-b20a-df20c0ca1c61 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1245 microversion: 2.1 time: 0.072325 Oct 11 02:45:10.650471 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3845/7639] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:10 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:11.675438 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6fd1bc9-f154-4f9d-92c8-1a6c11ea4f8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:11.676148 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6fd1bc9-f154-4f9d-92c8-1a6c11ea4f8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:11.731461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6fd1bc9-f154-4f9d-92c8-1a6c11ea4f8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:11.738426 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6fd1bc9-f154-4f9d-92c8-1a6c11ea4f8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1245 microversion: 2.1 time: 0.068357 Oct 11 02:45:11.739010 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3795/7640] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:11 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:12.762028 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c691d686-8bdc-4c82-80b1-ead56d750fbf tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:12.762740 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c691d686-8bdc-4c82-80b1-ead56d750fbf tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:12.822699 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c691d686-8bdc-4c82-80b1-ead56d750fbf tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:12.829886 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c691d686-8bdc-4c82-80b1-ead56d750fbf tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1245 microversion: 2.1 time: 0.072582 Oct 11 02:45:12.830869 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3846/7641] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:12 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:13.854318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a6dcce3-a3b5-4b89-9ef8-301b1a4462fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:13.854952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a6dcce3-a3b5-4b89-9ef8-301b1a4462fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:13.912900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a6dcce3-a3b5-4b89-9ef8-301b1a4462fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:13.920453 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a6dcce3-a3b5-4b89-9ef8-301b1a4462fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1245 microversion: 2.1 time: 0.070490 Oct 11 02:45:13.921043 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3796/7642] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:13 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:14.943436 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:14.943946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:14.950845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:14.951406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:14.951859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:14.952563 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:14.953027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:14.953461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:15.015898 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:15.024166 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec9c21cb-3c7e-4b69-80e0-a2d9936d431b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1249 microversion: 2.1 time: 0.084838 Oct 11 02:45:15.024734 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3847/7643] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:14 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:16.047673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:16.048421 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:16.056014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:16.056602 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:16.057139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:16.057952 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:16.058504 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:16.059025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:16.127479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:16.135400 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34253881-5056-4b78-babf-a06c3bd75b26 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1303 microversion: 2.1 time: 0.091844 Oct 11 02:45:16.135992 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3797/7644] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:16 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:17.094934 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:45:17.104807 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:17.105291 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:17.105724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:17.116746 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] Creating event network-changed:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:45:17.121720 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-0c9e71af-83b6-4753-9b77-ee1527adb3fa req-7389140f-843f-44cf-aef6-f2b24b978b3f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092545 Oct 11 02:45:17.122509 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3848/7645] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:45:17.158130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:17.158791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:17.166585 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:17.167101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:17.167597 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:17.168328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:17.168805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:17.169276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:17.309501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:17.317461 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0317e20-d584-4038-9656-4d98e56f520c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.163300 Oct 11 02:45:17.318373 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3798/7646] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:17 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:18.342621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:18.343402 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:18.349959 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:18.351228 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:18.352015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:18.352925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:18.353547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:18.354144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:18.492878 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:18.501731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-77560cd2-787f-40ff-86e4-ce1e548bd957 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.164272 Oct 11 02:45:18.502746 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3849/7647] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:18 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:19.525889 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:19.526524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:19.533071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:19.533578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:19.534042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:19.534759 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:19.535234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:19.535714 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:19.669983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:19.677776 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08d667ab-453f-44a0-ac64-0aaf5349510f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.156549 Oct 11 02:45:19.678362 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3799/7648] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:19 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:20.701580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:20.702419 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:20.709663 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:20.710714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:20.711159 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:20.711892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:20.712384 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:20.712810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:20.847805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:20.856069 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c31ff53a-a7c7-4c5c-8400-c65a9f8e666d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.158431 Oct 11 02:45:20.856650 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3850/7649] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:20 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:21.879896 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:21.880531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:21.882912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:21.889657 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:21.890166 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:21.890629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:21.891369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:21.891843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:21.892290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:22.023532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:22.031781 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-873eb47c-b391-45dc-a5be-d41d33020de3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.156165 Oct 11 02:45:22.032368 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3800/7650] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:21 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:22.335449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "name": "network-vif-plugged", "status": "completed", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:45:22.346390 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:22.346885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:22.347363 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:22.358505 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] Creating event network-vif-plugged:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:45:22.363847 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b9f2fdf2-27c7-4f86-9d8a-77e08d480861 req-3cdc74b2-1c2b-48aa-b842-56ce507a8bd1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088347 Oct 11 02:45:22.364445 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3851/7651] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:45:23.054078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:23.054726 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:23.061865 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:23.062376 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:23.062835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:23.063583 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:23.064064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:23.064511 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:23.197961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:23.205938 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-13aefc02-69c3-4443-bc79-b86483c8d8cd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1371 microversion: 2.1 time: 0.155580 Oct 11 02:45:23.206513 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3801/7652] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:23 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:24.226236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=8 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:24.231422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:24.232129 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:24.238632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:24.239062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:24.239537 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:24.240231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:24.240688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:24.241123 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:24.375485 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:24.383718 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-28413bf7-b991-4ff9-927e-cbea97cff7ec tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1554 microversion: 2.1 time: 0.158455 Oct 11 02:45:24.384302 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3852/7653] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:24 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:24.406209 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:45:24.406843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:45:24.408773 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:45:24.415131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:24.415671 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:24.416130 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:24.416845 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:24.418224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:24.418702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:24.549057 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:45:24.557460 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4db21dba-a718-4e32-894b-c71528a4510b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1554 microversion: 2.1 time: 0.155220 Oct 11 02:45:24.558042 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3802/7654] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:45:24 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:45:26.224515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:45:26.234555 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:45:26.235029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:45:26.235489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:45:26.249854 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] Creating event network-changed:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:45:26.254835 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-4fe86938-0d42-4596-9aaa-569dbcc53b5a req-8b97cc6f-2b5b-4510-98ba-e9e54bb00e32 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 Oct 11 02:45:26.255575 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3853/7655] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:47:22.372878 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:47:22.373485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:22.375933 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 02:47:22.376458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:22.377215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=38 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:22.378663 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:47:22.378806 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037/action (ip 10.222.0.66) !!! Oct 11 02:47:22.386007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:22.386559 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:22.387018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:22.387772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:22.388242 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:22.388685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:22.415033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lazy-loading 'flavor' on Instance uuid f4878bed-87d9-44da-8f28-dec16e378037 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:47:22.766000 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0ad931b-1f3f-41f0-83f8-66cc72bfda9c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037/action" status: 202 len: 0 microversion: 2.1 time: 0.397766 Oct 11 02:47:22.766616 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3803/7656] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:47:22 2022] POST /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:47:22.773447 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:47:22.774265 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:47:22.774861 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:22.775774 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=30 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:22.776797 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:47:22.777036 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 (ip 10.222.0.66) !!! Oct 11 02:47:22.784267 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:22.785003 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:22.794217 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:22.794708 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:22.795382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:22.795942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:22.796406 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:22.796834 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:22.980870 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:22.988699 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-27568812-d9ea-4e56-8185-a7443d307c3c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.217227 Oct 11 02:47:22.989811 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3854/7657] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:22 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:24.016534 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:24.017259 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:24.025798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:24.026315 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:24.026798 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:24.027548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:24.028033 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:24.028481 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:24.034500 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42244. Oct 11 02:47:24.166540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:24.174460 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-13a9be45-488a-4407-886f-9c213f36400d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.164156 Oct 11 02:47:24.174889 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3804/7658] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:24 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:25.197717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:25.198372 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:25.208536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:25.209112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:25.209557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:25.210268 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:25.210732 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:25.211161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:25.217173 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42248. Oct 11 02:47:25.228278 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42250. Oct 11 02:47:25.345469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:25.353737 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f74c2a91-bdf5-418d-b9a3-3c329a201fd7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.159940 Oct 11 02:47:25.354337 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3855/7659] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:25 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:47:26.377813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:26.378417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:26.387645 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:26.388137 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:26.388584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:26.389288 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:26.389751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:26.390185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:26.524772 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:26.532730 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0989ed01-3aa1-41c0-ac27-1a841fe999c1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.158931 Oct 11 02:47:26.533318 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3805/7660] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:26 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:27.556916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:27.557529 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:27.564320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:27.564799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:27.565232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:27.565915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:27.566367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:27.566788 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:27.696076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:27.703764 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-510abb3a-251a-44f3-bc44-f06f0c1d12b1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.150779 Oct 11 02:47:27.704605 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3856/7661] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:27 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:28.727802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:28.728348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:28.735114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:28.735637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:28.736086 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:28.736791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:28.737253 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:28.737716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:28.870218 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:28.877972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55502dfd-8434-45b0-83f3-d844092417fd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.154310 Oct 11 02:47:28.878564 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3806/7662] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:28 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:29.901942 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:29.902557 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:29.909404 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:29.909885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:29.910323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:29.911013 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:29.911504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:29.912498 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:30.046548 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:30.054372 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b593377e-c133-479c-b5a0-9dafe69d0c21 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.156476 Oct 11 02:47:30.054952 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3857/7663] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:29 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:31.077171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:31.077804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:31.085629 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:31.086142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:31.086601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:31.087319 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:31.087827 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:31.088277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:31.216768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:31.224569 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-968fc8c9-d31d-4d12-9f6b-806a22d1b5c8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.151327 Oct 11 02:47:31.225155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3807/7664] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:31 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:32.248223 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:32.248852 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:32.255770 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:32.256271 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:32.256700 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:32.257398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:32.257849 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:32.258281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:32.391207 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:32.399653 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d10e648-546d-4a25-9782-cb37a832bf6f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.155260 Oct 11 02:47:32.400271 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3858/7665] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:32 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:33.424078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:33.424672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:33.432277 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:33.432831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:33.433289 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:33.434006 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:33.434482 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:33.434932 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:33.564053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:33.572484 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-70862fd1-85a2-4cd2-a1b3-67df9815fad9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1699 microversion: 2.1 time: 0.152448 Oct 11 02:47:33.573068 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3808/7666] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:33 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:34.596236 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:34.596885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:34.603903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:34.604481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:34.604933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:34.605632 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:34.606092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:34.606515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:34.740274 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:34.748076 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-80ce7d82-0ee6-4a00-a222-85e4b3b38279 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1699 microversion: 2.1 time: 0.155785 Oct 11 02:47:34.748669 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3859/7667] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:34 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:35.773028 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:35.774549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:35.781712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:35.782446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:35.783119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:35.784254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:35.784755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:35.785203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:35.931744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:35.941124 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6221e15-9c84-4151-8a1a-f067feb9a221 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.172972 Oct 11 02:47:35.956034 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3809/7668] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:35 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:47:36.968334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:36.969946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:36.977940 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:36.978829 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:36.979718 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:36.980723 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:36.981542 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:36.982221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:37.049099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "name": "network-vif-plugged", "status": "completed", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:47:37.065408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:37.066114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:37.066830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:37.081890 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] Creating event network-vif-plugged:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:47:37.100972 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a742dd5f-1a5c-4bee-a706-12ee8b72af1d req-2e10fcb5-14d1-42e8-9692-77c5e2675cc9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056480 Oct 11 02:47:37.104574 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3810/7669] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:47:37.173574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:37.182483 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-633356d6-1b00-4eff-8441-541725611092 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.218311 Oct 11 02:47:37.183187 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3860/7670] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:36 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:38.208639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:38.209461 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:38.216074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:38.216581 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:38.217035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:38.217754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:38.218221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:38.218658 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:38.373170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:38.381507 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-648bba5c-3c82-4c21-853a-b101f516db3b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.178529 Oct 11 02:47:38.382095 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3811/7671] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:38 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:39.405547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:39.406103 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:39.415040 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:39.415560 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:39.415996 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:39.416863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:39.417325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:39.417792 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:39.568573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:39.576671 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abef217b-f813-4275-b46a-12604be7c08d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.175559 Oct 11 02:47:39.580751 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3861/7672] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:39 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:40.602869 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:40.603598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:40.610558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:40.612338 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:40.613503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:40.614255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:40.615294 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:40.615760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:40.789611 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:40.798012 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a2f9268-2e91-4e7a-bb7f-18ec40d04f71 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.201333 Oct 11 02:47:40.798960 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3812/7673] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:40 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:41.825299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:41.826540 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:41.835331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:41.835979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:41.836429 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:41.837146 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:41.837611 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:41.838047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:41.989962 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:42.000658 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29197c22-18da-48b8-b689-ff8e22a5e117 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.182518 Oct 11 02:47:42.006356 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3862/7674] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:41 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:43.027146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:43.028045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:43.035301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:43.035830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:43.036609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:43.037488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:43.038270 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:43.039221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:43.181960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:43.189912 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60d14b4f-43ac-4285-aa36-8192b105090c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.166694 Oct 11 02:47:43.190515 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3813/7675] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:43 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:44.214211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:44.214905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:44.221561 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:44.222052 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:44.222487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:44.223184 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:44.223698 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:44.224335 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:44.367553 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:44.375323 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ddf2066b-5d36-4df3-8da8-74feb4df158f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1694 microversion: 2.1 time: 0.165290 Oct 11 02:47:44.375931 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3863/7676] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:44 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:45.400146 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:45.400797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:45.409018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:45.409555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:45.410015 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:45.410755 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:45.411802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:45.412255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:45.554397 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:45.562624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78ada88e-7240-4fa4-aa08-facc4dbac0c0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1676 microversion: 2.1 time: 0.166917 Oct 11 02:47:45.579370 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3814/7677] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:45 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:46.586904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:46.587565 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:46.594527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:46.595005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:46.595467 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:46.596151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:46.596600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:46.597018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:46.732015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:46.740447 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5e58d5af-5558-467c-ba69-99ee5ef03d86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1676 microversion: 2.1 time: 0.157438 Oct 11 02:47:46.740978 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3864/7678] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:46 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:47.763709 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:47.764281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:47.771048 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:47.771635 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:47.772095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:47.772807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:47.773276 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:47.773718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:47.902867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:47.910624 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-686e475c-87bc-47a4-ac12-faef89599139 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1619 microversion: 2.1 time: 0.151006 Oct 11 02:47:47.911200 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3815/7679] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:47 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1619 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:47.933391 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:47:47.934046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:47.941209 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:47.941697 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:47.942142 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:47.942841 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:47.943299 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:47.944374 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:48.030642 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120493) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 02:47:48.094216 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [868c7c36-9197-472d-8681-aa00ed5326a0] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:47:48.993328 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "name": "network-vif-unplugged", "status": "completed", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:47:49.004510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:49.005005 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:49.005446 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:49.016815 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.server_external_events [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] Unable to find a host for instance f4878bed-87d9-44da-8f28-dec16e378037. Dropping event network-vif-unplugged {{(pid=120494) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 02:47:49.017721 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-fb1f6704-a596-47df-89d3-e1c0659bab19 req-35c50312-4a9d-4f4c-94c3-2705ebd36b83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028951 Oct 11 02:47:49.018518 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3816/7680] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 02:47:49.103087 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [868c7c36-9197-472d-8681-aa00ed5326a0] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42348. Oct 11 02:47:49.106506 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-35fc5226-636e-409e-8357-8c3f784fc391 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037/action" status: 202 len: 0 microversion: 2.1 time: 1.176986 Oct 11 02:47:49.107142 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3865/7681] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:47:47 2022] POST /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:47:49.115227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:49.117543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:49.124170 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:49.124760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:49.125325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:49.126196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:49.126579 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:49.127103 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:49.263102 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:49.271191 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bdd5e31-27a5-4af7-82f5-8125b3ddf452 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1627 microversion: 2.1 time: 0.159813 Oct 11 02:47:49.271824 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3817/7682] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:49 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1627 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:50.298144 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:50.298764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:50.306256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:50.306739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:50.307179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:50.307903 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:50.308360 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:50.308784 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:50.443628 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:50.451432 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d36d1ec2-6a65-468c-b710-2500c25eb6a0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.158051 Oct 11 02:47:50.452020 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3866/7683] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:50 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:51.478880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:51.479467 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:51.486104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:51.487030 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:51.488163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:51.489203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:51.490087 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:51.490850 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:51.633900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:51.641020 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:51.648414 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4b74217-9147-4e53-af6a-942983041eaa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.177572 Oct 11 02:47:51.649316 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3818/7684] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:51 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:47:52.672749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:52.673371 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:52.680455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:52.680946 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:52.681388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:52.682097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:52.682556 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:52.682986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:52.836545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:52.838753 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:52.846952 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-da97ad87-f6ef-4f86-99c5-4553af9d8fb3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.178096 Oct 11 02:47:52.847848 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3867/7685] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:52 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:53.870544 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:53.871171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:53.874226 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=33 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:53.881801 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:53.882496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:53.882927 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:53.883740 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:53.884211 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:53.884651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:54.033045 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:54.042305 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-125b5ad2-3566-4e2f-813e-7afb5a84468e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.175716 Oct 11 02:47:54.043109 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3819/7686] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:53 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:55.065850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:55.066460 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:55.070158 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:47:55.076323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:55.076821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:55.077337 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:55.078064 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:55.079059 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:55.079587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:55.228365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:55.236569 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b83ad7b5-4514-45ff-b668-5331ee97ead2 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.174619 Oct 11 02:47:55.237170 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3868/7687] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:55 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:56.261733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:56.262962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:56.270474 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:56.270984 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:56.271458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:56.272223 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:56.272686 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:56.273343 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:56.417071 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:56.425418 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfe175ba-3070-4b43-b1ab-9e8b42e116b0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.167514 Oct 11 02:47:56.426358 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3820/7688] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:56 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:57.450005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:57.450860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:57.458339 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:57.458838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:57.459516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:57.460373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:57.460908 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:57.461270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:57.601690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:57.610441 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ada5fad9-8598-4f69-8fbd-6a251c3e9428 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.164431 Oct 11 02:47:57.611044 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3869/7689] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:57 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:58.635590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:58.636217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:58.642990 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:58.643522 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:58.643971 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:58.644668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:58.645131 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:58.645566 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:58.782406 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:58.790805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b538b48c-bb30-4393-b68f-01d704f91e74 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.159238 Oct 11 02:47:58.791440 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3821/7690] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:58 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:47:59.814009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:47:59.814656 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:47:59.821644 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:59.822121 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:59.822550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:59.823240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:47:59.823714 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:47:59.824134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:47:59.955435 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:47:59.963701 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-002ad0a0-f83a-422a-b6cf-b127a168c281 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.153582 Oct 11 02:47:59.964281 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3870/7691] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:47:59 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:48:00.987886 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:48:00.988523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:48:00.995716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:00.996227 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:00.996691 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:00.997403 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:00.997908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:00.998332 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:01.136186 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:48:01.144623 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e60b1f6-d91a-463c-9bbb-e81fe3832f4c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.160952 Oct 11 02:48:01.146204 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3822/7692] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:48:00 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:48:02.169683 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:48:02.170301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:48:02.177179 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:02.177664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:02.178105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:02.178796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:02.179251 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:02.179712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:02.311838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:48:02.320096 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b33a7c0-832a-4ce4-a11a-3e070227c01b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.154328 Oct 11 02:48:02.320677 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3871/7693] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:48:02 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:48:03.104616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "name": "network-vif-plugged", "status": "completed", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:48:03.115316 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:03.115908 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:03.116873 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:03.128141 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] Creating event network-vif-plugged:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:48:03.133228 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3a23a4a3-0be8-421b-9f65-737c36798a91 req-7367b522-7a8b-4fe1-861a-22406ecb5566 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032905 Oct 11 02:48:03.133836 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3823/7694] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:48:03.344256 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:48:03.344879 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:48:03.352171 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:03.352662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:03.353100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:03.353799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:03.354257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:03.354685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:03.487314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:48:03.495054 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-19dff3bd-c059-4457-881f-41f96dda1844 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.154807 Oct 11 02:48:03.495654 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3872/7695] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:48:03 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:48:04.519803 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:48:04.520464 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:48:04.526843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:04.527506 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:04.527821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:04.528543 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:04.529025 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:04.529472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:04.673118 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:48:04.681725 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-566e8f60-f514-4271-bc42-f4a65476d356 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1685 microversion: 2.1 time: 0.167387 Oct 11 02:48:04.682361 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3824/7696] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:48:04 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:48:05.705612 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:48:05.706232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:48:05.713382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:05.713904 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:05.714346 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:05.715050 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:48:05.715572 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:48:05.716005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:48:05.845266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:48:05.853023 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9a85c839-eec6-405d-8f2f-042121da9482 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1672 microversion: 2.1 time: 0.151605 Oct 11 02:48:05.853605 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3873/7697] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:48:05 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:19.936553 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=11 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:19.937888 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=32 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:19.939042 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:49:19.939172 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 (ip 10.222.0.66) !!! Oct 11 02:49:19.945365 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:19.945890 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:19.947738 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=11 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:19.948492 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=37 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:19.950722 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:49:19.951094 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.66) !!! Oct 11 02:49:19.956620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:19.957196 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:19.957668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:19.959381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:19.962290 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:19.963847 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:19.996023 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:49:20.018046 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:20.029409 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:20.030048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:20.030592 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:20.043194 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] Creating event network-changed:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:49:20.049752 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-5ca2a057-9dea-4bf2-9a11-ed89be885bc2 req-ddee4b99-6ab7-4b43-b5d4-555b7d1acb91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111719 Oct 11 02:49:20.050818 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3874/7698] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:49:20.089217 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e64c732c-9772-4cca-918b-99a6c31090ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 204 len: 0 microversion: 2.1 time: 0.154584 Oct 11 02:49:20.094556 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3825/7699] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:49:19 2022] DELETE /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:49:20.099793 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:20.101086 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:20.107724 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:20.108515 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:20.108963 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:20.109686 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:20.110152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:20.110587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:20.252941 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:20.261544 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d9f16f8f-ce25-4a0a-8095-ef915b770dd6 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.166040 Oct 11 02:49:20.262134 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3875/7700] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:20 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:21.286234 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:21.286958 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:21.294779 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:21.295285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:21.295784 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:21.296497 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:21.296970 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:21.297417 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:21.432205 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:21.441570 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b6a900ec-70d6-4e21-acf3-06acb5cfa9be tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 200 len: 1678 microversion: 2.1 time: 0.159577 Oct 11 02:49:21.442494 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3826/7701] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:21 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:22.065344 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4878bed-87d9-44da-8f28-dec16e378037", "name": "network-vif-deleted", "tag": "17c058a7-e0ac-4356-ac4b-36b15c804819"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:22.076910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:22.077334 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:22.078061 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:22.090207 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] Creating event network-vif-deleted:17c058a7-e0ac-4356-ac4b-36b15c804819 for instance f4878bed-87d9-44da-8f28-dec16e378037 on n-h1-772273-9 Oct 11 02:49:22.095299 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-be26c2b3-6e3f-498b-84ae-1de50dcd0566 req-97c168b9-4e81-45c2-a1f5-81cd79a4bc75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033813 Oct 11 02:49:22.095945 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3876/7702] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:49:22.465930 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:22.466491 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f4878bed-87d9-44da-8f28-dec16e378037] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:22.473320 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:22.473829 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:22.474291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:22.475043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:22.475552 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:22.476000 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:22.489248 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] HTTP exception thrown: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Request method failure captured: Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 HTTP/1.1 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNivRe1juBhkkI_uPpeDAtWoA3Indd057SmNhPmekHD9gregvki9iakbDOxtv-aGEXOJVvZjmJAMIYiqM_dPJpulOM8QTxjIf9iasJFOvls3HCOm38dqixNPUkSWizKG7mNtsaqVSVgk_qCcYhz6sKIEO-rK2jLFEMdA4gLfEa0v8pE Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7589e18232fc4522b7bd4e0f538a846c Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestShelveInstance-1888989032 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestShelveInstance-1888989032 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7589e18232fc4522b7bd4e0f538a846c Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestShelveInstance-1888989032 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestShelveInstance-1888989032-project Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 670256b965a34790bd4ac2ba743903d3 Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestShelveInstance-1888989032-project Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'f4878bed-87d9-44da-8f28-dec16e378037'} Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:49:22.490922 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Returning 404 to user: Instance f4878bed-87d9-44da-8f28-dec16e378037 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83891699-c063-4ba7-a729-1b92ddaef752 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037" status: 404 len: 111 microversion: 2.1 time: 0.030721 Oct 11 02:49:22.495729 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3827/7703] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:22 2022] GET /compute/v2.1/servers/f4878bed-87d9-44da-8f28-dec16e378037 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:49:22.654624 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-33321a46-6933-4ca4-8e81-1626017eff4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '.version_select at 0x7f112fbe4a60>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:22.680513 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-33321a46-6933-4ca4-8e81-1626017eff4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-909583458" status: 202 len: 0 microversion: 2.1 time: 0.030078 Oct 11 02:49:22.681047 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3877/7704] 10.222.0.66 () {58 vars in 1251 bytes} [Tue Oct 11 02:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-909583458 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:49:22.705034 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c88ff0f-628b-427d-97c2-2b8917ad8a53 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'create', calling method: .version_select at 0x7f112f6b5940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1197206409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdSUR9EMrWm/s7Kf0uO4hSA13C8GtnDKkHtOthfg3UNZA9G2gc15hndvCJFV6U0cb/tu2DA1ET3T0gZaDuggQ6QAi2PaNhEhpRw2iD2/eO2IHeMOEUP5M6ksHICUkeraA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:22.720861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4c88ff0f-628b-427d-97c2-2b8917ad8a53 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:49:22.725960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-4c88ff0f-628b-427d-97c2-2b8917ad8a53 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for user 670256b965a34790bd4ac2ba743903d3 and project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:49:22.751867 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c88ff0f-628b-427d-97c2-2b8917ad8a53 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.050947 Oct 11 02:49:22.752495 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3828/7705] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:49:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:49:38.909071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:38.909818 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:38.915266 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1229938775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1197206409", "security_groups": [{"name": "tempest-secgroup-smoke-1193680049"}], "networks": [{"uuid": "c9be4997-0ca4-442b-8926-729946ad25ab"}], "block_device_mapping_v2": [{"uuid": "2b960fcb-c01d-4a6c-8fc2-01536b182070", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:39.033270 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] validate_networks() for [('c9be4997-0ca4-442b-8926-729946ad25ab', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:49:39.409221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:49:39.409649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:49:39.410127 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:49:39.410539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:49:39.410954 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:49:39.420005 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:39.420490 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:39.420930 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:39.421657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:39.422112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:39.422541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:39.440690 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:49:39.446517 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Getting quotas for user 670256b965a34790bd4ac2ba743903d3 and project 7589e18232fc4522b7bd4e0f538a846c. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:49:39.504549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:49:39.506819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b960fcb-c01d-4a6c-8fc2-01536b182070',volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:49:39.633823 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-03a91e01-65e9-4a57-a81a-5545d17e8b0c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726572 Oct 11 02:49:39.634491 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3878/7706] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:49:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:49:39.643723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:39.644524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:39.645171 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:39.650348 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee675b08-0e3c-4441-8843-ee134d3563a8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:39.650994 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee675b08-0e3c-4441-8843-ee134d3563a8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:39.710335 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee675b08-0e3c-4441-8843-ee134d3563a8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:39.717319 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee675b08-0e3c-4441-8843-ee134d3563a8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1089 microversion: 2.1 time: 0.075627 Oct 11 02:49:39.717890 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3829/7707] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:39 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:40.740906 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1aa5231f-2e9c-4868-ba4d-5e46b8a9af0f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:40.741539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1aa5231f-2e9c-4868-ba4d-5e46b8a9af0f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:40.798280 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1aa5231f-2e9c-4868-ba4d-5e46b8a9af0f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:40.805717 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1aa5231f-2e9c-4868-ba4d-5e46b8a9af0f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1089 microversion: 2.1 time: 0.070235 Oct 11 02:49:40.806285 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3879/7708] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:40 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:41.828838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ebbe4b58-e5b7-4cf8-8a01-7adbfcf36bf9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:41.829595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ebbe4b58-e5b7-4cf8-8a01-7adbfcf36bf9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:41.883551 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ebbe4b58-e5b7-4cf8-8a01-7adbfcf36bf9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:41.890743 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ebbe4b58-e5b7-4cf8-8a01-7adbfcf36bf9 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1089 microversion: 2.1 time: 0.066044 Oct 11 02:49:41.891314 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3830/7709] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:41 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:42.914294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fb9f7ae7-b6fe-481f-9b77-903f53733b4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:42.914854 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fb9f7ae7-b6fe-481f-9b77-903f53733b4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:42.971500 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-fb9f7ae7-b6fe-481f-9b77-903f53733b4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:42.978935 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fb9f7ae7-b6fe-481f-9b77-903f53733b4f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1089 microversion: 2.1 time: 0.069523 Oct 11 02:49:42.979552 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3880/7710] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:42 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:44.002134 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:44.002751 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:44.011038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:44.011587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:44.012049 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:44.012777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:44.013256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:44.013705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:44.074256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:44.082293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a466941c-aa63-4413-a5aa-35a51dc9fa86 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1139 microversion: 2.1 time: 0.084069 Oct 11 02:49:44.082876 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3831/7711] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:43 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:45.105314 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:45.106376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:45.115329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:45.115947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:45.116606 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:45.117382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:45.118027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:45.118536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:45.226884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:45.234881 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c2bd0b8f-8498-42f4-b5cf-a73658bf1e92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1205 microversion: 2.1 time: 0.133613 Oct 11 02:49:45.235491 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3881/7712] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:45 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1205 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:46.126429 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:46.140825 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:46.141771 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:46.142480 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:46.156308 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] Creating event network-changed:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h1-772273-9 Oct 11 02:49:46.161661 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d2c88530-07d7-4b91-9bdc-1108f7034062 req-d164a882-9671-4d78-ad5d-f9ac2984ff41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039771 Oct 11 02:49:46.162680 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3832/7713] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:49:46.258302 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:46.258979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:46.269449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:46.269950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:46.276433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:46.277512 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:46.277991 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:46.278601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:46.501501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:46.510471 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-504c8df8-8ad4-4aee-896b-7d7866422dd8 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1273 microversion: 2.1 time: 0.256250 Oct 11 02:49:46.511201 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3882/7714] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:46 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:47.535203 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:47.535956 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:47.542555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:47.543089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:47.543577 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:47.544331 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:47.544805 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:47.545383 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:47.682111 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:47.690029 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2746607-7d4d-4dac-a8eb-54081d11142c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1273 microversion: 2.1 time: 0.159972 Oct 11 02:49:47.690607 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3833/7715] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:47 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:48.714098 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:48.714715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:48.721693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:48.722200 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:48.722622 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:48.723319 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:48.723800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:48.724231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:48.860221 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:48.868179 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-0ced9e2d-c204-4f8c-9ba2-9ba99ad028b5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1273 microversion: 2.1 time: 0.158038 Oct 11 02:49:48.868774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3883/7716] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:48 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:49.890587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:49.891240 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:49.898690 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:49.899181 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:49.899662 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:49.900359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:49.900822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:49.901256 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:50.033079 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:50.041188 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cb158df-d85e-4449-b44b-77c484c0d724 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.154436 Oct 11 02:49:50.041884 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3834/7717] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:49 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:51.064433 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:51.065047 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:51.066900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:51.073044 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:51.073526 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:51.073961 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:51.074653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:51.075106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:51.075570 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:51.208413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:51.216772 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-92fdfbcf-c64e-40a8-ab1d-6263fa89f205 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.156197 Oct 11 02:49:51.217285 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3884/7718] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:51 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:52.238937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:52.239521 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:52.242849 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:52.248161 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:52.248661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:52.249113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:52.249859 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:52.250326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:52.250765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:52.380108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:52.388500 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8c3ffbb-6142-459a-b5b4-6023666bcffd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.153561 Oct 11 02:49:52.389083 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3835/7719] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:52 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:53.410741 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:53.411278 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:53.414108 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=10 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:49:53.420092 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:53.420587 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:53.421031 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:53.421731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:53.422191 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:53.422621 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:53.550795 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:53.558620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-29b2d16b-d4b1-4016-978d-03614c04fa8f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.151939 Oct 11 02:49:53.559200 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3885/7720] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:53 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:54.582262 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:54.582894 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:54.590792 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:54.591298 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:54.591777 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:54.592484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:54.592968 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:54.593410 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:54.727230 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:54.735457 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-286c7161-cdcb-4499-beee-9a8fd90251c4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.157051 Oct 11 02:49:54.736035 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3836/7721] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:54 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:55.758822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:55.759414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:55.765653 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:55.766143 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:55.766584 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:55.767279 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:55.767763 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:55.768194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:55.900393 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:55.908101 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-9045c1e2-d3c6-434e-9345-434941371395 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.154064 Oct 11 02:49:55.908684 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3886/7722] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:55 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:56.930565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:56.931128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:56.938141 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:56.938638 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:56.939089 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:56.939820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:56.940293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:56.940735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:57.076292 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:57.084437 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e781128f-813e-45e8-b5f6-c2b8edd3c94a tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.158565 Oct 11 02:49:57.085018 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3837/7723] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:56 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:58.106090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:58.106680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:58.113648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:58.114136 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:58.114571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:58.115298 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:58.115777 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:58.116206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:58.248651 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:58.256917 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-24df3754-c0cd-436c-a6d9-55f7ff49c138 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.154649 Oct 11 02:49:58.258137 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3887/7724] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:58 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:59.280682 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:49:59.281221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:49:59.287661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:59.288156 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:59.288604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:59.289302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:59.289765 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:59.290201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:59.418507 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:49:59.426248 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-307a704c-759f-45fe-a4de-c4107e21ab82 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.149751 Oct 11 02:49:59.426812 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3838/7725] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:49:59 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:49:59.803063 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "name": "network-vif-plugged", "status": "completed", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:49:59.814846 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:49:59.815325 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:49:59.815782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:49:59.827703 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] Creating event network-vif-plugged:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h1-772273-9 Oct 11 02:49:59.832702 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-b87cb1a8-3645-46bf-b47d-ac7d50b0871b req-fbb0ef8f-9a50-47ee-8701-d0f283971fc5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033849 Oct 11 02:49:59.833304 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3888/7726] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:50:00.449279 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:50:00.449916 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:50:00.457139 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:00.457646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:00.458104 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:00.458824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:00.459301 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:00.459770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:00.589639 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:50:00.597367 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3871eee1-fa4f-4172-b7dd-d394c476e8aa tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1261 microversion: 2.1 time: 0.152078 Oct 11 02:50:00.597948 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3839/7727] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:50:00 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:50:01.621593 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:50:01.622300 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:50:01.628478 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:01.628960 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:01.629392 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:01.630073 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:01.630520 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:01.630939 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:01.766380 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:50:01.776364 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-75519bf4-e61c-461e-8e48-1cef9d4ae692 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1444 microversion: 2.1 time: 0.159891 Oct 11 02:50:01.776944 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3889/7728] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:50:01 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:50:01.798043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:50:01.798676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:50:01.806119 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:01.806623 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:01.807083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:01.807835 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:01.808311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:01.808756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:01.940302 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:50:01.948779 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94e7c310-5db1-4bff-b41f-88dedb336c63 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1444 microversion: 2.1 time: 0.154730 Oct 11 02:50:01.949361 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3840/7729] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:50:01 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:50:03.539071 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:50:03.549421 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:50:03.549989 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:50:03.550486 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:50:03.562398 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] Creating event network-changed:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h1-772273-9 Oct 11 02:50:03.567595 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-8ff59add-d13c-4be5-9dac-07c4de975486 req-cd9ab452-f7aa-4773-9aa8-cf561bdd7489 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Oct 11 02:50:03.568270 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3890/7730] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:52:00.673688 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 02:52:00.674853 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 02:52:00.675472 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:00.676257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=56 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:00.746337 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:52:00.746917 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:00.753668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:00.754165 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:00.754621 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:00.755326 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:00.755821 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:00.756254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:00.779151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lazy-loading 'flavor' on Instance uuid f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:52:00.848764 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e8dbd39-1523-4ce6-8871-3418c1671066 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.176702 Oct 11 02:52:00.849476 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3841/7731] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:52:00 2022] POST /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:52:00.856074 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:52:00.856901 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:52:00.857510 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:00.858383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=54 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:00.859624 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:52:00.859841 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:52:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e (ip 10.222.0.66) !!! Oct 11 02:52:00.860849 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:52:00.861127 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:52:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e (ip 10.222.0.66) !!! Oct 11 02:52:00.865880 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:00.866591 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:00.878872 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:00.879294 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:00.879764 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:00.880482 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:00.880948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:00.881386 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:01.018169 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:01.026731 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-82b07392-793e-42fa-8ca6-171a17220e8c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.172495 Oct 11 02:52:01.027323 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3891/7732] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:00 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:02.053152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:02.053870 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:02.061860 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:02.062360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:02.062813 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:02.063548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:02.064018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:02.064458 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:02.069715 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42780. Oct 11 02:52:02.072767 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42778. Oct 11 02:52:02.200768 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:02.208556 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd39e76d-0c14-42f4-b8c5-845a28997036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.162146 Oct 11 02:52:02.209136 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3842/7733] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:02 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:03.232234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:03.232910 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:03.241857 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:03.242356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:03.242799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:03.243545 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:03.244009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:03.244443 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:03.261321 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42784. Oct 11 02:52:03.265154 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42786. Oct 11 02:52:03.378660 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:03.386514 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-47011550-62a2-4a68-9833-3e88d71b1e11 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.158250 Oct 11 02:52:03.387092 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3892/7734] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:03 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:04.410252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:04.410820 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:04.417584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:04.418078 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:04.418524 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:04.419221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:04.419719 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:04.420152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:04.549056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:04.556737 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4735278b-4d99-469f-b254-66e60e975afd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.151185 Oct 11 02:52:04.557304 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3843/7735] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:04 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:05.579823 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:05.580376 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:05.587263 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:05.587850 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:05.588303 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:05.589057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:05.589514 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:05.589945 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:05.731199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:05.740136 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cbbbb914-e5a2-4931-acc2-c357d434948b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.164597 Oct 11 02:52:05.740726 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3893/7736] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:05 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:06.764564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:06.765325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:06.774716 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:06.775235 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:06.775744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:06.776484 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:06.776961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:06.777412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:06.910600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:06.918428 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bad17620-c5df-4777-909a-335ebd0f7c92 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.157849 Oct 11 02:52:06.919016 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3844/7737] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:06 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:07.942216 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:07.942827 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:07.949551 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:07.950030 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:07.950722 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:07.951431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:07.951884 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:07.952308 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:08.085833 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:08.093503 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6b0b9efd-a8ae-462d-8da8-4fc4afe5be4b tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.155793 Oct 11 02:52:08.094081 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3894/7738] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:07 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:09.116702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:09.117334 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:09.124311 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:09.124822 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:09.125287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:09.126092 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:09.126575 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:09.127027 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:09.257280 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:09.265045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34898b54-10a9-4e45-a9e7-364fa1757e6c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.152309 Oct 11 02:52:09.265617 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3845/7739] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:09 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:10.289648 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:10.290182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:10.297083 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:10.297574 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:10.298018 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:10.298710 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:10.299172 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:10.299635 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:10.433588 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:10.441832 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f24987b6-df7c-4040-b573-1c208e6c06c7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.156204 Oct 11 02:52:10.442405 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3895/7740] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:10 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:11.465702 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:11.466341 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:11.473839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:11.474349 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:11.474804 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:11.475545 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:11.476018 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:11.476465 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:11.640678 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:11.649066 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb2ef13d-1715-42d5-887c-50361cd60aab tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.187261 Oct 11 02:52:11.649652 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3846/7741] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:11 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:12.672242 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:12.672863 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:12.679952 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:12.680447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:12.680895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:12.681596 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:12.682062 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:12.682497 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:12.813133 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:12.820991 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-ec902456-e854-4da8-9a4b-7f58ba9ef6af tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.152720 Oct 11 02:52:12.821576 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3896/7742] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:12 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:13.844953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:13.845617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:13.852580 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:13.853088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:13.853548 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:13.854263 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:13.854735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:13.855178 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:13.996151 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:14.004561 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4cc2d22e-01ce-48fd-be21-a86fa84bfdd5 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.163590 Oct 11 02:52:14.005138 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3847/7743] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:13 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:15.027286 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:15.027936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:15.034885 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.035411 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.035864 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.036647 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.037134 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.037674 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.167985 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:15.176465 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-066ff81c-b231-4337-95d6-9611918741ac tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1570 microversion: 2.1 time: 0.153191 Oct 11 02:52:15.178225 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3897/7744] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:15 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:15.199617 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:52:15.200219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:15.207473 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.207962 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.208420 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.209346 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.209824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.210268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.301940 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120494) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 02:52:15.366045 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-864205b6-7070-480f-ae72-688ea84492cb tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "POST /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.170431 Oct 11 02:52:15.366664 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3848/7745] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:52:15 2022] POST /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:52:15.374869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:15.375524 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:15.381936 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.382426 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.382869 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.383602 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:15.384060 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:15.384499 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:15.522689 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:15.530864 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d33f3d0e-1b36-4894-9bde-35705e62c036 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1518 microversion: 2.1 time: 0.159865 Oct 11 02:52:15.531480 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3898/7746] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:15 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:16.387934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:52:16.399133 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:16.399672 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:16.400152 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:16.411637 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.server_external_events [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] Unable to find a host for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e. Dropping event network-vif-unplugged {{(pid=120494) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 02:52:16.412574 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e9fe02db-2a2b-412c-9614-d65458163a2a req-67836a58-5997-40cf-be86-9df75054bc1c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082796 Oct 11 02:52:16.413502 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3849/7747] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 02:52:16.554283 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:16.554805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:16.561680 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:16.562170 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:16.562610 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:16.563301 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:16.563800 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:16.564225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:16.703165 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:16.711702 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3d6044dd-fb60-4b93-9b25-3dfe3618ffda tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1520 microversion: 2.1 time: 0.161467 Oct 11 02:52:16.712281 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3899/7748] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:16 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:17.734206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:17.734783 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:17.741565 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:17.742063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:17.742514 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:17.743216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:17.743705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:17.744142 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:17.874101 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:17.882051 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4e5dd2d-843b-4bc3-ae19-cf3391acd1bd tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1520 microversion: 2.1 time: 0.151891 Oct 11 02:52:17.882636 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3850/7749] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:17 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:18.905819 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:18.906375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:18.914149 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:18.914649 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:18.915094 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:18.915843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:18.916306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:18.916737 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:19.059016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:19.067045 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-d781a4c2-ee6d-48a8-aa6f-4e548b4d60d7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1520 microversion: 2.1 time: 0.165319 Oct 11 02:52:19.067664 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3900/7750] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:18 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:20.090224 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:20.090891 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:20.099537 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:20.100053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:20.100515 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:20.101265 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:20.101744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:20.102189 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:20.233780 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:20.241885 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5789c17c-2b1b-4d16-868d-b4005184d92f tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1520 microversion: 2.1 time: 0.155685 Oct 11 02:52:20.242469 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3851/7751] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:20 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:21.265131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:21.265782 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:21.273253 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:21.273751 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:21.274194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:21.274905 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:21.275388 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:21.275824 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:21.553607 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:21.561498 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b1f8171b-9e2e-4fe0-833d-7f75b70c88b7 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.300316 Oct 11 02:52:21.562079 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3901/7752] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:21 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:22.082770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:52:22.093293 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:22.094523 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:22.094983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:22.107021 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] Creating event network-changed:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h2-772273-9 Oct 11 02:52:22.112990 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c03c3650-827a-48b0-887b-bd21b40e5833 req-ecb070c7-c5bd-405f-ac9e-4820480155ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034093 Oct 11 02:52:22.113484 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3852/7753] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:52:22.585684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:22.586395 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:22.593780 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:22.594382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:22.594949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:22.595736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:22.596225 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:22.596693 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:22.732664 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:22.740489 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5fb3dabc-3ff7-4570-9677-6ef28267a0f0 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.159335 Oct 11 02:52:22.741008 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3902/7754] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:22 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:23.764587 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:23.765318 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:23.773692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:23.774204 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:23.774663 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:23.775413 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:23.775964 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:23.776449 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:24.040378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:24.048559 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d65216c3-4d8b-48e1-a11e-e3d997d2171e tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.288286 Oct 11 02:52:24.049155 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3853/7755] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:23 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:25.071533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:25.072232 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:25.079297 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:25.079813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:25.080257 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:25.080947 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:25.082177 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:25.082614 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:25.209552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:25.217453 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-15e8ce39-16fc-4dda-8171-1aa4b694cf49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.149827 Oct 11 02:52:25.218045 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3903/7756] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:25 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:26.243409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:26.244035 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:26.250839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:26.251357 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:26.251823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:26.252542 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:26.253014 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:26.253450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:26.389172 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:26.396915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9f99603d-e963-4d5a-87f1-35195c21db4d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.157432 Oct 11 02:52:26.397527 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3854/7757] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:26 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:27.420320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:27.420979 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:27.428943 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:27.429432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:27.429874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:27.430575 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:27.431034 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:27.431501 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:27.563694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:27.572028 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-686a4e4a-52bf-4065-b81a-aa0885d63c5d tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.155703 Oct 11 02:52:27.572602 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3904/7758] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:27 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:28.596441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:28.597075 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:28.604095 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:28.604604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:28.605109 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:28.605934 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:28.606557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:28.607215 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:28.742167 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:28.745764 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:28.751390 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c285b02-6ee8-4709-a896-538c1cd77e47 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.160221 Oct 11 02:52:28.751972 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3855/7759] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:28 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:29.774547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:29.775156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:29.781997 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:29.782479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:29.782913 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:29.783625 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:29.784075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:29.785137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:29.916608 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:29.924378 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b6a7dd51-31f6-402d-9aee-afc2999ef033 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.153717 Oct 11 02:52:29.924969 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3905/7760] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:29 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:30.948539 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:30.949074 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:30.951963 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:30.961807 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:30.962496 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:30.962953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:30.963700 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:30.964174 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:30.964616 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:31.105531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:31.113985 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37e4fbea-6f93-4ed2-b0bb-c30e1516418c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.170432 Oct 11 02:52:31.114565 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3856/7761] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:30 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:32.138181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:32.138799 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:32.141476 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=31 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:32.147219 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:32.147729 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:32.148174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:32.148871 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:32.149329 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:32.149757 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:32.153838 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=91 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:52:32.285897 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:32.293863 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1e3c0cc5-2554-4be0-aa1b-41cee762e5f3 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.159709 Oct 11 02:52:32.294446 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3906/7762] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:32 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:33.127601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "name": "network-vif-plugged", "status": "completed", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:52:33.138982 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:33.139529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:33.139983 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:33.152266 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] Creating event network-vif-plugged:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h2-772273-9 Oct 11 02:52:33.157336 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-3a56d161-5f82-43f9-a7e7-0b8e0d76069b req-4b8c515a-42f0-4431-a0e4-b1cb259926d7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033913 Oct 11 02:52:33.157954 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3857/7763] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:52:33.316074 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:33.317174 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:33.323550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:33.324043 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:33.324484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:33.325432 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:33.325933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:33.326366 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:33.458375 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:33.466176 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-abe8c60e-facf-4527-9b1d-375e681b9714 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.154160 Oct 11 02:52:33.466756 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3907/7764] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:33 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:34.491147 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:34.491901 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:34.498100 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:34.498604 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:34.499063 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:34.499811 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:34.500287 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:34.500733 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:34.631734 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:34.639976 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e664558-909e-43f5-99ae-d86bb3e92021 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1576 microversion: 2.1 time: 0.154576 Oct 11 02:52:34.640765 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3858/7765] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:34 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:52:35.663662 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:52:35.664287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:52:35.671182 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:35.671711 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:35.672152 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:35.672845 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:52:35.673306 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:52:35.673736 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:52:35.808835 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:52:35.817249 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-257dac6a-4e47-48a0-ad0b-67a9fff134ee tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1563 microversion: 2.1 time: 0.157597 Oct 11 02:52:35.817834 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3908/7766] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:52:35 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:49.289502 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=5 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:53:49.290424 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=17 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:53:49.291096 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:53:49.291240 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.66) !!! Oct 11 02:53:49.295831 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:49.296360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:49.298892 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=5 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:53:49.299599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=14 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:53:49.300621 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:53:49.305279 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e (ip 10.222.0.66) !!! Oct 11 02:53:49.305448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:53:49.314185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:49.314965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:49.315836 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:49.316535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:49.317020 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:49.317455 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:49.317586 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:49.318329 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:49.318986 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:49.330763 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] Creating event network-changed:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h2-772273-9 Oct 11 02:53:49.339729 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-316e7e41-2557-4a4d-b1bf-96ad52e81efa req-0c6bb84e-711f-47eb-a163-3a8e39c8a0a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052634 Oct 11 02:53:49.340531 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3909/7767] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:53:49.350333 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:53:49.440025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9269ce05-a27f-49b8-844b-48455b955c94 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 204 len: 0 microversion: 2.1 time: 0.154989 Oct 11 02:53:49.444514 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3859/7768] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:53:49 2022] DELETE /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:53:49.451413 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:49.452535 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:49.461021 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:49.461865 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:49.462573 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:49.463549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:49.464234 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:49.464895 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:49.619029 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:49.627004 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-63b9e9ba-e967-4a41-9fa2-ba95030b07d4 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.180067 Oct 11 02:53:49.627824 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3910/7769] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:49 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:50.650668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:50.651424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:50.658904 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:50.659441 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:50.659899 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:50.660620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:50.661096 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:50.661540 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:50.875676 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:50.883600 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6d6740a-4550-4987-852a-e76cbe337f49 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1569 microversion: 2.1 time: 0.237226 Oct 11 02:53:50.884183 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3860/7770] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:50 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:51.525365 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e", "name": "network-vif-deleted", "tag": "368fff92-fa97-4f2a-a497-57ffc944818d"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:53:51.535957 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:51.536448 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:51.536881 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:51.548925 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] Creating event network-vif-deleted:368fff92-fa97-4f2a-a497-57ffc944818d for instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e on n-h2-772273-9 Oct 11 02:53:51.554023 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-2f333e38-cfbc-494f-989d-40677bd06fca req-48890be1-6985-49cb-9b8c-aafbfa853743 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Oct 11 02:53:51.554626 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3911/7771] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:53:51.906268 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:51.907064 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:51.914487 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:51.915424 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:51.915959 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:51.916802 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:51.917344 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:51.918113 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:51.988526 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:51.997003 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b68be880-213f-4fe3-80ff-b3f9530f099c tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1220 microversion: 2.1 time: 0.094799 Oct 11 02:53:51.997587 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3861/7772] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:51 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:53.022569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:53.023281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:53.029889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:53.030892 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:53.031091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:53.032012 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:53.032484 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:53.032915 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:53.098382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:53.107456 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-1ca5af4e-ee3a-49d5-8e99-653d7c177515 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1220 microversion: 2.1 time: 0.090006 Oct 11 02:53:53.108067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3912/7773] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:53 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:54.130194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:54.130830 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:54.138248 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:54.138758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:54.139217 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:54.139957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:54.140435 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:54.140880 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:54.203206 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:54.211127 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5447aad0-59c3-4143-9752-1244ab06b865 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1220 microversion: 2.1 time: 0.084913 Oct 11 02:53:54.211737 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3862/7774] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:54 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:55.234287 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:55.234877 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:55.242016 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:55.242511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:55.242950 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:55.243688 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:55.244148 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:55.244577 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:55.312041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670256b965a34790bd4ac2ba743903d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7589e18232fc4522b7bd4e0f538a846c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:53:55.320620 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cf5fd94f-d5f0-4ebf-b97c-3c1d2bdbe6a1 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 200 len: 1220 microversion: 2.1 time: 0.090359 Oct 11 02:53:55.321206 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3913/7775] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:55 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:53:56.344450 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:56.345088 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] [instance: f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:53:56.352744 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:56.353252 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:56.353712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:56.354434 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:53:56.354912 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:53:56.355445 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:53:56.369464 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] HTTP exception thrown: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Request method failure captured: Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e HTTP/1.1 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNivRe1juBhkkI_uPpeDAtWoA3Indd057SmNhPmekHD9gregvki9iakbDOxtv-aGEXOJVvZjmJAMIYiqM_dPJpulOM8QTxjIf9iasJFOvls3HCOm38dqixNPUkSWizKG7mNtsaqVSVgk_qCcYhz6sKIEO-rK2jLFEMdA4gLfEa0v8pE Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 7589e18232fc4522b7bd4e0f538a846c Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestShelveInstance-1888989032 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7589e18232fc4522b7bd4e0f538a846c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestShelveInstance-1888989032 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 7589e18232fc4522b7bd4e0f538a846c Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestShelveInstance-1888989032 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestShelveInstance-1888989032-project Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: 670256b965a34790bd4ac2ba743903d3 Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestShelveInstance-1888989032-project Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': 'f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e'} Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:53:56.371214 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Returning 404 to user: Instance f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89a5d7a2-5b5c-4a57-8852-fd0711feb887 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e" status: 404 len: 111 microversion: 2.1 time: 0.032332 Oct 11 02:53:56.375650 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3863/7776] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:53:56 2022] GET /compute/v2.1/servers/f45bdca2-2324-4c8b-bf62-ad9ea8f21e0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:53:56.549249 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-767dbcf1-9a4e-46b0-9db1-7430ff0dc989 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] Calling method '.version_select at 0x7f11388eb5e0>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:53:56.585924 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-767dbcf1-9a4e-46b0-9db1-7430ff0dc989 tempest-TestShelveInstance-1888989032 tempest-TestShelveInstance-1888989032-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1197206409" status: 202 len: 0 microversion: 2.1 time: 0.040195 Oct 11 02:53:56.587232 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3914/7777] 10.222.0.66 () {58 vars in 1254 bytes} [Tue Oct 11 02:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1197206409 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 02:54:14.013107 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:14.013960 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:14.185400 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-054a6388-b01d-4fce-8f3c-d88039cd7bce tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Action: 'create', calling method: .version_select at 0x7f112f2683a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2085517057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYQ/mZ3Sb5eUYTBnebq3jbaR07hBcPPQ88yDZt8urPBcadQrfitjdlbhKp5y5QBTXN4BTKrWRaCAnUKCYfBb2dhG2QAfKiFoG2IroF07nvvm6yA97P2ltNQ/KjNjCPurg=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:54:14.200943 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-054a6388-b01d-4fce-8f3c-d88039cd7bce tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for project 3d82809e02384697bb228b979adcc46d. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:54:14.206053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-054a6388-b01d-4fce-8f3c-d88039cd7bce tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for user e95041e8229a48e2a11f10a279d3362f and project 3d82809e02384697bb228b979adcc46d. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:54:14.246293 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-054a6388-b01d-4fce-8f3c-d88039cd7bce tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.238120 Oct 11 02:54:14.247274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3864/7778] 10.222.0.66 () {60 vars in 1159 bytes} [Tue Oct 11 02:54:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:54:15.317831 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1241990816", "imageRef": "2d331602-222c-492e-9d47-dfe2484eac74", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2085517057", "security_groups": [{"name": "tempest-secgroup-smoke-687100980"}], "networks": [{"uuid": "cc82769a-9d19-4a22-9938-3bcc7f67f80f"}]}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:54:15.328163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=22 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:15.328821 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:15.437233 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.network.neutron [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] validate_networks() for [('cc82769a-9d19-4a22-9938-3bcc7f67f80f', None, None, None, None, None)] {{(pid=120493) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:54:15.920469 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Flavor limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:54:15.920923 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Image limits 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:54:15.921528 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Flavor pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:54:15.921949 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Image pref 0:0:0 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:54:15.922367 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.virt.hardware [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:54:15.931508 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:15.932002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:15.932440 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:15.933181 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:15.933666 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:15.934096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:15.951859 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for project 3d82809e02384697bb228b979adcc46d. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:54:15.957151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.quota [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for user e95041e8229a48e2a11f10a279d3362f and project 3d82809e02384697bb228b979adcc46d. Resources: {'instances', 'cores', 'ram'} {{(pid=120493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:54:15.970026 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Going to run 1 instances... {{(pid=120493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:54:15.972382 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d331602-222c-492e-9d47-dfe2484eac74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:54:16.019030 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-fdf87c0d-9b40-40d9-abe7-8d01026714fe tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705307 Oct 11 02:54:16.019721 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3915/7779] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:54:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:54:16.033451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-645c30cd-5290-447a-a55c-a7ba53014009 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:16.034083 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-645c30cd-5290-447a-a55c-a7ba53014009 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:16.095044 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-645c30cd-5290-447a-a55c-a7ba53014009 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:16.102840 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-645c30cd-5290-447a-a55c-a7ba53014009 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1249 microversion: 2.1 time: 0.075092 Oct 11 02:54:16.103530 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3865/7780] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:16 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:17.126358 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:17.127731 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:17.136320 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:17.137105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:17.137766 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:17.138820 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:17.139684 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:17.140318 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:17.232716 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:17.241017 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4f89962f-a56b-49e6-8441-c0ef36ade29f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1319 microversion: 2.1 time: 0.118771 Oct 11 02:54:17.243725 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3916/7781] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:17 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:54:18.264900 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:18.266055 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:18.273531 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:18.274255 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:18.274707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:18.275630 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:18.276114 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:18.276557 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:18.526569 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:18.534893 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac1d386f-abe1-4f67-979f-afec36ae04ea tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.273906 Oct 11 02:54:18.535592 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3866/7782] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:18 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:54:18.685990 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:54:18.697966 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:18.698541 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:18.699654 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:18.713309 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] Creating event network-changed:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:54:18.718859 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-01c6e409-21fe-47f6-8c0e-86174e9d40b3 req-27dee9b8-c0de-4c33-bb65-8897c520ad2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037895 Oct 11 02:54:18.720259 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3917/7783] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:54:19.559042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:19.559601 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:19.566763 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:19.567264 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:19.567739 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:19.568454 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:19.568924 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:19.569360 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:19.710237 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:19.717856 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a550c821-eaff-493d-a7a2-51e6308dda2f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.162874 Oct 11 02:54:19.718430 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3867/7784] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:19 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:20.741100 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:20.741803 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:20.749342 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:20.749840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:20.750281 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:20.750998 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:20.751590 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:20.752022 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:20.888707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:20.896464 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-568bc3fd-e93f-40c9-8b38-e8fa915fb4ae tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.159646 Oct 11 02:54:20.897035 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3918/7785] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:20 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:21.919791 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:21.920426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:21.927306 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:21.927839 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:21.928296 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:21.929009 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:21.929485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:21.929933 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:22.066488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:22.075035 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc9f3560-e10e-4290-b8ea-fcf041898ec4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.159381 Oct 11 02:54:22.075654 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3868/7786] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:21 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:23.103315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:23.104569 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:23.111247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:23.111759 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:23.112194 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:23.112876 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:23.113331 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:23.113749 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:23.247157 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:23.254863 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-7634c0fe-6210-40c6-a79b-1a27fe8cbec3 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.155437 Oct 11 02:54:23.255463 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3919/7787] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:23 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:24.277620 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:24.278257 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:24.285285 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:24.285735 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:24.286194 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:24.286905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:24.287404 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:24.287861 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:24.419163 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:24.426859 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d247b38-ebc4-4fc0-834a-f8850c9ddf25 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.153242 Oct 11 02:54:24.427462 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3869/7788] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:24 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:24.956161 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "name": "network-vif-plugged", "status": "completed", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:54:24.967597 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:24.968075 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:24.968694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:24.979548 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] Creating event network-vif-plugged:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:54:24.984632 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-c3b56ec5-dc78-4423-baf9-d30a784896f2 req-8e066257-ea69-4f5c-8c0b-328931c664cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032479 Oct 11 02:54:24.985781 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3920/7789] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:54:25.451040 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:25.451750 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:25.458718 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:25.459222 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:25.459712 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:25.460456 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:25.460937 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:25.461381 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:25.589993 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:25.597653 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dbee77fb-48ba-4337-ba57-13231c6d798d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1374 microversion: 2.1 time: 0.150827 Oct 11 02:54:25.598234 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3870/7790] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:25 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:26.618678 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:26.620408 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=6 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:26.625137 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:26.625840 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:26.632580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:26.633068 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:26.633511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:26.634211 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:26.634717 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:26.635105 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:26.779786 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:26.787474 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5a0450ce-2ed7-4ed2-8c1c-a2071b17825f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1558 microversion: 2.1 time: 0.169766 Oct 11 02:54:26.788067 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3921/7791] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:26 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:26.809774 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:54:26.810408 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:54:26.812307 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:54:26.818501 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:26.819007 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:26.819563 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:26.820281 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:26.820754 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:26.821200 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:26.953201 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:54:26.960918 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1975d618-1957-4a9d-8c54-b4f28b783482 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1558 microversion: 2.1 time: 0.155036 Oct 11 02:54:26.961488 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3871/7792] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:54:26 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:54:28.959265 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:54:28.969323 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:54:28.969695 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:54:28.970131 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:54:28.981094 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] Creating event network-changed:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:54:28.986120 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-22b30236-70b1-4220-9c17-8a01d32b097b req-30ac96b0-81ab-49cd-838e-7ee918bd2cfe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091118 Oct 11 02:54:28.986720 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3922/7793] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:56:26.409823 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 02:56:26.410725 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 02:56:26.411555 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:26.412372 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=36 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:26.413329 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:56:26.413649 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864/action (ip 10.222.0.66) !!! Oct 11 02:56:26.414590 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:56:26.414712 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864/action (ip 10.222.0.66) !!! Oct 11 02:56:26.421730 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-300618856"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:26.424082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:26.439781 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:26.440291 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:26.440749 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:26.441466 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:26.441954 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:26.442407 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:26.642822 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-87503922-42bf-4fa8-9f95-cec9c15471f8 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "POST /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864/action" status: 202 len: 0 microversion: 2.1 time: 0.234669 Oct 11 02:56:26.643496 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3872/7794] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:56:26 2022] POST /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 02:56:31.547938 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:56:31.550472 n-d-772273-9 devstack@n-api.service[120493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 02:56:31.551096 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:31.552552 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=32 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:31.553594 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:56:31.553742 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.66) !!! Oct 11 02:56:31.566163 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "name": "network-vif-plugged", "status": "completed", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:31.584866 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:31.585808 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:31.586255 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:31.598690 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.compute.server_external_events [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] Creating event network-vif-plugged:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:56:31.609259 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [req-404b4898-59ea-4eae-8d9a-891d8133e88b req-4905ba03-ca26-439d-9f80-229a10428c5f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063085 Oct 11 02:56:31.609794 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3923/7795] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:56:40.197052 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:40.198720 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:40.202832 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-708173129", "imageRef": "338363c9-836e-4f7f-b235-a0388d01f239", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2085517057", "security_groups": [{"name": "tempest-secgroup-smoke-687100980"}], "networks": [{"uuid": "cc82769a-9d19-4a22-9938-3bcc7f67f80f"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:40.222401 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43280. Oct 11 02:56:40.226735 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43278. Oct 11 02:56:40.325038 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] validate_networks() for [('cc82769a-9d19-4a22-9938-3bcc7f67f80f', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 02:56:40.709711 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 02:56:40.710157 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 02:56:40.710651 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 02:56:40.711080 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 02:56:40.711549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 02:56:40.720359 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:40.720858 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:40.721310 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:40.722061 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:40.722532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:40.722974 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:40.744589 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for project 3d82809e02384697bb228b979adcc46d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 02:56:40.749840 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.quota [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Getting quotas for user e95041e8229a48e2a11f10a279d3362f and project 3d82809e02384697bb228b979adcc46d. Resources: {'instances', 'cores', 'ram'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 02:56:40.762056 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 02:56:40.764599 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='338363c9-836e-4f7f-b235-a0388d01f239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 02:56:40.813213 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caec4ed8-3a3b-4aaa-98ce-9cecdc904a1e tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.618897 Oct 11 02:56:40.813883 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3873/7796] 10.222.0.66 () {60 vars in 1147 bytes} [Tue Oct 11 02:56:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 02:56:40.828340 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-449e133f-dcdd-4116-a241-9369a20c8c0b tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:40.829054 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-449e133f-dcdd-4116-a241-9369a20c8c0b tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:40.839562 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f19dff0-2705-4180-82c7-b8064865ae28] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43294. Oct 11 02:56:40.841219 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] [85cad7df-ddb1-4716-8ec4-aeea643ec1c2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43292. Oct 11 02:56:40.888927 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-449e133f-dcdd-4116-a241-9369a20c8c0b tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:40.896819 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-449e133f-dcdd-4116-a241-9369a20c8c0b tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1248 microversion: 2.1 time: 0.075412 Oct 11 02:56:40.897570 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3924/7797] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:40 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:41.922760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:41.924053 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:41.931325 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:41.932378 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:41.933042 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:41.933756 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:41.934411 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:41.934856 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:42.010770 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:42.018685 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a40ef946-01b5-4c0e-8ebe-f859062aef88 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1318 microversion: 2.1 time: 0.099831 Oct 11 02:56:42.019270 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3874/7798] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:41 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:43.044944 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:43.045668 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:43.047704 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:43.055712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:43.056715 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:43.057449 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:43.058554 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:43.059240 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:43.060027 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:43.226431 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:43.234356 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-283d3b29-9516-4230-a127-eb2d4c0022c6 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.193743 Oct 11 02:56:43.235129 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3925/7799] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:43 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:43.520595 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "name": "network-vif-unplugged", "status": "completed", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:43.541568 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:43.542661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:43.543503 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:43.560606 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] Creating event network-vif-unplugged:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:56:43.566763 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-131e5a18-b405-4496-b0ce-0031336cd1ff req-a680f5fb-7c73-4928-94cd-f77b6a2cfca1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050506 Oct 11 02:56:43.568283 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3875/7800] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:56:44.258084 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:44.258685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:44.266739 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:44.267173 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:44.267645 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:44.268417 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:44.268817 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:44.269241 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:44.430002 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:44.439234 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-052d4573-6d19-4872-b569-927731e386a4 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.185006 Oct 11 02:56:44.441019 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3926/7801] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:44 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:45.469187 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:45.470797 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:45.477758 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:45.479278 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:45.480221 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:45.481488 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:45.482037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:45.482558 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:45.633149 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:45.641528 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-655b1742-136a-43e1-b150-9fbc096fdb6f tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.177407 Oct 11 02:56:45.642700 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3876/7802] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:45 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:46.668397 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:46.669015 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:46.676309 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:46.676810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:46.677356 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:46.678313 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:46.678767 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:46.679536 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:46.827489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:46.836793 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-c440136f-5de8-440c-b913-235627c37fe9 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.172794 Oct 11 02:56:46.837770 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3927/7803] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:46 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:47.860590 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:47.861254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:47.868426 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:47.868961 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:47.869412 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:47.870128 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:47.870594 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:47.871029 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:48.028108 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:48.036854 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d024b75c-4558-4551-b80c-334b6fe316ad tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.180387 Oct 11 02:56:48.037453 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3877/7804] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:47 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:49.060422 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:49.061813 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:49.069937 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:49.070810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:49.071533 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:49.073290 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:49.074487 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:49.075156 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:49.222315 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:49.230509 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-cebd6228-586d-4464-99d9-279498c814b1 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.174620 Oct 11 02:56:49.231108 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3928/7805] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:49 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:50.253625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:50.254251 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:50.261535 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:50.262032 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:50.262479 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:50.263183 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:50.263685 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:50.264124 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:50.392184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:50.399805 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d6da642-e1a0-49a3-b3ef-f0b7a9615c67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.150125 Oct 11 02:56:50.401001 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3878/7806] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:50 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:51.423058 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:51.423822 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:51.426550 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell0:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:51.432447 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:51.432933 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:51.433369 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:51.434057 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:51.434511 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:51.434935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:51.574796 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:51.582369 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-48598ea8-e6f2-46a7-9f0e-5671714624c2 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.163192 Oct 11 02:56:51.582960 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3929/7807] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:51 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:52.470246 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:52.477532 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:52.478547 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:56:52.485584 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:52.486562 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:52.487185 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:52.500368 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] Creating event network-changed:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:56:52.505506 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d836ba33-7777-4c22-84a5-d9b9873a69f6 req-3ebf241a-74eb-4ba5-b478-e6e59257e4a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039520 Oct 11 02:56:52.506309 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3879/7808] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:56:52.606430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:52.607048 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:52.613916 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:52.614401 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:52.614843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:52.615568 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:52.616032 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:52.616461 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:52.844900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:52.852635 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-54803bae-f192-4089-83e5-bf33e6012cca tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.250985 Oct 11 02:56:52.853741 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3930/7809] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:52 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:53.877099 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:53.877812 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:53.883965 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:53.884459 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:53.884905 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:53.885598 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:53.886062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:53.886500 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:54.023668 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:54.031440 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b1a6cd8c-1425-4793-9e5b-9ffdc51dca52 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.159489 Oct 11 02:56:54.032023 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3880/7810] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:53 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:55.054154 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:55.054707 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:55.062235 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:55.062725 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:55.063167 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:55.063893 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:55.064355 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:55.064785 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:55.558874 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:55.566619 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8aac0631-396b-492c-b71a-d4bd74fd7d67 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.516460 Oct 11 02:56:55.567202 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3931/7811] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:55 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 02:56:56.590517 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:56.591082 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:56.597868 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:56.598369 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:56.598823 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:56.599564 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:56.600043 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:56.600485 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:56.736609 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:56.744836 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af6cde44-b0f6-40cd-88c5-5f9096bb569d tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.158942 Oct 11 02:56:56.745414 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3881/7812] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:56 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:57.767806 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:57.768423 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:57.775112 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:57.775615 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:57.776069 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:57.776758 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:57.777206 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:57.777626 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:57.907696 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:57.915284 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-2c0df601-0a8c-4a27-a36d-6fd7cc25bb31 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.151364 Oct 11 02:56:57.915877 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3932/7813] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:57 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:56:58.475304 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "name": "network-vif-plugged", "status": "completed", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:56:58.485674 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:58.486418 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:58.486867 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:58.498489 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] Creating event network-vif-plugged:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:56:58.503576 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-25fd1018-1daf-4196-9854-b7156e402497 req-bd58e2bc-48b2-47b1-afeb-03ea2f630c4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Oct 11 02:56:58.504180 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3882/7814] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:56:58.937805 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:56:58.938348 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:56:58.945151 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:58.945661 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:58.946091 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:58.946776 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:56:58.947231 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:56:58.947948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:56:59.078383 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:56:59.086130 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-205e4bc8-254e-4a44-962d-9b5117b0b507 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1373 microversion: 2.1 time: 0.152313 Oct 11 02:56:59.086774 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3933/7815] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:56:58 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:57:00.110510 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:57:00.111232 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:57:00.117451 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:57:00.117953 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:57:00.118409 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:57:00.119707 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:57:00.120184 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:57:00.120625 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:57:00.251065 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:57:00.258887 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-364134e9-53e3-4f4b-86c5-0c958b61abbd tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1557 microversion: 2.1 time: 0.153523 Oct 11 02:57:00.259492 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3883/7816] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:57:00 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:57:00.280516 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:57:00.281076 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:57:00.287965 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:57:00.288452 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:57:00.288889 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:57:00.289580 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:57:00.290038 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:57:00.291017 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:57:00.425761 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:57:00.433960 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-4b2ae77f-dfdf-4487-aefc-4c2116b30251 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1557 microversion: 2.1 time: 0.157408 Oct 11 02:57:00.434538 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3934/7817] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:57:00 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:57:02.018885 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:57:02.029713 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:57:02.030219 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:57:02.030673 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:57:02.042534 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] Creating event network-changed:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:57:02.047915 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a5c2f94f-b9ef-4746-9e9a-dd0283d47619 req-ae8e9f54-aedf-4b0a-8552-ac3fee1a4305 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Oct 11 02:57:02.048520 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3884/7818] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:59:04.929078 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=26 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:04.929948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=60 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:04.930660 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:59:04.930851 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2/action (ip 10.222.0.66) !!! Oct 11 02:59:04.932207 n-d-772273-9 devstack@n-api.service[120493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 02:59:04.932369 n-d-772273-9 devstack@n-api.service[120493]: Tue Oct 11 02:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2/action (ip 10.222.0.66) !!! Oct 11 02:59:04.937712 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1459059292"}} {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:04.940160 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:04.952694 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:04.953185 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:04.953623 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:04.954321 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:04.954775 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:04.955199 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:05.365786 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-8ca90a96-6244-4bd5-899d-71ac78903cf7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "POST /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.438564 Oct 11 02:59:05.366454 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3935/7819] 10.222.0.66 () {60 vars in 1278 bytes} [Tue Oct 11 02:59:04 2022] POST /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 02:59:13.038674 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:59:13.039698 n-d-772273-9 devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 02:59:13.040876 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:13.041641 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=52 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:13.042542 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 02:59:13.042542 n-d-772273-9 devstack@n-api.service[120494]: Tue Oct 11 02:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.66) !!! Oct 11 02:59:13.119728 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "name": "network-vif-plugged", "status": "completed", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:13.130578 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:13.131072 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:13.131549 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:13.142116 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] Creating event network-vif-plugged:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:59:13.147683 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2ac60589-0a66-4683-94d7-4ca439fd2f8c req-5790e859-f937-4c79-94ea-f6e5af70aa64 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111947 Oct 11 02:59:13.148274 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3885/7820] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:59:24.125925 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_api:SELECT=2 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:24.126978 n-d-772273-9 devstack@n-api.service[120493]: DEBUG dbcounter [-] [120493] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:24.131489 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:24.132081 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:24.135939 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:24.137228 n-d-772273-9 devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 02:59:24.142430 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:24.142935 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:24.143727 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:24.144579 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:24.145247 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:24.145860 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:24.152904 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2fc2238-b850-441f-bdb8-abd67462552f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43624. Oct 11 02:59:24.158940 n-d-772273-9 devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a29c90-9322-4907-9623-4a2bc27b4b49] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43622. Oct 11 02:59:24.176810 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:59:24.203600 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:24.214250 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:24.214883 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:24.215366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:24.226828 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] Creating event network-changed:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:59:24.233038 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ff5aa829-6296-4489-b8de-b84e7a8f2386 req-1554b58a-0bb7-4917-a9bd-a4e12f8b572c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105762 Oct 11 02:59:24.235126 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3886/7821] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:59:24.265450 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-6d98e150-5fcb-49f9-b7ba-3a55259f3087 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 204 len: 0 microversion: 2.1 time: 0.142314 Oct 11 02:59:24.266411 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3936/7822] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:59:24 2022] DELETE /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:59:24.275164 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:24.276210 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:24.284520 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:24.285037 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:24.285529 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:24.286432 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:24.287135 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:24.287608 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:24.478649 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:59:24.487154 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df25a2c0-fb4c-4284-8523-b59c069bfe35 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1682 microversion: 2.1 time: 0.216260 Oct 11 02:59:24.487848 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3887/7823] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:24 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:59:25.510843 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:25.511657 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:25.519007 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:25.519547 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:25.519986 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:25.520685 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:25.521141 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:25.521571 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:25.726617 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:59:25.734409 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-b68a914a-4f50-493f-8b90-7987ddff8a46 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1682 microversion: 2.1 time: 0.227997 Oct 11 02:59:25.735193 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3937/7824] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:25 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:59:26.526646 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9876e8-7aa9-4151-8da7-77a7a217c9a2", "name": "network-vif-deleted", "tag": "9f3981df-fd91-4a2c-a87d-81af510f8b36"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:26.537254 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:26.537692 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:26.538145 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:26.550025 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] Creating event network-vif-deleted:9f3981df-fd91-4a2c-a87d-81af510f8b36 for instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 on n-h2-772273-9 Oct 11 02:59:26.554929 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-957fdd55-fb2a-497e-bae1-3d0f1cabcdda req-dab61730-b6d6-4130-8f73-a06fb3f9c76a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Oct 11 02:59:26.555613 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3888/7825] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 02:59:26.758025 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:26.758601 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:26.765479 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:26.765967 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:26.766414 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:26.767106 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:26.767600 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:26.768036 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:26.801009 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:26.801504 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:26.801948 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:26.802481 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.objects.instance [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lazy-loading 'fault' on Instance uuid 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 {{(pid=120493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 02:59:26.856361 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:59:26.864419 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-292df547-9b1f-4a5b-8d39-57b4555b85db tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 200 len: 1338 microversion: 2.1 time: 0.110351 Oct 11 02:59:26.865026 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3938/7826] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:26 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:59:27.889824 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:27.890469 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: 3e9876e8-7aa9-4151-8da7-77a7a217c9a2] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:27.896705 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:27.897199 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:27.897656 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:27.898366 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:27.898838 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:27.899282 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:27.914788 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] HTTP exception thrown: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Request method failure captured: Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 HTTP/1.1 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Accept: application/json Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Accept-Encoding: identity Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Connection: close Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Content-Length: 0 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Content-Type: application/json Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Host: 10.222.0.66 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: Openstack-System-Scope: None Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjRNrR2wLa31udn55RtEwn1hgChKJm5_WVKGN3cwM67AbgKcEXZ_Xbpi_n1ODP1XnUL3vCmCqgwpCpqNCYoxaqU5HEKU67NKy-lumKJeFfoNPN7QwMFxN98xg2fILfz1Z0OtaT4UEXSrJ4dc8Vxrhv5dJKPzWqKBBC6BAjvZZJZbv1xEM Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Id: None Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Domain-Name: None Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Identity-Status: Confirmed Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Is-Admin-Project: True Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Id: default Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Domain-Name: Default Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Id: 3d82809e02384697bb228b979adcc46d Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Project-Name: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Role: reader,member Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Roles: reader,member Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3d82809e02384697bb228b979adcc46d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3d82809e02384697bb228b979adcc46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d82809e02384697bb228b979adcc46d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d82809e02384697bb228b979adcc46d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Id: 3d82809e02384697bb228b979adcc46d Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-Tenant-Name: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-User: tempest-TestSnapshotPattern-412420923-project Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Id: default Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Domain-Name: Default Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Id: e95041e8229a48e2a11f10a279d3362f Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: X-User-Name: tempest-TestSnapshotPattern-412420923-project Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: method: > Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: exception: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: action_args: {'id': '3e9876e8-7aa9-4151-8da7-77a7a217c9a2'} Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:59:27.916455 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Returning 404 to user: Instance 3e9876e8-7aa9-4151-8da7-77a7a217c9a2 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85e77302-96c8-4b9b-9a69-a9ae03ea8652 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2" status: 404 len: 111 microversion: 2.1 time: 0.033576 Oct 11 02:59:27.922843 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3889/7827] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:27 2022] GET /compute/v2.1/servers/3e9876e8-7aa9-4151-8da7-77a7a217c9a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:59:29.260726 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:29.261362 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:29.263877 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:29.268900 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:29.269398 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:29.269842 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:29.270539 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:29.271373 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:29.272041 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:29.274945 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:29.275666 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:29.276115 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:29.288539 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] Creating event network-changed:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:59:29.293907 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-61ba5d0d-ba6c-4706-a0f4-83f13a441d67 req-cab8e9f3-bf26-462b-83dc-a5620ff1621a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034472 Oct 11 02:59:29.294919 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3890/7828] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:59:29.302679 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Going to try to terminate instance {{(pid=120493) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 02:59:29.396582 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-5500cece-fbae-4e38-9db6-2930c91da32a tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 204 len: 0 microversion: 2.1 time: 0.139513 Oct 11 02:59:29.400808 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3939/7829] 10.222.0.66 () {58 vars in 1239 bytes} [Tue Oct 11 02:59:29 2022] DELETE /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 02:59:29.407760 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:29.408495 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:29.414957 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:29.415490 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:29.415948 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:29.416669 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:29.417140 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:29.417607 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:29.553677 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.policy [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:59:29.562081 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07301a8f-8243-4ae2-8103-8ba1a35522e7 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1683 microversion: 2.1 time: 0.159734 Oct 11 02:59:29.562671 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3891/7830] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:29 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:59:30.587672 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:30.588394 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:30.595735 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:30.596230 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:30.596673 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:30.597370 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:30.597830 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:30.598258 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:30.667527 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.policy [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95041e8229a48e2a11f10a279d3362f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d82809e02384697bb228b979adcc46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120493) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 02:59:30.676484 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-f544bf17-513c-4428-927e-0278cb2518cb tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 200 len: 1334 microversion: 2.1 time: 0.093916 Oct 11 02:59:30.677076 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3940/7831] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:30 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 02:59:31.308884 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a43f9d-37c8-4c72-ace7-1a752a276864", "name": "network-vif-deleted", "tag": "567a6960-3f77-4a48-b945-4d2b90b9c31b"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 02:59:31.319723 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:31.320216 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:31.320661 n-d-772273-9 devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:31.331955 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] Creating event network-vif-deleted:567a6960-3f77-4a48-b945-4d2b90b9c31b for instance c5a43f9d-37c8-4c72-ace7-1a752a276864 on n-h1-772273-9 Oct 11 02:59:31.336694 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-190d1e1e-30f2-49e1-a03a-7d82260c2dde req-309d94b3-9d8b-4053-8f49-4ff9574ef869 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Oct 11 02:59:31.337277 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3892/7832] 10.222.0.66 () {64 vars in 1317 bytes} [Tue Oct 11 02:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 02:59:31.699701 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '>' {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:31.700260 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.compute.api [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] [instance: c5a43f9d-37c8-4c72-ace7-1a752a276864] Fetching instance by UUID {{(pid=120493) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 02:59:31.707637 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:31.708119 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:31.708549 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:31.709229 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Acquiring lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 02:59:31.709677 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 02:59:31.710097 n-d-772273-9 devstack@n-api.service[120493]: DEBUG oslo_concurrency.lockutils [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Lock "74b16a17-e49d-48bd-a8bb-b10dbf3ef543" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 02:59:31.722979 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.wsgi [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] HTTP exception thrown: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Request method failure captured: Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: request: GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 HTTP/1.1 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Accept: application/json Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Accept-Encoding: identity Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Connection: close Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Content-Length: 0 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Content-Type: application/json Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Host: 10.222.0.66 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: Openstack-System-Scope: None Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: User-Agent: python-urllib3/1.26.12 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Auth-Token: gAAAAABjRNrR2wLa31udn55RtEwn1hgChKJm5_WVKGN3cwM67AbgKcEXZ_Xbpi_n1ODP1XnUL3vCmCqgwpCpqNCYoxaqU5HEKU67NKy-lumKJeFfoNPN7QwMFxN98xg2fILfz1Z0OtaT4UEXSrJ4dc8Vxrhv5dJKPzWqKBBC6BAjvZZJZbv1xEM Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Id: None Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Domain-Name: None Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Identity-Status: Confirmed Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Is-Admin-Project: True Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Id: default Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Domain-Name: Default Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Id: 3d82809e02384697bb228b979adcc46d Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Project-Name: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Role: reader,member Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Roles: reader,member Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3d82809e02384697bb228b979adcc46d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3d82809e02384697bb228b979adcc46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d82809e02384697bb228b979adcc46d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d82809e02384697bb228b979adcc46d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Id: 3d82809e02384697bb228b979adcc46d Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-Tenant-Name: tempest-TestSnapshotPattern-412420923 Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-User: tempest-TestSnapshotPattern-412420923-project Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Id: default Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Domain-Name: Default Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Id: e95041e8229a48e2a11f10a279d3362f Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: X-User-Name: tempest-TestSnapshotPattern-412420923-project Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: method: > Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: exception: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: action_args: {'id': 'c5a43f9d-37c8-4c72-ace7-1a752a276864'} Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: {{(pid=120493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 02:59:31.724659 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: ERROR nova.api.openstack.wsgi Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: DEBUG nova.api.openstack.wsgi [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Returning 404 to user: Instance c5a43f9d-37c8-4c72-ace7-1a752a276864 could not be found. {{(pid=120493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: INFO nova.api.openstack.requestlog [None req-3018a195-6570-45b8-b170-3467ba0a5a43 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864" status: 404 len: 111 microversion: 2.1 time: 0.030651 Oct 11 02:59:31.730090 n-d-772273-9 devstack@n-api.service[120493]: [pid: 120493|app: 0|req: 3941/7833] 10.222.0.66 () {58 vars in 1236 bytes} [Tue Oct 11 02:59:31 2022] GET /compute/v2.1/servers/c5a43f9d-37c8-4c72-ace7-1a752a276864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 02:59:31.889062 n-d-772273-9 devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2afb9110-c5f8-477c-ad28-56e944db1b40 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] Calling method '.version_select at 0x7f112f262a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 02:59:31.911128 n-d-772273-9 devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2afb9110-c5f8-477c-ad28-56e944db1b40 tempest-TestSnapshotPattern-412420923 tempest-TestSnapshotPattern-412420923-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2085517057" status: 202 len: 0 microversion: 2.1 time: 0.026645 Oct 11 02:59:31.911877 n-d-772273-9 devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3893/7834] 10.222.0.66 () {58 vars in 1257 bytes} [Tue Oct 11 02:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2085517057 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)